2024-03-20T13:23:35.837 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-20T13:23:35.837 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_amaredia@teuthology --description rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} --verbose --name amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi --archive /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306 -- /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/orig.config.yaml 2024-03-20T13:23:35.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T13:23:35.948 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306 branch: wip_thotz_update_attrs_from_state_setattrs description: rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7612306' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip_thotz_update_attrs_from_state_setattrs ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 12fa452f60a20733b42c92efd8302af373c366e6 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 12fa452f60a20733b42c92efd8302af373c366e6 rgw: ec-data-pool: true frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip_thotz_update_attrs_from_state_setattrs sha1: 12fa452f60a20733b42c92efd8302af373c366e6 owner: scheduled_amaredia@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 4446 sha1: 12fa452f60a20733b42c92efd8302af373c366e6 sleep_before_teardown: 0 suite: rgw:singleton suite_branch: wip_thotz_update_attrs_from_state_setattrs suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 12fa452f60a20733b42c92efd8302af373c366e6 targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMbK4rSjKzHq63OtQk8TyPWImhHazniDExDiCWzzLNE9jTrGz//wfI0H7VmDV61pnyL7ekG+T2F727nuJ+GsJVk= smithi177.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqeRG9DZazhxoY5qcCH/UbzKFrb939/JY29nBxWaSMi27N06NIlI6MWSjKiVIZNxm0ylRfWB3EUtm3fg+/xQeA= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-20_13:11:42 tube: smithi user: amaredia verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-20T13:23:35.949 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa; will attempt to use it 2024-03-20T13:23:35.966 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa/tasks 2024-03-20T13:23:35.966 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-20T13:23:35.968 INFO:teuthology.task.internal:Checking packages... 2024-03-20T13:23:35.992 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '12fa452f60a20733b42c92efd8302af373c366e6' 2024-03-20T13:23:35.992 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-20T13:23:35.992 INFO:teuthology.packaging:ref: None 2024-03-20T13:23:35.992 INFO:teuthology.packaging:tag: None 2024-03-20T13:23:35.992 INFO:teuthology.packaging:branch: wip_thotz_update_attrs_from_state_setattrs 2024-03-20T13:23:35.992 INFO:teuthology.packaging:sha1: 12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:23:35.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip_thotz_update_attrs_from_state_setattrs 2024-03-20T13:23:36.133 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-1426.g12fa452f 2024-03-20T13:23:36.134 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-20T13:23:36.141 INFO:teuthology.task.internal:no buildpackages task found 2024-03-20T13:23:36.141 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-20T13:23:36.150 INFO:teuthology.task.internal:Saving configuration 2024-03-20T13:23:36.162 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-20T13:23:36.169 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-20T13:23:36.194 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:42.831143', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMbK4rSjKzHq63OtQk8TyPWImhHazniDExDiCWzzLNE9jTrGz//wfI0H7VmDV61pnyL7ekG+T2F727nuJ+GsJVk='} 2024-03-20T13:23:36.215 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:42.832964', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqeRG9DZazhxoY5qcCH/UbzKFrb939/JY29nBxWaSMi27N06NIlI6MWSjKiVIZNxm0ylRfWB3EUtm3fg+/xQeA='} 2024-03-20T13:23:36.215 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-20T13:23:36.297 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-03-20T13:23:36.297 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-03-20T13:23:36.297 INFO:teuthology.run_tasks:Running task console_log... 2024-03-20T13:23:36.367 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd7937aee50>, signals=[15]) 2024-03-20T13:23:36.367 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-20T13:23:36.374 INFO:teuthology.task.internal:Opening connections... 2024-03-20T13:23:36.374 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2024-03-20T13:23:36.376 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:23:36.483 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:23:36.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:23:36.572 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-20T13:23:36.579 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2024-03-20T13:23:36.596 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2024-03-20T13:23:36.597 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2024-03-20T13:23:36.653 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="CentOS Stream" 2024-03-20T13:23:36.653 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="9" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:ID="centos" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE="rhel fedora" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="9" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:PLATFORM_ID="platform:el9" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:ANSI_COLOR="0;31" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:LOGO="fedora-logo-icon" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://centos.org/" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T13:23:36.654 INFO:teuthology.orchestra.run.smithi028.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T13:23:36.655 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2024-03-20T13:23:36.686 DEBUG:teuthology.orchestra.run.smithi177:> uname -m 2024-03-20T13:23:36.707 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2024-03-20T13:23:36.707 DEBUG:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="CentOS Stream" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="9" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:ID="centos" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE="rhel fedora" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="9" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:PLATFORM_ID="platform:el9" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:ANSI_COLOR="0;31" 2024-03-20T13:23:36.764 INFO:teuthology.orchestra.run.smithi177.stdout:LOGO="fedora-logo-icon" 2024-03-20T13:23:36.765 INFO:teuthology.orchestra.run.smithi177.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-20T13:23:36.765 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://centos.org/" 2024-03-20T13:23:36.765 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-20T13:23:36.765 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-20T13:23:36.765 INFO:teuthology.orchestra.run.smithi177.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-20T13:23:36.765 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2024-03-20T13:23:36.810 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-20T13:23:36.819 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-20T13:23:36.825 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-20T13:23:36.825 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2024-03-20T13:23:36.828 DEBUG:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2024-03-20T13:23:36.844 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-20T13:23:36.849 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-20T13:23:36.850 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2024-03-20T13:23:36.885 DEBUG:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2024-03-20T13:23:36.963 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-20T13:23:37.021 INFO:teuthology.run_tasks:Running task kernel... 2024-03-20T13:23:37.035 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-20T13:23:37.035 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-20T13:23:37.035 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-20T13:23:37.036 DEBUG:teuthology.orchestra.run.smithi177:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-20T13:23:37.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:23:37.052 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-03-20T13:23:37.053 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:23:37.053 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-03-20T13:23:37.108 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-361.el9.x86_64 2024-03-20T13:23:37.109 INFO:teuthology.task.kernel:Running kernel on smithi177: 5.14.0-361.el9.x86_64 2024-03-20T13:23:37.109 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum install -y kernel 2024-03-20T13:23:37.110 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-361.el9.x86_64 2024-03-20T13:23:37.111 INFO:teuthology.task.kernel:Running kernel on smithi028: 5.14.0-361.el9.x86_64 2024-03-20T13:23:37.111 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum install -y kernel 2024-03-20T13:23:39.141 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - AppStream 16 MB/s | 6.7 MB 00:00 2024-03-20T13:23:39.235 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-20T13:23:40.525 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2024-03-20T13:23:40.652 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - BaseOS 7.2 MB/s | 2.0 MB 00:00 2024-03-20T13:23:41.734 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 9.3 MB/s | 8.0 MB 00:00 2024-03-20T13:23:44.875 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 9.0 MB/s | 19 MB 00:02 2024-03-20T13:23:44.967 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 2.0 MB/s | 8.0 MB 00:03 2024-03-20T13:23:48.983 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.1 MB 00:00 2024-03-20T13:23:50.559 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-03-20T13:23:51.894 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-03-20T13:23:52.334 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 19 MB 00:06 2024-03-20T13:23:56.368 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.1 MB 00:00 2024-03-20T13:23:56.793 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-03-20T13:23:57.920 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-03-20T13:23:58.901 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-20T13:23:58.901 INFO:teuthology.orchestra.run.smithi177.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-20T13:23:58.996 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:23:59.008 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:23:59.008 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-03-20T13:23:59.008 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:23:59.008 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:23:59.008 INFO:teuthology.orchestra.run.smithi177.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-20T13:23:59.008 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout:Install 4 Packages 2024-03-20T13:23:59.009 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:23:59.010 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 76 M 2024-03-20T13:23:59.010 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 123 M 2024-03-20T13:23:59.010 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:23:59.220 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 17 MB/s | 21 MB 00:01 2024-03-20T13:23:59.420 INFO:teuthology.orchestra.run.smithi177.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 129 kB/s | 44 kB 00:00 2024-03-20T13:24:04.321 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-20T13:24:06.503 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-20T13:24:06.503 INFO:teuthology.orchestra.run.smithi028.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-20T13:24:06.612 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout: kernel x86_64 5.14.0-430.el9 baseos 44 k 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core x86_64 5.14.0-430.el9 baseos 15 M 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules x86_64 5.14.0-430.el9 baseos 33 M 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core x86_64 5.14.0-430.el9 baseos 27 M 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:24:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:Install 4 Packages 2024-03-20T13:24:06.625 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:24:06.625 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 76 M 2024-03-20T13:24:06.625 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 123 M 2024-03-20T13:24:06.625 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:24:07.364 INFO:teuthology.orchestra.run.smithi028.stdout:(1/4): kernel-5.14.0-430.el9.x86_64.rpm 66 kB/s | 44 kB 00:00 2024-03-20T13:24:08.178 INFO:teuthology.orchestra.run.smithi177.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 1.6 MB/s | 15 MB 00:09 2024-03-20T13:24:09.927 INFO:teuthology.orchestra.run.smithi177.stdout:(3/4): kernel-modules-core-5.14.0-430.el9.x86_6 2.6 MB/s | 27 MB 00:10 2024-03-20T13:24:13.181 INFO:teuthology.orchestra.run.smithi028.stdout:(2/4): kernel-core-5.14.0-430.el9.x86_64.rpm 2.3 MB/s | 15 MB 00:06 2024-03-20T13:24:20.234 INFO:teuthology.orchestra.run.smithi177.stdout:(4/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 1.6 MB/s | 33 MB 00:21 2024-03-20T13:24:20.235 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:24:20.235 INFO:teuthology.orchestra.run.smithi177.stdout:Total 3.6 MB/s | 76 MB 00:21 2024-03-20T13:24:20.905 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:24:21.274 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:24:21.274 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:24:22.251 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:24:22.251 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:24:24.704 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:24:25.304 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-20T13:24:25.402 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-20T13:24:28.118 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-20T13:24:28.246 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-20T13:24:32.954 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-20T13:24:33.062 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:24:37.786 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:24:44.636 INFO:teuthology.orchestra.run.smithi028.stdout:(3/4): kernel-modules-core-5.14.0-430.el9.x86_6 755 kB/s | 27 MB 00:37 2024-03-20T13:24:52.119 INFO:teuthology.orchestra.run.smithi028.stdout:(4/4): kernel-modules-5.14.0-430.el9.x86_64.rpm 754 kB/s | 33 MB 00:45 2024-03-20T13:24:52.119 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:24:52.119 INFO:teuthology.orchestra.run.smithi028.stdout:Total 1.7 MB/s | 76 MB 00:45 2024-03-20T13:24:52.811 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:24:53.230 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:24:53.230 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:24:54.273 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:24:54.274 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:24:56.888 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:24:57.523 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-core-5.14.0-430.el9.x86_64 1/4 2024-03-20T13:24:57.611 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-20T13:25:00.503 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-20T13:25:00.629 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-20T13:25:05.727 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-20T13:25:05.771 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : kernel-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:06.755 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:06.755 INFO:teuthology.orchestra.run.smithi177.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-20T13:25:06.755 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:25:06.799 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:07.222 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:07.222 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-20T13:25:07.222 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-20T13:25:07.222 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-20T13:25:07.631 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:25:07.632 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:25:07.971 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-03-20T13:25:08.087 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-20T13:25:08.087 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-20T13:25:08.088 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-20T13:25:08.088 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-20T13:25:08.088 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-20T13:25:08.088 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-03-20T13:25:08.088 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi177.front.sepia.ceph.com, path=None, version=distro) 2024-03-20T13:25:08.088 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q kernel | sort -rV | head -n 1 2024-03-20T13:25:08.170 INFO:teuthology.orchestra.run.smithi177.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-20T13:25:08.170 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-20T13:25:08.170 DEBUG:teuthology.orchestra.run.smithi177:> sudo rpm -qi grub2-tools 2024-03-20T13:25:08.204 INFO:teuthology.orchestra.run.smithi177.stdout:Name : grub2-tools 2024-03-20T13:25:08.204 INFO:teuthology.orchestra.run.smithi177.stdout:Epoch : 1 2024-03-20T13:25:08.204 INFO:teuthology.orchestra.run.smithi177.stdout:Version : 2.06 2024-03-20T13:25:08.204 INFO:teuthology.orchestra.run.smithi177.stdout:Release : 68.el9 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: x86_64 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Group : Unspecified 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Size : 8264254 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:License : GPLv3+ 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Packager : builder@centos.org 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Vendor : CentOS 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-20T13:25:08.205 INFO:teuthology.orchestra.run.smithi177.stdout:Summary : Support tools for GRUB. 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout:Description : 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout:hardware devices. 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:25:08.206 INFO:teuthology.orchestra.run.smithi177.stdout:This subpackage provides tools for support of all platforms. 2024-03-20T13:25:08.207 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-20T13:25:08.207 INFO:teuthology.task.kernel:Updating grub on smithi177 to boot 5.14.0-430.el9.x86_64 2024-03-20T13:25:08.207 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-20T13:25:08.836 INFO:teuthology.orchestra.run.smithi177.stderr:Generating grub configuration file ... 2024-03-20T13:25:10.315 INFO:teuthology.orchestra.run.smithi177.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-20T13:25:10.348 INFO:teuthology.orchestra.run.smithi177.stderr:done 2024-03-20T13:25:10.359 DEBUG:teuthology.orchestra.run.smithi177:> mktemp 2024-03-20T13:25:10.382 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.Z4I1jUa6id 2024-03-20T13:25:10.382 DEBUG:teuthology.orchestra.run.smithi177:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Z4I1jUa6id 2024-03-20T13:25:10.452 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.Z4I1jUa6id 2024-03-20T13:25:10.586 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.Z4I1jUa6id is 6KB 2024-03-20T13:25:10.634 DEBUG:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.Z4I1jUa6id 2024-03-20T13:25:10.648 DEBUG:teuthology.orchestra.run.smithi177:> sudo /bin/ls /boot/loader/entries || true 2024-03-20T13:25:10.713 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-20T13:25:10.713 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-20T13:25:10.713 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-20T13:25:10.713 INFO:teuthology.orchestra.run.smithi177.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-20T13:25:10.714 DEBUG:teuthology.orchestra.run.smithi177:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-20T13:25:10.871 DEBUG:teuthology.orchestra.run.smithi177:> sudo shutdown -r now 2024-03-20T13:25:10.898 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:40.873 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-03-20T13:25:40.874 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T13:25:40.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:25:41.436 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-core-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:41.436 INFO:teuthology.orchestra.run.smithi028.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-20T13:25:41.437 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:25:41.481 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-modules-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:41.862 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: kernel-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:41.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-5.14.0-430.el9.x86_64 1/4 2024-03-20T13:25:41.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-core-5.14.0-430.el9.x86_64 2/4 2024-03-20T13:25:41.862 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-5.14.0-430.el9.x86_64 3/4 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : kernel-modules-core-5.14.0-430.el9.x86_64 4/4 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-5.14.0-430.el9.x86_64 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-core-5.14.0-430.el9.x86_64 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-5.14.0-430.el9.x86_64 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: kernel-modules-core-5.14.0-430.el9.x86_64 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:25:42.276 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:25:42.597 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-03-20T13:25:42.698 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-20T13:25:42.699 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-20T13:25:42.699 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-430.el9.x86_64 2024-03-20T13:25:42.699 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-20T13:25:42.699 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-20T13:25:42.699 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-03-20T13:25:42.699 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi028.front.sepia.ceph.com, path=None, version=distro) 2024-03-20T13:25:42.699 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q kernel | sort -rV | head -n 1 2024-03-20T13:25:42.781 INFO:teuthology.orchestra.run.smithi028.stdout:kernel-5.14.0-430.el9.x86_64 2024-03-20T13:25:42.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-430.el9.x86_64 2024-03-20T13:25:42.782 DEBUG:teuthology.orchestra.run.smithi028:> sudo rpm -qi grub2-tools 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Name : grub2-tools 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Epoch : 1 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Version : 2.06 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Release : 68.el9 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Architecture: x86_64 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Group : Unspecified 2024-03-20T13:25:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Size : 8264254 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:License : GPLv3+ 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Packager : builder@centos.org 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Vendor : CentOS 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Summary : Support tools for GRUB. 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:Description : 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-20T13:25:42.832 INFO:teuthology.orchestra.run.smithi028.stdout:hardware devices. 2024-03-20T13:25:42.833 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:25:42.833 INFO:teuthology.orchestra.run.smithi028.stdout:This subpackage provides tools for support of all platforms. 2024-03-20T13:25:42.833 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-20T13:25:42.833 INFO:teuthology.task.kernel:Updating grub on smithi028 to boot 5.14.0-430.el9.x86_64 2024-03-20T13:25:42.834 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-20T13:25:43.429 INFO:teuthology.orchestra.run.smithi028.stderr:Generating grub configuration file ... 2024-03-20T13:25:44.846 INFO:teuthology.orchestra.run.smithi028.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-20T13:25:44.891 INFO:teuthology.orchestra.run.smithi028.stderr:done 2024-03-20T13:25:44.893 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-20T13:25:44.908 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.efAlhpVcCi 2024-03-20T13:25:44.909 DEBUG:teuthology.orchestra.run.smithi028:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.efAlhpVcCi 2024-03-20T13:25:44.980 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.efAlhpVcCi 2024-03-20T13:25:45.132 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.efAlhpVcCi is 6KB 2024-03-20T13:25:45.181 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.efAlhpVcCi 2024-03-20T13:25:45.196 DEBUG:teuthology.orchestra.run.smithi028:> sudo /bin/ls /boot/loader/entries || true 2024-03-20T13:25:45.264 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-20T13:25:45.264 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-20T13:25:45.264 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-20T13:25:45.264 INFO:teuthology.orchestra.run.smithi028.stdout:15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64.conf 2024-03-20T13:25:45.266 DEBUG:teuthology.orchestra.run.smithi028:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-430.el9.x86_64 2024-03-20T13:25:45.421 DEBUG:teuthology.orchestra.run.smithi028:> sudo shutdown -r now 2024-03-20T13:25:59.198 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T13:26:08.204 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T13:26:08.205 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:11.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.177 2024-03-20T13:26:15.428 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-20T13:26:15.428 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-20T13:26:15.429 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:23.267 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T13:26:23.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:33.758 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-03-20T13:26:42.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-20T13:26:42.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:26:55.045 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-03-20T13:26:55.468 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T13:26:55.468 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-430.el9.x86_64"... 2024-03-20T13:26:55.468 DEBUG:teuthology.orchestra.run.smithi177:> uname -r 2024-03-20T13:26:55.482 INFO:teuthology.orchestra.run.smithi177.stdout:5.14.0-430.el9.x86_64 2024-03-20T13:26:55.482 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-20T13:26:55.483 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-20T13:26:55.483 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-20T13:26:56.483 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-03-20T13:26:56.483 DEBUG:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-20T13:26:56.574 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2024-03-20T13:26:56.629 DEBUG:teuthology.parallel:result is None 2024-03-20T13:27:01.150 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.28 2024-03-20T13:27:13.151 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-20T13:27:13.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:27:13.847 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-03-20T13:27:14.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-20T13:27:14.311 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-430.el9.x86_64"... 2024-03-20T13:27:14.312 DEBUG:teuthology.orchestra.run.smithi028:> uname -r 2024-03-20T13:27:14.325 INFO:teuthology.orchestra.run.smithi028.stdout:5.14.0-430.el9.x86_64 2024-03-20T13:27:14.325 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-430.el9.x86_64 vs 5.14.0-430.el9.x86_64 2024-03-20T13:27:14.325 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-20T13:27:14.326 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-20T13:27:15.326 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-20T13:27:15.326 DEBUG:teuthology.orchestra.run.smithi028:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-20T13:27:15.413 INFO:teuthology.orchestra.run.smithi028.stdout:ttyS1 2024-03-20T13:27:15.450 DEBUG:teuthology.parallel:result is None 2024-03-20T13:27:15.451 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-20T13:27:15.457 INFO:teuthology.task.internal:Creating test directory... 2024-03-20T13:27:15.457 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-20T13:27:15.459 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-20T13:27:15.478 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-20T13:27:15.484 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-20T13:27:15.490 INFO:teuthology.task.internal:Creating archive directory... 2024-03-20T13:27:15.490 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-20T13:27:15.514 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-20T13:27:15.570 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-20T13:27:15.575 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-20T13:27:15.576 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-20T13:27:15.578 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-20T13:27:15.610 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:27:15.613 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:27:15.624 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:27:15.626 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-20T13:27:15.628 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-20T13:27:15.634 INFO:teuthology.task.internal:Configuring sudo... 2024-03-20T13:27:15.634 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-20T13:27:15.670 DEBUG:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-20T13:27:15.700 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-20T13:27:15.709 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-20T13:27:15.709 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-20T13:27:15.737 DEBUG:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-20T13:27:15.756 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-20T13:27:15.827 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-20T13:27:15.877 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-20T13:27:15.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-20T13:27:16.002 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:27:16.002 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-20T13:27:16.090 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-20T13:27:16.134 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-20T13:27:16.240 DEBUG:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-20T13:27:16.285 DEBUG:teuthology.orchestra.run.smithi177:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-20T13:27:16.329 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:27:16.329 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-20T13:27:16.398 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2024-03-20T13:27:16.400 DEBUG:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2024-03-20T13:27:16.450 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-20T13:27:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-20T13:27:16.818 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-20T13:27:16.826 INFO:teuthology.task.internal:Starting timer... 2024-03-20T13:27:16.826 INFO:teuthology.run_tasks:Running task pcp... 2024-03-20T13:27:16.879 INFO:teuthology.run_tasks:Running task selinux... 2024-03-20T13:27:16.896 DEBUG:teuthology.orchestra.run.smithi028:> sudo service auditd rotate 2024-03-20T13:27:16.966 INFO:teuthology.orchestra.run.smithi028.stdout:Rotating logs: 2024-03-20T13:27:16.968 DEBUG:teuthology.orchestra.run.smithi177:> sudo service auditd rotate 2024-03-20T13:27:17.047 INFO:teuthology.orchestra.run.smithi177.stdout:Rotating logs: 2024-03-20T13:27:17.049 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-20T13:27:17.049 DEBUG:teuthology.orchestra.run.smithi028:> /usr/sbin/getenforce 2024-03-20T13:27:17.071 INFO:teuthology.orchestra.run.smithi028.stdout:Permissive 2024-03-20T13:27:17.071 DEBUG:teuthology.orchestra.run.smithi177:> /usr/sbin/getenforce 2024-03-20T13:27:17.092 INFO:teuthology.orchestra.run.smithi177.stdout:Permissive 2024-03-20T13:27:17.092 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi028.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi177.front.sepia.ceph.com': 'permissive'} 2024-03-20T13:27:17.092 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-20T13:27:17.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:27:17.140 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-20T13:27:17.168 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:27:17.169 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-20T13:27:17.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo /usr/sbin/setenforce permissive 2024-03-20T13:27:17.214 DEBUG:teuthology.orchestra.run.smithi177:> sudo /usr/sbin/setenforce permissive 2024-03-20T13:27:17.252 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-20T13:27:17.262 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-20T13:27:17.278 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-20T13:27:17.279 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-20T13:31:32.378 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2024-03-20T13:31:32.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-20T13:31:32.381 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:31:32.477 DEBUG:teuthology.orchestra.run.smithi028:> true 2024-03-20T13:31:32.558 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2024-03-20T13:31:32.559 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T13:31:32.559 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi177.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-20T13:31:32.647 DEBUG:teuthology.orchestra.run.smithi177:> true 2024-03-20T13:31:32.728 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi177.front.sepia.ceph.com' 2024-03-20T13:31:32.729 INFO:teuthology.run_tasks:Running task clock... 2024-03-20T13:31:32.740 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-20T13:31:32.741 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-20T13:31:32.741 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:31:32.744 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-20T13:31:32.744 DEBUG:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:31:32.774 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-20T13:31:32.792 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-20T13:31:32.799 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-20T13:31:32.816 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-20T13:31:32.822 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: ntpd: command not found 2024-03-20T13:31:32.837 INFO:teuthology.orchestra.run.smithi028.stdout:506 Cannot talk to daemon 2024-03-20T13:31:32.844 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: ntpd: command not found 2024-03-20T13:31:32.853 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-20T13:31:32.858 INFO:teuthology.orchestra.run.smithi177.stdout:506 Cannot talk to daemon 2024-03-20T13:31:32.870 INFO:teuthology.orchestra.run.smithi028.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-20T13:31:32.874 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-20T13:31:32.890 INFO:teuthology.orchestra.run.smithi177.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-20T13:31:32.938 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-03-20T13:31:32.941 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-20T13:31:32.941 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-03-20T13:31:32.941 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.942 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.942 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.942 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.952 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-03-20T13:31:32.955 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-20T13:31:32.955 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-03-20T13:31:32.955 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.955 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.955 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.956 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:31:32.956 INFO:teuthology.run_tasks:Running task install... 2024-03-20T13:31:32.965 DEBUG:teuthology.task.install:project ceph 2024-03-20T13:31:32.965 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}} 2024-03-20T13:31:32.966 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'} 2024-03-20T13:31:32.966 INFO:teuthology.task.install:Using flavor: default 2024-03-20T13:31:33.003 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-20T13:31:33.003 INFO:teuthology.task.install:extra packages: [] 2024-03-20T13:31:33.004 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'tag': None, 'wait_for_package': False} 2024-03-20T13:31:33.004 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:31:33.006 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'tag': None, 'wait_for_package': False} 2024-03-20T13:31:33.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:31:33.237 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/ 2024-03-20T13:31:33.237 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1426.g12fa452f 2024-03-20T13:31:33.245 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/ 2024-03-20T13:31:33.245 INFO:teuthology.task.install.rpm:Package version is 19.0.0-1426.g12fa452f 2024-03-20T13:31:33.508 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-20T13:31:33.509 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:31:33.509 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-20T13:31:33.537 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-20T13:31:33.538 DEBUG:teuthology.orchestra.run.smithi177:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/12fa452f60a20733b42c92efd8302af373c366e6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-20T13:31:33.572 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip_thotz_update_attrs_from_state_setattrs/12fa452f60a20733b42c92efd8302af373c366e6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-20T13:31:33.572 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:31:33.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-20T13:31:33.601 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-20T13:31:33.602 DEBUG:teuthology.orchestra.run.smithi028:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/12fa452f60a20733b42c92efd8302af373c366e6/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-20T13:31:33.607 DEBUG:teuthology.orchestra.run.smithi177:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-20T13:31:33.671 DEBUG:teuthology.orchestra.run.smithi028:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-20T13:31:33.687 DEBUG:teuthology.orchestra.run.smithi177:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-20T13:31:33.752 DEBUG:teuthology.orchestra.run.smithi028:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-20T13:31:33.753 INFO:teuthology.orchestra.run.smithi177.stdout:check_obsoletes = 1 2024-03-20T13:31:33.754 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum clean all 2024-03-20T13:31:33.818 INFO:teuthology.orchestra.run.smithi028.stdout:check_obsoletes = 1 2024-03-20T13:31:33.820 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum clean all 2024-03-20T13:31:34.008 INFO:teuthology.orchestra.run.smithi177.stdout:74 files removed 2024-03-20T13:31:34.035 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-radosgw 2024-03-20T13:31:34.074 INFO:teuthology.orchestra.run.smithi028.stdout:74 files removed 2024-03-20T13:31:34.101 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-radosgw 2024-03-20T13:31:35.252 INFO:teuthology.orchestra.run.smithi177.stdout:ceph packages for x86_64 89 kB/s | 82 kB 00:00 2024-03-20T13:31:35.262 INFO:teuthology.orchestra.run.smithi028.stdout:ceph packages for x86_64 96 kB/s | 82 kB 00:00 2024-03-20T13:31:36.038 INFO:teuthology.orchestra.run.smithi028.stdout:ceph noarch packages 14 kB/s | 10 kB 00:00 2024-03-20T13:31:36.052 INFO:teuthology.orchestra.run.smithi177.stdout:ceph noarch packages 13 kB/s | 10 kB 00:00 2024-03-20T13:31:36.822 INFO:teuthology.orchestra.run.smithi028.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-03-20T13:31:36.828 INFO:teuthology.orchestra.run.smithi177.stdout:ceph source packages 2.6 kB/s | 1.9 kB 00:00 2024-03-20T13:31:37.430 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-20T13:31:37.490 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-20T13:31:39.199 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2024-03-20T13:31:39.431 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS-9 - BaseOS 2.3 MB/s | 2.0 MB 00:00 2024-03-20T13:31:40.189 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.0 MB 00:00 2024-03-20T13:31:40.556 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - BaseOS 7.9 MB/s | 8.0 MB 00:01 2024-03-20T13:31:42.716 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - AppStream 18 MB/s | 19 MB 00:01 2024-03-20T13:31:44.489 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - AppStream 5.8 MB/s | 19 MB 00:03 2024-03-20T13:31:47.262 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - CRB 6.8 MB/s | 6.1 MB 00:00 2024-03-20T13:31:48.606 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.1 MB 00:00 2024-03-20T13:31:48.709 INFO:teuthology.orchestra.run.smithi028.stdout:CentOS Stream 9 - Extras packages 85 kB/s | 16 kB 00:00 2024-03-20T13:31:50.400 INFO:teuthology.orchestra.run.smithi177.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-03-20T13:31:51.047 INFO:teuthology.orchestra.run.smithi028.stdout:Extra Packages for Enterprise Linux 9.3 MB/s | 21 MB 00:02 2024-03-20T13:31:56.170 INFO:teuthology.orchestra.run.smithi028.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-20T13:31:58.703 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:31:58.706 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:31:58.706 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:31:58.706 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:31:58.706 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 9.7 M 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrading: 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout: librados2 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 3.4 M 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 3.1 M 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-20T13:31:58.707 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 5.3 M 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 20 M 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 25 k 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 742 k 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-20T13:31:58.708 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 500 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 5.1 M 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 45 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 131 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 162 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-20T13:31:58.709 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 321 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 298 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 99 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout:Installing weak dependencies: 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:31:58.710 INFO:teuthology.orchestra.run.smithi028.stdout:Install 30 Packages 2024-03-20T13:31:58.711 INFO:teuthology.orchestra.run.smithi028.stdout:Upgrade 2 Packages 2024-03-20T13:31:58.711 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:31:58.711 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 58 M 2024-03-20T13:31:58.711 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:32:00.563 INFO:teuthology.orchestra.run.smithi028.stdout:(1/32): ceph-base-19.0.0-1426.g12fa452f.el9.x86 3.1 MB/s | 5.3 MB 00:01 2024-03-20T13:32:00.705 INFO:teuthology.orchestra.run.smithi028.stdout:(2/32): ceph-radosgw-19.0.0-1426.g12fa452f.el9. 5.2 MB/s | 9.7 MB 00:01 2024-03-20T13:32:00.722 INFO:teuthology.orchestra.run.smithi028.stdout:(3/32): ceph-selinux-19.0.0-1426.g12fa452f.el9. 159 kB/s | 25 kB 00:00 2024-03-20T13:32:00.838 INFO:teuthology.orchestra.run.smithi028.stdout:(4/32): libcephfs2-19.0.0-1426.g12fa452f.el9.x8 5.4 MB/s | 742 kB 00:00 2024-03-20T13:32:00.864 INFO:teuthology.orchestra.run.smithi028.stdout:(5/32): libradosstriper1-19.0.0-1426.g12fa452f. 3.4 MB/s | 500 kB 00:00 2024-03-20T13:32:01.056 INFO:teuthology.orchestra.run.smithi028.stdout:(6/32): python3-ceph-argparse-19.0.0-1426.g12fa 235 kB/s | 45 kB 00:00 2024-03-20T13:32:01.189 INFO:teuthology.orchestra.run.smithi028.stdout:(7/32): python3-ceph-common-19.0.0-1426.g12fa45 987 kB/s | 131 kB 00:00 2024-03-20T13:32:01.298 INFO:teuthology.orchestra.run.smithi028.stdout:(8/32): librgw2-19.0.0-1426.g12fa452f.el9.x86_6 11 MB/s | 5.1 MB 00:00 2024-03-20T13:32:01.323 INFO:teuthology.orchestra.run.smithi028.stdout:(9/32): python3-cephfs-19.0.0-1426.g12fa452f.el 1.2 MB/s | 162 kB 00:00 2024-03-20T13:32:01.407 INFO:teuthology.orchestra.run.smithi028.stdout:(10/32): python3-rados-19.0.0-1426.g12fa452f.el 2.9 MB/s | 321 kB 00:00 2024-03-20T13:32:01.457 INFO:teuthology.orchestra.run.smithi028.stdout:(11/32): python3-rbd-19.0.0-1426.g12fa452f.el9. 2.2 MB/s | 298 kB 00:00 2024-03-20T13:32:01.541 INFO:teuthology.orchestra.run.smithi028.stdout:(12/32): python3-rgw-19.0.0-1426.g12fa452f.el9. 744 kB/s | 99 kB 00:00 2024-03-20T13:32:01.599 INFO:teuthology.orchestra.run.smithi028.stdout:(13/32): boost-program-options-1.75.0-8.el9.x86 746 kB/s | 106 kB 00:00 2024-03-20T13:32:01.624 INFO:teuthology.orchestra.run.smithi028.stdout:(14/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 159 kB 00:00 2024-03-20T13:32:01.650 INFO:teuthology.orchestra.run.smithi028.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 884 kB/s | 44 kB 00:00 2024-03-20T13:32:01.692 INFO:teuthology.orchestra.run.smithi028.stdout:(16/32): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-03-20T13:32:01.717 INFO:teuthology.orchestra.run.smithi028.stdout:(17/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 282 kB 00:00 2024-03-20T13:32:01.742 INFO:teuthology.orchestra.run.smithi028.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 833 kB/s | 41 kB 00:00 2024-03-20T13:32:01.884 INFO:teuthology.orchestra.run.smithi028.stdout:(19/32): qatlib-service-23.11.0-1.el9.x86_64.rp 246 kB/s | 35 kB 00:00 2024-03-20T13:32:01.959 INFO:teuthology.orchestra.run.smithi028.stdout:(20/32): qatlib-23.11.0-1.el9.x86_64.rpm 895 kB/s | 216 kB 00:00 2024-03-20T13:32:01.985 INFO:teuthology.orchestra.run.smithi028.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 444 kB/s | 44 kB 00:00 2024-03-20T13:32:02.202 INFO:teuthology.orchestra.run.smithi028.stdout:(22/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 1.2 MB/s | 309 kB 00:00 2024-03-20T13:32:02.252 INFO:teuthology.orchestra.run.smithi028.stdout:(23/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 521 kB/s | 26 kB 00:00 2024-03-20T13:32:02.294 INFO:teuthology.orchestra.run.smithi028.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2024-03-20T13:32:02.369 INFO:teuthology.orchestra.run.smithi028.stdout:(25/32): libunwind-1.6.2-1.el9.x86_64.rpm 901 kB/s | 67 kB 00:00 2024-03-20T13:32:02.544 INFO:teuthology.orchestra.run.smithi028.stdout:(26/32): libarrow-9.0.0-10.el9.x86_64.rpm 7.9 MB/s | 4.4 MB 00:00 2024-03-20T13:32:02.569 INFO:teuthology.orchestra.run.smithi028.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2024-03-20T13:32:02.597 INFO:teuthology.orchestra.run.smithi028.stdout:(28/32): re2-20211101-3.el9.x86_64.rpm 3.6 MB/s | 192 kB 00:00 2024-03-20T13:32:02.706 INFO:teuthology.orchestra.run.smithi028.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-03-20T13:32:03.198 INFO:teuthology.orchestra.run.smithi028.stdout:(30/32): librbd1-19.0.0-1426.g12fa452f.el9.x86_ 6.4 MB/s | 3.1 MB 00:00 2024-03-20T13:32:03.390 INFO:teuthology.orchestra.run.smithi028.stdout:(31/32): librados2-19.0.0-1426.g12fa452f.el9.x8 4.3 MB/s | 3.4 MB 00:00 2024-03-20T13:32:04.456 INFO:teuthology.orchestra.run.smithi028.stdout:(32/32): ceph-common-19.0.0-1426.g12fa452f.el9. 3.5 MB/s | 20 MB 00:05 2024-03-20T13:32:04.463 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:04.463 INFO:teuthology.orchestra.run.smithi028.stdout:Total 10 MB/s | 58 MB 00:05 2024-03-20T13:32:04.498 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:32:04.540 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:32:04.540 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:32:05.032 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:32:05.032 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:32:05.743 INFO:teuthology.orchestra.run.smithi177.stdout:Extra Packages for Enterprise Linux 1.4 MB/s | 21 MB 00:15 2024-03-20T13:32:06.536 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:32:06.610 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-20T13:32:06.636 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-20T13:32:06.664 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-20T13:32:06.692 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-20T13:32:06.709 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-20T13:32:06.910 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-20T13:32:06.966 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-20T13:32:07.321 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-20T13:32:07.370 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 7/34 2024-03-20T13:32:07.472 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 7/34 2024-03-20T13:32:07.570 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 8/34 2024-03-20T13:32:07.597 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 9/34 2024-03-20T13:32:07.660 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 9/34 2024-03-20T13:32:07.689 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-20T13:32:07.733 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-argparse-2:19.0.0-1426.g12fa452f.el9. 11/34 2024-03-20T13:32:07.802 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 12/34 2024-03-20T13:32:07.824 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_6 13/34 2024-03-20T13:32:07.887 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_6 13/34 2024-03-20T13:32:07.914 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-03-20T13:32:08.016 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-20T13:32:08.049 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-20T13:32:08.089 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-20T13:32:08.130 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-20T13:32:08.159 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-20T13:32:08.192 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-20T13:32:08.525 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-20T13:32:08.555 INFO:teuthology.orchestra.run.smithi028.stdout: Upgrading : librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 22/34 2024-03-20T13:32:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 22/34 2024-03-20T13:32:08.676 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 23/34 2024-03-20T13:32:08.718 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-20T13:32:09.201 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-20T13:32:09.225 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 26/34 2024-03-20T13:32:09.298 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 26/34 2024-03-20T13:32:09.383 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 27/34 2024-03-20T13:32:09.410 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ceph-common-2:19.0.0-1426.g12fa452f.el9.x8 28/34 2024-03-20T13:32:10.673 INFO:teuthology.orchestra.run.smithi177.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-03-20T13:32:11.702 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 29/34 2024-03-20T13:32:11.739 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 29/34 2024-03-20T13:32:12.322 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 29/34 2024-03-20T13:32:12.359 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 30/34 2024-03-20T13:32:12.449 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 30/34 2024-03-20T13:32:12.449 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-20T13:32:12.449 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-20T13:32:12.449 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:12.485 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 31/34 2024-03-20T13:32:13.092 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 9.7 M 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrading: 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 3.4 M 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 3.1 M 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:32:13.103 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 5.3 M 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 20 M 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 25 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 742 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 500 k 2024-03-20T13:32:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 5.1 M 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 45 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 131 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 162 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 321 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 298 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 99 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-20T13:32:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout:Installing weak dependencies: 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout:Install 30 Packages 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout:Upgrade 2 Packages 2024-03-20T13:32:13.106 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:13.107 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 58 M 2024-03-20T13:32:13.107 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:32:14.907 INFO:teuthology.orchestra.run.smithi177.stdout:(1/32): ceph-base-19.0.0-1426.g12fa452f.el9.x86 4.0 MB/s | 5.3 MB 00:01 2024-03-20T13:32:14.966 INFO:teuthology.orchestra.run.smithi177.stdout:(2/32): ceph-selinux-19.0.0-1426.g12fa452f.el9. 431 kB/s | 25 kB 00:00 2024-03-20T13:32:15.116 INFO:teuthology.orchestra.run.smithi177.stdout:(3/32): libcephfs2-19.0.0-1426.g12fa452f.el9.x8 4.8 MB/s | 742 kB 00:00 2024-03-20T13:32:15.233 INFO:teuthology.orchestra.run.smithi177.stdout:(4/32): libradosstriper1-19.0.0-1426.g12fa452f. 4.2 MB/s | 500 kB 00:00 2024-03-20T13:32:15.750 INFO:teuthology.orchestra.run.smithi177.stdout:(5/32): ceph-radosgw-19.0.0-1426.g12fa452f.el9. 4.5 MB/s | 9.7 MB 00:02 2024-03-20T13:32:15.867 INFO:teuthology.orchestra.run.smithi177.stdout:(6/32): python3-ceph-argparse-19.0.0-1426.g12fa 387 kB/s | 45 kB 00:00 2024-03-20T13:32:15.959 INFO:teuthology.orchestra.run.smithi177.stdout:(7/32): librgw2-19.0.0-1426.g12fa452f.el9.x86_6 7.0 MB/s | 5.1 MB 00:00 2024-03-20T13:32:15.984 INFO:teuthology.orchestra.run.smithi177.stdout:(8/32): python3-ceph-common-19.0.0-1426.g12fa45 1.1 MB/s | 131 kB 00:00 2024-03-20T13:32:16.176 INFO:teuthology.orchestra.run.smithi177.stdout:(9/32): ceph-common-19.0.0-1426.g12fa452f.el9.x 7.6 MB/s | 20 MB 00:02 2024-03-20T13:32:16.201 INFO:teuthology.orchestra.run.smithi177.stdout:(10/32): python3-cephfs-19.0.0-1426.g12fa452f.e 669 kB/s | 162 kB 00:00 2024-03-20T13:32:16.226 INFO:teuthology.orchestra.run.smithi177.stdout:(11/32): python3-rados-19.0.0-1426.g12fa452f.el 1.3 MB/s | 321 kB 00:00 2024-03-20T13:32:16.252 INFO:teuthology.orchestra.run.smithi177.stdout:(12/32): python3-rbd-19.0.0-1426.g12fa452f.el9. 3.9 MB/s | 298 kB 00:00 2024-03-20T13:32:16.302 INFO:teuthology.orchestra.run.smithi177.stdout:(13/32): python3-rgw-19.0.0-1426.g12fa452f.el9. 988 kB/s | 99 kB 00:00 2024-03-20T13:32:16.394 INFO:teuthology.orchestra.run.smithi177.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 633 kB/s | 106 kB 00:00 2024-03-20T13:32:16.421 INFO:teuthology.orchestra.run.smithi177.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 469 kB/s | 44 kB 00:00 2024-03-20T13:32:16.455 INFO:teuthology.orchestra.run.smithi177.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 891 kB/s | 159 kB 00:00 2024-03-20T13:32:16.480 INFO:teuthology.orchestra.run.smithi177.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 7.5 MB/s | 661 kB 00:00 2024-03-20T13:32:16.505 INFO:teuthology.orchestra.run.smithi177.stdout:(18/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-20T13:32:16.530 INFO:teuthology.orchestra.run.smithi177.stdout:(19/32): python3-prettytable-0.7.2-27.el9.noarc 554 kB/s | 41 kB 00:00 2024-03-20T13:32:17.206 INFO:teuthology.orchestra.run.smithi177.stdout:(20/32): qatlib-service-23.11.0-1.el9.x86_64.rp 50 kB/s | 35 kB 00:00 2024-03-20T13:32:17.256 INFO:teuthology.orchestra.run.smithi177.stdout:(21/32): qatzip-libs-1.1.2-2.el9.x86_64.rpm 61 kB/s | 44 kB 00:00 2024-03-20T13:32:17.440 INFO:teuthology.orchestra.run.smithi177.stdout:(22/32): qatlib-23.11.0-1.el9.x86_64.rpm 232 kB/s | 216 kB 00:00 2024-03-20T13:32:17.656 INFO:teuthology.orchestra.run.smithi177.stdout:(23/32): gperftools-libs-2.9.1-2.el9.x86_64.rpm 686 kB/s | 309 kB 00:00 2024-03-20T13:32:17.698 INFO:teuthology.orchestra.run.smithi177.stdout:(24/32): libarrow-doc-9.0.0-10.el9.noarch.rpm 101 kB/s | 26 kB 00:00 2024-03-20T13:32:17.732 INFO:teuthology.orchestra.run.smithi177.stdout:(25/32): liboath-2.6.7-2.el9.x86_64.rpm 646 kB/s | 49 kB 00:00 2024-03-20T13:32:17.841 INFO:teuthology.orchestra.run.smithi177.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 475 kB/s | 67 kB 00:00 2024-03-20T13:32:17.899 INFO:teuthology.orchestra.run.smithi177.stdout:(27/32): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.9 MB/s | 838 kB 00:00 2024-03-20T13:32:18.024 INFO:teuthology.orchestra.run.smithi177.stdout:(28/32): libarrow-9.0.0-10.el9.x86_64.rpm 5.9 MB/s | 4.4 MB 00:00 2024-03-20T13:32:18.041 INFO:teuthology.orchestra.run.smithi177.stdout:(29/32): re2-20211101-3.el9.x86_64.rpm 956 kB/s | 192 kB 00:00 2024-03-20T13:32:18.083 INFO:teuthology.orchestra.run.smithi177.stdout:(30/32): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2024-03-20T13:32:18.683 INFO:teuthology.orchestra.run.smithi177.stdout:(31/32): librbd1-19.0.0-1426.g12fa452f.el9.x86_ 4.9 MB/s | 3.1 MB 00:00 2024-03-20T13:32:18.775 INFO:teuthology.orchestra.run.smithi177.stdout:(32/32): librados2-19.0.0-1426.g12fa452f.el9.x8 4.5 MB/s | 3.4 MB 00:00 2024-03-20T13:32:18.782 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:18.783 INFO:teuthology.orchestra.run.smithi177.stdout:Total 10 MB/s | 58 MB 00:05 2024-03-20T13:32:18.817 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:32:18.856 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:32:18.856 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:32:19.328 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:32:19.328 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:32:20.804 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:32:20.898 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-03-20T13:32:20.930 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-03-20T13:32:20.955 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-03-20T13:32:20.978 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-20T13:32:20.995 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 4/34 2024-03-20T13:32:21.197 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-20T13:32:21.251 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 5/34 2024-03-20T13:32:21.595 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-03-20T13:32:21.648 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 7/34 2024-03-20T13:32:21.729 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 7/34 2024-03-20T13:32:21.831 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 8/34 2024-03-20T13:32:21.966 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 9/34 2024-03-20T13:32:22.012 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 9/34 2024-03-20T13:32:22.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-03-20T13:32:22.084 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-argparse-2:19.0.0-1426.g12fa452f.el9. 11/34 2024-03-20T13:32:22.153 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 12/34 2024-03-20T13:32:22.176 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_6 13/34 2024-03-20T13:32:22.239 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_6 13/34 2024-03-20T13:32:22.266 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 14/34 2024-03-20T13:32:22.374 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : re2-1:20211101-3.el9.x86_64 15/34 2024-03-20T13:32:22.409 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 16/34 2024-03-20T13:32:22.450 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-03-20T13:32:22.491 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 18/34 2024-03-20T13:32:22.502 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 31/34 2024-03-20T13:32:22.502 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /sys 2024-03-20T13:32:22.502 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /proc 2024-03-20T13:32:22.502 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /mnt 2024-03-20T13:32:22.503 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /var/tmp 2024-03-20T13:32:22.503 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /home 2024-03-20T13:32:22.503 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /root 2024-03-20T13:32:22.503 INFO:teuthology.orchestra.run.smithi028.stdout:skipping the directory /tmp 2024-03-20T13:32:22.503 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:22.520 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 19/34 2024-03-20T13:32:22.552 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-03-20T13:32:22.860 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-03-20T13:32:22.890 INFO:teuthology.orchestra.run.smithi177.stdout: Upgrading : librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 22/34 2024-03-20T13:32:22.980 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 22/34 2024-03-20T13:32:23.012 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 23/34 2024-03-20T13:32:23.058 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-03-20T13:32:23.423 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 32/34 2024-03-20T13:32:23.451 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 32/34 2024-03-20T13:32:23.451 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:23.451 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-20T13:32:23.451 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:32:23.451 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:32:23.452 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:23.453 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-20T13:32:23.510 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 25/34 2024-03-20T13:32:23.535 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 26/34 2024-03-20T13:32:23.543 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-20T13:32:23.543 INFO:teuthology.orchestra.run.smithi028.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-20T13:32:23.608 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 26/34 2024-03-20T13:32:23.674 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 27/34 2024-03-20T13:32:23.703 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ceph-common-2:19.0.0-1426.g12fa452f.el9.x8 28/34 2024-03-20T13:32:24.623 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-20T13:32:24.623 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 1/34 2024-03-20T13:32:24.623 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 2/34 2024-03-20T13:32:24.623 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 3/34 2024-03-20T13:32:24.623 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 4/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 5/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_6 6/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 7/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1426.g12fa452f.el9. 8/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ceph-common-2:19.0.0-1426.g12fa452f.el9.x8 9/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 10/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 11/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 12/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 13/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-20T13:32:24.624 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-20T13:32:24.625 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-20T13:32:24.626 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-20T13:32:24.626 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-20T13:32:24.626 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-20T13:32:24.626 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 31/34 2024-03-20T13:32:24.626 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-20T13:32:24.627 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 33/34 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout:Upgraded: 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.617 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-20T13:32:25.618 INFO:teuthology.orchestra.run.smithi028.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: re2-1:20211101-3.el9.x86_64 2024-03-20T13:32:25.619 INFO:teuthology.orchestra.run.smithi028.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-20T13:32:25.620 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:25.620 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:25.855 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 29/34 2024-03-20T13:32:25.900 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 29/34 2024-03-20T13:32:25.946 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-test 2024-03-20T13:32:26.454 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 29/34 2024-03-20T13:32:26.494 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 30/34 2024-03-20T13:32:26.513 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:30 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 30/34 2024-03-20T13:32:26.587 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-20T13:32:26.587 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-20T13:32:26.587 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:26.629 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 31/34 2024-03-20T13:32:26.668 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:26.669 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:26.669 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 47 M 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 163 k 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:26.670 INFO:teuthology.orchestra.run.smithi028.stdout:Install 6 Packages 2024-03-20T13:32:26.671 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:26.671 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 48 M 2024-03-20T13:32:26.671 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 204 M 2024-03-20T13:32:26.671 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:32:26.970 INFO:teuthology.orchestra.run.smithi028.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.2 MB/s | 217 kB 00:00 2024-03-20T13:32:27.020 INFO:teuthology.orchestra.run.smithi028.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 6.1 MB/s | 300 kB 00:00 2024-03-20T13:32:27.045 INFO:teuthology.orchestra.run.smithi028.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.5 MB/s | 63 kB 00:00 2024-03-20T13:32:27.196 INFO:teuthology.orchestra.run.smithi028.stdout:(4/6): jq-1.6-16.el9.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2024-03-20T13:32:27.321 INFO:teuthology.orchestra.run.smithi028.stdout:(5/6): libcephsqlite-19.0.0-1426.g12fa452f.el9. 313 kB/s | 163 kB 00:00 2024-03-20T13:32:29.696 INFO:teuthology.orchestra.run.smithi028.stdout:(6/6): ceph-test-19.0.0-1426.g12fa452f.el9.x86_ 16 MB/s | 47 MB 00:02 2024-03-20T13:32:29.699 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:29.699 INFO:teuthology.orchestra.run.smithi028.stdout:Total 16 MB/s | 48 MB 00:03 2024-03-20T13:32:29.714 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:32:29.736 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:32:29.737 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:32:30.140 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:32:30.140 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:32:30.733 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:32:30.798 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-20T13:32:30.836 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-20T13:32:30.876 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-20T13:32:30.922 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-20T13:32:30.949 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 5/6 2024-03-20T13:32:35.656 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 5/6 2024-03-20T13:32:35.751 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 6/6 2024-03-20T13:32:35.941 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 31/34 2024-03-20T13:32:35.941 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /sys 2024-03-20T13:32:35.941 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /proc 2024-03-20T13:32:35.941 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /mnt 2024-03-20T13:32:35.942 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /var/tmp 2024-03-20T13:32:35.942 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /home 2024-03-20T13:32:35.942 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /root 2024-03-20T13:32:35.942 INFO:teuthology.orchestra.run.smithi177.stdout:skipping the directory /tmp 2024-03-20T13:32:35.942 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:36.862 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 32/34 2024-03-20T13:32:36.887 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 32/34 2024-03-20T13:32:36.887 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:36.888 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-20T13:32:36.888 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:32:36.888 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-20T13:32:36.888 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:36.889 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-20T13:32:36.965 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-03-20T13:32:36.966 INFO:teuthology.orchestra.run.smithi177.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-20T13:32:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 6/6 2024-03-20T13:32:38.004 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 1/6 2024-03-20T13:32:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 2/6 2024-03-20T13:32:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-20T13:32:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-20T13:32:38.005 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 1/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 2/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 3/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 4/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 5/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_6 6/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 7/34 2024-03-20T13:32:38.160 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-argparse-2:19.0.0-1426.g12fa452f.el9. 8/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ceph-common-2:19.0.0-1426.g12fa452f.el9.x8 9/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 10/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 11/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 12/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 13/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 20/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 21/34 2024-03-20T13:32:38.161 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 22/34 2024-03-20T13:32:38.162 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 23/34 2024-03-20T13:32:38.162 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 24/34 2024-03-20T13:32:38.162 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 25/34 2024-03-20T13:32:38.162 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-03-20T13:32:38.162 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-03-20T13:32:38.163 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 28/34 2024-03-20T13:32:38.163 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : re2-1:20211101-3.el9.x86_64 29/34 2024-03-20T13:32:38.163 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-03-20T13:32:38.163 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 31/34 2024-03-20T13:32:38.163 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-03-20T13:32:38.163 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 33/34 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout: jq-1.6-16.el9.x86_64 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout: libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:38.362 INFO:teuthology.orchestra.run.smithi028.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-20T13:32:38.363 INFO:teuthology.orchestra.run.smithi028.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-20T13:32:38.363 INFO:teuthology.orchestra.run.smithi028.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-20T13:32:38.363 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:38.363 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:38.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph 2024-03-20T13:32:39.197 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-03-20T13:32:39.197 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:39.197 INFO:teuthology.orchestra.run.smithi177.stdout:Upgraded: 2024-03-20T13:32:39.197 INFO:teuthology.orchestra.run.smithi177.stdout: librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.197 INFO:teuthology.orchestra.run.smithi177.stdout: librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-radosgw-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-selinux-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-20T13:32:39.198 INFO:teuthology.orchestra.run.smithi177.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: libradosstriper1-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-common-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.199 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: re2-1:20211101-3.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:39.200 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:32:39.256 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:43 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:39.419 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:39.421 INFO:teuthology.orchestra.run.smithi028.stdout:========================================================================================= 2024-03-20T13:32:39.421 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:32:39.421 INFO:teuthology.orchestra.run.smithi028.stdout:========================================================================================= 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: ceph x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 6.6 k 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 2.1 M 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 1.5 M 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 247 k 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 4.7 M 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 17 M 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-20T13:32:39.422 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-20T13:32:39.423 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:32:39.424 INFO:teuthology.orchestra.run.smithi028.stdout:========================================================================================= 2024-03-20T13:32:39.425 INFO:teuthology.orchestra.run.smithi028.stdout:Install 36 Packages 2024-03-20T13:32:39.425 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:39.425 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 30 M 2024-03-20T13:32:39.425 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 107 M 2024-03-20T13:32:39.425 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:32:39.548 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-test 2024-03-20T13:32:40.132 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:30 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:32:40.148 INFO:teuthology.orchestra.run.smithi028.stdout:(1/36): ceph-19.0.0-1426.g12fa452f.el9.x86_64.r 38 kB/s | 6.6 kB 00:00 2024-03-20T13:32:40.291 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:32:40.291 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:32:40.291 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 47 M 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 163 k 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:32:40.292 INFO:teuthology.orchestra.run.smithi177.stdout:Install 6 Packages 2024-03-20T13:32:40.293 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 48 M 2024-03-20T13:32:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 204 M 2024-03-20T13:32:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:32:40.415 INFO:teuthology.orchestra.run.smithi028.stdout:(2/36): ceph-mds-19.0.0-1426.g12fa452f.el9.x86_ 4.8 MB/s | 2.1 MB 00:00 2024-03-20T13:32:40.518 INFO:teuthology.orchestra.run.smithi177.stdout:(1/6): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.5 MB/s | 217 kB 00:00 2024-03-20T13:32:40.568 INFO:teuthology.orchestra.run.smithi177.stdout:(2/6): socat-1.7.4.1-5.el9.x86_64.rpm 6.0 MB/s | 300 kB 00:00 2024-03-20T13:32:40.602 INFO:teuthology.orchestra.run.smithi177.stdout:(3/6): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.9 MB/s | 63 kB 00:00 2024-03-20T13:32:40.632 INFO:teuthology.orchestra.run.smithi028.stdout:(3/36): ceph-mon-19.0.0-1426.g12fa452f.el9.x86_ 9.7 MB/s | 4.7 MB 00:00 2024-03-20T13:32:40.707 INFO:teuthology.orchestra.run.smithi028.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1426.g12fa 3.2 MB/s | 247 kB 00:00 2024-03-20T13:32:40.824 INFO:teuthology.orchestra.run.smithi028.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2024-03-20T13:32:40.858 INFO:teuthology.orchestra.run.smithi028.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 4.3 MB/s | 144 kB 00:00 2024-03-20T13:32:40.883 INFO:teuthology.orchestra.run.smithi028.stdout:(7/36): python3-markupsafe-1.1.1-12.el9.x86_64. 1.2 MB/s | 32 kB 00:00 2024-03-20T13:32:40.908 INFO:teuthology.orchestra.run.smithi028.stdout:(8/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.8 MB/s | 47 kB 00:00 2024-03-20T13:32:40.933 INFO:teuthology.orchestra.run.smithi028.stdout:(9/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.5 MB/s | 39 kB 00:00 2024-03-20T13:32:40.984 INFO:teuthology.orchestra.run.smithi028.stdout:(10/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-03-20T13:32:41.101 INFO:teuthology.orchestra.run.smithi028.stdout:(11/36): python3-cryptography-36.0.1-4.el9.x86_ 9.8 MB/s | 1.1 MB 00:00 2024-03-20T13:32:41.134 INFO:teuthology.orchestra.run.smithi028.stdout:(12/36): python3-ply-3.11-14.el9.noarch.rpm 3.0 MB/s | 103 kB 00:00 2024-03-20T13:32:41.168 INFO:teuthology.orchestra.run.smithi028.stdout:(13/36): python3-pycparser-2.20-6.el9.noarch.rp 3.6 MB/s | 124 kB 00:00 2024-03-20T13:32:41.218 INFO:teuthology.orchestra.run.smithi177.stdout:(4/6): libcephsqlite-19.0.0-1426.g12fa452f.el9. 193 kB/s | 163 kB 00:00 2024-03-20T13:32:41.327 INFO:teuthology.orchestra.run.smithi028.stdout:(14/36): ceph-osd-19.0.0-1426.g12fa452f.el9.x86 18 MB/s | 17 MB 00:00 2024-03-20T13:32:41.351 INFO:teuthology.orchestra.run.smithi028.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 1.0 MB/s | 187 kB 00:00 2024-03-20T13:32:41.385 INFO:teuthology.orchestra.run.smithi028.stdout:(16/36): ceph-mgr-19.0.0-1426.g12fa452f.el9.x86 1.1 MB/s | 1.5 MB 00:01 2024-03-20T13:32:41.469 INFO:teuthology.orchestra.run.smithi028.stdout:(17/36): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-03-20T13:32:41.494 INFO:teuthology.orchestra.run.smithi028.stdout:(18/36): python3-requests-2.25.1-8.el9.noarch.r 749 kB/s | 125 kB 00:00 2024-03-20T13:32:41.510 INFO:teuthology.orchestra.run.smithi177.stdout:(5/6): jq-1.6-16.el9.x86_64.rpm 206 kB/s | 187 kB 00:00 2024-03-20T13:32:41.661 INFO:teuthology.orchestra.run.smithi028.stdout:(19/36): luarocks-3.9.2-1.el9.noarch.rpm 549 kB/s | 151 kB 00:00 2024-03-20T13:32:41.678 INFO:teuthology.orchestra.run.smithi028.stdout:(20/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 208 kB/s | 43 kB 00:00 2024-03-20T13:32:41.737 INFO:teuthology.orchestra.run.smithi028.stdout:(21/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 183 kB/s | 11 kB 00:00 2024-03-20T13:32:41.770 INFO:teuthology.orchestra.run.smithi028.stdout:(22/36): python3-cherrypy-18.6.1-2.el9.noarch.r 3.2 MB/s | 358 kB 00:00 2024-03-20T13:32:41.787 INFO:teuthology.orchestra.run.smithi028.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 353 kB/s | 18 kB 00:00 2024-03-20T13:32:41.813 INFO:teuthology.orchestra.run.smithi028.stdout:(24/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 542 kB/s | 172 kB 00:00 2024-03-20T13:32:41.838 INFO:teuthology.orchestra.run.smithi028.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 346 kB/s | 23 kB 00:00 2024-03-20T13:32:41.863 INFO:teuthology.orchestra.run.smithi028.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 257 kB/s | 19 kB 00:00 2024-03-20T13:32:41.888 INFO:teuthology.orchestra.run.smithi028.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 261 kB/s | 20 kB 00:00 2024-03-20T13:32:41.913 INFO:teuthology.orchestra.run.smithi028.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 614 kB/s | 46 kB 00:00 2024-03-20T13:32:41.972 INFO:teuthology.orchestra.run.smithi028.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 725 kB/s | 79 kB 00:00 2024-03-20T13:32:41.997 INFO:teuthology.orchestra.run.smithi028.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 196 kB/s | 16 kB 00:00 2024-03-20T13:32:42.022 INFO:teuthology.orchestra.run.smithi028.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-03-20T13:32:42.047 INFO:teuthology.orchestra.run.smithi028.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.2 MB/s | 90 kB 00:00 2024-03-20T13:32:42.073 INFO:teuthology.orchestra.run.smithi028.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 474 kB/s | 36 kB 00:00 2024-03-20T13:32:42.098 INFO:teuthology.orchestra.run.smithi028.stdout:(34/36): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-03-20T13:32:42.123 INFO:teuthology.orchestra.run.smithi028.stdout:(35/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.5 MB/s | 427 kB 00:00 2024-03-20T13:32:42.149 INFO:teuthology.orchestra.run.smithi028.stdout:(36/36): python3-zc-lockfile-2.0-10.el9.noarch. 264 kB/s | 20 kB 00:00 2024-03-20T13:32:42.155 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:42.155 INFO:teuthology.orchestra.run.smithi028.stdout:Total 11 MB/s | 30 MB 00:02 2024-03-20T13:32:42.180 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:32:42.225 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:32:42.225 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:32:42.639 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:32:42.639 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:32:43.988 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:32:44.037 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-20T13:32:44.076 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-20T13:32:44.105 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-20T13:32:44.179 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-20T13:32:44.221 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-20T13:32:44.254 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-20T13:32:44.348 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-20T13:32:44.425 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-20T13:32:44.473 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-20T13:32:44.546 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-20T13:32:44.599 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-20T13:32:44.637 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-20T13:32:44.695 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-20T13:32:44.759 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-20T13:32:44.951 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-20T13:32:45.000 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-20T13:32:45.038 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-20T13:32:45.073 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-20T13:32:45.102 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-20T13:32:45.181 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-20T13:32:45.213 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-20T13:32:45.246 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-20T13:32:45.286 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-20T13:32:45.322 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-20T13:32:45.356 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-20T13:32:45.448 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-20T13:32:45.486 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-20T13:32:45.561 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-20T13:32:45.701 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-20T13:32:45.825 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-20T13:32:45.993 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1426.g12fa452f.el9. 31/36 2024-03-20T13:32:46.024 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 32/36 2024-03-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 32/36 2024-03-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-20T13:32:46.050 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:46.485 INFO:teuthology.orchestra.run.smithi177.stdout:(6/6): ceph-test-19.0.0-1426.g12fa452f.el9.x86_ 7.7 MB/s | 47 MB 00:06 2024-03-20T13:32:46.488 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:46.488 INFO:teuthology.orchestra.run.smithi177.stdout:Total 7.8 MB/s | 48 MB 00:06 2024-03-20T13:32:46.501 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:32:46.520 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:32:46.520 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:32:46.908 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:32:46.908 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:32:47.484 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:32:47.566 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 33/36 2024-03-20T13:32:47.579 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/6 2024-03-20T13:32:47.593 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 33/36 2024-03-20T13:32:47.593 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:47.593 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-20T13:32:47.593 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-20T13:32:47.593 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-20T13:32:47.593 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:47.621 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 2/6 2024-03-20T13:32:47.655 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-20T13:32:47.694 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : jq-1.6-16.el9.x86_64 4/6 2024-03-20T13:32:47.721 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 5/6 2024-03-20T13:32:48.059 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 34/36 2024-03-20T13:32:48.082 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 34/36 2024-03-20T13:32:48.082 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:48.082 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-20T13:32:48.082 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-20T13:32:48.082 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-20T13:32:48.082 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:48.292 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 35/36 2024-03-20T13:32:48.315 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 35/36 2024-03-20T13:32:48.315 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-20T13:32:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-20T13:32:48.316 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-20T13:32:48.316 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:48.385 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 36/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 36/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 1/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 2/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 3/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 4/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 5/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1426.g12fa452f.el9. 6/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-20T13:32:50.137 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-20T13:32:50.138 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-20T13:32:50.139 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-20T13:32:50.140 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-20T13:32:50.140 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-20T13:32:50.140 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-20T13:32:50.140 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-20T13:32:50.140 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-20T13:32:51.159 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-20T13:32:51.159 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:51.159 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:32:51.159 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: lua-5.4.4-4.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-20T13:32:51.160 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ply-3.11-14.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-20T13:32:51.161 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:51.162 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:51.534 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-base 2024-03-20T13:32:52.121 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:56 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:52.166 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 5/6 2024-03-20T13:32:52.220 INFO:teuthology.orchestra.run.smithi028.stdout:Package ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:32:52.247 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 6/6 2024-03-20T13:32:52.275 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:52.276 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:32:52.276 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:52.343 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install cephadm 2024-03-20T13:32:52.911 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:56 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:53.065 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 748 k 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:32:53.066 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:53.067 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:32:53.067 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:53.067 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 748 k 2024-03-20T13:32:53.067 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 754 k 2024-03-20T13:32:53.067 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:32:53.638 INFO:teuthology.orchestra.run.smithi028.stdout:cephadm-19.0.0-1426.g12fa452f.el9.noarch.rpm 1.3 MB/s | 748 kB 00:00 2024-03-20T13:32:53.638 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:53.639 INFO:teuthology.orchestra.run.smithi028.stdout:Total 1.3 MB/s | 748 kB 00:00 2024-03-20T13:32:53.639 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:32:53.644 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:32:53.644 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:32:53.650 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:32:53.651 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:32:53.722 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:32:54.163 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:32:54.253 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:32:54.735 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 6/6 2024-03-20T13:32:54.735 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 1/6 2024-03-20T13:32:54.735 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 2/6 2024-03-20T13:32:54.735 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 3/6 2024-03-20T13:32:54.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 4/6 2024-03-20T13:32:54.736 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 5/6 2024-03-20T13:32:54.742 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:32:54.991 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:32:54.992 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:54.992 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:32:54.992 INFO:teuthology.orchestra.run.smithi028.stdout: cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:32:54.992 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:54.992 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : jq-1.6-16.el9.x86_64 6/6 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-test-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: jq-1.6-16.el9.x86_64 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: libcephsqlite-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:55.099 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:32:55.183 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-immutable-object-cache 2024-03-20T13:32:55.393 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph 2024-03-20T13:32:55.763 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:00:59 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:55.920 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:55.920 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:55.920 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 145 k 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 145 k 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 436 k 2024-03-20T13:32:55.921 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:32:55.959 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:45 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:32:56.117 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:32:56.119 INFO:teuthology.orchestra.run.smithi177.stdout:========================================================================================= 2024-03-20T13:32:56.119 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:32:56.119 INFO:teuthology.orchestra.run.smithi177.stdout:========================================================================================= 2024-03-20T13:32:56.119 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:32:56.119 INFO:teuthology.orchestra.run.smithi177.stdout: ceph x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 6.6 k 2024-03-20T13:32:56.119 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 2.1 M 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 1.5 M 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 247 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 4.7 M 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 17 M 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-20T13:32:56.120 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-20T13:32:56.121 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout:========================================================================================= 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout:Install 36 Packages 2024-03-20T13:32:56.122 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:32:56.123 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 30 M 2024-03-20T13:32:56.123 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 107 M 2024-03-20T13:32:56.123 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:32:56.276 INFO:teuthology.orchestra.run.smithi028.stdout:ceph-immutable-object-cache-19.0.0-1426.g12fa45 411 kB/s | 145 kB 00:00 2024-03-20T13:32:56.277 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:56.277 INFO:teuthology.orchestra.run.smithi028.stdout:Total 409 kB/s | 145 kB 00:00 2024-03-20T13:32:56.277 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:32:56.285 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:32:56.286 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:32:56.339 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:32:56.340 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:32:56.480 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:32:56.552 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f. 1/1 2024-03-20T13:32:56.576 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f. 1/1 2024-03-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-20T13:32:56.577 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:56.779 INFO:teuthology.orchestra.run.smithi177.stdout:(1/36): ceph-19.0.0-1426.g12fa452f.el9.x86_64.r 31 kB/s | 6.6 kB 00:00 2024-03-20T13:32:57.112 INFO:teuthology.orchestra.run.smithi177.stdout:(2/36): ceph-mgr-19.0.0-1426.g12fa452f.el9.x86_ 2.7 MB/s | 1.5 MB 00:00 2024-03-20T13:32:57.154 INFO:teuthology.orchestra.run.smithi177.stdout:(3/36): ceph-mds-19.0.0-1426.g12fa452f.el9.x86_ 3.6 MB/s | 2.1 MB 00:00 2024-03-20T13:32:57.263 INFO:teuthology.orchestra.run.smithi177.stdout:(4/36): ceph-mgr-modules-core-19.0.0-1426.g12fa 2.2 MB/s | 247 kB 00:00 2024-03-20T13:32:57.372 INFO:teuthology.orchestra.run.smithi177.stdout:(5/36): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2024-03-20T13:32:57.414 INFO:teuthology.orchestra.run.smithi177.stdout:(6/36): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 144 kB 00:00 2024-03-20T13:32:57.489 INFO:teuthology.orchestra.run.smithi177.stdout:(7/36): ceph-mon-19.0.0-1426.g12fa452f.el9.x86_ 6.6 MB/s | 4.7 MB 00:00 2024-03-20T13:32:57.506 INFO:teuthology.orchestra.run.smithi177.stdout:(8/36): python3-markupsafe-1.1.1-12.el9.x86_64. 344 kB/s | 32 kB 00:00 2024-03-20T13:32:57.510 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f. 1/1 2024-03-20T13:32:57.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:57.510 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:32:57.510 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:32:57.510 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:57.510 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:57.522 INFO:teuthology.orchestra.run.smithi177.stdout:(9/36): python3-pytz-2021.1-5.el9.noarch.rpm 1.4 MB/s | 47 kB 00:00 2024-03-20T13:32:57.539 INFO:teuthology.orchestra.run.smithi177.stdout:(10/36): python3-toml-0.10.2-6.el9.noarch.rpm 1.1 MB/s | 39 kB 00:00 2024-03-20T13:32:57.581 INFO:teuthology.orchestra.run.smithi177.stdout:(11/36): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.0 MB/s | 241 kB 00:00 2024-03-20T13:32:57.640 INFO:teuthology.orchestra.run.smithi177.stdout:(12/36): python3-cryptography-36.0.1-4.el9.x86_ 11 MB/s | 1.1 MB 00:00 2024-03-20T13:32:57.657 INFO:teuthology.orchestra.run.smithi177.stdout:(13/36): python3-ply-3.11-14.el9.noarch.rpm 1.3 MB/s | 103 kB 00:00 2024-03-20T13:32:57.682 INFO:teuthology.orchestra.run.smithi177.stdout:(14/36): python3-pycparser-2.20-6.el9.noarch.rp 2.9 MB/s | 124 kB 00:00 2024-03-20T13:32:57.708 INFO:teuthology.orchestra.run.smithi177.stdout:(15/36): python3-urllib3-1.26.5-5.el9.noarch.rp 3.6 MB/s | 187 kB 00:00 2024-03-20T13:32:57.818 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr 2024-03-20T13:32:57.833 INFO:teuthology.orchestra.run.smithi177.stdout:(16/36): lua-devel-5.4.4-4.el9.x86_64.rpm 178 kB/s | 22 kB 00:00 2024-03-20T13:32:57.858 INFO:teuthology.orchestra.run.smithi177.stdout:(17/36): python3-requests-2.25.1-8.el9.noarch.r 713 kB/s | 125 kB 00:00 2024-03-20T13:32:58.075 INFO:teuthology.orchestra.run.smithi177.stdout:(18/36): ceph-osd-19.0.0-1426.g12fa452f.el9.x86 17 MB/s | 17 MB 00:00 2024-03-20T13:32:58.250 INFO:teuthology.orchestra.run.smithi177.stdout:(19/36): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 111 kB/s | 43 kB 00:00 2024-03-20T13:32:58.309 INFO:teuthology.orchestra.run.smithi177.stdout:(20/36): luarocks-3.9.2-1.el9.noarch.rpm 317 kB/s | 151 kB 00:00 2024-03-20T13:32:58.351 INFO:teuthology.orchestra.run.smithi177.stdout:(21/36): python3-cheroot-8.6.0-4.el9.noarch.rpm 623 kB/s | 172 kB 00:00 2024-03-20T13:32:58.399 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:02 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:58.451 INFO:teuthology.orchestra.run.smithi177.stdout:(22/36): python3-jaraco-8.2.1-3.el9.noarch.rpm 75 kB/s | 11 kB 00:00 2024-03-20T13:32:58.499 INFO:teuthology.orchestra.run.smithi028.stdout:Package ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:32:58.510 INFO:teuthology.orchestra.run.smithi177.stdout:(23/36): python3-jaraco-classes-3.2.1-5.el9.noa 111 kB/s | 18 kB 00:00 2024-03-20T13:32:58.535 INFO:teuthology.orchestra.run.smithi177.stdout:(24/36): python3-cherrypy-18.6.1-2.el9.noarch.r 1.2 MB/s | 358 kB 00:00 2024-03-20T13:32:58.553 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:58.554 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:32:58.554 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:32:58.577 INFO:teuthology.orchestra.run.smithi177.stdout:(25/36): python3-jaraco-collections-3.0.0-8.el9 184 kB/s | 23 kB 00:00 2024-03-20T13:32:58.602 INFO:teuthology.orchestra.run.smithi177.stdout:(26/36): python3-jaraco-functools-3.5.0-2.el9.n 211 kB/s | 19 kB 00:00 2024-03-20T13:32:58.625 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-dashboard 2024-03-20T13:32:58.627 INFO:teuthology.orchestra.run.smithi177.stdout:(27/36): python3-jaraco-text-3.2.0-6.el9.noarch 213 kB/s | 20 kB 00:00 2024-03-20T13:32:58.678 INFO:teuthology.orchestra.run.smithi177.stdout:(28/36): python3-logutils-0.3.5-21.el9.noarch.r 461 kB/s | 46 kB 00:00 2024-03-20T13:32:58.703 INFO:teuthology.orchestra.run.smithi177.stdout:(29/36): python3-more-itertools-8.12.0-2.el9.no 783 kB/s | 79 kB 00:00 2024-03-20T13:32:58.795 INFO:teuthology.orchestra.run.smithi177.stdout:(30/36): python3-portend-3.1.0-2.el9.noarch.rpm 140 kB/s | 16 kB 00:00 2024-03-20T13:32:58.820 INFO:teuthology.orchestra.run.smithi177.stdout:(31/36): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-03-20T13:32:58.845 INFO:teuthology.orchestra.run.smithi177.stdout:(32/36): python3-pyOpenSSL-21.0.0-1.el9.noarch. 633 kB/s | 90 kB 00:00 2024-03-20T13:32:58.871 INFO:teuthology.orchestra.run.smithi177.stdout:(33/36): python3-tempora-5.0.0-2.el9.noarch.rpm 475 kB/s | 36 kB 00:00 2024-03-20T13:32:58.954 INFO:teuthology.orchestra.run.smithi177.stdout:(34/36): python3-zc-lockfile-2.0-10.el9.noarch. 240 kB/s | 20 kB 00:00 2024-03-20T13:32:59.074 INFO:teuthology.orchestra.run.smithi177.stdout:(35/36): python3-webob-1.8.7-6.el9.noarch.rpm 915 kB/s | 230 kB 00:00 2024-03-20T13:32:59.096 INFO:teuthology.orchestra.run.smithi177.stdout:(36/36): python3-werkzeug-2.0.3-3.el9.1.noarch. 1.7 MB/s | 427 kB 00:00 2024-03-20T13:32:59.099 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:32:59.099 INFO:teuthology.orchestra.run.smithi177.stdout:Total 10 MB/s | 30 MB 00:02 2024-03-20T13:32:59.124 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:32:59.166 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:32:59.166 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:32:59.189 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:03 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:32:59.346 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout:====================================================================================== 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout:====================================================================================== 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 1.8 M 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 31 k 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 15 k 2024-03-20T13:32:59.347 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout:====================================================================================== 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout:Install 12 Packages 2024-03-20T13:32:59.348 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:32:59.349 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 6.9 M 2024-03-20T13:32:59.349 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 26 M 2024-03-20T13:32:59.349 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:32:59.582 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:32:59.582 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:00.229 INFO:teuthology.orchestra.run.smithi028.stdout:(1/12): ceph-prometheus-alerts-19.0.0-1426.g12f 70 kB/s | 15 kB 00:00 2024-03-20T13:33:00.279 INFO:teuthology.orchestra.run.smithi028.stdout:(2/12): ceph-grafana-dashboards-19.0.0-1426.g12 117 kB/s | 31 kB 00:00 2024-03-20T13:33:00.438 INFO:teuthology.orchestra.run.smithi028.stdout:(3/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.5 MB/s | 238 kB 00:00 2024-03-20T13:33:00.480 INFO:teuthology.orchestra.run.smithi028.stdout:(4/12): protobuf-3.14.0-13.el9.x86_64.rpm 4.0 MB/s | 1.0 MB 00:00 2024-03-20T13:33:00.880 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:00.888 INFO:teuthology.orchestra.run.smithi028.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1426.g12fa452 2.0 MB/s | 1.8 MB 00:00 2024-03-20T13:33:00.922 INFO:teuthology.orchestra.run.smithi028.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 1.2 MB/s | 548 kB 00:00 2024-03-20T13:33:00.940 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/36 2024-03-20T13:33:00.975 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/36 2024-03-20T13:33:01.001 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/36 2024-03-20T13:33:01.056 INFO:teuthology.orchestra.run.smithi028.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 116 kB/s | 19 kB 00:00 2024-03-20T13:33:01.071 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/36 2024-03-20T13:33:01.118 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : luarocks-3.9.2-1.el9.noarch 5/36 2024-03-20T13:33:01.149 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/36 2024-03-20T13:33:01.240 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/36 2024-03-20T13:33:01.318 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/36 2024-03-20T13:33:01.331 INFO:teuthology.orchestra.run.smithi028.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 525 kB/s | 144 kB 00:00 2024-03-20T13:33:01.360 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 9/36 2024-03-20T13:33:01.406 INFO:teuthology.orchestra.run.smithi028.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 4.2 MB/s | 2.0 MB 00:00 2024-03-20T13:33:01.431 INFO:teuthology.orchestra.run.smithi028.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 307 kB/s | 31 kB 00:00 2024-03-20T13:33:01.434 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/36 2024-03-20T13:33:01.490 INFO:teuthology.orchestra.run.smithi028.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.2 MB/s | 188 kB 00:00 2024-03-20T13:33:01.610 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 11/36 2024-03-20T13:33:01.658 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 12/36 2024-03-20T13:33:01.716 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-ply-3.11-14.el9.noarch 13/36 2024-03-20T13:33:01.779 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 14/36 2024-03-20T13:33:01.962 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 15/36 2024-03-20T13:33:02.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 16/36 2024-03-20T13:33:02.077 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 17/36 2024-03-20T13:33:02.111 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 18/36 2024-03-20T13:33:02.150 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 19/36 2024-03-20T13:33:02.225 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 20/36 2024-03-20T13:33:02.260 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-20T13:33:02.293 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 22/36 2024-03-20T13:33:02.333 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 23/36 2024-03-20T13:33:02.368 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/36 2024-03-20T13:33:02.395 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 25/36 2024-03-20T13:33:02.482 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 26/36 2024-03-20T13:33:02.517 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/36 2024-03-20T13:33:02.588 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/36 2024-03-20T13:33:02.733 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 29/36 2024-03-20T13:33:02.823 INFO:teuthology.orchestra.run.smithi028.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 362 kB/s | 863 kB 00:02 2024-03-20T13:33:02.829 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:02.829 INFO:teuthology.orchestra.run.smithi028.stdout:Total 2.0 MB/s | 6.9 MB 00:03 2024-03-20T13:33:02.849 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:02.869 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:02.869 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:02.900 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-20T13:33:03.058 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:03.059 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-1426.g12fa452f.el9. 31/36 2024-03-20T13:33:03.059 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:03.089 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 32/36 2024-03-20T13:33:03.114 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 32/36 2024-03-20T13:33:03.136 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:03.136 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-20T13:33:03.136 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-20T13:33:03.136 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-20T13:33:03.136 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:03.575 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:03.667 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-20T13:33:03.702 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-20T13:33:03.748 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-20T13:33:03.777 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-20T13:33:03.893 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-20T13:33:04.024 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-20T13:33:04.107 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-20T13:33:04.157 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-20T13:33:04.185 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-20T13:33:04.217 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1426.g12fa452f.el9 10/12 2024-03-20T13:33:04.469 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1426.g12fa452f.el 11/12 2024-03-20T13:33:04.516 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noa 12/12 2024-03-20T13:33:04.548 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 33/36 2024-03-20T13:33:04.574 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 33/36 2024-03-20T13:33:04.574 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:04.574 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-20T13:33:04.574 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-20T13:33:04.574 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-20T13:33:04.575 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:05.041 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 34/36 2024-03-20T13:33:05.064 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 34/36 2024-03-20T13:33:05.064 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:05.064 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-20T13:33:05.064 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-20T13:33:05.064 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-20T13:33:05.064 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:05.274 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 35/36 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noa 12/12 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1426.g12fa452f.el 1/12 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noa 2/12 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1426.g12fa452f.el9 3/12 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-20T13:33:05.282 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-20T13:33:05.283 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-20T13:33:05.283 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-20T13:33:05.283 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-20T13:33:05.283 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-20T13:33:05.283 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-20T13:33:05.297 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 35/36 2024-03-20T13:33:05.297 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:05.297 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-20T13:33:05.297 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-20T13:33:05.297 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-20T13:33:05.297 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:05.354 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 36/36 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-grafana-dashboards-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-prometheus-alerts-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-20T13:33:05.636 INFO:teuthology.orchestra.run.smithi028.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:05.637 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:05.891 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-20T13:33:06.466 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:10 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:06.624 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:06.625 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================================ 2024-03-20T13:33:06.625 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:33:06.625 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================================ 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 7.4 M 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-20T13:33:06.626 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================================ 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout:Install 12 Packages 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 37 M 2024-03-20T13:33:06.627 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 209 M 2024-03-20T13:33:06.628 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:07.054 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 36/36 2024-03-20T13:33:07.054 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 1/36 2024-03-20T13:33:07.054 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 2/36 2024-03-20T13:33:07.054 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 3/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 4/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 5/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-1426.g12fa452f.el9. 6/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-5.4.4-4.el9.x86_64 7/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 8/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 9/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 10/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 11/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 12/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 13/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-ply-3.11-14.el9.noarch 14/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 15/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 16/36 2024-03-20T13:33:07.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 17/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 18/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 19/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 20/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 21/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 22/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 23/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 24/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 25/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 26/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 27/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 28/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 29/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 30/36 2024-03-20T13:33:07.056 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 31/36 2024-03-20T13:33:07.057 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 32/36 2024-03-20T13:33:07.057 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 33/36 2024-03-20T13:33:07.057 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 34/36 2024-03-20T13:33:07.057 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 35/36 2024-03-20T13:33:07.212 INFO:teuthology.orchestra.run.smithi028.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 191 kB/s | 32 kB 00:00 2024-03-20T13:33:07.237 INFO:teuthology.orchestra.run.smithi028.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 695 kB/s | 17 kB 00:00 2024-03-20T13:33:07.262 INFO:teuthology.orchestra.run.smithi028.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 1.4 MB/s | 34 kB 00:00 2024-03-20T13:33:07.421 INFO:teuthology.orchestra.run.smithi028.stdout:(4/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 30 MB/s | 4.7 MB 00:00 2024-03-20T13:33:07.554 INFO:teuthology.orchestra.run.smithi028.stdout:(5/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2024-03-20T13:33:07.621 INFO:teuthology.orchestra.run.smithi028.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 5.2 MB/s | 3.0 MB 00:00 2024-03-20T13:33:07.646 INFO:teuthology.orchestra.run.smithi028.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.4 MB/s | 217 kB 00:00 2024-03-20T13:33:07.797 INFO:teuthology.orchestra.run.smithi028.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-14 9.9 MB/s | 7.4 MB 00:00 2024-03-20T13:33:08.006 INFO:teuthology.orchestra.run.smithi028.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 41 MB/s | 16 MB 00:00 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 36/36 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mds-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-modules-core-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mon-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: lua-5.4.4-4.el9.x86_64 2024-03-20T13:33:08.092 INFO:teuthology.orchestra.run.smithi177.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-20T13:33:08.093 INFO:teuthology.orchestra.run.smithi177.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ply-3.11-14.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-20T13:33:08.094 INFO:teuthology.orchestra.run.smithi177.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-20T13:33:08.095 INFO:teuthology.orchestra.run.smithi177.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-20T13:33:08.095 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:08.095 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:08.164 INFO:teuthology.orchestra.run.smithi028.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 536 kB/s | 195 kB 00:00 2024-03-20T13:33:08.189 INFO:teuthology.orchestra.run.smithi028.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 1.3 MB/s | 245 kB 00:00 2024-03-20T13:33:08.231 INFO:teuthology.orchestra.run.smithi028.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 803 kB 00:00 2024-03-20T13:33:08.233 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:08.233 INFO:teuthology.orchestra.run.smithi028.stdout:Total 23 MB/s | 37 MB 00:01 2024-03-20T13:33:08.273 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:08.297 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:08.297 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:08.467 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-base 2024-03-20T13:33:08.678 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:08.678 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:09.038 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:59 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:09.135 INFO:teuthology.orchestra.run.smithi177.stdout:Package ceph-base-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:09.186 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:09.187 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:09.187 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:09.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install cephadm 2024-03-20T13:33:09.561 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:09.638 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-20T13:33:09.669 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-20T13:33:09.768 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-20T13:33:09.805 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:00:59 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:09.930 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-20T13:33:09.952 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 748 k 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 748 k 2024-03-20T13:33:09.953 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 754 k 2024-03-20T13:33:09.954 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:10.115 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-20T13:33:10.146 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-20T13:33:10.216 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-20T13:33:10.415 INFO:teuthology.orchestra.run.smithi177.stdout:cephadm-19.0.0-1426.g12fa452f.el9.noarch.rpm 1.6 MB/s | 748 kB 00:00 2024-03-20T13:33:10.415 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:10.415 INFO:teuthology.orchestra.run.smithi177.stdout:Total 1.6 MB/s | 748 kB 00:00 2024-03-20T13:33:10.416 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:10.421 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:10.421 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:10.426 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:10.427 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:10.497 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:10.904 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-20T13:33:10.972 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:33:11.030 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-20T13:33:11.053 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:33:11.413 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:33:11.691 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/1 2024-03-20T13:33:11.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:11.691 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:11.691 INFO:teuthology.orchestra.run.smithi177.stdout: cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:11.691 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:11.692 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:11.886 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-immutable-object-cache 2024-03-20T13:33:12.324 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-20T13:33:12.451 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:02 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:12.601 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:12.602 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:12.602 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-03-20T13:33:12.602 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 145 k 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 145 k 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 436 k 2024-03-20T13:33:12.603 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:12.820 INFO:teuthology.orchestra.run.smithi177.stdout:ceph-immutable-object-cache-19.0.0-1426.g12fa45 671 kB/s | 145 kB 00:00 2024-03-20T13:33:12.821 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:12.821 INFO:teuthology.orchestra.run.smithi177.stdout:Total 667 kB/s | 145 kB 00:00 2024-03-20T13:33:12.821 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:12.829 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:12.829 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:12.880 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:12.881 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:13.018 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:13.079 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f. 1/1 2024-03-20T13:33:13.104 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f. 1/1 2024-03-20T13:33:13.105 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:13.105 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-20T13:33:13.105 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:13.388 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-20T13:33:13.427 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa4 12/12 2024-03-20T13:33:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f. 1/1 2024-03-20T13:33:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-immutable-object-cache-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:14.055 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:14.055 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:14.340 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr 2024-03-20T13:33:14.919 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:04 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:15.017 INFO:teuthology.orchestra.run.smithi177.stdout:Package ceph-mgr-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:15.068 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:15.128 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-dashboard 2024-03-20T13:33:15.683 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:05 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:15.816 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa4 12/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa4 1/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-20T13:33:15.817 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-20T13:33:15.833 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-03-20T13:33:15.834 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-03-20T13:33:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:15.834 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 1.8 M 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 31 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 15 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-20T13:33:15.835 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout:====================================================================================== 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout:Install 12 Packages 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 6.9 M 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 26 M 2024-03-20T13:33:15.836 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:16.215 INFO:teuthology.orchestra.run.smithi177.stdout:(1/12): ceph-grafana-dashboards-19.0.0-1426.g12 153 kB/s | 31 kB 00:00 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-20T13:33:16.220 INFO:teuthology.orchestra.run.smithi028.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:16.221 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:16.307 INFO:teuthology.orchestra.run.smithi177.stdout:(2/12): ceph-prometheus-alerts-19.0.0-1426.g12f 51 kB/s | 15 kB 00:00 2024-03-20T13:33:16.366 INFO:teuthology.orchestra.run.smithi177.stdout:(3/12): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-03-20T13:33:16.391 INFO:teuthology.orchestra.run.smithi177.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 2.8 MB/s | 238 kB 00:00 2024-03-20T13:33:16.433 INFO:teuthology.orchestra.run.smithi177.stdout:(5/12): ceph-mgr-dashboard-19.0.0-1426.g12fa452 4.2 MB/s | 1.8 MB 00:00 2024-03-20T13:33:16.666 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-rook 2024-03-20T13:33:16.817 INFO:teuthology.orchestra.run.smithi177.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 51 kB/s | 19 kB 00:00 2024-03-20T13:33:17.125 INFO:teuthology.orchestra.run.smithi177.stdout:(7/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 747 kB/s | 548 kB 00:00 2024-03-20T13:33:17.242 INFO:teuthology.orchestra.run.smithi177.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 986 kB/s | 863 kB 00:00 2024-03-20T13:33:17.245 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:21 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:17.267 INFO:teuthology.orchestra.run.smithi177.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 1.0 MB/s | 144 kB 00:00 2024-03-20T13:33:17.393 INFO:teuthology.orchestra.run.smithi177.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 1.5 MB/s | 188 kB 00:00 2024-03-20T13:33:17.400 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:17.401 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-20T13:33:17.401 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 52 k 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-20T13:33:17.402 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout:Install 13 Packages 2024-03-20T13:33:17.403 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:17.404 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 2.0 M 2024-03-20T13:33:17.404 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 26 M 2024-03-20T13:33:17.404 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:17.509 INFO:teuthology.orchestra.run.smithi177.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 2.9 MB/s | 2.0 MB 00:00 2024-03-20T13:33:17.651 INFO:teuthology.orchestra.run.smithi177.stdout:(12/12): python3-repoze-lru-0.7-16.el9.noarch.r 75 kB/s | 31 kB 00:00 2024-03-20T13:33:17.656 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:17.657 INFO:teuthology.orchestra.run.smithi177.stdout:Total 3.8 MB/s | 6.9 MB 00:01 2024-03-20T13:33:17.675 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:17.692 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:17.692 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:17.867 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:17.868 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:17.877 INFO:teuthology.orchestra.run.smithi028.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 242 kB/s | 24 kB 00:00 2024-03-20T13:33:17.911 INFO:teuthology.orchestra.run.smithi028.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 135 kB/s | 18 kB 00:00 2024-03-20T13:33:17.994 INFO:teuthology.orchestra.run.smithi028.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.5 MB/s | 174 kB 00:00 2024-03-20T13:33:18.019 INFO:teuthology.orchestra.run.smithi028.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 132 kB 00:00 2024-03-20T13:33:18.053 INFO:teuthology.orchestra.run.smithi028.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 3.6 MB/s | 211 kB 00:00 2024-03-20T13:33:18.078 INFO:teuthology.orchestra.run.smithi028.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 732 kB/s | 43 kB 00:00 2024-03-20T13:33:18.228 INFO:teuthology.orchestra.run.smithi028.stdout:(7/13): python3-certifi-2021.10.8-2.el9.noarch. 100 kB/s | 15 kB 00:00 2024-03-20T13:33:18.253 INFO:teuthology.orchestra.run.smithi028.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 161 kB/s | 32 kB 00:00 2024-03-20T13:33:18.279 INFO:teuthology.orchestra.run.smithi028.stdout:(9/13): ceph-mgr-rook-19.0.0-1426.g12fa452f.el9 104 kB/s | 52 kB 00:00 2024-03-20T13:33:18.375 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:18.404 INFO:teuthology.orchestra.run.smithi028.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.1 MB/s | 203 kB 00:00 2024-03-20T13:33:18.429 INFO:teuthology.orchestra.run.smithi028.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2024-03-20T13:33:18.455 INFO:teuthology.orchestra.run.smithi028.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-03-20T13:33:18.468 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-03-20T13:33:18.504 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-03-20T13:33:18.550 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-03-20T13:33:18.554 INFO:teuthology.orchestra.run.smithi028.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 3.4 MB/s | 1.0 MB 00:00 2024-03-20T13:33:18.557 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:18.557 INFO:teuthology.orchestra.run.smithi028.stdout:Total 1.8 MB/s | 2.0 MB 00:01 2024-03-20T13:33:18.557 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:18.572 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:18.572 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:18.581 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-03-20T13:33:18.673 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:18.674 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:18.698 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-03-20T13:33:18.822 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-03-20T13:33:18.916 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-03-20T13:33:18.960 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-03-20T13:33:18.989 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-03-20T13:33:19.029 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-1426.g12fa452f.el9 10/12 2024-03-20T13:33:19.214 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:19.270 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-1426.g12fa452f.el 11/12 2024-03-20T13:33:19.295 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noa 12/12 2024-03-20T13:33:19.392 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-20T13:33:19.449 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-20T13:33:19.504 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-20T13:33:19.541 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-20T13:33:19.583 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-20T13:33:19.679 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-20T13:33:19.788 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-20T13:33:19.851 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-20T13:33:20.101 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noa 12/12 2024-03-20T13:33:20.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-1426.g12fa452f.el 1/12 2024-03-20T13:33:20.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noa 2/12 2024-03-20T13:33:20.101 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-1426.g12fa452f.el9 3/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-03-20T13:33:20.102 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-03-20T13:33:20.437 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-03-20T13:33:20.437 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:20.437 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:20.437 INFO:teuthology.orchestra.run.smithi177.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-grafana-dashboards-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-prometheus-alerts-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:20.438 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:20.612 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-20T13:33:20.655 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-20T13:33:20.687 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-20T13:33:20.688 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-20T13:33:20.737 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-20T13:33:20.766 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 13/13 2024-03-20T13:33:21.247 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:11 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:21.397 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:21.398 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2024-03-20T13:33:21.398 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:21.398 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 7.4 M 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-20T13:33:21.399 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-20T13:33:21.400 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-20T13:33:21.400 INFO:teuthology.orchestra.run.smithi177.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-20T13:33:21.400 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-20T13:33:21.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-20T13:33:21.400 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-20T13:33:21.401 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-20T13:33:21.401 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-20T13:33:21.401 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:21.401 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:21.402 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================================ 2024-03-20T13:33:21.402 INFO:teuthology.orchestra.run.smithi177.stdout:Install 12 Packages 2024-03-20T13:33:21.402 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:21.403 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 37 M 2024-03-20T13:33:21.403 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 209 M 2024-03-20T13:33:21.404 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:21.522 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 13/13 2024-03-20T13:33:21.522 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 1/13 2024-03-20T13:33:21.522 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-20T13:33:21.522 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-20T13:33:21.523 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-20T13:33:21.641 INFO:teuthology.orchestra.run.smithi177.stdout:(1/12): flexiblas-3.0.4-8.el9.x86_64.rpm 235 kB/s | 32 kB 00:00 2024-03-20T13:33:21.674 INFO:teuthology.orchestra.run.smithi177.stdout:(2/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 533 kB/s | 17 kB 00:00 2024-03-20T13:33:21.716 INFO:teuthology.orchestra.run.smithi177.stdout:(3/12): openblas-0.3.21-2.el9.x86_64.rpm 845 kB/s | 34 kB 00:00 2024-03-20T13:33:21.775 INFO:teuthology.orchestra.run.smithi177.stdout:(4/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 11 MB/s | 3.0 MB 00:00 2024-03-20T13:33:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-20T13:33:21.868 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:21.868 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-20T13:33:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-20T13:33:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-20T13:33:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-20T13:33:21.869 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:21.870 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:21.994 INFO:teuthology.orchestra.run.smithi177.stdout:(5/12): openblas-openmp-0.3.21-2.el9.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2024-03-20T13:33:22.067 INFO:teuthology.orchestra.run.smithi177.stdout:(6/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 16 MB/s | 4.8 MB 00:00 2024-03-20T13:33:22.093 INFO:teuthology.orchestra.run.smithi177.stdout:(7/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.2 MB/s | 217 kB 00:00 2024-03-20T13:33:22.152 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-mgr-cephadm 2024-03-20T13:33:22.243 INFO:teuthology.orchestra.run.smithi177.stdout:(8/12): ceph-mgr-diskprediction-local-19.0.0-14 10 MB/s | 7.4 MB 00:00 2024-03-20T13:33:22.468 INFO:teuthology.orchestra.run.smithi177.stdout:(9/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2024-03-20T13:33:22.724 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:26 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:22.878 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:22.879 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 138 k 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout:======================================================================================== 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout:Install 6 Packages 2024-03-20T13:33:22.880 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:22.881 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 6.8 M 2024-03-20T13:33:22.881 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 33 M 2024-03-20T13:33:22.881 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:22.893 INFO:teuthology.orchestra.run.smithi177.stdout:(10/12): libquadmath-11.4.1-3.el9.x86_64.rpm 301 kB/s | 195 kB 00:00 2024-03-20T13:33:22.977 INFO:teuthology.orchestra.run.smithi177.stdout:(11/12): python3-devel-3.9.17-2.el9.x86_64.rpm 483 kB/s | 245 kB 00:00 2024-03-20T13:33:23.010 INFO:teuthology.orchestra.run.smithi177.stdout:(12/12): libgfortran-11.4.1-3.el9.x86_64.rpm 876 kB/s | 803 kB 00:00 2024-03-20T13:33:23.012 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:23.012 INFO:teuthology.orchestra.run.smithi177.stdout:Total 23 MB/s | 37 MB 00:01 2024-03-20T13:33:23.052 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:23.077 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:23.077 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:23.347 INFO:teuthology.orchestra.run.smithi028.stdout:(1/6): ceph-mgr-cephadm-19.0.0-1426.g12fa452f.e 522 kB/s | 138 kB 00:00 2024-03-20T13:33:23.414 INFO:teuthology.orchestra.run.smithi028.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2024-03-20T13:33:23.439 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:23.439 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:23.455 INFO:teuthology.orchestra.run.smithi028.stdout:(3/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 664 kB/s | 248 kB 00:00 2024-03-20T13:33:23.472 INFO:teuthology.orchestra.run.smithi028.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 990 kB/s | 58 kB 00:00 2024-03-20T13:33:23.522 INFO:teuthology.orchestra.run.smithi028.stdout:(5/6): python3-typing-extensions-4.4.0-2.el9.no 763 kB/s | 51 kB 00:00 2024-03-20T13:33:23.564 INFO:teuthology.orchestra.run.smithi028.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.5 MB/s | 548 kB 00:00 2024-03-20T13:33:23.567 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:23.567 INFO:teuthology.orchestra.run.smithi028.stdout:Total 9.9 MB/s | 6.8 MB 00:00 2024-03-20T13:33:23.580 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:23.591 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:23.591 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:23.684 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:23.686 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:23.990 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:24.141 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:24.151 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-20T13:33:24.208 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-20T13:33:24.224 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 1/12 2024-03-20T13:33:24.264 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 2/12 2024-03-20T13:33:24.360 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 3/12 2024-03-20T13:33:24.409 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 4/12 2024-03-20T13:33:24.585 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-20T13:33:24.608 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-20T13:33:24.685 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-03-20T13:33:24.754 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-20T13:33:24.845 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-20T13:33:24.915 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-20T13:33:24.945 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 6/6 2024-03-20T13:33:25.328 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-03-20T13:33:25.429 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-03-20T13:33:25.750 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 6/6 2024-03-20T13:33:25.750 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/6 2024-03-20T13:33:25.750 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-20T13:33:25.750 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-20T13:33:25.750 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-20T13:33:25.750 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-20T13:33:26.041 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-20T13:33:26.041 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:26.041 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:26.041 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:26.042 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:26.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-fuse 2024-03-20T13:33:26.648 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-03-20T13:33:26.868 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:30 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:27.026 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:27.027 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:27.027 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:33:27.027 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:27.027 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:27.027 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 886 k 2024-03-20T13:33:27.027 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout:Install 2 Packages 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 964 k 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 2.8 M 2024-03-20T13:33:27.028 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:27.148 INFO:teuthology.orchestra.run.smithi028.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 654 kB/s | 79 kB 00:00 2024-03-20T13:33:27.671 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-03-20T13:33:27.682 INFO:teuthology.orchestra.run.smithi028.stdout:(2/2): ceph-fuse-19.0.0-1426.g12fa452f.el9.x86_ 1.3 MB/s | 886 kB 00:00 2024-03-20T13:33:27.683 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:27.684 INFO:teuthology.orchestra.run.smithi028.stdout:Total 1.4 MB/s | 964 kB 00:00 2024-03-20T13:33:27.684 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:27.691 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa4 12/12 2024-03-20T13:33:27.705 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:27.705 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:27.781 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:27.781 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:27.967 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:28.105 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-20T13:33:28.176 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 2/2 2024-03-20T13:33:28.846 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 2/2 2024-03-20T13:33:28.847 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/2 2024-03-20T13:33:29.130 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-20T13:33:29.130 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:29.130 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:29.130 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-20T13:33:29.131 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:29.131 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:29.396 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install ceph-volume 2024-03-20T13:33:29.976 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:33 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:30.134 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:30.135 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repository Size 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 264 k 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout:Installing dependencies: 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:30.136 INFO:teuthology.orchestra.run.smithi028.stdout:Install 2 Packages 2024-03-20T13:33:30.137 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:30.137 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 332 k 2024-03-20T13:33:30.137 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 1.5 M 2024-03-20T13:33:30.137 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:30.270 INFO:teuthology.orchestra.run.smithi028.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 517 kB/s | 69 kB 00:00 2024-03-20T13:33:30.322 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa4 12/12 2024-03-20T13:33:30.322 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa4 1/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 2/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 3/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 4/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 5/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 6/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 7/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 8/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 9/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 10/12 2024-03-20T13:33:30.323 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 11/12 2024-03-20T13:33:30.578 INFO:teuthology.orchestra.run.smithi028.stdout:(2/2): ceph-volume-19.0.0-1426.g12fa452f.el9.no 597 kB/s | 264 kB 00:00 2024-03-20T13:33:30.579 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:30.580 INFO:teuthology.orchestra.run.smithi028.stdout:Total 749 kB/s | 332 kB 00:00 2024-03-20T13:33:30.580 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:30.590 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:30.590 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:30.627 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:30.628 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 12/12 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-20T13:33:30.730 INFO:teuthology.orchestra.run.smithi177.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:30.731 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:30.779 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:30.970 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-20T13:33:31.005 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 2/2 2024-03-20T13:33:31.020 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 2/2 2024-03-20T13:33:31.021 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:31.021 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-20T13:33:31.021 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:31.079 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-rook 2024-03-20T13:33:31.653 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:21 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:31.730 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 1/2 2024-03-20T13:33:31.808 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:31.809 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================== 2024-03-20T13:33:31.809 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:31.809 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================== 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 52 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-20T13:33:31.810 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================== 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout:Install 13 Packages 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:31.811 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 2.0 M 2024-03-20T13:33:31.812 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 26 M 2024-03-20T13:33:31.812 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:31.991 INFO:teuthology.orchestra.run.smithi177.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 190 kB/s | 24 kB 00:00 2024-03-20T13:33:32.017 INFO:teuthology.orchestra.run.smithi177.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 118 kB/s | 18 kB 00:00 2024-03-20T13:33:32.051 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-20T13:33:32.051 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:32.051 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:32.051 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:32.051 INFO:teuthology.orchestra.run.smithi028.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-20T13:33:32.052 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:32.052 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:32.067 INFO:teuthology.orchestra.run.smithi177.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2024-03-20T13:33:32.092 INFO:teuthology.orchestra.run.smithi177.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.3 MB/s | 174 kB 00:00 2024-03-20T13:33:32.117 INFO:teuthology.orchestra.run.smithi177.stdout:(5/13): python3-pyasn1-modules-0.4.8-6.el9.noar 4.1 MB/s | 211 kB 00:00 2024-03-20T13:33:32.142 INFO:teuthology.orchestra.run.smithi177.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 854 kB/s | 43 kB 00:00 2024-03-20T13:33:32.234 INFO:teuthology.orchestra.run.smithi177.stdout:(7/13): ceph-mgr-rook-19.0.0-1426.g12fa452f.el9 141 kB/s | 52 kB 00:00 2024-03-20T13:33:32.310 INFO:teuthology.orchestra.run.smithi177.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 168 kB/s | 32 kB 00:00 2024-03-20T13:33:32.335 INFO:teuthology.orchestra.run.smithi177.stdout:(9/13): python3-certifi-2021.10.8-2.el9.noarch. 78 kB/s | 15 kB 00:00 2024-03-20T13:33:32.385 INFO:teuthology.orchestra.run.smithi177.stdout:(10/13): python3-google-auth-2.28.2-1.el9.noarc 1.3 MB/s | 203 kB 00:00 2024-03-20T13:33:32.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install librados-devel 2024-03-20T13:33:32.486 INFO:teuthology.orchestra.run.smithi177.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 393 kB/s | 59 kB 00:00 2024-03-20T13:33:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 4.5 MB/s | 1.0 MB 00:00 2024-03-20T13:33:32.560 INFO:teuthology.orchestra.run.smithi177.stdout:(13/13): python3-websocket-client-1.2.3-2.el9.n 512 kB/s | 90 kB 00:00 2024-03-20T13:33:32.564 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:32.565 INFO:teuthology.orchestra.run.smithi177.stdout:Total 2.7 MB/s | 2.0 MB 00:00 2024-03-20T13:33:32.565 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:32.578 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:32.578 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:32.668 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:32.669 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:32.975 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:36 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:33.130 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:33.131 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:33.131 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-20T13:33:33.131 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:33.131 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:33.131 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 127 k 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 127 k 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 456 k 2024-03-20T13:33:33.132 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:33.188 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:33.347 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-03-20T13:33:33.395 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-03-20T13:33:33.451 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-03-20T13:33:33.488 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-03-20T13:33:33.499 INFO:teuthology.orchestra.run.smithi028.stdout:librados-devel-19.0.0-1426.g12fa452f.el9.x86_64 345 kB/s | 127 kB 00:00 2024-03-20T13:33:33.499 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:33.500 INFO:teuthology.orchestra.run.smithi028.stdout:Total 344 kB/s | 127 kB 00:00 2024-03-20T13:33:33.500 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:33.506 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:33.529 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 5/13 2024-03-20T13:33:33.564 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:33.564 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:33.623 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-03-20T13:33:33.708 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:33.724 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 7/13 2024-03-20T13:33:33.771 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-03-20T13:33:33.825 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:34.265 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:34.483 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-03-20T13:33:34.527 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-03-20T13:33:34.536 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:34.536 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:34.537 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:34.537 INFO:teuthology.orchestra.run.smithi028.stdout: librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:34.537 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:34.537 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:34.561 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-03-20T13:33:34.609 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-03-20T13:33:34.632 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 13/13 2024-03-20T13:33:34.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install libcephfs2 2024-03-20T13:33:35.346 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:39 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:35.446 INFO:teuthology.orchestra.run.smithi028.stdout:Package libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 13/13 2024-03-20T13:33:35.450 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 1/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 9/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 10/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-03-20T13:33:35.451 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-03-20T13:33:35.502 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:35.503 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:35.503 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:35.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install libcephfs-devel 2024-03-20T13:33:35.820 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-03-20T13:33:35.820 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:35.820 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-rook-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-20T13:33:35.821 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:35.822 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:36.083 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-mgr-cephadm 2024-03-20T13:33:36.144 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:40 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:36.301 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:36.302 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:36.302 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-20T13:33:36.302 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 31 k 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 31 k 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 140 k 2024-03-20T13:33:36.303 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:36.560 INFO:teuthology.orchestra.run.smithi028.stdout:libcephfs-devel-19.0.0-1426.g12fa452f.el9.x86_6 121 kB/s | 31 kB 00:00 2024-03-20T13:33:36.561 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:36.561 INFO:teuthology.orchestra.run.smithi028.stdout:Total 121 kB/s | 31 kB 00:00 2024-03-20T13:33:36.561 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:36.565 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:36.565 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:36.599 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:36.599 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:36.644 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:26 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:36.722 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:36.792 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================== 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================== 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 138 k 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:33:36.793 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout:======================================================================================== 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout:Install 6 Packages 2024-03-20T13:33:36.794 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:36.795 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 6.8 M 2024-03-20T13:33:36.795 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 33 M 2024-03-20T13:33:36.795 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:36.836 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:37.158 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:37.428 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:37.428 INFO:teuthology.orchestra.run.smithi028.stdout: libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:37.429 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:37.429 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:37.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install librados2 2024-03-20T13:33:37.687 INFO:teuthology.orchestra.run.smithi177.stdout:(1/6): ceph-mgr-cephadm-19.0.0-1426.g12fa452f.e 621 kB/s | 138 kB 00:00 2024-03-20T13:33:37.754 INFO:teuthology.orchestra.run.smithi177.stdout:(2/6): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-20T13:33:38.113 INFO:teuthology.orchestra.run.smithi177.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 173 kB/s | 58 kB 00:00 2024-03-20T13:33:38.185 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:42 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:38.247 INFO:teuthology.orchestra.run.smithi177.stdout:(4/6): python3-typing-extensions-4.4.0-2.el9.no 382 kB/s | 51 kB 00:00 2024-03-20T13:33:38.286 INFO:teuthology.orchestra.run.smithi028.stdout:Package librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:38.341 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:38.342 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:38.342 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:38.388 INFO:teuthology.orchestra.run.smithi177.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 783 kB/s | 548 kB 00:00 2024-03-20T13:33:38.399 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install librbd1 2024-03-20T13:33:38.522 INFO:teuthology.orchestra.run.smithi177.stdout:(6/6): python3-jinja2-2.11.3-5.el9.noarch.rpm 235 kB/s | 248 kB 00:01 2024-03-20T13:33:38.524 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:38.524 INFO:teuthology.orchestra.run.smithi177.stdout:Total 3.9 MB/s | 6.8 MB 00:01 2024-03-20T13:33:38.537 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:38.547 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:38.548 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:38.636 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:38.637 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:38.932 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:38.974 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:42 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:39.074 INFO:teuthology.orchestra.run.smithi028.stdout:Package librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:39.106 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 1/6 2024-03-20T13:33:39.129 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:39.130 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:39.131 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:39.157 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-03-20T13:33:39.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-rados 2024-03-20T13:33:39.683 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-03-20T13:33:39.769 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-03-20T13:33:39.773 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:43 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:39.829 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 5/6 2024-03-20T13:33:39.852 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 6/6 2024-03-20T13:33:39.873 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:39.931 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:39.932 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:39.986 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-rgw 2024-03-20T13:33:40.566 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:44 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 6/6 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 1/6 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 3/6 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-03-20T13:33:40.665 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:40.720 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:40.721 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:40.721 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:40.770 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-cephfs 2024-03-20T13:33:40.977 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 6/6 2024-03-20T13:33:40.977 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:40.977 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:40.977 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-cephadm-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:40.977 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-20T13:33:40.977 INFO:teuthology.orchestra.run.smithi177.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-20T13:33:40.978 INFO:teuthology.orchestra.run.smithi177.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-20T13:33:40.978 INFO:teuthology.orchestra.run.smithi177.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-20T13:33:40.978 INFO:teuthology.orchestra.run.smithi177.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-20T13:33:40.978 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:40.978 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:41.223 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-fuse 2024-03-20T13:33:41.346 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:45 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:41.446 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:41.501 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:41.502 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:41.502 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:41.553 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install python3-rbd 2024-03-20T13:33:41.790 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:31 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:41.940 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 886 k 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:41.941 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:Install 2 Packages 2024-03-20T13:33:41.942 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 964 k 2024-03-20T13:33:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 2.8 M 2024-03-20T13:33:41.942 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:42.082 INFO:teuthology.orchestra.run.smithi177.stdout:(1/2): fuse-2.9.9-15.el9.x86_64.rpm 565 kB/s | 79 kB 00:00 2024-03-20T13:33:42.128 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:46 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:42.228 INFO:teuthology.orchestra.run.smithi028.stdout:Package python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:42.283 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:42.284 INFO:teuthology.orchestra.run.smithi028.stdout:Nothing to do. 2024-03-20T13:33:42.284 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:42.339 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install rbd-fuse 2024-03-20T13:33:42.557 INFO:teuthology.orchestra.run.smithi177.stdout:(2/2): ceph-fuse-19.0.0-1426.g12fa452f.el9.x86_ 1.4 MB/s | 886 kB 00:00 2024-03-20T13:33:42.558 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:42.558 INFO:teuthology.orchestra.run.smithi177.stdout:Total 1.5 MB/s | 964 kB 00:00 2024-03-20T13:33:42.559 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:42.579 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:42.579 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:42.652 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:42.652 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:42.829 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:42.917 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:46 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:42.974 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : fuse-2.9.9-15.el9.x86_64 1/2 2024-03-20T13:33:43.040 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 2/2 2024-03-20T13:33:43.070 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:43.071 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:43.071 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 85 k 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 85 k 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 231 k 2024-03-20T13:33:43.072 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:43.398 INFO:teuthology.orchestra.run.smithi028.stdout:rbd-fuse-19.0.0-1426.g12fa452f.el9.x86_64.rpm 262 kB/s | 85 kB 00:00 2024-03-20T13:33:43.398 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:43.399 INFO:teuthology.orchestra.run.smithi028.stdout:Total 261 kB/s | 85 kB 00:00 2024-03-20T13:33:43.399 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:43.406 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:43.406 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:43.464 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:43.464 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:43.609 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:43.713 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:43.761 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 2/2 2024-03-20T13:33:43.761 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/2 2024-03-20T13:33:44.075 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 2/2 2024-03-20T13:33:44.075 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:44.076 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:44.076 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 fuse-2.9.9-15.el9.x86_64 2024-03-20T13:33:44.076 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:44.076 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:44.102 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:44.385 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install ceph-volume 2024-03-20T13:33:44.409 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:44.409 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:44.409 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:44.409 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:44.410 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:44.410 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:44.668 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install rbd-mirror 2024-03-20T13:33:44.971 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:34 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:45.126 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:45.126 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repository Size 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume noarch 2:19.0.0-1426.g12fa452f.el9 ceph-noarch 264 k 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout:Installing dependencies: 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout:Install 2 Packages 2024-03-20T13:33:45.127 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:45.128 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 332 k 2024-03-20T13:33:45.128 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 1.5 M 2024-03-20T13:33:45.128 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:45.253 INFO:teuthology.orchestra.run.smithi177.stdout:(1/2): python3-packaging-20.9-5.el9.noarch.rpm 552 kB/s | 69 kB 00:00 2024-03-20T13:33:45.255 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:49 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:45.418 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout: Package Arch Version Repo Size 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 3.1 M 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:45.419 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:45.420 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:33:45.420 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:45.420 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 3.1 M 2024-03-20T13:33:45.420 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 13 M 2024-03-20T13:33:45.420 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:45.628 INFO:teuthology.orchestra.run.smithi177.stdout:(2/2): ceph-volume-19.0.0-1426.g12fa452f.el9.no 528 kB/s | 264 kB 00:00 2024-03-20T13:33:45.629 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:45.629 INFO:teuthology.orchestra.run.smithi177.stdout:Total 662 kB/s | 332 kB 00:00 2024-03-20T13:33:45.629 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:45.638 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:45.677 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:45.678 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:45.825 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:46.001 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : python3-packaging-20.9-5.el9.noarch 1/2 2024-03-20T13:33:46.047 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 2/2 2024-03-20T13:33:46.063 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 2/2 2024-03-20T13:33:46.063 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:46.063 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-20T13:33:46.063 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:46.442 INFO:teuthology.orchestra.run.smithi028.stdout:rbd-mirror-19.0.0-1426.g12fa452f.el9.x86_64.rpm 3.0 MB/s | 3.1 MB 00:01 2024-03-20T13:33:46.443 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:46.444 INFO:teuthology.orchestra.run.smithi028.stdout:Total 3.0 MB/s | 3.1 MB 00:01 2024-03-20T13:33:46.444 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:46.456 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:46.456 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:46.536 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:46.536 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:46.801 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 1/2 2024-03-20T13:33:46.981 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:47.043 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:47.068 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:47.068 INFO:teuthology.orchestra.run.smithi028.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:33:47.068 INFO:teuthology.orchestra.run.smithi028.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-20T13:33:47.068 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-20T13:33:47.068 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-20T13:33:47.068 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 2/2 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-volume-2:19.0.0-1426.g12fa452f.el9.noarch 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:47.149 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:47.519 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install librados-devel 2024-03-20T13:33:48.095 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:38 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:48.220 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:48.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:48.220 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:48.220 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:48.220 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:48.220 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:48.244 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:48.244 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:48.244 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-03-20T13:33:48.244 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 127 k 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:48.245 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 127 k 2024-03-20T13:33:48.246 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 456 k 2024-03-20T13:33:48.246 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:48.463 DEBUG:teuthology.orchestra.run.smithi028:> sudo yum -y install rbd-nbd 2024-03-20T13:33:48.466 INFO:teuthology.orchestra.run.smithi177.stdout:librados-devel-19.0.0-1426.g12fa452f.el9.x86_64 574 kB/s | 127 kB 00:00 2024-03-20T13:33:48.467 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:48.467 INFO:teuthology.orchestra.run.smithi177.stdout:Total 570 kB/s | 127 kB 00:00 2024-03-20T13:33:48.467 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:48.473 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:48.473 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:48.528 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:48.529 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:48.670 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:48.766 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:49.044 INFO:teuthology.orchestra.run.smithi028.stdout:Last metadata expiration check: 0:01:53 ago on Wed 20 Mar 2024 01:31:56 PM UTC. 2024-03-20T13:33:49.197 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:49.200 INFO:teuthology.orchestra.run.smithi028.stdout:Dependencies resolved. 2024-03-20T13:33:49.201 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:49.201 INFO:teuthology.orchestra.run.smithi028.stdout: Package Architecture Version Repository Size 2024-03-20T13:33:49.201 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:Installing: 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 171 k 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction Summary 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:================================================================================ 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:Install 1 Package 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:Total download size: 171 k 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:Installed size: 494 k 2024-03-20T13:33:49.202 INFO:teuthology.orchestra.run.smithi028.stdout:Downloading Packages: 2024-03-20T13:33:49.428 INFO:teuthology.orchestra.run.smithi028.stdout:rbd-nbd-19.0.0-1426.g12fa452f.el9.x86_64.rpm 755 kB/s | 171 kB 00:00 2024-03-20T13:33:49.429 INFO:teuthology.orchestra.run.smithi028.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:49.429 INFO:teuthology.orchestra.run.smithi028.stdout:Total 749 kB/s | 171 kB 00:00 2024-03-20T13:33:49.429 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction check 2024-03-20T13:33:49.438 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction check succeeded. 2024-03-20T13:33:49.438 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction test 2024-03-20T13:33:49.456 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:49.456 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:49.456 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:49.456 INFO:teuthology.orchestra.run.smithi177.stdout: librados-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:49.456 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:49.456 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:49.496 INFO:teuthology.orchestra.run.smithi028.stdout:Transaction test succeeded. 2024-03-20T13:33:49.496 INFO:teuthology.orchestra.run.smithi028.stdout:Running transaction 2024-03-20T13:33:49.658 INFO:teuthology.orchestra.run.smithi028.stdout: Preparing : 1/1 2024-03-20T13:33:49.712 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install libcephfs2 2024-03-20T13:33:49.755 INFO:teuthology.orchestra.run.smithi028.stdout: Installing : rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:50.154 INFO:teuthology.orchestra.run.smithi028.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:50.294 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:40 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:50.394 INFO:teuthology.orchestra.run.smithi177.stdout:Package libcephfs2-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:50.448 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:50.449 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:50.449 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:50.457 INFO:teuthology.orchestra.run.smithi028.stdout: Verifying : rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:50.457 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:50.457 INFO:teuthology.orchestra.run.smithi028.stdout:Installed: 2024-03-20T13:33:50.457 INFO:teuthology.orchestra.run.smithi028.stdout: rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:50.457 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:33:50.457 INFO:teuthology.orchestra.run.smithi028.stdout:Complete! 2024-03-20T13:33:50.517 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install libcephfs-devel 2024-03-20T13:33:50.734 DEBUG:teuthology.parallel:result is None 2024-03-20T13:33:51.081 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:41 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:51.231 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:51.231 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:51.231 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 31 k 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 31 k 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 140 k 2024-03-20T13:33:51.232 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:libcephfs-devel-19.0.0-1426.g12fa452f.el9.x86_6 131 kB/s | 31 kB 00:00 2024-03-20T13:33:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:Total 131 kB/s | 31 kB 00:00 2024-03-20T13:33:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:51.473 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:51.474 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:51.509 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:51.510 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:51.630 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:51.735 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:52.104 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:52.374 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:52.374 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:52.374 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:52.374 INFO:teuthology.orchestra.run.smithi177.stdout: libcephfs-devel-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:52.374 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:52.374 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:52.541 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install librados2 2024-03-20T13:33:53.100 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:43 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:53.197 INFO:teuthology.orchestra.run.smithi177.stdout:Package librados2-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:53.249 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:53.250 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:53.251 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:53.307 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install librbd1 2024-03-20T13:33:53.871 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:43 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:53.969 INFO:teuthology.orchestra.run.smithi177.stdout:Package librbd1-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:54.020 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:54.021 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:54.021 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:54.074 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-rados 2024-03-20T13:33:54.639 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:44 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:54.738 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-rados-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:54.790 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:54.790 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:54.791 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:54.841 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-rgw 2024-03-20T13:33:55.410 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:45 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:55.506 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-rgw-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:55.558 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:55.559 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:55.559 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:55.616 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-cephfs 2024-03-20T13:33:56.179 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:46 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:56.278 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-cephfs-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:56.331 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:56.332 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:56.332 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:56.386 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install python3-rbd 2024-03-20T13:33:56.951 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:46 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:57.048 INFO:teuthology.orchestra.run.smithi177.stdout:Package python3-rbd-2:19.0.0-1426.g12fa452f.el9.x86_64 is already installed. 2024-03-20T13:33:57.100 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:57.101 INFO:teuthology.orchestra.run.smithi177.stdout:Nothing to do. 2024-03-20T13:33:57.101 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:57.157 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install rbd-fuse 2024-03-20T13:33:57.722 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:47 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:33:57.871 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 85 k 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:33:57.872 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:57.873 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 85 k 2024-03-20T13:33:57.873 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 231 k 2024-03-20T13:33:57.873 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:33:58.181 INFO:teuthology.orchestra.run.smithi177.stdout:rbd-fuse-19.0.0-1426.g12fa452f.el9.x86_64.rpm 277 kB/s | 85 kB 00:00 2024-03-20T13:33:58.182 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:33:58.182 INFO:teuthology.orchestra.run.smithi177.stdout:Total 276 kB/s | 85 kB 00:00 2024-03-20T13:33:58.182 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:33:58.189 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:33:58.189 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:33:58.245 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:33:58.245 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:33:58.379 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:33:58.479 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:58.887 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:59.192 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:33:59.192 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:59.192 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:33:59.193 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-fuse-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:33:59.193 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:33:59.193 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:33:59.476 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install rbd-mirror 2024-03-20T13:34:00.075 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:50 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:34:00.230 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout: Package Arch Version Repo Size 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 3.1 M 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 3.1 M 2024-03-20T13:34:00.231 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 13 M 2024-03-20T13:34:00.232 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:34:00.886 INFO:teuthology.orchestra.run.smithi177.stdout:rbd-mirror-19.0.0-1426.g12fa452f.el9.x86_64.rpm 4.7 MB/s | 3.1 MB 00:00 2024-03-20T13:34:00.886 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:34:00.886 INFO:teuthology.orchestra.run.smithi177.stdout:Total 4.7 MB/s | 3.1 MB 00:00 2024-03-20T13:34:00.886 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:34:00.895 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:34:00.895 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:34:00.967 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:34:00.968 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:34:01.382 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:34:01.435 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:34:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:34:01.460 INFO:teuthology.orchestra.run.smithi177.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-20T13:34:01.460 INFO:teuthology.orchestra.run.smithi177.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-20T13:34:01.460 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-20T13:34:01.460 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-20T13:34:01.460 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:34:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:02.621 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:34:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:34:02.621 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:02.621 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:34:02.842 DEBUG:teuthology.orchestra.run.smithi177:> sudo yum -y install rbd-nbd 2024-03-20T13:34:03.422 INFO:teuthology.orchestra.run.smithi177.stdout:Last metadata expiration check: 0:01:53 ago on Wed 20 Mar 2024 01:32:10 PM UTC. 2024-03-20T13:34:03.573 INFO:teuthology.orchestra.run.smithi177.stdout:Dependencies resolved. 2024-03-20T13:34:03.573 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout: Package Architecture Version Repository Size 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:Installing: 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd x86_64 2:19.0.0-1426.g12fa452f.el9 ceph 171 k 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction Summary 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:================================================================================ 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:Install 1 Package 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:Total download size: 171 k 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:Installed size: 494 k 2024-03-20T13:34:03.574 INFO:teuthology.orchestra.run.smithi177.stdout:Downloading Packages: 2024-03-20T13:34:03.923 INFO:teuthology.orchestra.run.smithi177.stdout:rbd-nbd-19.0.0-1426.g12fa452f.el9.x86_64.rpm 490 kB/s | 171 kB 00:00 2024-03-20T13:34:03.924 INFO:teuthology.orchestra.run.smithi177.stdout:-------------------------------------------------------------------------------- 2024-03-20T13:34:03.924 INFO:teuthology.orchestra.run.smithi177.stdout:Total 487 kB/s | 171 kB 00:00 2024-03-20T13:34:03.924 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction check 2024-03-20T13:34:03.932 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction check succeeded. 2024-03-20T13:34:03.932 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction test 2024-03-20T13:34:03.988 INFO:teuthology.orchestra.run.smithi177.stdout:Transaction test succeeded. 2024-03-20T13:34:03.988 INFO:teuthology.orchestra.run.smithi177.stdout:Running transaction 2024-03-20T13:34:04.134 INFO:teuthology.orchestra.run.smithi177.stdout: Preparing : 1/1 2024-03-20T13:34:04.230 INFO:teuthology.orchestra.run.smithi177.stdout: Installing : rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:34:04.635 INFO:teuthology.orchestra.run.smithi177.stdout: Running scriptlet: rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:34:04.939 INFO:teuthology.orchestra.run.smithi177.stdout: Verifying : rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 1/1 2024-03-20T13:34:04.939 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:04.940 INFO:teuthology.orchestra.run.smithi177.stdout:Installed: 2024-03-20T13:34:04.940 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-nbd-2:19.0.0-1426.g12fa452f.el9.x86_64 2024-03-20T13:34:04.940 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:04.940 INFO:teuthology.orchestra.run.smithi177.stdout:Complete! 2024-03-20T13:34:05.187 DEBUG:teuthology.parallel:result is None 2024-03-20T13:34:05.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:34:05.404 DEBUG:teuthology.orchestra.run.smithi028:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-20T13:34:05.429 INFO:teuthology.orchestra.run.smithi028.stdout:19.0.0-1426.g12fa452f.el9 2024-03-20T13:34:05.429 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1426.g12fa452f.el9 2024-03-20T13:34:05.429 INFO:teuthology.task.install:The correct ceph version 19.0.0-1426.g12fa452f is installed. 2024-03-20T13:34:05.432 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=12fa452f60a20733b42c92efd8302af373c366e6 2024-03-20T13:34:05.653 DEBUG:teuthology.orchestra.run.smithi177:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-20T13:34:05.675 INFO:teuthology.orchestra.run.smithi177.stdout:19.0.0-1426.g12fa452f.el9 2024-03-20T13:34:05.675 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-1426.g12fa452f.el9 2024-03-20T13:34:05.675 INFO:teuthology.task.install:The correct ceph version 19.0.0-1426.g12fa452f is installed. 2024-03-20T13:34:05.677 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-20T13:34:05.677 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:05.677 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-20T13:34:05.709 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:05.709 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-20T13:34:05.755 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-20T13:34:05.755 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:05.755 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2024-03-20T13:34:05.786 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-20T13:34:05.856 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:05.856 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/daemon-helper 2024-03-20T13:34:05.883 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-20T13:34:05.950 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-20T13:34:05.950 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:05.950 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-20T13:34:05.979 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-20T13:34:06.050 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:06.051 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-20T13:34:06.079 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-20T13:34:06.145 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-20T13:34:06.146 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:06.146 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2024-03-20T13:34:06.175 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-20T13:34:06.244 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:06.244 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/usr/bin/stdin-killer 2024-03-20T13:34:06.271 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-20T13:34:06.338 INFO:teuthology.run_tasks:Running task ceph... 2024-03-20T13:34:06.429 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-20T13:34:06.430 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2024-03-20T13:34:06.433 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2024-03-20T13:34:06.459 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-20T13:34:06.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-20T13:34:06.501 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-20T13:34:06.528 INFO:tasks.ceph:Creating extra log directories... 2024-03-20T13:34:06.528 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-20T13:34:06.570 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-20T13:34:06.612 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-20T13:34:06.613 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-20T13:34:06.613 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306', 'branch': 'wip_thotz_update_attrs_from_state_setattrs', 'description': 'rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7612306', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip_thotz_update_attrs_from_state_setattrs'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}}, 'rgw': {'ec-data-pool': True, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip_thotz_update_attrs_from_state_setattrs', 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6'}}, 'owner': 'scheduled_amaredia@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4446, 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'sleep_before_teardown': 0, 'suite': 'rgw:singleton', 'suite_branch': 'wip_thotz_update_attrs_from_state_setattrs', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMbK4rSjKzHq63OtQk8TyPWImhHazniDExDiCWzzLNE9jTrGz//wfI0H7VmDV61pnyL7ekG+T2F727nuJ+GsJVk=', 'smithi177.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqeRG9DZazhxoY5qcCH/UbzKFrb939/JY29nBxWaSMi27N06NIlI6MWSjKiVIZNxm0ylRfWB3EUtm3fg+/xQeA='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '12fa452f60a20733b42c92efd8302af373c366e6', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-20_13:11:42', 'tube': 'smithi', 'user': 'amaredia', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-20T13:34:06.614 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-20T13:34:06.641 DEBUG:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-20T13:34:06.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2024-03-20T13:34:06.697 DEBUG:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2024-03-20T13:34:06.724 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:06.724 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2024-03-20T13:34:06.779 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-20T13:34:06.779 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2024-03-20T13:34:06.834 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-20T13:34:06.834 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:06.834 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-03-20T13:34:06.834 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:06.834 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:06.834 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-20 13:33:47.304344634 +0000 2024-03-20T13:34:06.835 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-20 13:31:08.964179290 +0000 2024-03-20T13:34:06.835 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-20 13:31:08.964179290 +0000 2024-03-20T13:34:06.835 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-20 13:31:08.964179290 +0000 2024-03-20T13:34:06.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-20T13:34:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-20T13:34:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-20T13:34:06.900 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.5139e-05 s, 5.4 MB/s 2024-03-20T13:34:06.901 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-20T13:34:06.957 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-20 13:33:47.304344634 +0000 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-20 13:31:09.323169014 +0000 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-20 13:31:09.323169014 +0000 2024-03-20T13:34:07.013 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-20 13:31:09.323169014 +0000 2024-03-20T13:34:07.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-20T13:34:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-20T13:34:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-20T13:34:07.078 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.6549e-05 s, 5.3 MB/s 2024-03-20T13:34:07.079 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-20T13:34:07.135 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-20 13:33:47.304344634 +0000 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-20 13:31:09.660159368 +0000 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-20 13:31:09.660159368 +0000 2024-03-20T13:34:07.190 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-20 13:31:09.660159368 +0000 2024-03-20T13:34:07.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-20T13:34:07.255 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-20T13:34:07.255 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-20T13:34:07.255 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 8.9971e-05 s, 5.7 MB/s 2024-03-20T13:34:07.256 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-20T13:34:07.312 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2024-03-20T13:34:07.366 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-20T13:34:07.366 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:07.366 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-20T13:34:07.366 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:07.367 INFO:teuthology.orchestra.run.smithi028.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:07.367 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2024-03-20 13:33:47.305344606 +0000 2024-03-20T13:34:07.367 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2024-03-20 13:31:09.996149750 +0000 2024-03-20T13:34:07.367 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2024-03-20 13:31:09.996149750 +0000 2024-03-20T13:34:07.367 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: 2024-03-20 13:31:09.996149750 +0000 2024-03-20T13:34:07.367 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-20T13:34:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2024-03-20T13:34:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2024-03-20T13:34:07.431 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 9.5052e-05 s, 5.4 MB/s 2024-03-20T13:34:07.434 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-20T13:34:07.489 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-03-20T13:34:07.489 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:07.489 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/scratch_devs of=/dev/stdout 2024-03-20T13:34:07.506 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-20T13:34:07.506 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 2024-03-20T13:34:07.562 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-03-20 13:34:01.708626304 +0000 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-03-20 13:31:08.961079442 +0000 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-03-20 13:31:08.961079442 +0000 2024-03-20T13:34:07.563 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-03-20 13:31:08.961079442 +0000 2024-03-20T13:34:07.563 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-20T13:34:07.630 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-03-20T13:34:07.630 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-03-20T13:34:07.630 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000204879 s, 2.5 MB/s 2024-03-20T13:34:07.632 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-20T13:34:07.689 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 2024-03-20T13:34:07.744 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-20T13:34:07.744 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:07.744 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-03-20T13:34:07.744 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:07.745 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:07.745 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-03-20 13:34:01.708626304 +0000 2024-03-20T13:34:07.745 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-03-20 13:31:09.311069679 +0000 2024-03-20T13:34:07.745 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-03-20 13:31:09.311069679 +0000 2024-03-20T13:34:07.745 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-03-20 13:31:09.311069679 +0000 2024-03-20T13:34:07.745 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-20T13:34:07.811 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-03-20T13:34:07.812 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-03-20T13:34:07.812 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000223806 s, 2.3 MB/s 2024-03-20T13:34:07.813 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-20T13:34:07.869 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-03-20 13:34:01.708626304 +0000 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-03-20 13:31:09.646060337 +0000 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-03-20 13:31:09.646060337 +0000 2024-03-20T13:34:07.925 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-03-20 13:31:09.646060337 +0000 2024-03-20T13:34:07.926 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-20T13:34:07.991 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-03-20T13:34:07.991 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-03-20T13:34:07.991 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000191551 s, 2.7 MB/s 2024-03-20T13:34:07.992 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-20T13:34:08.048 DEBUG:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout:Context: system_u:object_r:device_t:s0 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2024-03-20 13:34:01.709626277 +0000 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2024-03-20 13:31:09.983050941 +0000 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2024-03-20 13:31:09.983050941 +0000 2024-03-20T13:34:08.103 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: 2024-03-20 13:31:09.983050941 +0000 2024-03-20T13:34:08.104 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-20T13:34:08.168 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2024-03-20T13:34:08.168 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2024-03-20T13:34:08.168 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000215391 s, 2.4 MB/s 2024-03-20T13:34:08.169 DEBUG:teuthology.orchestra.run.smithi177:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-20T13:34:08.225 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:34:08.225 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-03-20T13:34:08.225 INFO:tasks.ceph:Generating config... 2024-03-20T13:34:08.226 INFO:tasks.ceph:[client] debug ms = 1 2024-03-20T13:34:08.227 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-03-20T13:34:08.227 INFO:tasks.ceph:[client] debug rgw = 20 2024-03-20T13:34:08.227 INFO:tasks.ceph:[client] setgroup = ceph 2024-03-20T13:34:08.227 INFO:tasks.ceph:[client] setuser = ceph 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] debug objclass = 20 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-20T13:34:08.227 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-20T13:34:08.228 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-20T13:34:08.228 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-20T13:34:08.228 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-20T13:34:08.228 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-20T13:34:08.228 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-20T13:34:08.228 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-20T13:34:08.228 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-20T13:34:08.228 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-20T13:34:08.228 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-20T13:34:08.229 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-20T13:34:08.229 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-20T13:34:08.229 INFO:tasks.ceph:Setting up mon.a... 2024-03-20T13:34:08.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-20T13:34:08.283 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2024-03-20T13:34:08.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-20T13:34:08.331 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-20T13:34:08.357 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28')] 2024-03-20T13:34:08.358 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-03-20T13:34:08.359 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:08.359 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-20T13:34:08.413 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --print /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:08.491 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:34:08.491 INFO:teuthology.orchestra.run.smithi028.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid 9edff1c8-555e-48c3-ac0b-d5587f9be096 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = quincy 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:fsid 9edff1c8-555e-48c3-ac0b-d5587f9be096 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2024-03-20T13:34:08.491597+0000 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:created 2024-03-20T13:34:08.491597+0000 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 17 (quincy) 2024-03-20T13:34:08.492 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2024-03-20T13:34:08.493 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2024-03-20T13:34:08.493 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-03-20T13:34:08.494 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-20T13:34:08.548 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9edff1c8-555e-48c3-ac0b-d5587f9be096... 2024-03-20T13:34:08.549 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-20T13:34:08.591 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-20T13:34:08.638 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2024-03-20T13:34:08.638 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.639 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2024-03-20T13:34:08.640 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2024-03-20T13:34:08.641 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = 172.21.15.28 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = 9edff1c8-555e-48c3-ac0b-d5587f9be096 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.642 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug trim objects = true 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.643 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: debug objclass = 20 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: bdev async discard = True 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: bdev enable discard = True 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = bitmap 2024-03-20T13:34:08.644 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 1/20 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 1/20 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 4/10 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-20T13:34:08.645 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2024-03-20T13:34:08.646 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2024-03-20T13:34:08.647 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-20T13:34:08.648 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi028.stdout: rgw gc obj min wait = 15 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi028.stdout: debug rgw = 20 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi028.stdout: setgroup = ceph 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi028.stdout: setuser = ceph 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2024-03-20T13:34:08.649 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.650 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2024-03-20T13:34:08.651 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon_allow_pool_size_one = true 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2024-03-20T13:34:08.652 INFO:teuthology.orchestra.run.smithi177.stdout: mon health detail to clog = false 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = 172.21.15.28 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = 9edff1c8-555e-48c3-ac0b-d5587f9be096 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd mclock profile = high_recovery_ops 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.653 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug trim objects = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.654 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: debug objclass = 20 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = bitmap 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 1/20 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 1/20 2024-03-20T13:34:08.655 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 20 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 4/10 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:34:08.656 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.657 INFO:teuthology.orchestra.run.smithi177.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: auth mon ticket ttl = 660 # 11m 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: auth service ticket ttl = 240 # 4m 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: # don't complain about insecure global_id in the test suite 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: # 1m isn't quite enough 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon_down_mkfs_grace = 2m 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_filestore_osds = false 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout: 2024-03-20T13:34:08.658 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: rgw gc obj min wait = 15 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: debug rgw = 20 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: setgroup = ceph 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout: setuser = ceph 2024-03-20T13:34:08.659 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2024-03-20T13:34:08.661 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-20T13:34:08.661 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-20T13:34:08.757 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-20T13:34:08.757 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:08.758 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-20T13:34:08.772 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:08.772 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-20T13:34:08.826 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2024-03-20T13:34:08.826 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:08.826 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-20T13:34:08.826 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-20T13:34:08.905 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:08.905 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:08.960 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:34:08.960 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:08.960 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-20T13:34:08.960 DEBUG:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-20T13:34:09.001 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:09.001 DEBUG:teuthology.orchestra.run.smithi177:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:09.056 INFO:tasks.ceph:Setting up mon nodes... 2024-03-20T13:34:09.056 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-20T13:34:09.056 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-20T13:34:09.157 INFO:teuthology.orchestra.run.smithi177.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-20T13:34:09.160 INFO:tasks.ceph:Setting up mds nodes... 2024-03-20T13:34:09.160 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-20T13:34:09.160 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-20T13:34:09.203 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-20T13:34:09.218 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-20T13:34:09.218 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-03-20T13:34:09.219 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-20T13:34:09.247 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-03-20T13:34:09.247 INFO:tasks.ceph:role: osd.0 2024-03-20T13:34:09.247 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-20T13:34:09.247 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-20T13:34:09.314 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:34:09.315 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:34:09.346 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2024-03-20T13:34:09.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2024-03-20T13:34:09.348 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-20T13:34:09.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-20T13:34:09.493 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:09.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:09.591+0000 7ff1d4e15640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-20T13:34:09.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:09.592+0000 7ff1d4e15640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-20T13:34:09.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:09.592+0000 7ff1d4e15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-20T13:34:09.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:09.592+0000 7ff1d4e15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-20T13:34:09.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:09.592+0000 7ff1d4e15640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-20T13:34:09.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:09.592+0000 7ff1d4e15640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-20T13:34:12.445 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-20T13:34:12.478 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-20T13:34:12.511 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:34:12.511 INFO:tasks.ceph:role: osd.1 2024-03-20T13:34:12.511 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:34:12.511 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:34:12.589 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:34:12.590 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-20T13:34:12.590 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:34:12.590 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:34:13.082 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-03-20T13:34:13.084 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-03-20T13:34:13.084 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-03-20T13:34:13.224 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-20T13:34:13.262 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-20T13:34:13.331 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:34:13.331 INFO:tasks.ceph:role: osd.2 2024-03-20T13:34:13.332 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:34:13.332 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:34:13.409 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:34:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-03-20T13:34:13.854 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-03-20T13:34:13.854 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-03-20T13:34:13.958 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-20T13:34:13.989 DEBUG:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-20T13:34:14.056 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-03-20T13:34:14.056 INFO:tasks.ceph:role: osd.3 2024-03-20T13:34:14.056 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:34:14.056 DEBUG:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-20T13:34:14.130 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-20T13:34:14.130 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-20T13:34:14.130 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-20T13:34:14.130 INFO:teuthology.orchestra.run.smithi177.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-20T13:34:14.130 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-20T13:34:14.131 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2024-03-20T13:34:14.131 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-20T13:34:14.131 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-20T13:34:14.131 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-20T13:34:14.131 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-20T13:34:14.612 INFO:teuthology.orchestra.run.smithi177.stdout:Discarding blocks...Done. 2024-03-20T13:34:14.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2024-03-20T13:34:14.614 DEBUG:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-03-20T13:34:14.763 DEBUG:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-20T13:34:14.796 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:14.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:14.888+0000 7faf02981640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-20T13:34:14.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:14.893+0000 7faf02981640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-20T13:34:14.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:14.893+0000 7faf02981640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-20T13:34:14.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:14.893+0000 7faf02981640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-20T13:34:14.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:14.893+0000 7faf02981640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-20T13:34:14.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:14.900+0000 7faf02981640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-20T13:34:17.755 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-20T13:34:17.785 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:17.872+0000 7f79f97df640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-20T13:34:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:17.873+0000 7f79f97df640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-20T13:34:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:17.873+0000 7f79f97df640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-20T13:34:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:17.873+0000 7f79f97df640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-20T13:34:17.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:17.873+0000 7f79f97df640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-20T13:34:17.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:17.873+0000 7f79f97df640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-20T13:34:20.731 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-20T13:34:20.762 DEBUG:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:20.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:20.852+0000 7fcb75424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-20T13:34:20.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:20.852+0000 7fcb75424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-20T13:34:20.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:20.852+0000 7fcb75424640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-20T13:34:20.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:20.852+0000 7fcb75424640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-20T13:34:20.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:20.852+0000 7fcb75424640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-20T13:34:20.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:20.853+0000 7fcb75424640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-20T13:34:23.707 DEBUG:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-20T13:34:23.739 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-20T13:34:23.739 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:23.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-20T13:34:23.771 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:23.771 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-20T13:34:23.809 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:23.809 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-20T13:34:23.880 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:23.880 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-20T13:34:23.950 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:23.950 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-20T13:34:24.018 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:24.019 DEBUG:teuthology.orchestra.run.smithi177:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-20T13:34:24.075 INFO:tasks.ceph:Adding keys to all mons... 2024-03-20T13:34:24.075 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDR5fplTJJVIxAAR0T8O8eD8RAYryKTSAkVGQ== 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDR5fplwJNbCRAAXsDCmpgAJgOJmGGeqrlK0A== 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDW5fplPMQCNRAA1fHG/zL0k4GeM0W3rWXQHQ== 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2024-03-20T13:34:24.105 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDZ5fpl5SMUNBAAZL/hka+ZBDstvyn9gXRX1A== 2024-03-20T13:34:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2024-03-20T13:34:24.106 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDc5fplIeXWMhAAQq3dui/YWfNuw/PXe90yCQ== 2024-03-20T13:34:24.106 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2024-03-20T13:34:24.106 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDR5fpln9sVDBAAN+Bxk7E+aSo6m5VrXhjzlA== 2024-03-20T13:34:24.107 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:34:24.204 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-20T13:34:24.258 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:34:24.309 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:34:24.360 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-20T13:34:24.411 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-20T13:34:24.465 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-20T13:34:24.465 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-20T13:34:24.492 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-20T13:34:24.588 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-20T13:34:24.614 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-20T13:34:24.669 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-20T13:34:24.669 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-20T13:34:24.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-20T13:34:24.711 INFO:tasks.ceph.mon.a:Started 2024-03-20T13:34:24.711 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-20T13:34:24.711 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-20T13:34:24.712 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-20T13:34:24.714 INFO:tasks.ceph.mgr.x:Started 2024-03-20T13:34:24.714 INFO:tasks.ceph:Setting crush tunables to default 2024-03-20T13:34:24.715 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2024-03-20T13:34:24.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd809afb640 1 Processor -- start 2024-03-20T13:34:24.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd809afb640 1 -- start start 2024-03-20T13:34:24.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd809afb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 0x7fd80412c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:24.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd809afb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80409be70 con 0x7fd80412c1f0 2024-03-20T13:34:24.816 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd809afb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80412bdb0 con 0x7fd80409c4e0 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd802ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 0x7fd80412c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd8037fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd80412c1f0 0x7fd80409a180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49214/0 (socket says 172.21.15.28:49214) 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.814+0000 7fd8037fe640 1 -- 172.21.15.28:0/3881503105 learned_addr learned my addr 172.21.15.28:0/3881503105 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.815+0000 7fd802ffd640 1 -- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 msgr2=0x7fd80412c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.815+0000 7fd802ffd640 1 -- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 msgr2=0x7fd80412c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.815+0000 7fd802ffd640 1 --2- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 0x7fd80412c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-20T13:34:24.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.815+0000 7fd802ffd640 1 --2- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 0x7fd80412c5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-20T13:34:24.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929413223 0 0) 0x7fd80409be70 con 0x7fd80412c1f0 2024-03-20T13:34:24.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7ec003520 con 0x7fd80412c1f0 2024-03-20T13:34:24.827 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1120118951 0 0) 0x7fd7ec003520 con 0x7fd80412c1f0 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 msgr2=0x7fd80412c5d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 --2- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 0x7fd80412c5d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80409b4b0 con 0x7fd80412c1f0 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.825+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7fd7f80015a0 con 0x7fd80412c1f0 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.826+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 >> v1:172.21.15.28:6789/0 conn(0x7fd80412c1f0 legacy=0x7fd80409a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.826+0000 7fd8027fc640 1 --2- 172.21.15.28:0/3881503105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd7ec003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.826+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80412bdb0 con 0x7fd7ec003970 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.826+0000 7fd8037fe640 1 --2- 172.21.15.28:0/3881503105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd7ec003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:24.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.826+0000 7fd8037fe640 1 -- 172.21.15.28:0/3881503105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7ec003520 con 0x7fd7ec003970 2024-03-20T13:34:24.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.827+0000 7fd8037fe640 1 --2- 172.21.15.28:0/3881503105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd7ec003d70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8007fb0 tx=0x7fd7ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20431b2faa8b0b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:24.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7f802caf0 con 0x7fd7ec003970 2024-03-20T13:34:24.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f802cc50 con 0x7fd7ec003970 2024-03-20T13:34:24.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd8027fc640 1 -- 172.21.15.28:0/3881503105 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7f80058d0 con 0x7fd7ec003970 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 -- 172.21.15.28:0/3881503105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 msgr2=0x7fd7ec003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 --2- 172.21.15.28:0/3881503105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd7ec003d70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8007fb0 tx=0x7fd7ec0057f0 comp rx=0 tx=0).stop 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 -- 172.21.15.28:0/3881503105 shutdown_connections 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 --2- 172.21.15.28:0/3881503105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd7ec003d70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 --2- 172.21.15.28:0/3881503105 >> v2:172.21.15.28:3300/0 conn(0x7fd80409c4e0 0x7fd80412c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 -- 172.21.15.28:0/3881503105 >> 172.21.15.28:0/3881503105 conn(0x7fd804070150 msgr2=0x7fd804098a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:24.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 -- 172.21.15.28:0/3881503105 shutdown_connections 2024-03-20T13:34:24.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.828+0000 7fd809afb640 1 -- 172.21.15.28:0/3881503105 wait complete. 2024-03-20T13:34:24.831 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.829+0000 7fd809afb640 1 Processor -- start 2024-03-20T13:34:24.832 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.829+0000 7fd809afb640 1 -- start start 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd809afb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd80411b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd809afb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80411d8d0 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd8037fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd80411b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd8037fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd80411b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56150/0 (socket says 172.21.15.28:56150) 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd8037fe640 1 -- 172.21.15.28:0/2559956244 learned_addr learned my addr 172.21.15.28:0/2559956244 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd8037fe640 1 -- 172.21.15.28:0/2559956244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80411c580 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd8037fe640 1 --2- 172.21.15.28:0/2559956244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd80411b420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8007fb0 tx=0x7fd7f802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7f803c040 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f8001560 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd7f80071a0 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80411e4e0 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80411e920 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fd7f8032070 con 0x7fd7ec003970 2024-03-20T13:34:24.833 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.830+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fd7f8041e30 con 0x7fd7ec003970 2024-03-20T13:34:24.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.831+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8040627b0 con 0x7fd7ec003970 2024-03-20T13:34:24.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.833+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fd7f8050060 con 0x7fd7ec003970 2024-03-20T13:34:24.900 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.899+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fd804067aa0 con 0x7fd7ec003970 2024-03-20T13:34:24.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.900+0000 7fd7ebfff640 1 -- 172.21.15.28:0/2559956244 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fd7f8046070 con 0x7fd7ec003970 2024-03-20T13:34:24.901 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2024-03-20T13:34:24.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 msgr2=0x7fd80411b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:24.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 --2- 172.21.15.28:0/2559956244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd80411b420 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fd7f8007fb0 tx=0x7fd7f802e070 comp rx=0 tx=0).stop 2024-03-20T13:34:24.902 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 shutdown_connections 2024-03-20T13:34:24.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 --2- 172.21.15.28:0/2559956244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7ec003970 0x7fd80411b420 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:24.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 >> 172.21.15.28:0/2559956244 conn(0x7fd804070150 msgr2=0x7fd804070530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:24.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 shutdown_connections 2024-03-20T13:34:24.903 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:24.901+0000 7fd809afb640 1 -- 172.21.15.28:0/2559956244 wait complete. 2024-03-20T13:34:24.912 INFO:tasks.ceph:check_enable_crimson: False 2024-03-20T13:34:24.913 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-20T13:34:24.913 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2024-03-20T13:34:24.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-20T13:34:24.939 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:24.939 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-20T13:34:24.966 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:24.967 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-20T13:34:25.034 DEBUG:teuthology.orchestra.run.smithi177:> set -ex 2024-03-20T13:34:25.034 DEBUG:teuthology.orchestra.run.smithi177:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-20T13:34:25.102 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new ce70bf47-7c35-4e78-80ea-b50bc701391e 0 2024-03-20T13:34:25.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.241+0000 7f757fbe6640 1 Processor -- start 2024-03-20T13:34:25.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.241+0000 7f757fbe6640 1 -- start start 2024-03-20T13:34:25.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.241+0000 7f757fbe6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7578118250 0x7f757811a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.241+0000 7f757fbe6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757811ab80 con 0x7f7578110410 2024-03-20T13:34:25.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.241+0000 7f757fbe6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757811bd20 con 0x7f7578118250 2024-03-20T13:34:25.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757d181640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7578118250 0x7f757811a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757d982640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f7578110410 0x7f75781107f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:33546/0 (socket says 172.21.15.177:33546) 2024-03-20T13:34:25.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757d982640 1 -- 172.21.15.177:0/2203608714 learned_addr learned my addr 172.21.15.177:0/2203608714 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:34:25.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757c980640 1 -- 172.21.15.177:0/2203608714 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1066559338 0 0) 0x7f757811ab80 con 0x7f7578110410 2024-03-20T13:34:25.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757c980640 1 -- 172.21.15.177:0/2203608714 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7564003520 con 0x7f7578110410 2024-03-20T13:34:25.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757d181640 1 -- 172.21.15.177:0/2203608714 >> v1:172.21.15.28:6789/0 conn(0x7f7578110410 legacy=0x7f75781107f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.242+0000 7f757d181640 1 -- 172.21.15.177:0/2203608714 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757811be60 con 0x7f7578118250 2024-03-20T13:34:25.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.243+0000 7f757d181640 1 --2- 172.21.15.177:0/2203608714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578118250 0x7f757811a640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7574009720 tx=0x7f757402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=588d6389f2d1d29 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757c980640 1 -- 172.21.15.177:0/2203608714 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f757402e070 con 0x7f7578118250 2024-03-20T13:34:25.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757c980640 1 -- 172.21.15.177:0/2203608714 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75740316d0 con 0x7f7578118250 2024-03-20T13:34:25.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757c980640 1 -- 172.21.15.177:0/2203608714 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7574031990 con 0x7f7578118250 2024-03-20T13:34:25.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 -- 172.21.15.177:0/2203608714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578118250 msgr2=0x7f757811a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 --2- 172.21.15.177:0/2203608714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578118250 0x7f757811a640 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7574009720 tx=0x7f757402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:25.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 -- 172.21.15.177:0/2203608714 shutdown_connections 2024-03-20T13:34:25.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 --2- 172.21.15.177:0/2203608714 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578118250 0x7f757811a640 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 -- 172.21.15.177:0/2203608714 >> 172.21.15.177:0/2203608714 conn(0x7f757806f440 msgr2=0x7f7578071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 -- 172.21.15.177:0/2203608714 shutdown_connections 2024-03-20T13:34:25.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.244+0000 7f757fbe6640 1 -- 172.21.15.177:0/2203608714 wait complete. 2024-03-20T13:34:25.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.245+0000 7f757fbe6640 1 Processor -- start 2024-03-20T13:34:25.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.245+0000 7f757fbe6640 1 -- start start 2024-03-20T13:34:25.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.245+0000 7f757fbe6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 0x7f75781a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.245+0000 7f757fbe6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75781a6410 con 0x7f7578110410 2024-03-20T13:34:25.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757d982640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 0x7f75781a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757d982640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 0x7f75781a5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:48402/0 (socket says 172.21.15.177:48402) 2024-03-20T13:34:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757d982640 1 -- 172.21.15.177:0/3366160287 learned_addr learned my addr 172.21.15.177:0/3366160287 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757d982640 1 -- 172.21.15.177:0/3366160287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7574009400 con 0x7f7578110410 2024-03-20T13:34:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757d982640 1 --2- 172.21.15.177:0/3366160287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 0x7f75781a5ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f756800c480 tx=0x7f756800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7568005c10 con 0x7f7578110410 2024-03-20T13:34:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7568005d70 con 0x7f7578110410 2024-03-20T13:34:25.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f75680071e0 con 0x7f7578110410 2024-03-20T13:34:25.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75781a6670 con 0x7f7578110410 2024-03-20T13:34:25.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75781aa790 con 0x7f7578110410 2024-03-20T13:34:25.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.246+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f7568007340 con 0x7f7578110410 2024-03-20T13:34:25.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.247+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7568012740 con 0x7f7578110410 2024-03-20T13:34:25.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.247+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75780627b0 con 0x7f7578110410 2024-03-20T13:34:25.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.249+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f7568017070 con 0x7f7578110410 2024-03-20T13:34:25.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.322+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ce70bf47-7c35-4e78-80ea-b50bc701391e", "id": 0} v 0) v1 -- 0x7f7578067570 con 0x7f7578110410 2024-03-20T13:34:25.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.323+0000 7f756e7fc640 1 -- 172.21.15.177:0/3366160287 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ce70bf47-7c35-4e78-80ea-b50bc701391e", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7568012950 con 0x7f7578110410 2024-03-20T13:34:25.325 INFO:teuthology.orchestra.run.smithi177.stdout:0 2024-03-20T13:34:25.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 msgr2=0x7f75781a5ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 --2- 172.21.15.177:0/3366160287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 0x7f75781a5ed0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f756800c480 tx=0x7f756800c940 comp rx=0 tx=0).stop 2024-03-20T13:34:25.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 shutdown_connections 2024-03-20T13:34:25.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 --2- 172.21.15.177:0/3366160287 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7578110410 0x7f75781a5ed0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 >> 172.21.15.177:0/3366160287 conn(0x7f757806f440 msgr2=0x7f75781193b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 shutdown_connections 2024-03-20T13:34:25.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.324+0000 7f757fbe6640 1 -- 172.21.15.177:0/3366160287 wait complete. 2024-03-20T13:34:25.337 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new ba65bad5-2710-4d75-82f4-a0f9b573f885 1 2024-03-20T13:34:25.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.436+0000 7f0793293640 1 Processor -- start 2024-03-20T13:34:25.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.436+0000 7f0793293640 1 -- start start 2024-03-20T13:34:25.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f0793293640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f078c06c8e0 0x7f078c06ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f0793293640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f078c11ccf0 con 0x7f078c06d200 2024-03-20T13:34:25.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f0793293640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f078c11deb0 con 0x7f078c06c8e0 2024-03-20T13:34:25.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f079102f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f078c06c8e0 0x7f078c06ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f079082e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f078c06d200 0x7f078c11b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:33548/0 (socket says 172.21.15.177:33548) 2024-03-20T13:34:25.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f079082e640 1 -- 172.21.15.177:0/1116661809 learned_addr learned my addr 172.21.15.177:0/1116661809 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:34:25.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f079102f640 1 -- 172.21.15.177:0/1116661809 >> v1:172.21.15.28:6789/0 conn(0x7f078c06d200 legacy=0x7f078c11b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f0783fff640 1 -- 172.21.15.177:0/1116661809 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1034279775 0 0) 0x7f078c11ccf0 con 0x7f078c06d200 2024-03-20T13:34:25.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.437+0000 7f079102f640 1 -- 172.21.15.177:0/1116661809 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c11e020 con 0x7f078c06c8e0 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.438+0000 7f079102f640 1 --2- 172.21.15.177:0/1116661809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c06ccc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0788009720 tx=0x7f078802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f782c79977f50ee4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.438+0000 7f0783fff640 1 -- 172.21.15.177:0/1116661809 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f078802e070 con 0x7f078c06c8e0 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.438+0000 7f0783fff640 1 -- 172.21.15.177:0/1116661809 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07880316d0 con 0x7f078c06c8e0 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.438+0000 7f0783fff640 1 -- 172.21.15.177:0/1116661809 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0788031990 con 0x7f078c06c8e0 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 -- 172.21.15.177:0/1116661809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 msgr2=0x7f078c06ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 --2- 172.21.15.177:0/1116661809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c06ccc0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0788009720 tx=0x7f078802b840 comp rx=0 tx=0).stop 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 -- 172.21.15.177:0/1116661809 shutdown_connections 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 --2- 172.21.15.177:0/1116661809 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c06ccc0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 -- 172.21.15.177:0/1116661809 >> 172.21.15.177:0/1116661809 conn(0x7f078c070250 msgr2=0x7f078c072670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 -- 172.21.15.177:0/1116661809 shutdown_connections 2024-03-20T13:34:25.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.439+0000 7f0793293640 1 -- 172.21.15.177:0/1116661809 wait complete. 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f0793293640 1 Processor -- start 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f0793293640 1 -- start start 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f0793293640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c1a5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f0793293640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f078c1a63f0 con 0x7f078c06c8e0 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f079102f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c1a5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f079102f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c1a5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:48414/0 (socket says 172.21.15.177:48414) 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.440+0000 7f079102f640 1 -- 172.21.15.177:0/990254137 learned_addr learned my addr 172.21.15.177:0/990254137 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f079102f640 1 -- 172.21.15.177:0/990254137 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788009400 con 0x7f078c06c8e0 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f079102f640 1 --2- 172.21.15.177:0/990254137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c1a5eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0788034040 tx=0x7f07880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0788032830 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0788032990 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f078c1a65f0 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0788032c50 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f078c1aa7c0 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f078804e7e0 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.441+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f0788045d70 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.442+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f078c0627b0 con 0x7f078c06c8e0 2024-03-20T13:34:25.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.444+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f0788032db0 con 0x7f078c06c8e0 2024-03-20T13:34:25.474 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:25.472+0000 7f26bd82c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-20T13:34:25.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.517+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba65bad5-2710-4d75-82f4-a0f9b573f885", "id": 1} v 0) v1 -- 0x7f078c067570 con 0x7f078c06c8e0 2024-03-20T13:34:25.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.519+0000 7f0781ffb640 1 -- 172.21.15.177:0/990254137 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba65bad5-2710-4d75-82f4-a0f9b573f885", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f07880453f0 con 0x7f078c06c8e0 2024-03-20T13:34:25.521 INFO:teuthology.orchestra.run.smithi177.stdout:1 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 msgr2=0x7f078c1a5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 --2- 172.21.15.177:0/990254137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c1a5eb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0788034040 tx=0x7f07880046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 shutdown_connections 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 --2- 172.21.15.177:0/990254137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f078c06c8e0 0x7f078c1a5eb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 >> 172.21.15.177:0/990254137 conn(0x7f078c070250 msgr2=0x7f078c11a520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 shutdown_connections 2024-03-20T13:34:25.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.520+0000 7f0793293640 1 -- 172.21.15.177:0/990254137 wait complete. 2024-03-20T13:34:25.531 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:25.529+0000 7f26bd82c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-20T13:34:25.532 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new c1773e64-4aed-4bb8-a290-27b4963b7ed1 2 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.630+0000 7fecdf14d640 1 Processor -- start 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.630+0000 7fecdf14d640 1 -- start start 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.630+0000 7fecdf14d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecd811a370 0x7fecd811c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.630+0000 7fecdf14d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecd811cd30 con 0x7fecd81165c0 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.630+0000 7fecdf14d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecd811def0 con 0x7fecd811a370 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.631+0000 7fecd7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecd811a370 0x7fecd811c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.631+0000 7fecdcee9640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fecd81165c0 0x7fecd81169a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:33562/0 (socket says 172.21.15.177:33562) 2024-03-20T13:34:25.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.631+0000 7fecd7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fecd811a370 0x7fecd811c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:48428/0 (socket says 172.21.15.177:48428) 2024-03-20T13:34:25.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.631+0000 7fecdcee9640 1 -- 172.21.15.177:0/2162061798 learned_addr learned my addr 172.21.15.177:0/2162061798 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:34:25.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.631+0000 7fecd7fff640 1 -- 172.21.15.177:0/2162061798 >> v1:172.21.15.28:6789/0 conn(0x7fecd81165c0 legacy=0x7fecd81169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.631+0000 7fecd7fff640 1 -- 172.21.15.177:0/2162061798 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd811e060 con 0x7fecd811a370 2024-03-20T13:34:25.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.633+0000 7fecd7fff640 1 --2- 172.21.15.177:0/2162061798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd811a370 0x7fecd811c760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009720 tx=0x7fecc402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ed8109dfb1d039 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecd77fe640 1 -- 172.21.15.177:0/2162061798 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecc402e070 con 0x7fecd811a370 2024-03-20T13:34:25.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecd77fe640 1 -- 172.21.15.177:0/2162061798 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc40316d0 con 0x7fecd811a370 2024-03-20T13:34:25.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecd77fe640 1 -- 172.21.15.177:0/2162061798 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fecc4031990 con 0x7fecd811a370 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 -- 172.21.15.177:0/2162061798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd811a370 msgr2=0x7fecd811c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 --2- 172.21.15.177:0/2162061798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd811a370 0x7fecd811c760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009720 tx=0x7fecc402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 -- 172.21.15.177:0/2162061798 shutdown_connections 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 --2- 172.21.15.177:0/2162061798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd811a370 0x7fecd811c760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 -- 172.21.15.177:0/2162061798 >> 172.21.15.177:0/2162061798 conn(0x7fecd806db50 msgr2=0x7fecd806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 -- 172.21.15.177:0/2162061798 shutdown_connections 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.634+0000 7fecdf14d640 1 -- 172.21.15.177:0/2162061798 wait complete. 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdf14d640 1 Processor -- start 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdf14d640 1 -- start start 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdf14d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 0x7fecd81abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdf14d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecd81ac380 con 0x7fecd81165c0 2024-03-20T13:34:25.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdcee9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 0x7fecd81abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdcee9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 0x7fecd81abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:48442/0 (socket says 172.21.15.177:48442) 2024-03-20T13:34:25.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.635+0000 7fecdcee9640 1 -- 172.21.15.177:0/4090716556 learned_addr learned my addr 172.21.15.177:0/4090716556 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:25.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecdcee9640 1 -- 172.21.15.177:0/4090716556 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc4009400 con 0x7fecd81165c0 2024-03-20T13:34:25.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecdcee9640 1 --2- 172.21.15.177:0/4090716556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 0x7fecd81abdb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c480 tx=0x7feccc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feccc005c10 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feccc005d70 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecd81ac580 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feccc007200 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecd81a5cb0 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7feccc007360 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.636+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7feccc012820 con 0x7fecd81165c0 2024-03-20T13:34:25.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.637+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecd80627b0 con 0x7fecd81165c0 2024-03-20T13:34:25.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.639+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7feccc021060 con 0x7fecd81165c0 2024-03-20T13:34:25.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.712+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1773e64-4aed-4bb8-a290-27b4963b7ed1", "id": 2} v 0) v1 -- 0x7fecd811a370 con 0x7fecd81165c0 2024-03-20T13:34:25.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.713+0000 7fecd57fa640 1 -- 172.21.15.177:0/4090716556 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1773e64-4aed-4bb8-a290-27b4963b7ed1", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7feccc017070 con 0x7fecd81165c0 2024-03-20T13:34:25.715 INFO:teuthology.orchestra.run.smithi177.stdout:2 2024-03-20T13:34:25.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 msgr2=0x7fecd81abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 --2- 172.21.15.177:0/4090716556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 0x7fecd81abdb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7feccc00c480 tx=0x7feccc00c940 comp rx=0 tx=0).stop 2024-03-20T13:34:25.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 shutdown_connections 2024-03-20T13:34:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 --2- 172.21.15.177:0/4090716556 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fecd81165c0 0x7fecd81abdb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 >> 172.21.15.177:0/4090716556 conn(0x7fecd806db50 msgr2=0x7fecd8118e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 shutdown_connections 2024-03-20T13:34:25.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.714+0000 7fecdf14d640 1 -- 172.21.15.177:0/4090716556 wait complete. 2024-03-20T13:34:25.727 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph --cluster ceph osd new fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b 3 2024-03-20T13:34:25.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.824+0000 7f58964f1640 1 Processor -- start 2024-03-20T13:34:25.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.824+0000 7f58964f1640 1 -- start start 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f58964f1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f589010e020 0x7f589010e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f58964f1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f589010eb40 con 0x7f58901171d0 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f58964f1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f589011bcf0 con 0x7f589010e020 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f588ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f589010e020 0x7f589010e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f588ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f589010e020 0x7f589010e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:48452/0 (socket says 172.21.15.177:48452) 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f588f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f58901171d0 0x7f58901195c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:33566/0 (socket says 172.21.15.177:33566) 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f588ffff640 1 -- 172.21.15.177:0/1469430680 learned_addr learned my addr 172.21.15.177:0/1469430680 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f588ffff640 1 -- 172.21.15.177:0/1469430680 >> v1:172.21.15.28:6789/0 conn(0x7f58901171d0 legacy=0x7f58901195c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.825+0000 7f588ffff640 1 -- 172.21.15.177:0/1469430680 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f589011be30 con 0x7f589010e020 2024-03-20T13:34:25.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.826+0000 7f588ffff640 1 --2- 172.21.15.177:0/1469430680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f589010e400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f58840097f0 tx=0x7f588402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51e8ad82be0d8b7c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.826+0000 7f588effd640 1 -- 172.21.15.177:0/1469430680 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58840317a0 con 0x7f589010e020 2024-03-20T13:34:25.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.826+0000 7f588effd640 1 -- 172.21.15.177:0/1469430680 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5884031900 con 0x7f589010e020 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.826+0000 7f588effd640 1 -- 172.21.15.177:0/1469430680 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5884031bc0 con 0x7f589010e020 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 -- 172.21.15.177:0/1469430680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 msgr2=0x7f589010e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 --2- 172.21.15.177:0/1469430680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f589010e400 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f58840097f0 tx=0x7f588402b910 comp rx=0 tx=0).stop 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 -- 172.21.15.177:0/1469430680 shutdown_connections 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 --2- 172.21.15.177:0/1469430680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f589010e400 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 -- 172.21.15.177:0/1469430680 >> 172.21.15.177:0/1469430680 conn(0x7f589006ed10 msgr2=0x7f5890071130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 -- 172.21.15.177:0/1469430680 shutdown_connections 2024-03-20T13:34:25.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 -- 172.21.15.177:0/1469430680 wait complete. 2024-03-20T13:34:25.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.827+0000 7f58964f1640 1 Processor -- start 2024-03-20T13:34:25.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f58964f1640 1 -- start start 2024-03-20T13:34:25.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f58964f1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f58901a9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:25.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f58964f1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58901aa1f0 con 0x7f589010e020 2024-03-20T13:34:25.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f588ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f58901a9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f588ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f58901a9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:48456/0 (socket says 172.21.15.177:48456) 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f588ffff640 1 -- 172.21.15.177:0/2063252260 learned_addr learned my addr 172.21.15.177:0/2063252260 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f588ffff640 1 -- 172.21.15.177:0/2063252260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58840094d0 con 0x7f589010e020 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.828+0000 7f588ffff640 1 --2- 172.21.15.177:0/2063252260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f58901a9c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f58840097f0 tx=0x7f58840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f588403ac00 con 0x7f589010e020 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588403ad60 con 0x7f589010e020 2024-03-20T13:34:25.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58901aa3f0 con 0x7f589010e020 2024-03-20T13:34:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f58840443f0 con 0x7f589010e020 2024-03-20T13:34:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58901a3a60 con 0x7f589010e020 2024-03-20T13:34:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f58840448e0 con 0x7f589010e020 2024-03-20T13:34:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.829+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f588402d040 con 0x7f589010e020 2024-03-20T13:34:25.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.830+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58900627b0 con 0x7f589010e020 2024-03-20T13:34:25.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.832+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f5884035020 con 0x7f589010e020 2024-03-20T13:34:25.905 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.903+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b", "id": 3} v 0) v1 -- 0x7f5890067570 con 0x7f589010e020 2024-03-20T13:34:25.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.904+0000 7f588cff9640 1 -- 172.21.15.177:0/2063252260 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5884044e00 con 0x7f589010e020 2024-03-20T13:34:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:3 2024-03-20T13:34:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 msgr2=0x7f58901a9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:25.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 --2- 172.21.15.177:0/2063252260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f58901a9c20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f58840097f0 tx=0x7f58840046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 shutdown_connections 2024-03-20T13:34:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 --2- 172.21.15.177:0/2063252260 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f589010e020 0x7f58901a9c20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 >> 172.21.15.177:0/2063252260 conn(0x7f589006ed10 msgr2=0x7f589006f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 shutdown_connections 2024-03-20T13:34:25.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:25.905+0000 7f58964f1640 1 -- 172.21.15.177:0/2063252260 wait complete. 2024-03-20T13:34:25.918 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-20T13:34:25.918 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-20T13:34:25.922 INFO:tasks.ceph.osd.0:Started 2024-03-20T13:34:25.922 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-20T13:34:25.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-20T13:34:25.925 INFO:tasks.ceph.osd.1:Started 2024-03-20T13:34:25.925 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-20T13:34:25.925 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-20T13:34:25.928 INFO:tasks.ceph.osd.2:Started 2024-03-20T13:34:25.928 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-20T13:34:25.928 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-20T13:34:25.930 INFO:tasks.ceph.osd.3:Started 2024-03-20T13:34:25.930 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:34:26.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.040+0000 7f3afb715640 1 Processor -- start 2024-03-20T13:34:26.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.040+0000 7f3afb715640 1 -- start start 2024-03-20T13:34:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3afb715640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3af4098900 0x7f3af4098ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3afb715640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af409dc90 con 0x7f3af4099220 2024-03-20T13:34:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3afb715640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af409a360 con 0x7f3af4098900 2024-03-20T13:34:26.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3af94b1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3af4098900 0x7f3af4098ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3af8cb0640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3af4099220 0x7f3af4096580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49242/0 (socket says 172.21.15.28:49242) 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3af8cb0640 1 -- 172.21.15.28:0/4276696294 learned_addr learned my addr 172.21.15.28:0/4276696294 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3af94b1640 1 -- 172.21.15.28:0/4276696294 >> v1:172.21.15.28:6789/0 conn(0x7f3af4099220 legacy=0x7f3af4096580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.041+0000 7f3af94b1640 1 -- 172.21.15.28:0/4276696294 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af4099d30 con 0x7f3af4098900 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.042+0000 7f3af94b1640 1 --2- 172.21.15.28:0/4276696294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4098ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009720 tx=0x7f3ae402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba7c186f688c34a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.042+0000 7f3aebfff640 1 -- 172.21.15.28:0/4276696294 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ae402e070 con 0x7f3af4098900 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.042+0000 7f3aebfff640 1 -- 172.21.15.28:0/4276696294 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40316d0 con 0x7f3af4098900 2024-03-20T13:34:26.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.042+0000 7f3aebfff640 1 -- 172.21.15.28:0/4276696294 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4031990 con 0x7f3af4098900 2024-03-20T13:34:26.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 -- 172.21.15.28:0/4276696294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 msgr2=0x7f3af4098ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:26.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 --2- 172.21.15.28:0/4276696294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4098ce0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009720 tx=0x7f3ae402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:26.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 -- 172.21.15.28:0/4276696294 shutdown_connections 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 --2- 172.21.15.28:0/4276696294 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4098ce0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 -- 172.21.15.28:0/4276696294 >> 172.21.15.28:0/4276696294 conn(0x7f3af40a0a20 msgr2=0x7f3af409cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 -- 172.21.15.28:0/4276696294 shutdown_connections 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.043+0000 7f3afb715640 1 -- 172.21.15.28:0/4276696294 wait complete. 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3afb715640 1 Processor -- start 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3afb715640 1 -- start start 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3afb715640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4129df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3afb715640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af4072150 con 0x7f3af4098900 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3af94b1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4129df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3af94b1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4129df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56190/0 (socket says 172.21.15.28:56190) 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3af94b1640 1 -- 172.21.15.28:0/1914177983 learned_addr learned my addr 172.21.15.28:0/1914177983 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3af94b1640 1 -- 172.21.15.28:0/1914177983 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009400 con 0x7f3af4098900 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.044+0000 7f3af94b1640 1 --2- 172.21.15.28:0/1914177983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4129df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4034040 tx=0x7f3ae40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4031ec0 con 0x7f3af4098900 2024-03-20T13:34:26.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae4032990 con 0x7f3af4098900 2024-03-20T13:34:26.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af412b5f0 con 0x7f3af4098900 2024-03-20T13:34:26.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3ae4032c30 con 0x7f3af4098900 2024-03-20T13:34:26.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af406c7d0 con 0x7f3af4098900 2024-03-20T13:34:26.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7f3ae4005d20 con 0x7f3af4098900 2024-03-20T13:34:26.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.045+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f3ae404d900 con 0x7f3af4098900 2024-03-20T13:34:26.048 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.046+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af40627b0 con 0x7f3af4098900 2024-03-20T13:34:26.049 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.048+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7f3ae404d3f0 con 0x7f3af4098900 2024-03-20T13:34:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.110+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3af4073050 con 0x7f3af4098900 2024-03-20T13:34:26.111 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.110+0000 7f3ae9ffb640 1 -- 172.21.15.28:0/1914177983 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7f3ae404d640 con 0x7f3af4098900 2024-03-20T13:34:26.112 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:26.112 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":6,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:34:25.905721+0000","last_up_change":"0.000000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 msgr2=0x7f3af4129df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 --2- 172.21.15.28:0/1914177983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4129df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4034040 tx=0x7f3ae40046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 shutdown_connections 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 --2- 172.21.15.28:0/1914177983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3af4098900 0x7f3af4129df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 >> 172.21.15.28:0/1914177983 conn(0x7f3af40a0a20 msgr2=0x7f3af4126510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 shutdown_connections 2024-03-20T13:34:26.113 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:26.111+0000 7f3afb715640 1 -- 172.21.15.28:0/1914177983 wait complete. 2024-03-20T13:34:26.113 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.111+0000 7f26bd82c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-20T13:34:26.122 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-20T13:34:26.123 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-20T13:34:26.166 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.164+0000 7f26bd82c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-20T13:34:26.210 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.208+0000 7f26bd82c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-20T13:34:26.263 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.261+0000 7f26bd82c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-20T13:34:26.307 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.305+0000 7f26bd82c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-20T13:34:26.422 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.420+0000 7f26bd82c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-20T13:34:26.494 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.489+0000 7f26bd82c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-20T13:34:26.520 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-20T13:34:26.518+0000 7f75abaa6640 -1 Falling back to public interface 2024-03-20T13:34:26.520 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-03-20T13:34:26.518+0000 7fa27881f640 -1 Falling back to public interface 2024-03-20T13:34:26.524 INFO:tasks.ceph.osd.1.smithi177.stderr:2024-03-20T13:34:26.522+0000 7fdb6d819640 -1 Falling back to public interface 2024-03-20T13:34:26.525 INFO:tasks.ceph.osd.3.smithi177.stderr:2024-03-20T13:34:26.522+0000 7f6d82262640 -1 Falling back to public interface 2024-03-20T13:34:26.525 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-20T13:34:26.538 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.536+0000 7f26bd82c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-20T13:34:26.590 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.588+0000 7f26bd82c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-20T13:34:26.618 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.616+0000 7fe05e70e640 1 Processor -- start 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.616+0000 7fe05e70e640 1 -- start start 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe05e70e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe05812e8c0 0x7fe05809a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe05e70e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe05809cf40 con 0x7fe05812e4e0 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe05e70e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe05812ed10 con 0x7fe05812e8c0 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe0577fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe05812e8c0 0x7fe05809a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe057fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe05812e4e0 0x7fe058099a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33548/0 (socket says 172.21.15.28:33548) 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe057fff640 1 -- 172.21.15.28:0/3857158606 learned_addr learned my addr 172.21.15.28:0/3857158606 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe0577fe640 1 -- 172.21.15.28:0/3857158606 >> v1:172.21.15.28:6789/0 conn(0x7fe05812e4e0 legacy=0x7fe058099a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe0577fe640 1 -- 172.21.15.28:0/3857158606 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe05809cc30 con 0x7fe05812e8c0 2024-03-20T13:34:26.619 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.617+0000 7fe056ffd640 1 -- 172.21.15.28:0/3857158606 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1859449470 0 0) 0x7fe05809cf40 con 0x7fe05812e4e0 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.618+0000 7fe0577fe640 1 --2- 172.21.15.28:0/3857158606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e8c0 0x7fe05809a130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe04802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b638fb79d8888b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.618+0000 7fe056ffd640 1 -- 172.21.15.28:0/3857158606 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe04802e070 con 0x7fe05812e8c0 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.618+0000 7fe056ffd640 1 -- 172.21.15.28:0/3857158606 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0480316d0 con 0x7fe05812e8c0 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.618+0000 7fe056ffd640 1 -- 172.21.15.28:0/3857158606 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe048031990 con 0x7fe05812e8c0 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 -- 172.21.15.28:0/3857158606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e8c0 msgr2=0x7fe05809a130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 --2- 172.21.15.28:0/3857158606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e8c0 0x7fe05809a130 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe048009720 tx=0x7fe04802b840 comp rx=0 tx=0).stop 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 -- 172.21.15.28:0/3857158606 shutdown_connections 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 --2- 172.21.15.28:0/3857158606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e8c0 0x7fe05809a130 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 -- 172.21.15.28:0/3857158606 >> 172.21.15.28:0/3857158606 conn(0x7fe05806c210 msgr2=0x7fe05806c620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 -- 172.21.15.28:0/3857158606 shutdown_connections 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 -- 172.21.15.28:0/3857158606 wait complete. 2024-03-20T13:34:26.621 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.619+0000 7fe05e70e640 1 Processor -- start 2024-03-20T13:34:26.622 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe05e70e640 1 -- start start 2024-03-20T13:34:26.623 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe05e70e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 0x7fe05811cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:26.623 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe05e70e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe05811ff40 con 0x7fe05812e4e0 2024-03-20T13:34:26.623 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe057fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 0x7fe05811cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:26.623 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe057fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 0x7fe05811cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57670/0 (socket says 172.21.15.28:57670) 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe057fff640 1 -- 172.21.15.28:0/3624784902 learned_addr learned my addr 172.21.15.28:0/3624784902 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.620+0000 7fe057fff640 1 -- 172.21.15.28:0/3624784902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe048009400 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe057fff640 1 --2- 172.21.15.28:0/3624784902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 0x7fe05811cb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe04000c420 tx=0x7fe04000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe0400074d0 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe040007630 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe05811f3c0 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe040004950 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe05811f7d0 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 807+0+0 (secure 0 0 0) 0x7fe040004b70 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.621+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fe04001c990 con 0x7fe05812e4e0 2024-03-20T13:34:26.624 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.622+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe058067ef0 con 0x7fe05812e4e0 2024-03-20T13:34:26.625 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.624+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73141 (secure 0 0 0) 0x7fe040018070 con 0x7fe05812e4e0 2024-03-20T13:34:26.636 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:26.634+0000 7f26bd82c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-20T13:34:26.686 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.685+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe05811e6a0 con 0x7fe05812e4e0 2024-03-20T13:34:26.687 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.685+0000 7fe054ff9640 1 -- 172.21.15.28:0/3624784902 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4153 (secure 0 0 0) 0x7fe04001cc20 con 0x7fe05812e4e0 2024-03-20T13:34:26.687 INFO:teuthology.misc.health.smithi028.stdout: 2024-03-20T13:34:26.687 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":6,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:34:25.905721+0000","last_up_change":"0.000000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 msgr2=0x7fe05811cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 --2- 172.21.15.28:0/3624784902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 0x7fe05811cb60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe04000c420 tx=0x7fe04000c8e0 comp rx=0 tx=0).stop 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 shutdown_connections 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 --2- 172.21.15.28:0/3624784902 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe05812e4e0 0x7fe05811cb60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 >> 172.21.15.28:0/3624784902 conn(0x7fe05806c210 msgr2=0x7fe0581b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 shutdown_connections 2024-03-20T13:34:26.689 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:26.686+0000 7fe05e70e640 1 -- 172.21.15.28:0/3624784902 wait complete. 2024-03-20T13:34:26.697 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-03-20T13:34:27.013 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.011+0000 7f26bd82c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-20T13:34:27.147 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.145+0000 7f26bd82c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-20T13:34:27.253 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.251+0000 7f26bd82c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-20T13:34:27.298 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.296+0000 7f26bd82c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-20T13:34:27.411 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.409+0000 7f26bd82c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-20T13:34:27.505 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.503+0000 7f26bd82c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-20T13:34:27.661 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.659+0000 7f26bd82c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-20T13:34:27.703 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.701+0000 7f26bd82c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-20T13:34:27.856 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:27.854+0000 7f26bd82c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-20T13:34:28.676 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:28.674+0000 7f26bd82c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-20T13:34:28.950 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:28.947+0000 7f26bd82c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-20T13:34:29.003 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:29.001+0000 7f26bd82c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-20T13:34:29.119 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:29.117+0000 7f26bd82c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-20T13:34:29.951 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-20T13:34:29.950+0000 7f75abaa6640 -1 osd.0 0 log_to_monitors true 2024-03-20T13:34:29.986 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-03-20T13:34:29.984+0000 7fa27881f640 -1 osd.2 0 log_to_monitors true 2024-03-20T13:34:30.036 INFO:tasks.ceph.osd.1.smithi177.stderr:2024-03-20T13:34:30.034+0000 7fdb6d819640 -1 osd.1 0 log_to_monitors true 2024-03-20T13:34:30.079 INFO:tasks.ceph.osd.3.smithi177.stderr:2024-03-20T13:34:30.077+0000 7f6d82262640 -1 osd.3 0 log_to_monitors true 2024-03-20T13:34:30.139 INFO:tasks.ceph.mgr.x.smithi177.stderr:2024-03-20T13:34:30.137+0000 7f265dc67640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-03-20T13:34:31.882 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-20T13:34:31.881+0000 7f75a7219640 -1 osd.0 0 waiting for initial osdmap 2024-03-20T13:34:31.892 INFO:tasks.ceph.osd.0.smithi028.stderr:2024-03-20T13:34:31.891+0000 7f759f84b640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:34:32.854 INFO:tasks.ceph.osd.3.smithi177.stderr:2024-03-20T13:34:32.853+0000 7f6d7d9d5640 -1 osd.3 0 waiting for initial osdmap 2024-03-20T13:34:32.864 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-03-20T13:34:32.863+0000 7fa273a65640 -1 osd.2 0 waiting for initial osdmap 2024-03-20T13:34:32.866 INFO:tasks.ceph.osd.3.smithi177.stderr:2024-03-20T13:34:32.865+0000 7f6d76007640 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:34:32.870 INFO:tasks.ceph.osd.1.smithi177.stderr:2024-03-20T13:34:32.869+0000 7fdb68a5a640 -1 osd.1 0 waiting for initial osdmap 2024-03-20T13:34:32.876 INFO:tasks.ceph.osd.2.smithi177.stderr:2024-03-20T13:34:32.875+0000 7fa26c097640 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:34:32.884 INFO:tasks.ceph.osd.1.smithi177.stderr:2024-03-20T13:34:32.883+0000 7fdb6108c640 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-20T13:34:33.101 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-20T13:34:33.205 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec1a68f640 1 Processor -- start 2024-03-20T13:34:33.205 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec1a68f640 1 -- start start 2024-03-20T13:34:33.205 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec1a68f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fec1406ccf0 0x7fec14133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:33.205 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec1a68f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec14092880 con 0x7fec1406c200 2024-03-20T13:34:33.205 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec1a68f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1406de20 con 0x7fec1406ccf0 2024-03-20T13:34:33.205 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec137fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fec1406ccf0 0x7fec14133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:33.206 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec13fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fec1406c200 0x7fec1406c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:33552/0 (socket says 172.21.15.28:33552) 2024-03-20T13:34:33.206 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.203+0000 7fec13fff640 1 -- 172.21.15.28:0/993475851 learned_addr learned my addr 172.21.15.28:0/993475851 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:33.206 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.204+0000 7fec137fe640 1 -- 172.21.15.28:0/993475851 >> v1:172.21.15.28:6789/0 conn(0x7fec1406c200 legacy=0x7fec1406c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:33.206 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.204+0000 7fec137fe640 1 -- 172.21.15.28:0/993475851 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14091f10 con 0x7fec1406ccf0 2024-03-20T13:34:33.207 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.204+0000 7fec137fe640 1 --2- 172.21.15.28:0/993475851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406ccf0 0x7fec14133350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec08009720 tx=0x7fec0802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df806344cdec76b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:33.207 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec12ffd640 1 -- 172.21.15.28:0/993475851 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec0802e070 con 0x7fec1406ccf0 2024-03-20T13:34:33.207 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec12ffd640 1 -- 172.21.15.28:0/993475851 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec080316d0 con 0x7fec1406ccf0 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec12ffd640 1 -- 172.21.15.28:0/993475851 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec08031990 con 0x7fec1406ccf0 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 -- 172.21.15.28:0/993475851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406ccf0 msgr2=0x7fec14133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 --2- 172.21.15.28:0/993475851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406ccf0 0x7fec14133350 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec08009720 tx=0x7fec0802b840 comp rx=0 tx=0).stop 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 -- 172.21.15.28:0/993475851 shutdown_connections 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 --2- 172.21.15.28:0/993475851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406ccf0 0x7fec14133350 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 -- 172.21.15.28:0/993475851 >> 172.21.15.28:0/993475851 conn(0x7fec1409c4d0 msgr2=0x7fec1409c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 -- 172.21.15.28:0/993475851 shutdown_connections 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.205+0000 7fec1a68f640 1 -- 172.21.15.28:0/993475851 wait complete. 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.206+0000 7fec1a68f640 1 Processor -- start 2024-03-20T13:34:33.208 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.206+0000 7fec1a68f640 1 -- start start 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec1a68f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 0x7fec14123270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec1a68f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14124880 con 0x7fec1406c200 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec13fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 0x7fec14123270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec13fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 0x7fec14123270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:57702/0 (socket says 172.21.15.28:57702) 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec13fff640 1 -- 172.21.15.28:0/2000996491 learned_addr learned my addr 172.21.15.28:0/2000996491 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec13fff640 1 -- 172.21.15.28:0/2000996491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08009400 con 0x7fec1406c200 2024-03-20T13:34:33.210 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec13fff640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 0x7fec14123270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec0400c380 tx=0x7fec0400c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec04005c10 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04005d70 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fec04004930 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec141243a0 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.207+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec14071590 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.208+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 45152+0+0 (secure 0 0 0) 0x7fec04004a90 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.208+0000 7fec10ff9640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fec00037e60 0x7fec0003a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.208+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 2183+0+0 (secure 0 0 0) 0x7fec04049d70 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.208+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec14133850 con 0x7fec1406c200 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.209+0000 7fec137fe640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fec00037e60 0x7fec0003a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:33.211 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.209+0000 7fec137fe640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fec00037e60 0x7fec0003a320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec08036000 tx=0x7fec08008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:33.214 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.214+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fec04004d90 con 0x7fec1406c200 2024-03-20T13:34:33.393 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.392+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec140627b0 con 0x7fec1406c200 2024-03-20T13:34:33.394 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.393+0000 7fec10ff9640 1 -- 172.21.15.28:0/2000996491 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) v1 ==== 74+0+5122 (secure 0 0 0) 0x7fec040118b0 con 0x7fec1406c200 2024-03-20T13:34:33.394 INFO:teuthology.misc.health.smithi028.stdout: 2024-03-20T13:34:33.394 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":9,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:34:32.883137+0000","last_up_change":"2024-03-20T13:34:32.883137+0000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6801","nonce":801909073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6803","nonce":801909073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6807","nonce":801909073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6805","nonce":801909073}]},"public_addr":"172.21.15.28:6801/801909073","cluster_addr":"172.21.15.28:6803/801909073","heartbeat_back_addr":"172.21.15.28:6807/801909073","heartbeat_front_addr":"172.21.15.28:6805/801909073","state":["exists","up"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6811","nonce":1493521224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6815","nonce":1493521224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6823","nonce":1493521224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6817","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6819","nonce":1493521224}]},"public_addr":"172.21.15.177:6811/1493521224","cluster_addr":"172.21.15.177:6815/1493521224","heartbeat_back_addr":"172.21.15.177:6823/1493521224","heartbeat_front_addr":"172.21.15.177:6819/1493521224","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:34:33.396 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fec00037e60 msgr2=0x7fec0003a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:33.396 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fec00037e60 0x7fec0003a320 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fec08036000 tx=0x7fec08008030 comp rx=0 tx=0).stop 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 msgr2=0x7fec14123270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 0x7fec14123270 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fec0400c380 tx=0x7fec0400c840 comp rx=0 tx=0).stop 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 shutdown_connections 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fec00037e60 0x7fec0003a320 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 --2- 172.21.15.28:0/2000996491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fec1406c200 0x7fec14123270 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 >> 172.21.15.28:0/2000996491 conn(0x7fec1409c4d0 msgr2=0x7fec140903c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 shutdown_connections 2024-03-20T13:34:33.397 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:33.395+0000 7fec1a68f640 1 -- 172.21.15.28:0/2000996491 wait complete. 2024-03-20T13:34:33.406 DEBUG:teuthology.misc:2 of 4 OSDs are up 2024-03-20T13:34:39.810 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-20T13:34:39.913 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.910+0000 7f570a18c640 1 Processor -- start 2024-03-20T13:34:39.913 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.910+0000 7f570a18c640 1 -- start start 2024-03-20T13:34:39.913 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f570a18c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5704128910 0x7f5704128cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:39.913 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f570a18c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5704128710 con 0x7f5704129230 2024-03-20T13:34:39.914 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f570a18c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5704096f00 con 0x7f5704128910 2024-03-20T13:34:39.914 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f57037fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5704128910 0x7f5704128cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:39.914 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f56fbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5704129230 0x7f57040615c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58976/0 (socket says 172.21.15.28:58976) 2024-03-20T13:34:39.914 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f56fbfff640 1 -- 172.21.15.28:0/3837015234 learned_addr learned my addr 172.21.15.28:0/3837015234 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:39.914 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f57037fe640 1 -- 172.21.15.28:0/3837015234 >> v1:172.21.15.28:6789/0 conn(0x7f5704129230 legacy=0x7f57040615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:39.914 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.911+0000 7f57037fe640 1 -- 172.21.15.28:0/3837015234 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57040911b0 con 0x7f5704128910 2024-03-20T13:34:39.915 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.912+0000 7f57037fe640 1 --2- 172.21.15.28:0/3837015234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f5704128cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009720 tx=0x7f56f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e424dbf2cf3d88c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:39.915 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.912+0000 7f5702ffd640 1 -- 172.21.15.28:0/3837015234 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f402e070 con 0x7f5704128910 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.912+0000 7f5702ffd640 1 -- 172.21.15.28:0/3837015234 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f40316d0 con 0x7f5704128910 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.912+0000 7f5702ffd640 1 -- 172.21.15.28:0/3837015234 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f4031990 con 0x7f5704128910 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.912+0000 7f570a18c640 1 -- 172.21.15.28:0/3837015234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 msgr2=0x7f5704128cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.912+0000 7f570a18c640 1 --2- 172.21.15.28:0/3837015234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f5704128cf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f56f4009720 tx=0x7f56f402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 -- 172.21.15.28:0/3837015234 shutdown_connections 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 --2- 172.21.15.28:0/3837015234 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f5704128cf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 -- 172.21.15.28:0/3837015234 >> 172.21.15.28:0/3837015234 conn(0x7f570409d530 msgr2=0x7f570409d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 -- 172.21.15.28:0/3837015234 shutdown_connections 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 -- 172.21.15.28:0/3837015234 wait complete. 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 Processor -- start 2024-03-20T13:34:39.916 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.913+0000 7f570a18c640 1 -- start start 2024-03-20T13:34:39.918 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f570a18c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f57041bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:39.918 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f570a18c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5704127810 con 0x7f5704128910 2024-03-20T13:34:39.918 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f57037fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f57041bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:39.918 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f57037fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f57041bf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48624/0 (socket says 172.21.15.28:48624) 2024-03-20T13:34:39.918 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f57037fe640 1 -- 172.21.15.28:0/1856679060 learned_addr learned my addr 172.21.15.28:0/1856679060 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:39.918 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f57037fe640 1 -- 172.21.15.28:0/1856679060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f4009400 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f57037fe640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f57041bf4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56f4034040 tx=0x7f56f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.914+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f4032830 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.915+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f4032990 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.915+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f56f4032c50 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.915+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57040721b0 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.915+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5704122c70 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.915+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f56f404e450 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.916+0000 7f5700ff9640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f56e4037ef0 0x7f56e403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.916+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f56f406ca10 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.916+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57040719c0 con 0x7f5704128910 2024-03-20T13:34:39.919 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.916+0000 7f56fbfff640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f56e4037ef0 0x7f56e403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:39.920 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.916+0000 7f56fbfff640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f56e4037ef0 0x7f56e403a3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f56ec007fd0 tx=0x7f56ec007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:39.923 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:39.921+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f56f4032db0 con 0x7f5704128910 2024-03-20T13:34:40.104 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.102+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57040627b0 con 0x7f5704128910 2024-03-20T13:34:40.105 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.103+0000 7f5700ff9640 1 -- 172.21.15.28:0/1856679060 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7977 (secure 0 0 0) 0x7f56f404c350 con 0x7f5704128910 2024-03-20T13:34:40.105 INFO:teuthology.misc.health.smithi028.stdout: 2024-03-20T13:34:40.105 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":12,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:34:35.885786+0000","last_up_change":"2024-03-20T13:34:33.883766+0000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:34:33.177605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6801","nonce":801909073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6803","nonce":801909073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6807","nonce":801909073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6805","nonce":801909073}]},"public_addr":"172.21.15.28:6801/801909073","cluster_addr":"172.21.15.28:6803/801909073","heartbeat_back_addr":"172.21.15.28:6807/801909073","heartbeat_front_addr":"172.21.15.28:6805/801909073","state":["exists","up"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6810","nonce":2492741617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6814","nonce":2492741617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6822","nonce":2492741617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6818","nonce":2492741617}]},"public_addr":"172.21.15.177:6810/2492741617","cluster_addr":"172.21.15.177:6814/2492741617","heartbeat_back_addr":"172.21.15.177:6822/2492741617","heartbeat_front_addr":"172.21.15.177:6818/2492741617","state":["exists","up"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6801","nonce":3663022842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6803","nonce":3663022842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6807","nonce":3663022842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6805","nonce":3663022842}]},"public_addr":"172.21.15.177:6801/3663022842","cluster_addr":"172.21.15.177:6803/3663022842","heartbeat_back_addr":"172.21.15.177:6807/3663022842","heartbeat_front_addr":"172.21.15.177:6805/3663022842","state":["exists","up"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6811","nonce":1493521224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6815","nonce":1493521224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6823","nonce":1493521224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6817","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6819","nonce":1493521224}]},"public_addr":"172.21.15.177:6811/1493521224","cluster_addr":"172.21.15.177:6815/1493521224","heartbeat_back_addr":"172.21.15.177:6823/1493521224","heartbeat_front_addr":"172.21.15.177:6819/1493521224","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.985582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.990757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.029723+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.082287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:34:40.107 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f56e4037ef0 msgr2=0x7f56e403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:40.107 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f56e4037ef0 0x7f56e403a3b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f56ec007fd0 tx=0x7f56ec007ac0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.107 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 msgr2=0x7f57041bf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:40.107 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f57041bf4c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f56f4034040 tx=0x7f56f40046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.107 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 shutdown_connections 2024-03-20T13:34:40.107 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f56e4037ef0 0x7f56e403a3b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.108 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 --2- 172.21.15.28:0/1856679060 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5704128910 0x7f57041bf4c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.108 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.104+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 >> 172.21.15.28:0/1856679060 conn(0x7f570409d530 msgr2=0x7f57040989a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:40.108 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.105+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 shutdown_connections 2024-03-20T13:34:40.108 INFO:teuthology.misc.health.smithi028.stderr:2024-03-20T13:34:40.105+0000 7f570a18c640 1 -- 172.21.15.28:0/1856679060 wait complete. 2024-03-20T13:34:40.116 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-03-20T13:34:40.117 INFO:tasks.ceph:Creating RBD pool 2024-03-20T13:34:40.117 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd pool create rbd 8 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a45d6640 1 Processor -- start 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a45d6640 1 -- start start 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a45d6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f789c06d130 0x7f789c06d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a45d6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789c098a60 con 0x7f789c06da50 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a45d6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f789c06e460 con 0x7f789c06d130 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a2372640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f789c06d130 0x7f789c06d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a1b71640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f789c06da50 0x7f789c12dec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58980/0 (socket says 172.21.15.28:58980) 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.215+0000 7f78a1b71640 1 -- 172.21.15.28:0/2845637105 learned_addr learned my addr 172.21.15.28:0/2845637105 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.216+0000 7f78a2372640 1 -- 172.21.15.28:0/2845637105 >> v1:172.21.15.28:6789/0 conn(0x7f789c06da50 legacy=0x7f789c12dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:40.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.216+0000 7f78a2372640 1 -- 172.21.15.28:0/2845637105 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c09b570 con 0x7f789c06d130 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.216+0000 7f78a2372640 1 --2- 172.21.15.28:0/2845637105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c06d510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7898009720 tx=0x7f789802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=156c29f48abc95cd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.216+0000 7f78a1370640 1 -- 172.21.15.28:0/2845637105 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f789802e070 con 0x7f789c06d130 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.216+0000 7f78a1370640 1 -- 172.21.15.28:0/2845637105 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78980316d0 con 0x7f789c06d130 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.216+0000 7f78a1370640 1 -- 172.21.15.28:0/2845637105 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7898031990 con 0x7f789c06d130 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 -- 172.21.15.28:0/2845637105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 msgr2=0x7f789c06d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 --2- 172.21.15.28:0/2845637105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c06d510 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7898009720 tx=0x7f789802b840 comp rx=0 tx=0).stop 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 -- 172.21.15.28:0/2845637105 shutdown_connections 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 --2- 172.21.15.28:0/2845637105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c06d510 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 -- 172.21.15.28:0/2845637105 >> 172.21.15.28:0/2845637105 conn(0x7f789c09c210 msgr2=0x7f789c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 -- 172.21.15.28:0/2845637105 shutdown_connections 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.217+0000 7f78a45d6640 1 -- 172.21.15.28:0/2845637105 wait complete. 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a45d6640 1 Processor -- start 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a45d6640 1 -- start start 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a45d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c1a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a45d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f789c1a6ee0 con 0x7f789c06d130 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a2372640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c1a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a2372640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c1a5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48634/0 (socket says 172.21.15.28:48634) 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.218+0000 7f78a2372640 1 -- 172.21.15.28:0/2710141665 learned_addr learned my addr 172.21.15.28:0/2710141665 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f78a2372640 1 -- 172.21.15.28:0/2710141665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009400 con 0x7f789c06d130 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f78a2372640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c1a5d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f789802b880 tx=0x7f78980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7898031ec0 con 0x7f789c06d130 2024-03-20T13:34:40.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7898032a10 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f789c1a8ff0 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7898032cb0 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.219+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789c1a9290 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.220+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f789804d3f0 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.220+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789c1a8e50 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.220+0000 7f7892ffd640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7880037ef0 0x7f788003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.220+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f789806c790 con 0x7f789c06d130 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.220+0000 7f78a1b71640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7880037ef0 0x7f788003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.221+0000 7f78a1b71640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7880037ef0 0x7f788003a3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f788c000f60 tx=0x7f788c007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:40.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.224+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f789c1a8e50 con 0x7f789c06d130 2024-03-20T13:34:40.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.405+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f789c1a8e50 con 0x7f789c06d130 2024-03-20T13:34:40.895 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.893+0000 7f7892ffd640 1 -- 172.21.15.28:0/2710141665 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f789c1a8e50 con 0x7f789c06d130 2024-03-20T13:34:40.895 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'rbd' created 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7880037ef0 msgr2=0x7f788003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7880037ef0 0x7f788003a3b0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f788c000f60 tx=0x7f788c007a80 comp rx=0 tx=0).stop 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 msgr2=0x7f789c1a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c1a5d40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f789802b880 tx=0x7f78980046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 shutdown_connections 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7880037ef0 0x7f788003a3b0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 --2- 172.21.15.28:0/2710141665 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f789c06d130 0x7f789c1a5d40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 >> 172.21.15.28:0/2710141665 conn(0x7f789c09c210 msgr2=0x7f789c1b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 shutdown_connections 2024-03-20T13:34:40.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:40.896+0000 7f78a45d6640 1 -- 172.21.15.28:0/2710141665 wait complete. 2024-03-20T13:34:40.911 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-03-20T13:34:41.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.017+0000 7f364c900640 1 Processor -- start 2024-03-20T13:34:41.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.017+0000 7f364c900640 1 -- start start 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f364c900640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3648099310 0x7f36481333c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f364c900640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364809a800 con 0x7f3648098820 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f364c900640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364809a580 con 0x7f3648099310 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f3645d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3648099310 0x7f36481333c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f364659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3648098820 0x7f3648098c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:58986/0 (socket says 172.21.15.28:58986) 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f364659c640 1 -- 172.21.15.28:0/963111108 learned_addr learned my addr 172.21.15.28:0/963111108 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f3645d9b640 1 -- 172.21.15.28:0/963111108 >> v1:172.21.15.28:6789/0 conn(0x7f3648098820 legacy=0x7f3648098c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:41.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.018+0000 7f3645d9b640 1 -- 172.21.15.28:0/963111108 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f364809dab0 con 0x7f3648099310 2024-03-20T13:34:41.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.019+0000 7f3645d9b640 1 --2- 172.21.15.28:0/963111108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648099310 0x7f36481333c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3630009720 tx=0x7f363002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48c1631dfda051e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:41.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.019+0000 7f364559a640 1 -- 172.21.15.28:0/963111108 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363002e070 con 0x7f3648099310 2024-03-20T13:34:41.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.019+0000 7f364559a640 1 -- 172.21.15.28:0/963111108 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36300316d0 con 0x7f3648099310 2024-03-20T13:34:41.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.019+0000 7f364559a640 1 -- 172.21.15.28:0/963111108 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3630031990 con 0x7f3648099310 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.019+0000 7f364c900640 1 -- 172.21.15.28:0/963111108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648099310 msgr2=0x7f36481333c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.019+0000 7f364c900640 1 --2- 172.21.15.28:0/963111108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648099310 0x7f36481333c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3630009720 tx=0x7f363002b840 comp rx=0 tx=0).stop 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.020+0000 7f364c900640 1 -- 172.21.15.28:0/963111108 shutdown_connections 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.020+0000 7f364c900640 1 --2- 172.21.15.28:0/963111108 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648099310 0x7f36481333c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.020+0000 7f364c900640 1 -- 172.21.15.28:0/963111108 >> 172.21.15.28:0/963111108 conn(0x7f36480a0940 msgr2=0x7f364809ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.020+0000 7f364c900640 1 -- 172.21.15.28:0/963111108 shutdown_connections 2024-03-20T13:34:41.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.020+0000 7f364c900640 1 -- 172.21.15.28:0/963111108 wait complete. 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364c900640 1 Processor -- start 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364c900640 1 -- start start 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364c900640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 0x7f36481c2aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364c900640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36481325a0 con 0x7f3648098820 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 0x7f36481c2aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 0x7f36481c2aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48658/0 (socket says 172.21.15.28:48658) 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364659c640 1 -- 172.21.15.28:0/530613694 learned_addr learned my addr 172.21.15.28:0/530613694 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364659c640 1 -- 172.21.15.28:0/530613694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009400 con 0x7f3648098820 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.021+0000 7f364659c640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 0x7f36481c2aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f364000c480 tx=0x7f364000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.022+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3640005c10 con 0x7f3648098820 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.022+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3640005d70 con 0x7f3648098820 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.022+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364806c3c0 con 0x7f3648098820 2024-03-20T13:34:41.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.022+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3640007200 con 0x7f3648098820 2024-03-20T13:34:41.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.022+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f364806cc10 con 0x7f3648098820 2024-03-20T13:34:41.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.023+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3640007360 con 0x7f3648098820 2024-03-20T13:34:41.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.023+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36480627b0 con 0x7f3648098820 2024-03-20T13:34:41.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.023+0000 7f363effd640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3628037ef0 0x7f362803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:41.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.023+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3471+0+0 (secure 0 0 0) 0x7f3640049dc0 con 0x7f3648098820 2024-03-20T13:34:41.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.023+0000 7f3645d9b640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3628037ef0 0x7f362803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:41.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.024+0000 7f3645d9b640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3628037ef0 0x7f362803a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3630036000 tx=0x7f3630008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:41.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.028+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f364001b3b0 con 0x7f3648098820 2024-03-20T13:34:41.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.209+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3648072b00 con 0x7f3648098820 2024-03-20T13:34:41.898 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.896+0000 7f363effd640 1 -- 172.21.15.28:0/530613694 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f3640017070 con 0x7f3648098820 2024-03-20T13:34:41.898 INFO:teuthology.orchestra.run.smithi028.stderr:enabled application 'rbd' on pool 'rbd' 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3628037ef0 msgr2=0x7f362803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3628037ef0 0x7f362803a3b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3630036000 tx=0x7f3630008030 comp rx=0 tx=0).stop 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 msgr2=0x7f36481c2aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 0x7f36481c2aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f364000c480 tx=0x7f364000c940 comp rx=0 tx=0).stop 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 shutdown_connections 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3628037ef0 0x7f362803a3b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 --2- 172.21.15.28:0/530613694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3648098820 0x7f36481c2aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 >> 172.21.15.28:0/530613694 conn(0x7f36480a0940 msgr2=0x7f3648127640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 shutdown_connections 2024-03-20T13:34:41.901 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:41.899+0000 7f364c900640 1 -- 172.21.15.28:0/530613694 wait complete. 2024-03-20T13:34:41.915 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-20T13:34:41.915 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-20T13:34:41.915 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-20T13:34:41.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-20T13:34:41.916 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-20T13:34:42.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.021+0000 7f4181f4b640 1 Processor -- start 2024-03-20T13:34:42.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.021+0000 7f4181f4b640 1 -- start start 2024-03-20T13:34:42.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.021+0000 7f4181f4b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f417c096ac0 0x7f417c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.021+0000 7f4181f4b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f417c06ecc0 con 0x7f417c06e110 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.021+0000 7f4181f4b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f417c067100 con 0x7f417c096ac0 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.021+0000 7f417b7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f417c096ac0 0x7f417c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.022+0000 7f417affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f417c06e110 0x7f417c06d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59000/0 (socket says 172.21.15.28:59000) 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.022+0000 7f417affd640 1 -- 172.21.15.28:0/176158046 learned_addr learned my addr 172.21.15.28:0/176158046 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.022+0000 7f417b7fe640 1 -- 172.21.15.28:0/176158046 >> v1:172.21.15.28:6789/0 conn(0x7f417c06e110 legacy=0x7f417c06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.022+0000 7f417b7fe640 1 -- 172.21.15.28:0/176158046 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f417c066b50 con 0x7f417c096ac0 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.022+0000 7f417b7fe640 1 --2- 172.21.15.28:0/176158046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c096ac0 0x7f417c06ce00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f416c009720 tx=0x7f416c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2a160a6d759354 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f417a7fc640 1 -- 172.21.15.28:0/176158046 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f416c02e070 con 0x7f417c096ac0 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f417a7fc640 1 -- 172.21.15.28:0/176158046 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c0316d0 con 0x7f417c096ac0 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f417a7fc640 1 -- 172.21.15.28:0/176158046 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f416c031990 con 0x7f417c096ac0 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 -- 172.21.15.28:0/176158046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c096ac0 msgr2=0x7f417c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 --2- 172.21.15.28:0/176158046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c096ac0 0x7f417c06ce00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f416c009720 tx=0x7f416c02b840 comp rx=0 tx=0).stop 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 -- 172.21.15.28:0/176158046 shutdown_connections 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 --2- 172.21.15.28:0/176158046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c096ac0 0x7f417c06ce00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 -- 172.21.15.28:0/176158046 >> 172.21.15.28:0/176158046 conn(0x7f417c0974b0 msgr2=0x7f417c0978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 -- 172.21.15.28:0/176158046 shutdown_connections 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.023+0000 7f4181f4b640 1 -- 172.21.15.28:0/176158046 wait complete. 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.024+0000 7f4181f4b640 1 Processor -- start 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.024+0000 7f4181f4b640 1 -- start start 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4181f4b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 0x7f417c0920f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4181f4b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417c095900 con 0x7f417c06e110 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f417b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 0x7f417c0920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f417b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 0x7f417c0920f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48666/0 (socket says 172.21.15.28:48666) 2024-03-20T13:34:42.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f417b7fe640 1 -- 172.21.15.28:0/750485758 learned_addr learned my addr 172.21.15.28:0/750485758 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f417b7fe640 1 -- 172.21.15.28:0/750485758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416c009400 con 0x7f417c06e110 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f417b7fe640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 0x7f417c0920f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f416c009840 tx=0x7f416c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f416c0328b0 con 0x7f417c06e110 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c032a10 con 0x7f417c06e110 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f417c094940 con 0x7f417c06e110 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f416c032cf0 con 0x7f417c06e110 2024-03-20T13:34:42.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.025+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f417c095c10 con 0x7f417c06e110 2024-03-20T13:34:42.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.026+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f416c04d3f0 con 0x7f417c06e110 2024-03-20T13:34:42.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.026+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417c0627b0 con 0x7f417c06e110 2024-03-20T13:34:42.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.026+0000 7f4163fff640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4168037ef0 0x7f416803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.026+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f416c06c8c0 con 0x7f417c06e110 2024-03-20T13:34:42.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.027+0000 7f417affd640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4168037ef0 0x7f416803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.027+0000 7f417affd640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4168037ef0 0x7f416803a3b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4170007fd0 tx=0x7f4170007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.031+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f416c0308e0 con 0x7f417c06e110 2024-03-20T13:34:42.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.257+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f417c073050 con 0x7f417c06e110 2024-03-20T13:34:42.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.258+0000 7f4163fff640 1 -- 172.21.15.28:0/750485758 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+86632 (secure 0 0 0) 0x7f416c0302f0 con 0x7f417c06e110 2024-03-20T13:34:42.264 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4168037ef0 msgr2=0x7f416803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4168037ef0 0x7f416803a3b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4170007fd0 tx=0x7f4170007ac0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 msgr2=0x7f417c0920f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 0x7f417c0920f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f416c009840 tx=0x7f416c0046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 shutdown_connections 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4168037ef0 0x7f416803a3b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 --2- 172.21.15.28:0/750485758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f417c06e110 0x7f417c0920f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.260+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 >> 172.21.15.28:0/750485758 conn(0x7f417c0974b0 msgr2=0x7f417c130e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.261+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 shutdown_connections 2024-03-20T13:34:42.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.261+0000 7f4181f4b640 1 -- 172.21.15.28:0/750485758 wait complete. 2024-03-20T13:34:42.272 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6824","nonce":915573033},{"type":"v1","addr":"172.21.15.177:6825","nonce":915573033}]},"active_addr":"172.21.15.177:6825/915573033","active_change":"2024-03-20T13:34:29.131892+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2472158390}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":4062402211}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":2416522338}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.177:0","nonce":3613232856}]}]} 2024-03-20T13:34:42.275 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-20T13:34:42.275 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-20T13:34:42.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:34:42.379 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.377+0000 7f5691e33640 1 Processor -- start 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.377+0000 7f5691e33640 1 -- start start 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f5691e33640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f568c0993f0 0x7f568c133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f5691e33640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f568c09dc90 con 0x7f568c098900 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f5691e33640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f568c09a170 con 0x7f568c0993f0 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f568affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f568c0993f0 0x7f568c133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f568b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f568c098900 0x7f568c098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59016/0 (socket says 172.21.15.28:59016) 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f568b7fe640 1 -- 172.21.15.28:0/4102500257 learned_addr learned my addr 172.21.15.28:0/4102500257 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f568affd640 1 -- 172.21.15.28:0/4102500257 >> v1:172.21.15.28:6789/0 conn(0x7f568c098900 legacy=0x7f568c098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f568a7fc640 1 -- 172.21.15.28:0/4102500257 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4276247829 0 0) 0x7f568c09dc90 con 0x7f568c098900 2024-03-20T13:34:42.380 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.378+0000 7f568affd640 1 -- 172.21.15.28:0/4102500257 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568c099d30 con 0x7f568c0993f0 2024-03-20T13:34:42.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f568affd640 1 --2- 172.21.15.28:0/4102500257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c0993f0 0x7f568c133350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5680009720 tx=0x7f568002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bcbd2a555b7ffb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f568a7fc640 1 -- 172.21.15.28:0/4102500257 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f568002e070 con 0x7f568c0993f0 2024-03-20T13:34:42.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f568a7fc640 1 -- 172.21.15.28:0/4102500257 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56800316d0 con 0x7f568c0993f0 2024-03-20T13:34:42.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f568a7fc640 1 -- 172.21.15.28:0/4102500257 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5680031990 con 0x7f568c0993f0 2024-03-20T13:34:42.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 -- 172.21.15.28:0/4102500257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c0993f0 msgr2=0x7f568c133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.385 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 --2- 172.21.15.28:0/4102500257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c0993f0 0x7f568c133350 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5680009720 tx=0x7f568002b840 comp rx=0 tx=0).stop 2024-03-20T13:34:42.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 -- 172.21.15.28:0/4102500257 shutdown_connections 2024-03-20T13:34:42.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 --2- 172.21.15.28:0/4102500257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c0993f0 0x7f568c133350 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 -- 172.21.15.28:0/4102500257 >> 172.21.15.28:0/4102500257 conn(0x7f568c0a0a20 msgr2=0x7f568c09cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:42.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 -- 172.21.15.28:0/4102500257 shutdown_connections 2024-03-20T13:34:42.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.379+0000 7f5691e33640 1 -- 172.21.15.28:0/4102500257 wait complete. 2024-03-20T13:34:42.386 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.380+0000 7f5691e33640 1 Processor -- start 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.380+0000 7f5691e33640 1 -- start start 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f5691e33640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 0x7f568c06fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f5691e33640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c12c2a0 con 0x7f568c098900 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 0x7f568c06fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f568b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 0x7f568c06fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48674/0 (socket says 172.21.15.28:48674) 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f568b7fe640 1 -- 172.21.15.28:0/920041606 learned_addr learned my addr 172.21.15.28:0/920041606 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f568b7fe640 1 -- 172.21.15.28:0/920041606 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5680009400 con 0x7f568c098900 2024-03-20T13:34:42.387 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f568b7fe640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 0x7f568c06fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c420 tx=0x7f567c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f567c0074d0 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567c007630 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568c12c860 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.381+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f567c004950 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.382+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c071c90 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.382+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f567c004b70 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.383+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568c0627b0 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.383+0000 7f5673fff640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5678037ea0 0x7f567803a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.383+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f567c049f20 con 0x7f568c098900 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.383+0000 7f568affd640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5678037ea0 0x7f567803a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.384+0000 7f568affd640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5678037ea0 0x7f567803a360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5680036000 tx=0x7f5680008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.387+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f567c01abe0 con 0x7f568c098900 2024-03-20T13:34:42.568 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.567+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f568c073050 con 0x7f568c098900 2024-03-20T13:34:42.569 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.568+0000 7f5673fff640 1 -- 172.21.15.28:0/920041606 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9758 (secure 0 0 0) 0x7f567c018070 con 0x7f568c098900 2024-03-20T13:34:42.569 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:42.569 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":14,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:34:41.895105+0000","last_up_change":"2024-03-20T13:34:33.883766+0000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:34:33.177605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-20T13:34:40.425350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6801","nonce":801909073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6803","nonce":801909073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6807","nonce":801909073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6805","nonce":801909073}]},"public_addr":"172.21.15.28:6801/801909073","cluster_addr":"172.21.15.28:6803/801909073","heartbeat_back_addr":"172.21.15.28:6807/801909073","heartbeat_front_addr":"172.21.15.28:6805/801909073","state":["exists","up"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6810","nonce":2492741617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6814","nonce":2492741617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6822","nonce":2492741617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6818","nonce":2492741617}]},"public_addr":"172.21.15.177:6810/2492741617","cluster_addr":"172.21.15.177:6814/2492741617","heartbeat_back_addr":"172.21.15.177:6822/2492741617","heartbeat_front_addr":"172.21.15.177:6818/2492741617","state":["exists","up"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6801","nonce":3663022842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6803","nonce":3663022842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6807","nonce":3663022842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6805","nonce":3663022842}]},"public_addr":"172.21.15.177:6801/3663022842","cluster_addr":"172.21.15.177:6803/3663022842","heartbeat_back_addr":"172.21.15.177:6807/3663022842","heartbeat_front_addr":"172.21.15.177:6805/3663022842","state":["exists","up"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6811","nonce":1493521224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6815","nonce":1493521224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6823","nonce":1493521224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6817","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6819","nonce":1493521224}]},"public_addr":"172.21.15.177:6811/1493521224","cluster_addr":"172.21.15.177:6815/1493521224","heartbeat_back_addr":"172.21.15.177:6823/1493521224","heartbeat_front_addr":"172.21.15.177:6819/1493521224","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.985582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.990757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.029723+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.082287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:34:42.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5678037ea0 msgr2=0x7f567803a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5678037ea0 0x7f567803a360 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f5680036000 tx=0x7f5680008030 comp rx=0 tx=0).stop 2024-03-20T13:34:42.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 msgr2=0x7f568c06fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 0x7f568c06fca0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f567c00c420 tx=0x7f567c00c8e0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 shutdown_connections 2024-03-20T13:34:42.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5678037ea0 0x7f567803a360 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 --2- 172.21.15.28:0/920041606 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568c098900 0x7f568c06fca0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 >> 172.21.15.28:0/920041606 conn(0x7f568c0a0a20 msgr2=0x7f568c09b920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:42.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 shutdown_connections 2024-03-20T13:34:42.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.570+0000 7f5691e33640 1 -- 172.21.15.28:0/920041606 wait complete. 2024-03-20T13:34:42.582 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-20T13:34:42.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:34:42.684 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26cd38640 1 Processor -- start 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26cd38640 1 -- start start 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26cd38640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff268094ec0 0x7ff26812f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26cd38640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff268095990 con 0x7ff2680943d0 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26cd38640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff268095ef0 con 0x7ff268094ec0 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff2680943d0 0x7ff2680947b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59026/0 (socket says 172.21.15.28:59026) 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff26659c640 1 -- 172.21.15.28:0/2465106568 learned_addr learned my addr 172.21.15.28:0/2465106568 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.681+0000 7ff265d9b640 1 --2- 172.21.15.28:0/2465106568 >> v2:172.21.15.28:3300/0 conn(0x7ff268094ec0 0x7ff26812f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.685 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.682+0000 7ff26559a640 1 -- 172.21.15.28:0/2465106568 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1373478440 0 0) 0x7ff268095990 con 0x7ff2680943d0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.682+0000 7ff26559a640 1 -- 172.21.15.28:0/2465106568 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff250003520 con 0x7ff2680943d0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.682+0000 7ff265d9b640 1 -- 172.21.15.28:0/2465106568 >> v1:172.21.15.28:6789/0 conn(0x7ff2680943d0 legacy=0x7ff2680947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.682+0000 7ff265d9b640 1 -- 172.21.15.28:0/2465106568 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26806c400 con 0x7ff268094ec0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.682+0000 7ff265d9b640 1 --2- 172.21.15.28:0/2465106568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff268094ec0 0x7ff26812f5c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009720 tx=0x7ff25c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a2e25e1aedee34 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26559a640 1 -- 172.21.15.28:0/2465106568 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff25c02e070 con 0x7ff268094ec0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26559a640 1 -- 172.21.15.28:0/2465106568 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff25c0316d0 con 0x7ff268094ec0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26559a640 1 -- 172.21.15.28:0/2465106568 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff25c031970 con 0x7ff268094ec0 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 -- 172.21.15.28:0/2465106568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff268094ec0 msgr2=0x7ff26812f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 --2- 172.21.15.28:0/2465106568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff268094ec0 0x7ff26812f5c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009720 tx=0x7ff25c02b840 comp rx=0 tx=0).stop 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 -- 172.21.15.28:0/2465106568 shutdown_connections 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 --2- 172.21.15.28:0/2465106568 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff268094ec0 0x7ff26812f5c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 -- 172.21.15.28:0/2465106568 >> 172.21.15.28:0/2465106568 conn(0x7ff26809a300 msgr2=0x7ff26809a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:42.686 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 -- 172.21.15.28:0/2465106568 shutdown_connections 2024-03-20T13:34:42.687 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.683+0000 7ff26cd38640 1 -- 172.21.15.28:0/2465106568 wait complete. 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.684+0000 7ff26cd38640 1 Processor -- start 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.684+0000 7ff26cd38640 1 -- start start 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26cd38640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 0x7ff2681bef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26cd38640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff268092c30 con 0x7ff2680943d0 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 0x7ff2681bef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 0x7ff2681bef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48682/0 (socket says 172.21.15.28:48682) 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26659c640 1 -- 172.21.15.28:0/643201543 learned_addr learned my addr 172.21.15.28:0/643201543 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:42.689 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26659c640 1 -- 172.21.15.28:0/643201543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff25c009400 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26659c640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 0x7ff2681bef50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c3b0 tx=0x7ff25800c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff258005c10 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff258005d70 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff258007220 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2681a9410 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.685+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2681aa170 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.686+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff258007380 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.686+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2681a9830 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.687+0000 7ff256ffd640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff248037ef0 0x7ff24803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.687+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff258049ed0 con 0x7ff2680943d0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.687+0000 7ff265d9b640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff248037ef0 0x7ff24803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:42.690 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.687+0000 7ff265d9b640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff248037ef0 0x7ff24803a3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009720 tx=0x7ff25c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:42.692 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.691+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff258019be0 con 0x7ff2680943d0 2024-03-20T13:34:42.871 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.870+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff2680627b0 con 0x7ff2680943d0 2024-03-20T13:34:42.872 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.871+0000 7ff256ffd640 1 -- 172.21.15.28:0/643201543 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+9758 (secure 0 0 0) 0x7ff258017070 con 0x7ff2680943d0 2024-03-20T13:34:42.872 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:42.872 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":14,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:34:41.895105+0000","last_up_change":"2024-03-20T13:34:33.883766+0000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:34:33.177605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-20T13:34:40.425350+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6801","nonce":801909073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6803","nonce":801909073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6807","nonce":801909073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6805","nonce":801909073}]},"public_addr":"172.21.15.28:6801/801909073","cluster_addr":"172.21.15.28:6803/801909073","heartbeat_back_addr":"172.21.15.28:6807/801909073","heartbeat_front_addr":"172.21.15.28:6805/801909073","state":["exists","up"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6810","nonce":2492741617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6814","nonce":2492741617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6822","nonce":2492741617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6818","nonce":2492741617}]},"public_addr":"172.21.15.177:6810/2492741617","cluster_addr":"172.21.15.177:6814/2492741617","heartbeat_back_addr":"172.21.15.177:6822/2492741617","heartbeat_front_addr":"172.21.15.177:6818/2492741617","state":["exists","up"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6801","nonce":3663022842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6803","nonce":3663022842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6807","nonce":3663022842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6805","nonce":3663022842}]},"public_addr":"172.21.15.177:6801/3663022842","cluster_addr":"172.21.15.177:6803/3663022842","heartbeat_back_addr":"172.21.15.177:6807/3663022842","heartbeat_front_addr":"172.21.15.177:6805/3663022842","state":["exists","up"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6811","nonce":1493521224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6815","nonce":1493521224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6823","nonce":1493521224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6817","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6819","nonce":1493521224}]},"public_addr":"172.21.15.177:6811/1493521224","cluster_addr":"172.21.15.177:6815/1493521224","heartbeat_back_addr":"172.21.15.177:6823/1493521224","heartbeat_front_addr":"172.21.15.177:6819/1493521224","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.985582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.990757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.029723+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.082287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:34:42.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff248037ef0 msgr2=0x7ff24803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff248037ef0 0x7ff24803a3b0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7ff25c009720 tx=0x7ff25c008030 comp rx=0 tx=0).stop 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 msgr2=0x7ff2681bef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 0x7ff2681bef50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff25800c3b0 tx=0x7ff25800c870 comp rx=0 tx=0).stop 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 shutdown_connections 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff248037ef0 0x7ff24803a3b0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 --2- 172.21.15.28:0/643201543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff2680943d0 0x7ff2681bef50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 >> 172.21.15.28:0/643201543 conn(0x7ff26809a300 msgr2=0x7ff26808c540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 shutdown_connections 2024-03-20T13:34:42.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.873+0000 7ff26cd38640 1 -- 172.21.15.28:0/643201543 wait complete. 2024-03-20T13:34:42.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-20T13:34:42.886 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-20T13:34:42.886 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-20T13:34:42.887 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-20T13:34:42.993 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7f4ad500f640 1 Processor -- start 2024-03-20T13:34:42.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7f0a4cf0e640 1 Processor -- start 2024-03-20T13:34:42.994 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7f4ad500f640 1 -- start start 2024-03-20T13:34:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7f0a4cf0e640 1 -- start start 2024-03-20T13:34:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7fee3abe6640 1 Processor -- start 2024-03-20T13:34:42.995 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7f0e82d89640 1 Processor -- start 2024-03-20T13:34:42.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7fee3abe6640 1 -- start start 2024-03-20T13:34:42.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.992+0000 7f0e82d89640 1 -- start start 2024-03-20T13:34:42.996 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4ad500f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4ad012dc90 0x7f4ad0130080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4ad500f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad0072220 con 0x7f4ad012af10 2024-03-20T13:34:42.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4ad500f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad006cc30 con 0x7f4ad012dc90 2024-03-20T13:34:42.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7fee3abe6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fee3412af10 0x7fee3412b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.997 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0a4cf0e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0a4812dc90 0x7f0a48130080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0e82d89640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0e7c0989f0 0x7f0e7c1331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:42.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0a4cf0e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a48072220 con 0x7f0a4812af10 2024-03-20T13:34:42.998 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0a4cf0e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a4806cc30 con 0x7f0a4812dc90 2024-03-20T13:34:42.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0e82d89640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e7c06bdf0 con 0x7f0e7c097f00 2024-03-20T13:34:42.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0e82d89640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e7c0672c0 con 0x7f0e7c0989f0 2024-03-20T13:34:42.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4aced9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4ad012af10 0x7f4ad012b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59038/0 (socket says 172.21.15.28:59038) 2024-03-20T13:34:42.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4aced9d640 1 -- 172.21.15.28:0/171935900 learned_addr learned my addr 172.21.15.28:0/171935900 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:42.999 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4ace59c640 1 --2- 172.21.15.28:0/171935900 >> v2:172.21.15.28:3300/0 conn(0x7f4ad012dc90 0x7f4ad0130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0e7bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0e7c0989f0 0x7f0e7c1331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7fee3abe6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee34072220 con 0x7fee34095020 2024-03-20T13:34:43.000 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7fee3abe6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee3406cc30 con 0x7fee3412af10 2024-03-20T13:34:43.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0a45d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0a4812dc90 0x7f0a48130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0a45d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0a4812dc90 0x7f0a48130080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48698/0 (socket says 172.21.15.28:48698) 2024-03-20T13:34:43.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0a45d9b640 1 -- 172.21.15.28:0/3931472256 learned_addr learned my addr 172.21.15.28:0/3931472256 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0e7bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0e7c0989f0 0x7f0e7c1331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48716/0 (socket says 172.21.15.28:48716) 2024-03-20T13:34:43.001 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f0e7bfff640 1 -- 172.21.15.28:0/4269555763 learned_addr learned my addr 172.21.15.28:0/4269555763 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7fee38982640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fee3412af10 0x7fee3412b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7fee38982640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fee3412af10 0x7fee3412b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48712/0 (socket says 172.21.15.28:48712) 2024-03-20T13:34:43.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7fee38982640 1 -- 172.21.15.28:0/342069217 learned_addr learned my addr 172.21.15.28:0/342069217 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.002 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4ace59c640 1 -- 172.21.15.28:0/171935900 >> v1:172.21.15.28:6789/0 conn(0x7f4ad012af10 legacy=0x7f4ad012b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:34:43.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.993+0000 7f4ace59c640 1 -- 172.21.15.28:0/171935900 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad012aae0 con 0x7f4ad012dc90 2024-03-20T13:34:43.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f0a45d9b640 1 -- 172.21.15.28:0/3931472256 >> v1:172.21.15.28:6789/0 conn(0x7f0a4812af10 legacy=0x7f0a4812b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f0a45d9b640 1 -- 172.21.15.28:0/3931472256 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a4812aae0 con 0x7f0a4812dc90 2024-03-20T13:34:43.003 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f0e7bfff640 1 -- 172.21.15.28:0/4269555763 >> v1:172.21.15.28:6789/0 conn(0x7f0e7c097f00 legacy=0x7f0e7c0982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f0e7bfff640 1 -- 172.21.15.28:0/4269555763 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e7c09a5c0 con 0x7f0e7c0989f0 2024-03-20T13:34:43.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7fee38982640 1 -- 172.21.15.28:0/342069217 >> v1:172.21.15.28:6789/0 conn(0x7fee34095020 legacy=0x7fee34095440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.004 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7fee38982640 1 -- 172.21.15.28:0/342069217 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee3412aae0 con 0x7fee3412af10 2024-03-20T13:34:43.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f4ace59c640 1 --2- 172.21.15.28:0/171935900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012dc90 0x7f4ad0130080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400b9c0 tx=0x7f4ac402df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=609350444ca9aaf6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f4acdd9b640 1 -- 172.21.15.28:0/171935900 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac402ec60 con 0x7f4ad012dc90 2024-03-20T13:34:43.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f4acdd9b640 1 -- 172.21.15.28:0/171935900 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac402edc0 con 0x7f4ad012dc90 2024-03-20T13:34:43.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.994+0000 7f4acdd9b640 1 -- 172.21.15.28:0/171935900 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac4036590 con 0x7f4ad012dc90 2024-03-20T13:34:43.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0e7bfff640 1 --2- 172.21.15.28:0/4269555763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c0989f0 0x7f0e7c1331d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e680097f0 tx=0x7f0e6802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50be64f544b428e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.005 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0a45d9b640 1 --2- 172.21.15.28:0/3931472256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812dc90 0x7f0a48130080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0097f0 tx=0x7f0a3c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd6aa737949d3ed server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0e7b7fe640 1 -- 172.21.15.28:0/4269555763 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e68030790 con 0x7f0e7c0989f0 2024-03-20T13:34:43.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0e7b7fe640 1 -- 172.21.15.28:0/4269555763 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e680308f0 con 0x7f0e7c0989f0 2024-03-20T13:34:43.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0e7b7fe640 1 -- 172.21.15.28:0/4269555763 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e68030bb0 con 0x7f0e7c0989f0 2024-03-20T13:34:43.006 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7fee38982640 1 --2- 172.21.15.28:0/342069217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee3412af10 0x7fee3412b2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee280097f0 tx=0x7fee2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd284879cabe307c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0a4559a640 1 -- 172.21.15.28:0/3931472256 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c0317a0 con 0x7f0a4812dc90 2024-03-20T13:34:43.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0a4559a640 1 -- 172.21.15.28:0/3931472256 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a3c031900 con 0x7f0a4812dc90 2024-03-20T13:34:43.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f0a4559a640 1 -- 172.21.15.28:0/3931472256 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a3c031bc0 con 0x7f0a4812dc90 2024-03-20T13:34:43.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7fee337fe640 1 -- 172.21.15.28:0/342069217 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee280317a0 con 0x7fee3412af10 2024-03-20T13:34:43.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7fee337fe640 1 -- 172.21.15.28:0/342069217 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee28031900 con 0x7fee3412af10 2024-03-20T13:34:43.007 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7fee337fe640 1 -- 172.21.15.28:0/342069217 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee28031bc0 con 0x7fee3412af10 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 -- 172.21.15.28:0/171935900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012dc90 msgr2=0x7f4ad0130080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 --2- 172.21.15.28:0/171935900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012dc90 0x7f4ad0130080 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ac400b9c0 tx=0x7f4ac402df80 comp rx=0 tx=0).stop 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 -- 172.21.15.28:0/171935900 shutdown_connections 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 --2- 172.21.15.28:0/171935900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012dc90 0x7f4ad0130080 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 -- 172.21.15.28:0/171935900 >> 172.21.15.28:0/171935900 conn(0x7f4ad009a050 msgr2=0x7f4ad009a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 -- 172.21.15.28:0/171935900 shutdown_connections 2024-03-20T13:34:43.008 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.995+0000 7f4ad500f640 1 -- 172.21.15.28:0/171935900 wait complete. 2024-03-20T13:34:43.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 -- 172.21.15.28:0/4269555763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c0989f0 msgr2=0x7f0e7c1331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3931472256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812dc90 msgr2=0x7f0a48130080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 --2- 172.21.15.28:0/4269555763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c0989f0 0x7f0e7c1331d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0e680097f0 tx=0x7f0e6802b9a0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 -- 172.21.15.28:0/4269555763 shutdown_connections 2024-03-20T13:34:43.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 --2- 172.21.15.28:0/4269555763 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c0989f0 0x7f0e7c1331d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.009 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 -- 172.21.15.28:0/4269555763 >> 172.21.15.28:0/4269555763 conn(0x7f0e7c09e640 msgr2=0x7f0e7c09ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3931472256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812dc90 0x7f0a48130080 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0097f0 tx=0x7f0a3c02b910 comp rx=0 tx=0).stop 2024-03-20T13:34:43.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 -- 172.21.15.28:0/4269555763 shutdown_connections 2024-03-20T13:34:43.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 -- 172.21.15.28:0/342069217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee3412af10 msgr2=0x7fee3412b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.010 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0e82d89640 1 -- 172.21.15.28:0/4269555763 wait complete. 2024-03-20T13:34:43.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 --2- 172.21.15.28:0/342069217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee3412af10 0x7fee3412b2f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fee280097f0 tx=0x7fee2802b910 comp rx=0 tx=0).stop 2024-03-20T13:34:43.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3931472256 shutdown_connections 2024-03-20T13:34:43.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3931472256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812dc90 0x7f0a48130080 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3931472256 >> 172.21.15.28:0/3931472256 conn(0x7f0a4809a050 msgr2=0x7f0a4809a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.011 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3931472256 shutdown_connections 2024-03-20T13:34:43.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 -- 172.21.15.28:0/342069217 shutdown_connections 2024-03-20T13:34:43.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 --2- 172.21.15.28:0/342069217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee3412af10 0x7fee3412b2f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 -- 172.21.15.28:0/342069217 >> 172.21.15.28:0/342069217 conn(0x7fee3409a050 msgr2=0x7fee3409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3931472256 wait complete. 2024-03-20T13:34:43.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 -- 172.21.15.28:0/342069217 shutdown_connections 2024-03-20T13:34:43.012 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.996+0000 7fee3abe6640 1 -- 172.21.15.28:0/342069217 wait complete. 2024-03-20T13:34:43.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4ad500f640 1 Processor -- start 2024-03-20T13:34:43.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4ad500f640 1 -- start start 2024-03-20T13:34:43.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f0e82d89640 1 Processor -- start 2024-03-20T13:34:43.013 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7fee3abe6640 1 Processor -- start 2024-03-20T13:34:43.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f0e82d89640 1 -- start start 2024-03-20T13:34:43.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7fee3abe6640 1 -- start start 2024-03-20T13:34:43.014 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f0a4cf0e640 1 Processor -- start 2024-03-20T13:34:43.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4ad500f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 0x7f4ad01be120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4ad500f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad012d7b0 con 0x7f4ad012af10 2024-03-20T13:34:43.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f0a4cf0e640 1 -- start start 2024-03-20T13:34:43.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4aced9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 0x7f4ad01be120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4aced9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 0x7f4ad01be120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48728/0 (socket says 172.21.15.28:48728) 2024-03-20T13:34:43.015 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.997+0000 7f4aced9d640 1 -- 172.21.15.28:0/1251469897 learned_addr learned my addr 172.21.15.28:0/1251469897 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7fee3abe6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 0x7fee34131cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0e82d89640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 0x7f0e7c127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.016 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0e82d89640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e7c12f940 con 0x7f0e7c097f00 2024-03-20T13:34:43.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0a4cf0e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 0x7f0a481c05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0a4cf0e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4806e140 con 0x7f0a4812af10 2024-03-20T13:34:43.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7fee3abe6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee34091be0 con 0x7fee34095020 2024-03-20T13:34:43.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0e80b25640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 0x7f0e7c127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.017 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f4aced9d640 1 -- 172.21.15.28:0/1251469897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ac400b6a0 con 0x7f4ad012af10 2024-03-20T13:34:43.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0e80b25640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 0x7f0e7c127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48736/0 (socket says 172.21.15.28:48736) 2024-03-20T13:34:43.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0e80b25640 1 -- 172.21.15.28:0/1807302418 learned_addr learned my addr 172.21.15.28:0/1807302418 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0a4659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 0x7f0a481c05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.018 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7fee38982640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 0x7fee34131cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0a4659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 0x7f0a481c05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48738/0 (socket says 172.21.15.28:48738) 2024-03-20T13:34:43.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0a4659c640 1 -- 172.21.15.28:0/3865900001 learned_addr learned my addr 172.21.15.28:0/3865900001 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7fee38982640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 0x7fee34131cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48732/0 (socket says 172.21.15.28:48732) 2024-03-20T13:34:43.019 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7fee38982640 1 -- 172.21.15.28:0/314093391 learned_addr learned my addr 172.21.15.28:0/314093391 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0e80b25640 1 -- 172.21.15.28:0/1807302418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e680094d0 con 0x7f0e7c097f00 2024-03-20T13:34:43.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.998+0000 7f0a4659c640 1 -- 172.21.15.28:0/3865900001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0094d0 con 0x7f0a4812af10 2024-03-20T13:34:43.020 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0e80b25640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 0x7f0e7c127780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c450 tx=0x7f0e7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f4aced9d640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 0x7f4ad01be120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000c3e0 tx=0x7f4ac000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0a4659c640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 0x7f0a481c05f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c450 tx=0x7f0a3800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.021 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0005bf0 con 0x7f4ad012af10 2024-03-20T13:34:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad0124bb0 con 0x7f4ad012af10 2024-03-20T13:34:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7fee38982640 1 -- 172.21.15.28:0/314093391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280094d0 con 0x7fee34095020 2024-03-20T13:34:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7fee38982640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 0x7fee34131cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee280097f0 tx=0x7fee280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.022 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad006e740 con 0x7f4ad012af10 2024-03-20T13:34:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee2803ad00 con 0x7fee34095020 2024-03-20T13:34:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a38005200 con 0x7f0a4812af10 2024-03-20T13:34:43.023 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a38005380 con 0x7f0a4812af10 2024-03-20T13:34:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee34091930 con 0x7fee34095020 2024-03-20T13:34:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2803ae60 con 0x7fee34095020 2024-03-20T13:34:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee28044520 con 0x7fee34095020 2024-03-20T13:34:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee34092090 con 0x7fee34095020 2024-03-20T13:34:43.024 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e70005200 con 0x7f0e7c097f00 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70005380 con 0x7f0e7c097f00 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0e700035f0 con 0x7f0e7c097f00 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e7c130e00 con 0x7f0e7c097f00 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:42.999+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e7c12fe20 con 0x7f0e7c097f00 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac0005d50 con 0x7f4ad012af10 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ac0005bf0 con 0x7f4ad012af10 2024-03-20T13:34:43.025 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0e7c09a9f0 con 0x7f0e7c097f00 2024-03-20T13:34:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4ab0000f80 con 0x7f4ad012af10 2024-03-20T13:34:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0a380035f0 con 0x7f0a4812af10 2024-03-20T13:34:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4806d060 con 0x7f0a4812af10 2024-03-20T13:34:43.026 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.000+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a48124ee0 con 0x7f0a4812af10 2024-03-20T13:34:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4ac0007070 con 0x7f4ad012af10 2024-03-20T13:34:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0e70003750 con 0x7f0e7c097f00 2024-03-20T13:34:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fee14000f80 con 0x7fee34095020 2024-03-20T13:34:43.027 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fee2804d450 con 0x7fee34095020 2024-03-20T13:34:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f4ab77fe640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4abc037f30 0x7f4abc03a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f4ac001a520 con 0x7f4ad012af10 2024-03-20T13:34:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e797fa640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0e60037f40 0x7f0e6003a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0e70049e40 con 0x7f0e7c097f00 2024-03-20T13:34:43.028 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f4ab77fe640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7f4abc03dee0 0x7f4abc040380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4abc040a50 con 0x7f4abc03dee0 2024-03-20T13:34:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e797fa640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f0e6003d6c0 0x7f0e6003fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0e600401d0 con 0x7f0e6003d6c0 2024-03-20T13:34:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0e7004c3e0 con 0x7f0e7c097f00 2024-03-20T13:34:43.029 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0a4806c250 con 0x7f0a4812af10 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee317fa640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee18037ef0 0x7fee1803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fee2802d040 con 0x7fee34095020 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee317fa640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee1803d670 0x7fee1803fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fee18040180 con 0x7fee1803d670 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7fee28072500 con 0x7fee34095020 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ac00108f0 con 0x7f4ad012af10 2024-03-20T13:34:43.030 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0a38003750 con 0x7f0a4812af10 2024-03-20T13:34:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.001+0000 7f0e7bfff640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0e60037f40 0x7f0e6003a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0e81326640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f0e6003d6c0 0x7f0e6003fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.031 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7fee39183640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee1803d670 0x7fee1803fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0a36ffd640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0a28037f70 0x7f0a2803a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0a38049d70 con 0x7f0a4812af10 2024-03-20T13:34:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0a36ffd640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f0a2803d6f0 0x7f0a2803fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0a28040200 con 0x7f0a2803d6f0 2024-03-20T13:34:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=15) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a3804c2a0 con 0x7f0a4812af10 2024-03-20T13:34:43.032 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7fee39183640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee1803d670 0x7fee1803fab0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0e7bfff640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0e60037f40 0x7f0e6003a400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e68036000 tx=0x7f0e6803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f0e81326640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f0e6003d6c0 0x7f0e6003fb00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.002+0000 7f4ace59c640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4abc037f30 0x7f4abc03a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.033 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.003+0000 7f4acf59e640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7f4abc03dee0 0x7f4abc040380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.003+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fee18040180 con 0x7fee1803d670 2024-03-20T13:34:43.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.003+0000 7fee33fff640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee18037ef0 0x7fee1803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.003+0000 7f0a45d9b640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0a28037f70 0x7f0a2803a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.034 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.003+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0e600401d0 con 0x7f0e6003d6c0 2024-03-20T13:34:43.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.003+0000 7f0a46d9d640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f0a2803d6f0 0x7f0a2803fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.004+0000 7f4acf59e640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7f4abc03dee0 0x7f4abc040380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.035 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.004+0000 7f4ace59c640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4abc037f30 0x7f4abc03a3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4038000 tx=0x7f4ac4032000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.004+0000 7fee33fff640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee18037ef0 0x7fee1803a3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fee20000f60 tx=0x7fee20007a30 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.005+0000 7f0a45d9b640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0a28037f70 0x7f0a2803a430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c036000 tx=0x7f0a3c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.005+0000 7f0a46d9d640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f0a2803d6f0 0x7f0a2803fb30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.006+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f4abc040a50 con 0x7f4abc03dee0 2024-03-20T13:34:43.036 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.006+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f0a28040200 con 0x7f0a2803d6f0 2024-03-20T13:34:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.018+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fee14002bd0 con 0x7fee1803d670 2024-03-20T13:34:43.037 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.018+0000 7fee317fa640 1 -- 172.21.15.28:0/314093391 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fee14002bd0 con 0x7fee1803d670 2024-03-20T13:34:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.018+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee1803d670 msgr2=0x7fee1803fab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.018+0000 7fee3abe6640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee1803d670 0x7fee1803fab0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.018+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee18037ef0 msgr2=0x7fee1803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee18037ef0 0x7fee1803a3b0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fee20000f60 tx=0x7fee20007a30 comp rx=0 tx=0).stop 2024-03-20T13:34:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 msgr2=0x7fee34131cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.038 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 0x7fee34131cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fee280097f0 tx=0x7fee280046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0e7c09a350 con 0x7f0e6003d6c0 2024-03-20T13:34:43.039 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 shutdown_connections 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee1803d670 0x7fee1803fab0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee18037ef0 0x7fee1803a3b0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 --2- 172.21.15.28:0/314093391 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee34095020 0x7fee34131cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 >> 172.21.15.28:0/314093391 conn(0x7fee3409a050 msgr2=0x7fee34092490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 shutdown_connections 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.019+0000 7fee3abe6640 1 -- 172.21.15.28:0/314093391 wait complete. 2024-03-20T13:34:43.040 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e797fa640 1 -- 172.21.15.28:0/1807302418 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0e74011040 con 0x7f0e6003d6c0 2024-03-20T13:34:43.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f0e6003d6c0 msgr2=0x7f0e6003fb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f0e6003d6c0 0x7f0e6003fb00 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.041 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0e60037f40 msgr2=0x7f0e6003a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0e60037f40 0x7f0e6003a400 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0e68036000 tx=0x7f0e6803b040 comp rx=0 tx=0).stop 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 msgr2=0x7f0e7c127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 0x7f0e7c127780 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0e7000c450 tx=0x7f0e7000c910 comp rx=0 tx=0).stop 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 shutdown_connections 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f0e6003d6c0 0x7f0e6003fb00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0e60037f40 0x7f0e6003a400 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 --2- 172.21.15.28:0/1807302418 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e7c097f00 0x7f0e7c127780 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 >> 172.21.15.28:0/1807302418 conn(0x7f0e7c09e640 msgr2=0x7f0e7c096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 shutdown_connections 2024-03-20T13:34:43.042 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f0e82d89640 1 -- 172.21.15.28:0/1807302418 wait complete. 2024-03-20T13:34:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.020+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4ab0002bd0 con 0x7f4abc03dee0 2024-03-20T13:34:43.043 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.021+0000 7f4ab77fe640 1 -- 172.21.15.28:0/1251469897 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4ab0002bd0 con 0x7f4abc03dee0 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7f4abc03dee0 msgr2=0x7f4abc040380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7f4abc03dee0 0x7f4abc040380 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4abc037f30 msgr2=0x7f4abc03a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4abc037f30 0x7f4abc03a3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4038000 tx=0x7f4ac4032000 comp rx=0 tx=0).stop 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 msgr2=0x7f4ad01be120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 0x7f4ad01be120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4ac000c3e0 tx=0x7f4ac000c8a0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 shutdown_connections 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7f4abc03dee0 0x7f4abc040380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4abc037f30 0x7f4abc03a3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 --2- 172.21.15.28:0/1251469897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ad012af10 0x7f4ad01be120 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.044 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 >> 172.21.15.28:0/1251469897 conn(0x7f4ad009a050 msgr2=0x7f4ad0128760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0a48072220 con 0x7f0a2803d6f0 2024-03-20T13:34:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 shutdown_connections 2024-03-20T13:34:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.022+0000 7f4ad500f640 1 -- 172.21.15.28:0/1251469897 wait complete. 2024-03-20T13:34:43.045 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.023+0000 7f0a36ffd640 1 -- 172.21.15.28:0/3865900001 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0a48072220 con 0x7f0a2803d6f0 2024-03-20T13:34:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.023+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f0a2803d6f0 msgr2=0x7f0a2803fb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.046 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.023+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f0a2803d6f0 0x7f0a2803fb30 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.023+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0a28037f70 msgr2=0x7f0a2803a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.023+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0a28037f70 0x7f0a2803a430 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c036000 tx=0x7f0a3c008030 comp rx=0 tx=0).stop 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 msgr2=0x7f0a481c05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 0x7f0a481c05f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a3800c450 tx=0x7f0a3800c910 comp rx=0 tx=0).stop 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 shutdown_connections 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f0a2803d6f0 0x7f0a2803fb30 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0a28037f70 0x7f0a2803a430 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 --2- 172.21.15.28:0/3865900001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0a4812af10 0x7f0a481c05f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 >> 172.21.15.28:0/3865900001 conn(0x7f0a4809a050 msgr2=0x7f0a48128760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 shutdown_connections 2024-03-20T13:34:43.047 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.024+0000 7f0a4cf0e640 1 -- 172.21.15.28:0/3865900001 wait complete. 2024-03-20T13:34:43.048 INFO:teuthology.orchestra.run.smithi028.stdout:38654705669 2024-03-20T13:34:43.048 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-20T13:34:43.049 INFO:teuthology.orchestra.run.smithi028.stdout:38654705667 2024-03-20T13:34:43.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-20T13:34:43.050 INFO:teuthology.orchestra.run.smithi028.stdout:42949672965 2024-03-20T13:34:43.050 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-20T13:34:43.051 INFO:teuthology.orchestra.run.smithi028.stdout:42949672966 2024-03-20T13:34:43.051 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-20T13:34:43.194 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7fb04bf82640 1 Processor -- start 2024-03-20T13:34:43.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7ff953ac1640 1 Processor -- start 2024-03-20T13:34:43.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7f09eab8f640 1 Processor -- start 2024-03-20T13:34:43.195 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7f0dca97b640 1 Processor -- start 2024-03-20T13:34:43.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7fb04bf82640 1 -- start start 2024-03-20T13:34:43.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7f09eab8f640 1 -- start start 2024-03-20T13:34:43.196 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7f0dca97b640 1 -- start start 2024-03-20T13:34:43.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.193+0000 7ff953ac1640 1 -- start start 2024-03-20T13:34:43.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb04bf82640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0440989f0 0x7fb0441331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb04bf82640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb04406bdf0 con 0x7fb044097f00 2024-03-20T13:34:43.197 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb04bf82640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0440672c0 con 0x7fb0440989f0 2024-03-20T13:34:43.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09eab8f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f09e4098a60 0x7f09e4098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09eab8f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09e409a2e0 con 0x7f09e4099380 2024-03-20T13:34:43.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09eab8f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09e409aa50 con 0x7f09e4098a60 2024-03-20T13:34:43.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb049d1e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb044097f00 0x7fb0440982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59076/0 (socket says 172.21.15.28:59076) 2024-03-20T13:34:43.198 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb049d1e640 1 -- 172.21.15.28:0/3593379022 learned_addr learned my addr 172.21.15.28:0/3593379022 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:43.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f09e4099380 0x7f09e412bad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59088/0 (socket says 172.21.15.28:59088) 2024-03-20T13:34:43.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e3fff640 1 -- 172.21.15.28:0/2884847200 learned_addr learned my addr 172.21.15.28:0/2884847200 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:43.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e892b640 1 --2- 172.21.15.28:0/2884847200 >> v2:172.21.15.28:3300/0 conn(0x7f09e4098a60 0x7f09e4098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.199 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f0dca97b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0dc4097f00 0x7f0dc40982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb04951d640 1 --2- 172.21.15.28:0/3593379022 >> v2:172.21.15.28:3300/0 conn(0x7fb0440989f0 0x7fb0441331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f0dca97b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0dc406bdf0 con 0x7f0dc4098820 2024-03-20T13:34:43.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f0dca97b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40672c0 con 0x7f0dc4097f00 2024-03-20T13:34:43.200 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f0dc3fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0dc4097f00 0x7f0dc40982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e37fe640 1 -- 172.21.15.28:0/2884847200 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3263603395 0 0) 0x7f09e409a2e0 con 0x7f09e4099380 2024-03-20T13:34:43.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f0dc37fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0dc4098820 0x7f0dc412deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59092/0 (socket says 172.21.15.28:59092) 2024-03-20T13:34:43.201 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f0dc37fe640 1 -- 172.21.15.28:0/1820435835 learned_addr learned my addr 172.21.15.28:0/1820435835 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:43.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e37fe640 1 -- 172.21.15.28:0/2884847200 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09cc003520 con 0x7f09e4099380 2024-03-20T13:34:43.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e892b640 1 -- 172.21.15.28:0/2884847200 >> v1:172.21.15.28:6789/0 conn(0x7f09e4099380 legacy=0x7f09e412bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7f09e892b640 1 -- 172.21.15.28:0/2884847200 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09e409dce0 con 0x7f09e4098a60 2024-03-20T13:34:43.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7ff953ac1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff94c071b10 0x7ff94c071ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.202 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7ff953ac1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff94c06bdf0 con 0x7ff94c072430 2024-03-20T13:34:43.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb048d1c640 1 -- 172.21.15.28:0/3593379022 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711102522 0 0) 0x7fb04406bdf0 con 0x7fb044097f00 2024-03-20T13:34:43.203 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7ff953ac1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff94c06c0c0 con 0x7ff94c071b10 2024-03-20T13:34:43.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.194+0000 7fb048d1c640 1 -- 172.21.15.28:0/3593379022 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb030003520 con 0x7fb044097f00 2024-03-20T13:34:43.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7f0dc3fff640 1 -- 172.21.15.28:0/1820435835 >> v1:172.21.15.28:6789/0 conn(0x7f0dc4098820 legacy=0x7f0dc412deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.204 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7f0dc3fff640 1 -- 172.21.15.28:0/1820435835 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc409a5c0 con 0x7f0dc4097f00 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95105c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff94c072430 0x7ff94c12dd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59098/0 (socket says 172.21.15.28:59098) 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95105c640 1 -- 172.21.15.28:0/2296799649 learned_addr learned my addr 172.21.15.28:0/2296799649 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95185d640 1 --2- 172.21.15.28:0/2296799649 >> v2:172.21.15.28:3300/0 conn(0x7ff94c071b10 0x7ff94c071ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95085b640 1 -- 172.21.15.28:0/2296799649 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1785504445 0 0) 0x7ff94c06bdf0 con 0x7ff94c072430 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95085b640 1 -- 172.21.15.28:0/2296799649 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff938003520 con 0x7ff94c072430 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95185d640 1 -- 172.21.15.28:0/2296799649 >> v1:172.21.15.28:6789/0 conn(0x7ff94c072430 legacy=0x7ff94c12dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.205 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7ff95185d640 1 -- 172.21.15.28:0/2296799649 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff94c09a5e0 con 0x7ff94c071b10 2024-03-20T13:34:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7fb04951d640 1 -- 172.21.15.28:0/3593379022 >> v1:172.21.15.28:6789/0 conn(0x7fb044097f00 legacy=0x7fb0440982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7fb04951d640 1 -- 172.21.15.28:0/3593379022 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb04409a5c0 con 0x7fb0440989f0 2024-03-20T13:34:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.195+0000 7f09e892b640 1 --2- 172.21.15.28:0/2884847200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e4098e40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009720 tx=0x7f09d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc42eb3fe9f0fff server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f09e37fe640 1 -- 172.21.15.28:0/2884847200 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09d402e070 con 0x7f09e4098a60 2024-03-20T13:34:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f09e37fe640 1 -- 172.21.15.28:0/2884847200 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d40316d0 con 0x7f09e4098a60 2024-03-20T13:34:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f09e37fe640 1 -- 172.21.15.28:0/2884847200 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09d402e070 con 0x7f09e4098a60 2024-03-20T13:34:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7ff95185d640 1 --2- 172.21.15.28:0/2296799649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c071ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff948009720 tx=0x7ff94802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16fb62e548466011 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7fb04951d640 1 --2- 172.21.15.28:0/3593379022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0440989f0 0x7fb0441331d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb034009720 tx=0x7fb03402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff865df79f08c34 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f0dc3fff640 1 --2- 172.21.15.28:0/1820435835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc40982e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009720 tx=0x7f0db402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83ea85cf2445edb1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7ff95085b640 1 -- 172.21.15.28:0/2296799649 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff948031760 con 0x7ff94c071b10 2024-03-20T13:34:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7fb048d1c640 1 -- 172.21.15.28:0/3593379022 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb034031760 con 0x7fb0440989f0 2024-03-20T13:34:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7ff95085b640 1 -- 172.21.15.28:0/2296799649 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9480318c0 con 0x7ff94c071b10 2024-03-20T13:34:43.208 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7ff95085b640 1 -- 172.21.15.28:0/2296799649 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff948031b60 con 0x7ff94c071b10 2024-03-20T13:34:43.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7fb048d1c640 1 -- 172.21.15.28:0/3593379022 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0340318c0 con 0x7fb0440989f0 2024-03-20T13:34:43.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7fb048d1c640 1 -- 172.21.15.28:0/3593379022 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb034031b60 con 0x7fb0440989f0 2024-03-20T13:34:43.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f0dc2ffd640 1 -- 172.21.15.28:0/1820435835 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db402e070 con 0x7f0dc4097f00 2024-03-20T13:34:43.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f0dc2ffd640 1 -- 172.21.15.28:0/1820435835 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db40316d0 con 0x7f0dc4097f00 2024-03-20T13:34:43.209 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f0dc2ffd640 1 -- 172.21.15.28:0/1820435835 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db4031990 con 0x7f0dc4097f00 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 -- 172.21.15.28:0/2296799649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 msgr2=0x7ff94c071ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 --2- 172.21.15.28:0/2296799649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c071ef0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff948009720 tx=0x7ff94802b8d0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f09eab8f640 1 -- 172.21.15.28:0/2884847200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 msgr2=0x7f09e4098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.196+0000 7f09eab8f640 1 --2- 172.21.15.28:0/2884847200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e4098e40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f09d4009720 tx=0x7f09d402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f09eab8f640 1 -- 172.21.15.28:0/2884847200 shutdown_connections 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f09eab8f640 1 --2- 172.21.15.28:0/2884847200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e4098e40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f09eab8f640 1 -- 172.21.15.28:0/2884847200 >> 172.21.15.28:0/2884847200 conn(0x7f09e409c210 msgr2=0x7f09e4071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.210 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f09eab8f640 1 -- 172.21.15.28:0/2884847200 shutdown_connections 2024-03-20T13:34:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 -- 172.21.15.28:0/2296799649 shutdown_connections 2024-03-20T13:34:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f09eab8f640 1 -- 172.21.15.28:0/2884847200 wait complete. 2024-03-20T13:34:43.211 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 --2- 172.21.15.28:0/2296799649 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c071ef0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 -- 172.21.15.28:0/2296799649 >> 172.21.15.28:0/2296799649 conn(0x7ff94c09d790 msgr2=0x7ff94c099c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 -- 172.21.15.28:0/2296799649 shutdown_connections 2024-03-20T13:34:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7ff953ac1640 1 -- 172.21.15.28:0/2296799649 wait complete. 2024-03-20T13:34:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7fb04bf82640 1 -- 172.21.15.28:0/3593379022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0440989f0 msgr2=0x7fb0441331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f0dca97b640 1 -- 172.21.15.28:0/1820435835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 msgr2=0x7f0dc40982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.212 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f0dca97b640 1 --2- 172.21.15.28:0/1820435835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc40982e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f0db4009720 tx=0x7f0db402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7fb04bf82640 1 --2- 172.21.15.28:0/3593379022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0440989f0 0x7fb0441331d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb034009720 tx=0x7fb03402b8d0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7fb04bf82640 1 -- 172.21.15.28:0/3593379022 shutdown_connections 2024-03-20T13:34:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f0dca97b640 1 -- 172.21.15.28:0/1820435835 shutdown_connections 2024-03-20T13:34:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f0dca97b640 1 --2- 172.21.15.28:0/1820435835 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc40982e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.213 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f0dca97b640 1 -- 172.21.15.28:0/1820435835 >> 172.21.15.28:0/1820435835 conn(0x7f0dc409e640 msgr2=0x7f0dc409ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7fb04bf82640 1 --2- 172.21.15.28:0/3593379022 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0440989f0 0x7fb0441331d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7fb04bf82640 1 -- 172.21.15.28:0/3593379022 >> 172.21.15.28:0/3593379022 conn(0x7fb04409e640 msgr2=0x7fb04409ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.197+0000 7f0dca97b640 1 -- 172.21.15.28:0/1820435835 shutdown_connections 2024-03-20T13:34:43.214 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7fb04bf82640 1 -- 172.21.15.28:0/3593379022 shutdown_connections 2024-03-20T13:34:43.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f0dca97b640 1 -- 172.21.15.28:0/1820435835 wait complete. 2024-03-20T13:34:43.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09eab8f640 1 Processor -- start 2024-03-20T13:34:43.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09eab8f640 1 -- start start 2024-03-20T13:34:43.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7ff953ac1640 1 Processor -- start 2024-03-20T13:34:43.215 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7fb04bf82640 1 -- 172.21.15.28:0/3593379022 wait complete. 2024-03-20T13:34:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7ff953ac1640 1 -- start start 2024-03-20T13:34:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09eab8f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e412f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.216 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f0dca97b640 1 Processor -- start 2024-03-20T13:34:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09eab8f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09e4114ec0 con 0x7f09e4098a60 2024-03-20T13:34:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7ff953ac1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c12a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7ff953ac1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94c0940a0 con 0x7ff94c071b10 2024-03-20T13:34:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09e892b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e412f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.217 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09e892b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e412f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48802/0 (socket says 172.21.15.28:48802) 2024-03-20T13:34:43.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.198+0000 7f09e892b640 1 -- 172.21.15.28:0/2943901500 learned_addr learned my addr 172.21.15.28:0/2943901500 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f0dca97b640 1 -- start start 2024-03-20T13:34:43.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7ff95185d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c12a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.218 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09e892b640 1 -- 172.21.15.28:0/2943901500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09d4009400 con 0x7f09e4098a60 2024-03-20T13:34:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7ff95185d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c12a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48808/0 (socket says 172.21.15.28:48808) 2024-03-20T13:34:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7ff95185d640 1 -- 172.21.15.28:0/2719685600 learned_addr learned my addr 172.21.15.28:0/2719685600 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09e892b640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e412f970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f09d402b880 tx=0x7f09d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7fb04bf82640 1 Processor -- start 2024-03-20T13:34:43.219 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7fb04bf82640 1 -- start start 2024-03-20T13:34:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7ff95185d640 1 -- 172.21.15.28:0/2719685600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff948009400 con 0x7ff94c071b10 2024-03-20T13:34:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09d402e070 con 0x7f09e4098a60 2024-03-20T13:34:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09d40326c0 con 0x7f09e4098a60 2024-03-20T13:34:43.220 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09e4132bd0 con 0x7f09e4098a60 2024-03-20T13:34:43.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f0dca97b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc406c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f09d4032980 con 0x7f09e4098a60 2024-03-20T13:34:43.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.199+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09e4132480 con 0x7f09e4098a60 2024-03-20T13:34:43.221 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7f0dc3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc406c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7f0dc3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc406c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48818/0 (socket says 172.21.15.28:48818) 2024-03-20T13:34:43.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7fb04bf82640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 0x7fb04412ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7fb04bf82640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb044130dd0 con 0x7fb044097f00 2024-03-20T13:34:43.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7f0dc3fff640 1 -- 172.21.15.28:0/1079029135 learned_addr learned my addr 172.21.15.28:0/1079029135 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.222 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc406f430 con 0x7f0dc4097f00 2024-03-20T13:34:43.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7ff95185d640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c12a380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff94802b910 tx=0x7ff9480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7f0dc3fff640 1 -- 172.21.15.28:0/1079029135 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0db4009400 con 0x7f0dc4097f00 2024-03-20T13:34:43.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7f0dc3fff640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc406c4e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0db40316a0 tx=0x7f0db40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.223 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7fb049d1e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 0x7fb04412ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7fb049d1e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 0x7fb04412ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48830/0 (socket says 172.21.15.28:48830) 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7fb049d1e640 1 -- 172.21.15.28:0/1379416396 learned_addr learned my addr 172.21.15.28:0/1379416396 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff948004460 con 0x7ff94c071b10 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff948003610 con 0x7ff94c071b10 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9480038b0 con 0x7ff94c071b10 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff94c12b620 con 0x7ff94c071b10 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.200+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94c129700 con 0x7ff94c071b10 2024-03-20T13:34:43.224 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f09d4032ae0 con 0x7f09e4098a60 2024-03-20T13:34:43.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7fb049d1e640 1 -- 172.21.15.28:0/1379416396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb034009400 con 0x7fb044097f00 2024-03-20T13:34:43.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f09e17fa640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f09d0037f40 0x7f09d003a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09e4132720 con 0x7f09e4098a60 2024-03-20T13:34:43.225 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f09d406c700 con 0x7f09e4098a60 2024-03-20T13:34:43.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7fb049d1e640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 0x7fb04412ef80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c480 tx=0x7fb04000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db4032830 con 0x7f0dc4097f00 2024-03-20T13:34:43.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0db40329b0 con 0x7f0dc4097f00 2024-03-20T13:34:43.226 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0db4032c90 con 0x7f0dc4097f00 2024-03-20T13:34:43.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc4099a10 con 0x7f0dc4097f00 2024-03-20T13:34:43.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.202+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc406ecc0 con 0x7f0dc4097f00 2024-03-20T13:34:43.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.202+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff94c06cf80 con 0x7ff94c071b10 2024-03-20T13:34:43.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.202+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff948003a10 con 0x7ff94c071b10 2024-03-20T13:34:43.227 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.201+0000 7f09e3fff640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f09d0037f40 0x7f09d003a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.202+0000 7ff9427fc640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff930037f40 0x7ff93003a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.202+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7ff94806c6f0 con 0x7ff94c071b10 2024-03-20T13:34:43.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.202+0000 7ff95105c640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff930037f40 0x7ff93003a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.228 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.203+0000 7f09e3fff640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f09d0037f40 0x7f09d003a400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f09d8001610 tx=0x7f09d8007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.203+0000 7ff95105c640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff930037f40 0x7ff93003a400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff94c072830 tx=0x7ff93c007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.203+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc40627b0 con 0x7f0dc4097f00 2024-03-20T13:34:43.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.206+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb040005c10 con 0x7fb044097f00 2024-03-20T13:34:43.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.206+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb044127860 con 0x7fb044097f00 2024-03-20T13:34:43.229 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.206+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f09e4132720 con 0x7f09e4098a60 2024-03-20T13:34:43.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.206+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0441310e0 con 0x7fb044097f00 2024-03-20T13:34:43.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.207+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb044130490 con 0x7fb044097f00 2024-03-20T13:34:43.230 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.211+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff94c06cf80 con 0x7ff94c071b10 2024-03-20T13:34:43.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.211+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb040005d70 con 0x7fb044097f00 2024-03-20T13:34:43.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.211+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb0400071a0 con 0x7fb044097f00 2024-03-20T13:34:43.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.211+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0db404d3f0 con 0x7f0dc4097f00 2024-03-20T13:34:43.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.211+0000 7f0dc0ff9640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0db0037f90 0x7f0db003a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.231 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.211+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f0db406c8a0 con 0x7f0dc4097f00 2024-03-20T13:34:43.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.212+0000 7f0dc37fe640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0db0037f90 0x7f0db003a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.212+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb040007300 con 0x7fb044097f00 2024-03-20T13:34:43.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.212+0000 7fb03a7fc640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb028037ef0 0x7fb02803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:43.232 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.212+0000 7f0dc37fe640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0db0037f90 0x7f0db003a450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000f60 tx=0x7f0db8007a80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.212+0000 7fb04951d640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb028037ef0 0x7fb02803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:43.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.213+0000 7fb04951d640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb028037ef0 0x7fb02803a3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb034036000 tx=0x7fb034008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:43.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.216+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fb040010e30 con 0x7fb044097f00 2024-03-20T13:34:43.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.216+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f0db403b3f0 con 0x7f0dc4097f00 2024-03-20T13:34:43.233 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.224+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb040010c00 con 0x7fb044097f00 2024-03-20T13:34:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.392+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09e4130c10 con 0x7f09e4098a60 2024-03-20T13:34:43.393 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.392+0000 7f09e17fa640 1 -- 172.21.15.28:0/2943901500 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f09d4039ba0 con 0x7f09e4098a60 2024-03-20T13:34:43.393 INFO:teuthology.orchestra.run.smithi028.stdout:42949672965 2024-03-20T13:34:43.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f09d0037f40 msgr2=0x7f09d003a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f09d0037f40 0x7f09d003a400 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f09d8001610 tx=0x7f09d8007970 comp rx=0 tx=0).stop 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 msgr2=0x7f09e412f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e412f970 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f09d402b880 tx=0x7f09d40046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 shutdown_connections 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f09d0037f40 0x7f09d003a400 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 --2- 172.21.15.28:0/2943901500 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f09e4098a60 0x7f09e412f970 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 >> 172.21.15.28:0/2943901500 conn(0x7f09e409c210 msgr2=0x7f09e406dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 shutdown_connections 2024-03-20T13:34:43.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.395+0000 7f09eab8f640 1 -- 172.21.15.28:0/2943901500 wait complete. 2024-03-20T13:34:43.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.398+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff94c06cf80 con 0x7ff94c071b10 2024-03-20T13:34:43.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.398+0000 7ff9427fc640 1 -- 172.21.15.28:0/2719685600 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff94c06cf80 con 0x7ff94c071b10 2024-03-20T13:34:43.399 INFO:teuthology.orchestra.run.smithi028.stdout:42949672964 2024-03-20T13:34:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff930037f40 msgr2=0x7ff93003a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff930037f40 0x7ff93003a400 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff94c072830 tx=0x7ff93c007970 comp rx=0 tx=0).stop 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 msgr2=0x7ff94c12a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c12a380 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff94802b910 tx=0x7ff9480046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 shutdown_connections 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff930037f40 0x7ff93003a400 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 --2- 172.21.15.28:0/2719685600 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff94c071b10 0x7ff94c12a380 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 >> 172.21.15.28:0/2719685600 conn(0x7ff94c09d790 msgr2=0x7ff94c122220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 shutdown_connections 2024-03-20T13:34:43.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.400+0000 7ff953ac1640 1 -- 172.21.15.28:0/2719685600 wait complete. 2024-03-20T13:34:43.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.403+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0dc4073050 con 0x7f0dc4097f00 2024-03-20T13:34:43.404 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.403+0000 7f0dc0ff9640 1 -- 172.21.15.28:0/1079029135 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0db40302f0 con 0x7f0dc4097f00 2024-03-20T13:34:43.404 INFO:teuthology.orchestra.run.smithi028.stdout:38654705666 2024-03-20T13:34:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0db0037f90 msgr2=0x7f0db003a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0db0037f90 0x7f0db003a450 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f0db8000f60 tx=0x7f0db8007a80 comp rx=0 tx=0).stop 2024-03-20T13:34:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 msgr2=0x7f0dc406c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc406c4e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0db40316a0 tx=0x7f0db40046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 shutdown_connections 2024-03-20T13:34:43.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0db0037f90 0x7f0db003a450 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 --2- 172.21.15.28:0/1079029135 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0dc4097f00 0x7f0dc406c4e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 >> 172.21.15.28:0/1079029135 conn(0x7f0dc409e640 msgr2=0x7f0dc4096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 shutdown_connections 2024-03-20T13:34:43.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.406+0000 7f0dca97b640 1 -- 172.21.15.28:0/1079029135 wait complete. 2024-03-20T13:34:43.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672965 for osd.2 2024-03-20T13:34:43.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.409+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb0440627b0 con 0x7fb044097f00 2024-03-20T13:34:43.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.409+0000 7fb03a7fc640 1 -- 172.21.15.28:0/1379416396 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb040045020 con 0x7fb044097f00 2024-03-20T13:34:43.411 INFO:teuthology.orchestra.run.smithi028.stdout:38654705668 2024-03-20T13:34:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb028037ef0 msgr2=0x7fb02803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb028037ef0 0x7fb02803a3b0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb034036000 tx=0x7fb034008030 comp rx=0 tx=0).stop 2024-03-20T13:34:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 msgr2=0x7fb04412ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 0x7fb04412ef80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb04000c480 tx=0x7fb04000c940 comp rx=0 tx=0).stop 2024-03-20T13:34:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 shutdown_connections 2024-03-20T13:34:43.413 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb028037ef0 0x7fb02803a3b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 --2- 172.21.15.28:0/1379416396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb044097f00 0x7fb04412ef80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 >> 172.21.15.28:0/1379416396 conn(0x7fb04409e640 msgr2=0x7fb044096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 shutdown_connections 2024-03-20T13:34:43.414 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:43.411+0000 7fb04bf82640 1 -- 172.21.15.28:0/1379416396 wait complete. 2024-03-20T13:34:43.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672964 for osd.1 2024-03-20T13:34:43.420 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705666 for osd.3 2024-03-20T13:34:43.423 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-03-20T13:34:44.411 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-20T13:34:44.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-20T13:34:44.421 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-20T13:34:44.424 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-20T13:34:44.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.530+0000 7fbd275af640 1 Processor -- start 2024-03-20T13:34:44.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.530+0000 7fbd275af640 1 -- start start 2024-03-20T13:34:44.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.530+0000 7fbd275af640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbd200989f0 0x7fbd201331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.530+0000 7fbd275af640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd2006bdf0 con 0x7fbd20097f00 2024-03-20T13:34:44.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.531+0000 7fbd275af640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200672c0 con 0x7fbd200989f0 2024-03-20T13:34:44.533 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.531+0000 7fbd24b4a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbd200989f0 0x7fbd201331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.531+0000 7fbd2534b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fbd20097f00 0x7fbd200982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59110/0 (socket says 172.21.15.28:59110) 2024-03-20T13:34:44.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.531+0000 7fbd2534b640 1 -- 172.21.15.28:0/1563822377 learned_addr learned my addr 172.21.15.28:0/1563822377 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:44.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.531+0000 7fbd24b4a640 1 -- 172.21.15.28:0/1563822377 >> v1:172.21.15.28:6789/0 conn(0x7fbd20097f00 legacy=0x7fbd200982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.534 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.531+0000 7fbd24b4a640 1 -- 172.21.15.28:0/1563822377 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2009a5c0 con 0x7fbd200989f0 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.532+0000 7fbd24b4a640 1 --2- 172.21.15.28:0/1563822377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd200989f0 0x7fbd201331d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009720 tx=0x7fbd1002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db7916986796521 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.532+0000 7fbd17fff640 1 -- 172.21.15.28:0/1563822377 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd10031760 con 0x7fbd200989f0 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.532+0000 7fbd17fff640 1 -- 172.21.15.28:0/1563822377 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd100318c0 con 0x7fbd200989f0 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.532+0000 7fbd17fff640 1 -- 172.21.15.28:0/1563822377 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd10031b80 con 0x7fbd200989f0 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 -- 172.21.15.28:0/1563822377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd200989f0 msgr2=0x7fbd201331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 --2- 172.21.15.28:0/1563822377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd200989f0 0x7fbd201331d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009720 tx=0x7fbd1002b8d0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 -- 172.21.15.28:0/1563822377 shutdown_connections 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 --2- 172.21.15.28:0/1563822377 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd200989f0 0x7fbd201331d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 -- 172.21.15.28:0/1563822377 >> 172.21.15.28:0/1563822377 conn(0x7fbd2009e640 msgr2=0x7fbd2009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.540 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 -- 172.21.15.28:0/1563822377 shutdown_connections 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.533+0000 7fbd275af640 1 -- 172.21.15.28:0/1563822377 wait complete. 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd275af640 1 Processor -- start 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd275af640 1 -- start start 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd275af640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 0x7fbd20127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd275af640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd2012f940 con 0x7fbd20097f00 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd2534b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 0x7fbd20127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd2534b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 0x7fbd20127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48848/0 (socket says 172.21.15.28:48848) 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.535+0000 7fbd2534b640 1 -- 172.21.15.28:0/1583086708 learned_addr learned my addr 172.21.15.28:0/1583086708 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.536+0000 7fbd2534b640 1 -- 172.21.15.28:0/1583086708 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd10009400 con 0x7fbd20097f00 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.536+0000 7fbd2534b640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 0x7fbd20127780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c4a0 tx=0x7fbd1c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.536+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c005c10 con 0x7fbd20097f00 2024-03-20T13:34:44.541 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.536+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1c005d70 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.536+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd20130e00 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.536+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1c0071a0 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.537+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd2012fe20 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.538+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd1c007300 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.538+0000 7fbd15ffb640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04037ef0 0x7fbd0403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.538+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fbd1c04e170 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.538+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd201300f0 con 0x7fbd20097f00 2024-03-20T13:34:44.542 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.538+0000 7fbd24b4a640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04037ef0 0x7fbd0403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.543 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.539+0000 7fbd24b4a640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04037ef0 0x7fbd0403a3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd10036000 tx=0x7fbd10008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.544 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.543+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fbd1c04f060 con 0x7fbd20097f00 2024-03-20T13:34:44.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.568+0000 7fa057081640 1 Processor -- start 2024-03-20T13:34:44.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.568+0000 7fa057081640 1 -- start start 2024-03-20T13:34:44.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.568+0000 7f986ef54640 1 Processor -- start 2024-03-20T13:34:44.570 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f986ef54640 1 -- start start 2024-03-20T13:34:44.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa057081640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa0500989f0 0x7fa0501331d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa057081640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05006bdf0 con 0x7fa050097f00 2024-03-20T13:34:44.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa057081640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0500672c0 con 0x7fa0500989f0 2024-03-20T13:34:44.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa04ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa0500989f0 0x7fa0501331d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.571 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa054e1d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa050097f00 0x7fa0500982e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59114/0 (socket says 172.21.15.28:59114) 2024-03-20T13:34:44.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f986ef54640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f98680668e0 0x7f986806cb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa04ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa0500989f0 0x7fa0501331d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48858/0 (socket says 172.21.15.28:48858) 2024-03-20T13:34:44.572 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa054e1d640 1 -- 172.21.15.28:0/525376428 learned_addr learned my addr 172.21.15.28:0/525376428 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f986ef54640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9868066fe0 con 0x7f986806d040 2024-03-20T13:34:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f986ef54640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9868071c80 con 0x7f98680668e0 2024-03-20T13:34:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f9867fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f986806d040 0x7f986806d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59130/0 (socket says 172.21.15.28:59130) 2024-03-20T13:34:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f9867fff640 1 -- 172.21.15.28:0/2848162265 learned_addr learned my addr 172.21.15.28:0/2848162265 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:44.573 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7f986ccf0640 1 --2- 172.21.15.28:0/2848162265 >> v2:172.21.15.28:3300/0 conn(0x7f98680668e0 0x7f986806cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa04ffff640 1 -- 172.21.15.28:0/525376428 >> v1:172.21.15.28:6789/0 conn(0x7fa050097f00 legacy=0x7fa0500982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.569+0000 7fa04ffff640 1 -- 172.21.15.28:0/525376428 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05009a5c0 con 0x7fa0500989f0 2024-03-20T13:34:44.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.570+0000 7f986ccf0640 1 -- 172.21.15.28:0/2848162265 >> v1:172.21.15.28:6789/0 conn(0x7f986806d040 legacy=0x7f986806d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.574 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.570+0000 7f986ccf0640 1 -- 172.21.15.28:0/2848162265 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f986806e780 con 0x7f98680668e0 2024-03-20T13:34:44.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.570+0000 7fa04ffff640 1 --2- 172.21.15.28:0/525376428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0500989f0 0x7fa0501331d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009720 tx=0x7fa03c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a70d0e69f835705 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.570+0000 7fa04f7fe640 1 -- 172.21.15.28:0/525376428 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa03c031760 con 0x7fa0500989f0 2024-03-20T13:34:44.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.570+0000 7fa04f7fe640 1 -- 172.21.15.28:0/525376428 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03c0318c0 con 0x7fa0500989f0 2024-03-20T13:34:44.575 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.570+0000 7fa04f7fe640 1 -- 172.21.15.28:0/525376428 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa03c031b80 con 0x7fa0500989f0 2024-03-20T13:34:44.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7f986ccf0640 1 --2- 172.21.15.28:0/2848162265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98680668e0 0x7f986806cb00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f985c009720 tx=0x7f985c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8b25cc3690a49c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7f98677fe640 1 -- 172.21.15.28:0/2848162265 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f985c02e070 con 0x7f98680668e0 2024-03-20T13:34:44.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7f98677fe640 1 -- 172.21.15.28:0/2848162265 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c0316d0 con 0x7f98680668e0 2024-03-20T13:34:44.576 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7f98677fe640 1 -- 172.21.15.28:0/2848162265 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f985c031990 con 0x7f98680668e0 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 -- 172.21.15.28:0/525376428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0500989f0 msgr2=0x7fa0501331d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 --2- 172.21.15.28:0/525376428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0500989f0 0x7fa0501331d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009720 tx=0x7fa03c02b8d0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 -- 172.21.15.28:0/525376428 shutdown_connections 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 --2- 172.21.15.28:0/525376428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa0500989f0 0x7fa0501331d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 -- 172.21.15.28:0/525376428 >> 172.21.15.28:0/525376428 conn(0x7fa05009e640 msgr2=0x7fa05009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 -- 172.21.15.28:0/525376428 shutdown_connections 2024-03-20T13:34:44.577 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7fa057081640 1 -- 172.21.15.28:0/525376428 wait complete. 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7f986ef54640 1 -- 172.21.15.28:0/2848162265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98680668e0 msgr2=0x7f986806cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.571+0000 7f986ef54640 1 --2- 172.21.15.28:0/2848162265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98680668e0 0x7f986806cb00 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f985c009720 tx=0x7f985c02b840 comp rx=0 tx=0).stop 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 -- 172.21.15.28:0/2848162265 shutdown_connections 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 --2- 172.21.15.28:0/2848162265 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98680668e0 0x7f986806cb00 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 -- 172.21.15.28:0/2848162265 >> 172.21.15.28:0/2848162265 conn(0x7f986809c8d0 msgr2=0x7f986809cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 -- 172.21.15.28:0/2848162265 shutdown_connections 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 -- 172.21.15.28:0/2848162265 wait complete. 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7fa057081640 1 Processor -- start 2024-03-20T13:34:44.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7fa057081640 1 -- start start 2024-03-20T13:34:44.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 Processor -- start 2024-03-20T13:34:44.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.572+0000 7f986ef54640 1 -- start start 2024-03-20T13:34:44.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7fa057081640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 0x7fa050127780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7fa057081640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05012f940 con 0x7fa050097f00 2024-03-20T13:34:44.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7fa054e1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 0x7fa050127780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7f986ef54640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 0x7f986812e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7fa054e1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 0x7fa050127780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48864/0 (socket says 172.21.15.28:48864) 2024-03-20T13:34:44.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7fa054e1d640 1 -- 172.21.15.28:0/3524890474 learned_addr learned my addr 172.21.15.28:0/3524890474 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:44.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7f986ef54640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9868096030 con 0x7f986806d040 2024-03-20T13:34:44.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7f986ccf0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 0x7f986812e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7f986ccf0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 0x7f986812e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48866/0 (socket says 172.21.15.28:48866) 2024-03-20T13:34:44.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7f986ccf0640 1 -- 172.21.15.28:0/4003377743 learned_addr learned my addr 172.21.15.28:0/4003377743 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:44.582 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.573+0000 7fa054e1d640 1 -- 172.21.15.28:0/3524890474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c009400 con 0x7fa050097f00 2024-03-20T13:34:44.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7f986ccf0640 1 -- 172.21.15.28:0/4003377743 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c009400 con 0x7f986806d040 2024-03-20T13:34:44.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7fa054e1d640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 0x7fa050127780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c4a0 tx=0x7fa04400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.583 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa044005c10 con 0x7fa050097f00 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa050130e00 con 0x7fa050097f00 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05012fe20 con 0x7fa050097f00 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa044005d70 con 0x7fa050097f00 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa0440071a0 con 0x7fa050097f00 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7f986ccf0640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 0x7f986812e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f985c034040 tx=0x7f985c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f985c0327f0 con 0x7f986806d040 2024-03-20T13:34:44.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986812f170 con 0x7f986806d040 2024-03-20T13:34:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.574+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985c032950 con 0x7f986806d040 2024-03-20T13:34:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.575+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9868095260 con 0x7f986806d040 2024-03-20T13:34:44.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.575+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0501300f0 con 0x7fa050097f00 2024-03-20T13:34:44.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.575+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f985c032bf0 con 0x7f986806d040 2024-03-20T13:34:44.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.575+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa044007300 con 0x7fa050097f00 2024-03-20T13:34:44.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.575+0000 7fa04d7fa640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa034037ef0 0x7fa03403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.576+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fa04404d250 con 0x7fa050097f00 2024-03-20T13:34:44.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.576+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f985c032d50 con 0x7f986806d040 2024-03-20T13:34:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.576+0000 7f98657fa640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f984c037ef0 0x7f984c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.576+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f985c06cdd0 con 0x7f986806d040 2024-03-20T13:34:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.576+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98680627b0 con 0x7f986806d040 2024-03-20T13:34:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.576+0000 7f9867fff640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f984c037ef0 0x7f984c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.577+0000 7fa04ffff640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa034037ef0 0x7fa03403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.577+0000 7f9867fff640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f984c037ef0 0x7f984c03a3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9854007fd0 tx=0x7f9854007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.577+0000 7fa04ffff640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa034037ef0 0x7fa03403a3b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa03c036000 tx=0x7fa03c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.581+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa044010c20 con 0x7fa050097f00 2024-03-20T13:34:44.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.582+0000 7fdb721cb640 1 Processor -- start 2024-03-20T13:34:44.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.582+0000 7fdb721cb640 1 -- start start 2024-03-20T13:34:44.590 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.583+0000 7fdb721cb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb6c12c030 0x7fdb6c12c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.583+0000 7fdb721cb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6c09a960 con 0x7fdb6c098a60 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.583+0000 7fdb721cb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb6c071cd0 con 0x7fdb6c12c030 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.583+0000 7fdb6affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdb6c098a60 0x7fdb6c098e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59134/0 (socket says 172.21.15.28:59134) 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.583+0000 7fdb6affd640 1 -- 172.21.15.28:0/144226697 learned_addr learned my addr 172.21.15.28:0/144226697 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.583+0000 7fdb6b7fe640 1 --2- 172.21.15.28:0/144226697 >> v2:172.21.15.28:3300/0 conn(0x7fdb6c12c030 0x7fdb6c12c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.584+0000 7fdb6b7fe640 1 -- 172.21.15.28:0/144226697 >> v1:172.21.15.28:6789/0 conn(0x7fdb6c098a60 legacy=0x7fdb6c098e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.584+0000 7fdb6b7fe640 1 -- 172.21.15.28:0/144226697 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6c072340 con 0x7fdb6c12c030 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.585+0000 7fdb6b7fe640 1 --2- 172.21.15.28:0/144226697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c12c030 0x7fdb6c12c410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009980 tx=0x7fdb5c02baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8a3cb95d0bdc6b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.587+0000 7fdb6a7fc640 1 -- 172.21.15.28:0/144226697 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb5c02d580 con 0x7fdb6c12c030 2024-03-20T13:34:44.591 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.587+0000 7fdb6a7fc640 1 -- 172.21.15.28:0/144226697 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c02d6e0 con 0x7fdb6c12c030 2024-03-20T13:34:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.587+0000 7fdb6a7fc640 1 -- 172.21.15.28:0/144226697 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb5c02d9a0 con 0x7fdb6c12c030 2024-03-20T13:34:44.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.587+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f985c04ee40 con 0x7f986806d040 2024-03-20T13:34:44.594 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.587+0000 7fdb721cb640 1 -- 172.21.15.28:0/144226697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c12c030 msgr2=0x7fdb6c12c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.587+0000 7fdb721cb640 1 --2- 172.21.15.28:0/144226697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c12c030 0x7fdb6c12c410 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c009980 tx=0x7fdb5c02baa0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.588+0000 7fdb721cb640 1 -- 172.21.15.28:0/144226697 shutdown_connections 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.588+0000 7fdb721cb640 1 --2- 172.21.15.28:0/144226697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c12c030 0x7fdb6c12c410 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.588+0000 7fdb721cb640 1 -- 172.21.15.28:0/144226697 >> 172.21.15.28:0/144226697 conn(0x7fdb6c09c840 msgr2=0x7fdb6c071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.588+0000 7fdb721cb640 1 -- 172.21.15.28:0/144226697 shutdown_connections 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.588+0000 7fdb721cb640 1 -- 172.21.15.28:0/144226697 wait complete. 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb721cb640 1 Processor -- start 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb721cb640 1 -- start start 2024-03-20T13:34:44.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb721cb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 0x7fdb6c116680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb721cb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6c118dd0 con 0x7fdb6c098a60 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb6b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 0x7fdb6c116680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb6b7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 0x7fdb6c116680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48882/0 (socket says 172.21.15.28:48882) 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.589+0000 7fdb6b7fe640 1 -- 172.21.15.28:0/2218224440 learned_addr learned my addr 172.21.15.28:0/2218224440 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb6b7fe640 1 -- 172.21.15.28:0/2218224440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb5c009400 con 0x7fdb6c098a60 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb6b7fe640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 0x7fdb6c116680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c02bae0 tx=0x7fdb5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb5c003740 con 0x7fdb6c098a60 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c0038c0 con 0x7fdb6c098a60 2024-03-20T13:34:44.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdb5c003ba0 con 0x7fdb6c098a60 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb6c119e40 con 0x7fdb6c098a60 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.590+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb6c12b020 con 0x7fdb6c098a60 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.591+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdb5c003d00 con 0x7fdb6c098a60 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.591+0000 7fdb53fff640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdb5803c300 0x7fdb5803e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.591+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7fdb5c03e070 con 0x7fdb6c098a60 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.592+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb6c12b020 con 0x7fdb6c098a60 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.592+0000 7fdb6affd640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdb5803c300 0x7fdb5803e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.597 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.592+0000 7fdb6affd640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdb5803c300 0x7fdb5803e7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb60007fd0 tx=0x7fdb60007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.598 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.596+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fdb6c12b020 con 0x7fdb6c098a60 2024-03-20T13:34:44.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.744+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fbd200627b0 con 0x7fbd20097f00 2024-03-20T13:34:44.745 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.744+0000 7fbd15ffb640 1 -- 172.21.15.28:0/1583086708 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd1c0192c0 con 0x7fbd20097f00 2024-03-20T13:34:44.745 INFO:teuthology.orchestra.run.smithi028.stdout:42949672966 2024-03-20T13:34:44.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04037ef0 msgr2=0x7fbd0403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.748 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04037ef0 0x7fbd0403a3b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbd10036000 tx=0x7fbd10008030 comp rx=0 tx=0).stop 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 msgr2=0x7fbd20127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 0x7fbd20127780 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c4a0 tx=0x7fbd1c00c960 comp rx=0 tx=0).stop 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 shutdown_connections 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04037ef0 0x7fbd0403a3b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 --2- 172.21.15.28:0/1583086708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbd20097f00 0x7fbd20127780 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 >> 172.21.15.28:0/1583086708 conn(0x7fbd2009e640 msgr2=0x7fbd20096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 shutdown_connections 2024-03-20T13:34:44.749 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.747+0000 7fbd275af640 1 -- 172.21.15.28:0/1583086708 wait complete. 2024-03-20T13:34:44.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672966 got 42949672966 for osd.2 2024-03-20T13:34:44.763 DEBUG:teuthology.parallel:result is None 2024-03-20T13:34:44.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.781+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb6c12b020 con 0x7fdb6c098a60 2024-03-20T13:34:44.782 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.781+0000 7fdb53fff640 1 -- 172.21.15.28:0/2218224440 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb6c12b020 con 0x7fdb6c098a60 2024-03-20T13:34:44.782 INFO:teuthology.orchestra.run.smithi028.stdout:42949672965 2024-03-20T13:34:44.784 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdb5803c300 msgr2=0x7fdb5803e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdb5803c300 0x7fdb5803e7c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fdb60007fd0 tx=0x7fdb60007ac0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 msgr2=0x7fdb6c116680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 0x7fdb6c116680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c02bae0 tx=0x7fdb5c0046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 shutdown_connections 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdb5803c300 0x7fdb5803e7c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 --2- 172.21.15.28:0/2218224440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb6c098a60 0x7fdb6c116680 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 >> 172.21.15.28:0/2218224440 conn(0x7fdb6c09c840 msgr2=0x7fdb6c1b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 shutdown_connections 2024-03-20T13:34:44.785 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.783+0000 7fdb721cb640 1 -- 172.21.15.28:0/2218224440 wait complete. 2024-03-20T13:34:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.788+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9868130ea0 con 0x7f986806d040 2024-03-20T13:34:44.789 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.788+0000 7f98657fa640 1 -- 172.21.15.28:0/4003377743 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f985c03a380 con 0x7f986806d040 2024-03-20T13:34:44.790 INFO:teuthology.orchestra.run.smithi028.stdout:38654705669 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f984c037ef0 msgr2=0x7f984c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f984c037ef0 0x7f984c03a3b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9854007fd0 tx=0x7f9854007ac0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 msgr2=0x7f986812e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 0x7f986812e340 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f985c034040 tx=0x7f985c0046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 shutdown_connections 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f984c037ef0 0x7f984c03a3b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 --2- 172.21.15.28:0/4003377743 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f986806d040 0x7f986812e340 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.792 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.790+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 >> 172.21.15.28:0/4003377743 conn(0x7f986809c8d0 msgr2=0x7f9868133370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.791+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 shutdown_connections 2024-03-20T13:34:44.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.791+0000 7f986ef54640 1 -- 172.21.15.28:0/4003377743 wait complete. 2024-03-20T13:34:44.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.792+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fa0500627b0 con 0x7fa050097f00 2024-03-20T13:34:44.793 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.792+0000 7fa04d7fa640 1 -- 172.21.15.28:0/3524890474 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa044017020 con 0x7fa050097f00 2024-03-20T13:34:44.793 INFO:teuthology.orchestra.run.smithi028.stdout:38654705667 2024-03-20T13:34:44.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.794+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa034037ef0 msgr2=0x7fa03403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.794+0000 7fa057081640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa034037ef0 0x7fa03403a3b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa03c036000 tx=0x7fa03c008030 comp rx=0 tx=0).stop 2024-03-20T13:34:44.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.794+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 msgr2=0x7fa050127780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.794+0000 7fa057081640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 0x7fa050127780 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c4a0 tx=0x7fa04400c960 comp rx=0 tx=0).stop 2024-03-20T13:34:44.796 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.795+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 shutdown_connections 2024-03-20T13:34:44.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.795+0000 7fa057081640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa034037ef0 0x7fa03403a3b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.795+0000 7fa057081640 1 --2- 172.21.15.28:0/3524890474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa050097f00 0x7fa050127780 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.797 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.795+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 >> 172.21.15.28:0/3524890474 conn(0x7fa05009e640 msgr2=0x7fa050096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.797 INFO:tasks.ceph.ceph_manager.ceph:need seq 42949672965 got 42949672965 for osd.1 2024-03-20T13:34:44.797 DEBUG:teuthology.parallel:result is None 2024-03-20T13:34:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.795+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 shutdown_connections 2024-03-20T13:34:44.798 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.795+0000 7fa057081640 1 -- 172.21.15.28:0/3524890474 wait complete. 2024-03-20T13:34:44.804 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-03-20T13:34:44.804 DEBUG:teuthology.parallel:result is None 2024-03-20T13:34:44.807 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705667 got 38654705667 for osd.3 2024-03-20T13:34:44.807 DEBUG:teuthology.parallel:result is None 2024-03-20T13:34:44.807 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-20T13:34:44.807 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:34:44.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.947+0000 7f23368d3640 1 Processor -- start 2024-03-20T13:34:44.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.947+0000 7f23368d3640 1 -- start start 2024-03-20T13:34:44.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f23368d3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f233006dc20 0x7f23301332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f23368d3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f233009dc60 con 0x7f233006d130 2024-03-20T13:34:44.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f23368d3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f233009b510 con 0x7f233006dc20 2024-03-20T13:34:44.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f232f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f233006dc20 0x7f23301332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f232ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f233006d130 0x7f233006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59140/0 (socket says 172.21.15.28:59140) 2024-03-20T13:34:44.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f232ffff640 1 -- 172.21.15.28:0/645798438 learned_addr learned my addr 172.21.15.28:0/645798438 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:44.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f232f7fe640 1 -- 172.21.15.28:0/645798438 >> v1:172.21.15.28:6789/0 conn(0x7f233006d130 legacy=0x7f233006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.948+0000 7f232f7fe640 1 -- 172.21.15.28:0/645798438 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233009bfd0 con 0x7f233006dc20 2024-03-20T13:34:44.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f232f7fe640 1 --2- 172.21.15.28:0/645798438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006dc20 0x7f23301332a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2324009720 tx=0x7f232402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0be36516cca2a8b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f232effd640 1 -- 172.21.15.28:0/645798438 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f232402e070 con 0x7f233006dc20 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f232effd640 1 -- 172.21.15.28:0/645798438 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23240316d0 con 0x7f233006dc20 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f232effd640 1 -- 172.21.15.28:0/645798438 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2324031990 con 0x7f233006dc20 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 -- 172.21.15.28:0/645798438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006dc20 msgr2=0x7f23301332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 --2- 172.21.15.28:0/645798438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006dc20 0x7f23301332a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2324009720 tx=0x7f232402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 -- 172.21.15.28:0/645798438 shutdown_connections 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 --2- 172.21.15.28:0/645798438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006dc20 0x7f23301332a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 -- 172.21.15.28:0/645798438 >> 172.21.15.28:0/645798438 conn(0x7f233009c210 msgr2=0x7f2330071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 -- 172.21.15.28:0/645798438 shutdown_connections 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.949+0000 7f23368d3640 1 -- 172.21.15.28:0/645798438 wait complete. 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.950+0000 7f23368d3640 1 Processor -- start 2024-03-20T13:34:44.952 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.950+0000 7f23368d3640 1 -- start start 2024-03-20T13:34:44.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f23368d3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 0x7f233012f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f23368d3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2330130d90 con 0x7f233006d130 2024-03-20T13:34:44.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 0x7f233012f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 0x7f233012f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48892/0 (socket says 172.21.15.28:48892) 2024-03-20T13:34:44.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232ffff640 1 -- 172.21.15.28:0/2758243586 learned_addr learned my addr 172.21.15.28:0/2758243586 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232ffff640 1 -- 172.21.15.28:0/2758243586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2324009400 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232ffff640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 0x7f233012f550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f232000c4a0 tx=0x7f232000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2320005c10 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2320005d70 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2330121840 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23200071a0 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.951+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2330122590 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.952+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2320007300 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.952+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23300627b0 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.952+0000 7f232cff9640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f231c037ef0 0x7f231c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.952+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f2320049d40 con 0x7f233006d130 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.953+0000 7f232f7fe640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f231c037ef0 0x7f231c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:44.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.953+0000 7f232f7fe640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f231c037ef0 0x7f231c03a3b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2324036000 tx=0x7f2324008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:44.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:44.957+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f23200198b0 con 0x7f233006d130 2024-03-20T13:34:45.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.132+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f23301211a0 con 0x7f231c037ef0 2024-03-20T13:34:45.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.133+0000 7f232cff9640 1 -- 172.21.15.28:0/2758243586 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34600 (secure 0 0 0) 0x7f23301211a0 con 0x7f231c037ef0 2024-03-20T13:34:45.135 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:45.135 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f231c037ef0 msgr2=0x7f231c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f231c037ef0 0x7f231c03a3b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2324036000 tx=0x7f2324008030 comp rx=0 tx=0).stop 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 msgr2=0x7f233012f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 0x7f233012f550 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f232000c4a0 tx=0x7f232000c960 comp rx=0 tx=0).stop 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 shutdown_connections 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f231c037ef0 0x7f231c03a3b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 --2- 172.21.15.28:0/2758243586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f233006d130 0x7f233012f550 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 >> 172.21.15.28:0/2758243586 conn(0x7f233009c210 msgr2=0x7f2330118d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:45.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 shutdown_connections 2024-03-20T13:34:45.138 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.135+0000 7f23368d3640 1 -- 172.21.15.28:0/2758243586 wait complete. 2024-03-20T13:34:45.147 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-03-20T13:34:43.137799+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113888,"kb_used_data":1640,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373472,"statfs":{"total":386547056640,"available":386430435328,"internally_reserved":0,"allocated":1679360,"data_stored":1326568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.242458"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.948824+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:34:41.948824+0000","last_peered":"2024-03-20T13:34:41.948824+0000","last_clean":"2024-03-20T13:34:41.948824+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:34:41.948824+0000","last_undegraded":"2024-03-20T13:34:41.948824+0000","last_fullsized":"2024-03-20T13:34:41.948824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:29:46.424197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905486+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:34:41.905486+0000","last_peered":"2024-03-20T13:34:41.905486+0000","last_clean":"2024-03-20T13:34:41.905486+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:34:41.905486+0000","last_undegraded":"2024-03-20T13:34:41.905486+0000","last_fullsized":"2024-03-20T13:34:41.905486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:13.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905496+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:34:41.905496+0000","last_peered":"2024-03-20T13:34:41.905496+0000","last_clean":"2024-03-20T13:34:41.905496+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:34:41.905496+0000","last_undegraded":"2024-03-20T13:34:41.905496+0000","last_fullsized":"2024-03-20T13:34:41.905496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:53:59.278771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905466+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:34:41.905466+0000","last_peered":"2024-03-20T13:34:41.905466+0000","last_clean":"2024-03-20T13:34:41.905466+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:34:41.905466+0000","last_undegraded":"2024-03-20T13:34:41.905466+0000","last_fullsized":"2024-03-20T13:34:41.905466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:24:54.200791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905496+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:34:41.905496+0000","last_peered":"2024-03-20T13:34:41.905496+0000","last_clean":"2024-03-20T13:34:41.905496+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:34:41.905496+0000","last_undegraded":"2024-03-20T13:34:41.905496+0000","last_fullsized":"2024-03-20T13:34:41.905496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-20T13:34:42.900488+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:34:42.900488+0000","last_peered":"2024-03-20T13:34:42.900488+0000","last_clean":"2024-03-20T13:34:42.900488+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:34:42.900488+0000","last_undegraded":"2024-03-20T13:34:42.900488+0000","last_fullsized":"2024-03-20T13:34:42.900488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905508+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:34:41.905508+0000","last_peered":"2024-03-20T13:34:41.905508+0000","last_clean":"2024-03-20T13:34:41.905508+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:34:41.905508+0000","last_undegraded":"2024-03-20T13:34:41.905508+0000","last_fullsized":"2024-03-20T13:34:41.905508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:35.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.904922+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:34:41.904922+0000","last_peered":"2024-03-20T13:34:41.904922+0000","last_clean":"2024-03-20T13:34:41.904922+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:34:41.904922+0000","last_undegraded":"2024-03-20T13:34:41.904922+0000","last_fullsized":"2024-03-20T13:34:41.904922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:13.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":166,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.946622+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:34:41.946622+0000","last_peered":"2024-03-20T13:34:41.946622+0000","last_clean":"2024-03-20T13:34:41.946622+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:34:41.946622+0000","last_undegraded":"2024-03-20T13:34:41.946622+0000","last_fullsized":"2024-03-20T13:34:41.946622+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:19.105808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672966,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":626826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672965,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":626826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":3,"up_from":9,"seq":38654705667,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":36458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":122880,"data_stored":36458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:34:45.148 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f3643ac1640 1 Processor -- start 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f3643ac1640 1 -- start start 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f3643ac1640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f363c0956a0 0x7f363c095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f3643ac1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f363c095270 con 0x7f363c127460 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f3643ac1640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f363c0954a0 con 0x7f363c0956a0 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f364185d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f363c0956a0 0x7f363c095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f364105c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f363c127460 0x7f363c127870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59152/0 (socket says 172.21.15.28:59152) 2024-03-20T13:34:45.250 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.248+0000 7f364105c640 1 -- 172.21.15.28:0/2970010877 learned_addr learned my addr 172.21.15.28:0/2970010877 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:45.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.249+0000 7f364185d640 1 -- 172.21.15.28:0/2970010877 >> v1:172.21.15.28:6789/0 conn(0x7f363c127460 legacy=0x7f363c127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.251 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.249+0000 7f364185d640 1 -- 172.21.15.28:0/2970010877 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f363c093d90 con 0x7f363c0956a0 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.249+0000 7f364185d640 1 --2- 172.21.15.28:0/2970010877 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c095a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3638009720 tx=0x7f363802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b082fb7a8c8f2328 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.249+0000 7f364085b640 1 -- 172.21.15.28:0/2970010877 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f363802e070 con 0x7f363c0956a0 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.249+0000 7f364085b640 1 -- 172.21.15.28:0/2970010877 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380316d0 con 0x7f363c0956a0 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f364085b640 1 -- 172.21.15.28:0/2970010877 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3638031990 con 0x7f363c0956a0 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 -- 172.21.15.28:0/2970010877 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 msgr2=0x7f363c095a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 --2- 172.21.15.28:0/2970010877 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c095a80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3638009720 tx=0x7f363802b840 comp rx=0 tx=0).stop 2024-03-20T13:34:45.253 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 -- 172.21.15.28:0/2970010877 shutdown_connections 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 --2- 172.21.15.28:0/2970010877 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c095a80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 -- 172.21.15.28:0/2970010877 >> 172.21.15.28:0/2970010877 conn(0x7f363c09a300 msgr2=0x7f363c09a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 -- 172.21.15.28:0/2970010877 shutdown_connections 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.250+0000 7f3643ac1640 1 -- 172.21.15.28:0/2970010877 wait complete. 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f3643ac1640 1 Processor -- start 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f3643ac1640 1 -- start start 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f3643ac1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c08aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f3643ac1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363c097f20 con 0x7f363c0956a0 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f364185d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c08aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f364185d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c08aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48922/0 (socket says 172.21.15.28:48922) 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.251+0000 7f364185d640 1 -- 172.21.15.28:0/653389881 learned_addr learned my addr 172.21.15.28:0/653389881 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f364185d640 1 -- 172.21.15.28:0/653389881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3638009400 con 0x7f363c0956a0 2024-03-20T13:34:45.254 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f364185d640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c08aa60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3638009840 tx=0x7f36380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36380328b0 con 0x7f363c0956a0 2024-03-20T13:34:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3638032a10 con 0x7f363c0956a0 2024-03-20T13:34:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363c08de00 con 0x7f363c0956a0 2024-03-20T13:34:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3638032cf0 con 0x7f363c0956a0 2024-03-20T13:34:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.252+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363c08d030 con 0x7f363c0956a0 2024-03-20T13:34:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.253+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f363804d3f0 con 0x7f363c0956a0 2024-03-20T13:34:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.253+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f363c08dc60 con 0x7f363c0956a0 2024-03-20T13:34:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.253+0000 7f36327fc640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3620037ef0 0x7f362003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.253+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f363806c6b0 con 0x7f363c0956a0 2024-03-20T13:34:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.254+0000 7f364105c640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3620037ef0 0x7f362003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.255+0000 7f364105c640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3620037ef0 0x7f362003a3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f362c007fd0 tx=0x7f362c007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.258 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.257+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f363c08dc60 con 0x7f363c0956a0 2024-03-20T13:34:45.435 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.434+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f363c093ba0 con 0x7f3620037ef0 2024-03-20T13:34:45.437 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.436+0000 7f36327fc640 1 -- 172.21.15.28:0/653389881 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+34576 (secure 0 0 0) 0x7f363c093ba0 con 0x7f3620037ef0 2024-03-20T13:34:45.437 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:45.438 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:34:45.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3620037ef0 msgr2=0x7f362003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3620037ef0 0x7f362003a3b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f362c007fd0 tx=0x7f362c007ac0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 msgr2=0x7f363c08aa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c08aa60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3638009840 tx=0x7f36380046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 shutdown_connections 2024-03-20T13:34:45.439 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3620037ef0 0x7f362003a3b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 --2- 172.21.15.28:0/653389881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f363c0956a0 0x7f363c08aa60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 >> 172.21.15.28:0/653389881 conn(0x7f363c09a300 msgr2=0x7f363c094160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:45.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 shutdown_connections 2024-03-20T13:34:45.440 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.438+0000 7f3643ac1640 1 -- 172.21.15.28:0/653389881 wait complete. 2024-03-20T13:34:45.449 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2024-03-20T13:34:45.138154+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":113892,"kb_used_data":1648,"kb_used_omap":6,"kb_used_meta":112185,"kb_avail":377373468,"statfs":{"total":386547056640,"available":386430431232,"internally_reserved":0,"allocated":1687552,"data_stored":1330588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":114878230},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.242813"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.948824+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:34:41.948824+0000","last_peered":"2024-03-20T13:34:41.948824+0000","last_clean":"2024-03-20T13:34:41.948824+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:34:41.948824+0000","last_undegraded":"2024-03-20T13:34:41.948824+0000","last_fullsized":"2024-03-20T13:34:41.948824+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:29:46.424197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905486+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:34:41.905486+0000","last_peered":"2024-03-20T13:34:41.905486+0000","last_clean":"2024-03-20T13:34:41.905486+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:34:41.905486+0000","last_undegraded":"2024-03-20T13:34:41.905486+0000","last_fullsized":"2024-03-20T13:34:41.905486+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:13.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905496+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:34:41.905496+0000","last_peered":"2024-03-20T13:34:41.905496+0000","last_clean":"2024-03-20T13:34:41.905496+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:34:41.905496+0000","last_undegraded":"2024-03-20T13:34:41.905496+0000","last_fullsized":"2024-03-20T13:34:41.905496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:53:59.278771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905466+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:34:41.905466+0000","last_peered":"2024-03-20T13:34:41.905466+0000","last_clean":"2024-03-20T13:34:41.905466+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:34:41.905466+0000","last_undegraded":"2024-03-20T13:34:41.905466+0000","last_fullsized":"2024-03-20T13:34:41.905466+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:24:54.200791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905496+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:34:41.905496+0000","last_peered":"2024-03-20T13:34:41.905496+0000","last_clean":"2024-03-20T13:34:41.905496+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:34:41.905496+0000","last_undegraded":"2024-03-20T13:34:41.905496+0000","last_fullsized":"2024-03-20T13:34:41.905496+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-20T13:34:42.900488+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:34:42.900488+0000","last_peered":"2024-03-20T13:34:42.900488+0000","last_clean":"2024-03-20T13:34:42.900488+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:34:42.900488+0000","last_undegraded":"2024-03-20T13:34:42.900488+0000","last_fullsized":"2024-03-20T13:34:42.900488+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.905508+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:34:41.905508+0000","last_peered":"2024-03-20T13:34:41.905508+0000","last_clean":"2024-03-20T13:34:41.905508+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:34:41.905508+0000","last_undegraded":"2024-03-20T13:34:41.905508+0000","last_fullsized":"2024-03-20T13:34:41.905508+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:35.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2024-03-20T13:34:41.904922+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:34:41.904922+0000","last_peered":"2024-03-20T13:34:41.904922+0000","last_clean":"2024-03-20T13:34:41.904922+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:34:41.904922+0000","last_undegraded":"2024-03-20T13:34:41.904922+0000","last_fullsized":"2024-03-20T13:34:41.904922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:13.960862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":168,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-03-20T13:34:43.977164+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:34:43.977164+0000","last_peered":"2024-03-20T13:34:43.977164+0000","last_clean":"2024-03-20T13:34:43.977164+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:34:43.977164+0000","last_undegraded":"2024-03-20T13:34:43.977164+0000","last_fullsized":"2024-03-20T13:34:43.977164+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:19.105808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672967,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27728,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344112,"statfs":{"total":96636764160,"available":96608370688,"internally_reserved":0,"allocated":724992,"data_stored":630846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672966,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27724,"kb_used_data":700,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344116,"statfs":{"total":96636764160,"available":96608374784,"internally_reserved":0,"allocated":716800,"data_stored":626826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]}]},{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27140,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344700,"statfs":{"total":96636764160,"available":96608972800,"internally_reserved":0,"allocated":122880,"data_stored":36458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31300,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340540,"statfs":{"total":96636764160,"available":96604712960,"internally_reserved":0,"allocated":122880,"data_stored":36458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:34:45.450 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-20T13:34:45.451 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-20T13:34:45.451 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-20T13:34:45.451 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-20T13:34:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.549+0000 7f411786e640 1 Processor -- start 2024-03-20T13:34:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.549+0000 7f411786e640 1 -- start start 2024-03-20T13:34:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f411786e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f411006dc20 0x7f41101332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f411786e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f411009bfd0 con 0x7f411006d130 2024-03-20T13:34:45.551 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f411786e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f411006f0e0 con 0x7f411006dc20 2024-03-20T13:34:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f4114e09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f411006dc20 0x7f41101332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f411560a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f411006d130 0x7f411006d510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:59156/0 (socket says 172.21.15.28:59156) 2024-03-20T13:34:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f411560a640 1 -- 172.21.15.28:0/1172094682 learned_addr learned my addr 172.21.15.28:0/1172094682 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:34:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f4114e09640 1 -- 172.21.15.28:0/1172094682 >> v1:172.21.15.28:6789/0 conn(0x7f411006d130 legacy=0x7f411006d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f4114e09640 1 -- 172.21.15.28:0/1172094682 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f411009dd20 con 0x7f411006dc20 2024-03-20T13:34:45.552 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.550+0000 7f410ffff640 1 -- 172.21.15.28:0/1172094682 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053422303 0 0) 0x7f411009bfd0 con 0x7f411006d130 2024-03-20T13:34:45.554 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f4114e09640 1 --2- 172.21.15.28:0/1172094682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006dc20 0x7f41101332a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4104009720 tx=0x7f410402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d201a4ca0bd0684b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f410ffff640 1 -- 172.21.15.28:0/1172094682 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410402e070 con 0x7f411006dc20 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f410ffff640 1 -- 172.21.15.28:0/1172094682 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41040316d0 con 0x7f411006dc20 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f410ffff640 1 -- 172.21.15.28:0/1172094682 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4104031990 con 0x7f411006dc20 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 -- 172.21.15.28:0/1172094682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006dc20 msgr2=0x7f41101332a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 --2- 172.21.15.28:0/1172094682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006dc20 0x7f41101332a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f4104009720 tx=0x7f410402b840 comp rx=0 tx=0).stop 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 -- 172.21.15.28:0/1172094682 shutdown_connections 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 --2- 172.21.15.28:0/1172094682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006dc20 0x7f41101332a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 -- 172.21.15.28:0/1172094682 >> 172.21.15.28:0/1172094682 conn(0x7f411009c210 msgr2=0x7f4110071350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 -- 172.21.15.28:0/1172094682 shutdown_connections 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.551+0000 7f411786e640 1 -- 172.21.15.28:0/1172094682 wait complete. 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.552+0000 7f411786e640 1 Processor -- start 2024-03-20T13:34:45.555 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.552+0000 7f411786e640 1 -- start start 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411786e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 0x7f411011f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411786e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4110122c80 con 0x7f411006d130 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411560a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 0x7f411011f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411560a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 0x7f411011f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48952/0 (socket says 172.21.15.28:48952) 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411560a640 1 -- 172.21.15.28:0/327314837 learned_addr learned my addr 172.21.15.28:0/327314837 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411560a640 1 -- 172.21.15.28:0/327314837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4104009400 con 0x7f411006d130 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411560a640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 0x7f411011f780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f410000c700 tx=0x7f410000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4100004d70 con 0x7f411006d130 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f410000a660 con 0x7f411006d130 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f410000a940 con 0x7f411006d130 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.553+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4110130da0 con 0x7f411006d130 2024-03-20T13:34:45.556 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.554+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41101216a0 con 0x7f411006d130 2024-03-20T13:34:45.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.554+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f410000aaa0 con 0x7f411006d130 2024-03-20T13:34:45.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.554+0000 7f410dffb640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f40fc037ef0 0x7f40fc03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.554+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f410004a190 con 0x7f411006d130 2024-03-20T13:34:45.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.554+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4110122dc0 con 0x7f411006d130 2024-03-20T13:34:45.557 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.555+0000 7f4114e09640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f40fc037ef0 0x7f40fc03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.558 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.555+0000 7f4114e09640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f40fc037ef0 0x7f40fc03a3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4104036000 tx=0x7f4104008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.560 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.559+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4100018030 con 0x7f411006d130 2024-03-20T13:34:45.775 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.774+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f41100627b0 con 0x7f411006d130 2024-03-20T13:34:45.776 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.775+0000 7f410dffb640 1 -- 172.21.15.28:0/327314837 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f4100018020 con 0x7f411006d130 2024-03-20T13:34:45.776 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:34:45.776 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-20T13:34:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f40fc037ef0 msgr2=0x7f40fc03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f40fc037ef0 0x7f40fc03a3b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4104036000 tx=0x7f4104008030 comp rx=0 tx=0).stop 2024-03-20T13:34:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 msgr2=0x7f411011f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 0x7f411011f780 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f410000c700 tx=0x7f410000cbc0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 shutdown_connections 2024-03-20T13:34:45.778 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f40fc037ef0 0x7f40fc03a3b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.776+0000 7f411786e640 1 --2- 172.21.15.28:0/327314837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f411006d130 0x7f411011f780 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.777+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 >> 172.21.15.28:0/327314837 conn(0x7f411009c210 msgr2=0x7f411009a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:45.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.777+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 shutdown_connections 2024-03-20T13:34:45.779 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:34:45.777+0000 7f411786e640 1 -- 172.21.15.28:0/327314837 wait complete. 2024-03-20T13:34:45.788 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-20T13:34:45.789 INFO:teuthology.run_tasks:Running task rgw... 2024-03-20T13:34:45.802 DEBUG:tasks.rgw:config is {'client.0': None} 2024-03-20T13:34:45.803 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-03-20T13:34:45.803 INFO:tasks.rgw:Creating data pools 2024-03-20T13:34:45.803 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-03-20T13:34:45.803 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-03-20T13:34:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.915+0000 7f9c80ac9640 1 Processor -- start 2024-03-20T13:34:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.915+0000 7f9c80ac9640 1 -- start start 2024-03-20T13:34:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.915+0000 7f9c80ac9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9c7c10f190 0x7f9c7c10ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.915+0000 7f9c80ac9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7c10e7a0 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.915+0000 7f9c80ac9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c7c10e930 con 0x7f9c7c10f190 2024-03-20T13:34:45.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.916+0000 7f9c7a59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9c7c10f190 0x7f9c7c10ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.916+0000 7f9c73fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9c7c10e2f0 0x7f9c7c1199c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:53218/0 (socket says 172.21.15.177:53218) 2024-03-20T13:34:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.916+0000 7f9c73fff640 1 -- 172.21.15.177:0/409672921 learned_addr learned my addr 172.21.15.177:0/409672921 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:34:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.916+0000 7f9c7a59c640 1 -- 172.21.15.177:0/409672921 >> v1:172.21.15.28:6789/0 conn(0x7f9c7c10e2f0 legacy=0x7f9c7c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.916+0000 7f9c7a59c640 1 -- 172.21.15.177:0/409672921 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7c10eaa0 con 0x7f9c7c10f190 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.917+0000 7f9c7a59c640 1 --2- 172.21.15.177:0/409672921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10f190 0x7f9c7c10ddb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009720 tx=0x7f9c6c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad6c30637e0ba657 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.917+0000 7f9c79d9b640 1 -- 172.21.15.177:0/409672921 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c02e070 con 0x7f9c7c10f190 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.917+0000 7f9c79d9b640 1 -- 172.21.15.177:0/409672921 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0316d0 con 0x7f9c7c10f190 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.917+0000 7f9c79d9b640 1 -- 172.21.15.177:0/409672921 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c031990 con 0x7f9c7c10f190 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 -- 172.21.15.177:0/409672921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10f190 msgr2=0x7f9c7c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 --2- 172.21.15.177:0/409672921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10f190 0x7f9c7c10ddb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009720 tx=0x7f9c6c02b840 comp rx=0 tx=0).stop 2024-03-20T13:34:45.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 -- 172.21.15.177:0/409672921 shutdown_connections 2024-03-20T13:34:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 --2- 172.21.15.177:0/409672921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10f190 0x7f9c7c10ddb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 -- 172.21.15.177:0/409672921 >> 172.21.15.177:0/409672921 conn(0x7f9c7c06e9f0 msgr2=0x7f9c7c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 -- 172.21.15.177:0/409672921 shutdown_connections 2024-03-20T13:34:45.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.918+0000 7f9c80ac9640 1 -- 172.21.15.177:0/409672921 wait complete. 2024-03-20T13:34:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c80ac9640 1 Processor -- start 2024-03-20T13:34:45.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c80ac9640 1 -- start start 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c80ac9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 0x7f9c7c1a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c80ac9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7c1a4370 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c7a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 0x7f9c7c1a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c7a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 0x7f9c7c1a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40562/0 (socket says 172.21.15.177:40562) 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c7a59c640 1 -- 172.21.15.177:0/4199564799 learned_addr learned my addr 172.21.15.177:0/4199564799 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.919+0000 7f9c7a59c640 1 -- 172.21.15.177:0/4199564799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c009400 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.920+0000 7f9c7a59c640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 0x7f9c7c1a3e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c034040 tx=0x7f9c6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.920+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c032830 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.920+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c032990 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.920+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c7c1a4570 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.920+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6c032c50 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.920+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c7c1a8660 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.921+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c6c04e450 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.921+0000 7f9c72ffd640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9c5c037ef0 0x7f9c5c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.921+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c7c0627b0 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.921+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3482+0+0 (secure 0 0 0) 0x7f9c6c06cc30 con 0x7f9c7c10e2f0 2024-03-20T13:34:45.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.921+0000 7f9c73fff640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9c5c037ef0 0x7f9c5c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:45.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.921+0000 7f9c73fff640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9c5c037ef0 0x7f9c5c03a3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c64007fd0 tx=0x7f9c64007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:45.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:45.926+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f9c6c032db0 con 0x7f9c7c10e2f0 2024-03-20T13:34:46.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.106+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f9c7c067570 con 0x7f9c7c10e2f0 2024-03-20T13:34:46.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.906+0000 7f9c72ffd640 1 -- 172.21.15.177:0/4199564799 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["k=2", "m=1", "crush-failure-domain=osd"]}]=0 v16) v1 ==== 151+0+0 (secure 0 0 0) 0x7f9c6c04c350 con 0x7f9c7c10e2f0 2024-03-20T13:34:46.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9c5c037ef0 msgr2=0x7f9c5c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:46.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9c5c037ef0 0x7f9c5c03a3b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c64007fd0 tx=0x7f9c64007ac0 comp rx=0 tx=0).stop 2024-03-20T13:34:46.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 msgr2=0x7f9c7c1a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 0x7f9c7c1a3e30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c034040 tx=0x7f9c6c0046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 shutdown_connections 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9c5c037ef0 0x7f9c5c03a3b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 --2- 172.21.15.177:0/4199564799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9c7c10e2f0 0x7f9c7c1a3e30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 >> 172.21.15.177:0/4199564799 conn(0x7f9c7c06e9f0 msgr2=0x7f9c7c1170b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 shutdown_connections 2024-03-20T13:34:46.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:46.908+0000 7f9c80ac9640 1 -- 172.21.15.177:0/4199564799 wait complete. 2024-03-20T13:34:46.922 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-03-20T13:34:47.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.028+0000 7f738e5cf640 1 Processor -- start 2024-03-20T13:34:47.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.028+0000 7f738e5cf640 1 -- start start 2024-03-20T13:34:47.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f738e5cf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f738811a370 0x7f738811c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f738e5cf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738811cd30 con 0x7f73881165c0 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f738e5cf640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738811def0 con 0x7f738811a370 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f73877fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f738811a370 0x7f738811c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f7387fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f73881165c0 0x7f73881169a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:53224/0 (socket says 172.21.15.177:53224) 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f73877fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f738811a370 0x7f738811c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40578/0 (socket says 172.21.15.177:40578) 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f7387fff640 1 -- 172.21.15.177:0/474671813 learned_addr learned my addr 172.21.15.177:0/474671813 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f73877fe640 1 -- 172.21.15.177:0/474671813 >> v1:172.21.15.28:6789/0 conn(0x7f73881165c0 legacy=0x7f73881169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:47.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.029+0000 7f73877fe640 1 -- 172.21.15.177:0/474671813 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738811e060 con 0x7f738811a370 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.030+0000 7f73877fe640 1 --2- 172.21.15.177:0/474671813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f738811a370 0x7f738811c760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f737c009720 tx=0x7f737c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b36a604d4c1f09b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.030+0000 7f7386ffd640 1 -- 172.21.15.177:0/474671813 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f737c02e070 con 0x7f738811a370 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.030+0000 7f7386ffd640 1 -- 172.21.15.177:0/474671813 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c0316d0 con 0x7f738811a370 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.030+0000 7f7386ffd640 1 -- 172.21.15.177:0/474671813 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f737c031990 con 0x7f738811a370 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 -- 172.21.15.177:0/474671813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f738811a370 msgr2=0x7f738811c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 --2- 172.21.15.177:0/474671813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f738811a370 0x7f738811c760 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f737c009720 tx=0x7f737c02b840 comp rx=0 tx=0).stop 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 -- 172.21.15.177:0/474671813 shutdown_connections 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 --2- 172.21.15.177:0/474671813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f738811a370 0x7f738811c760 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 -- 172.21.15.177:0/474671813 >> 172.21.15.177:0/474671813 conn(0x7f738806db50 msgr2=0x7f738806df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 -- 172.21.15.177:0/474671813 shutdown_connections 2024-03-20T13:34:47.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 -- 172.21.15.177:0/474671813 wait complete. 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.031+0000 7f738e5cf640 1 Processor -- start 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f738e5cf640 1 -- start start 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f738e5cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 0x7f73881abde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f738e5cf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73881ac3b0 con 0x7f73881165c0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f7387fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 0x7f73881abde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f7387fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 0x7f73881abde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40592/0 (socket says 172.21.15.177:40592) 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f7387fff640 1 -- 172.21.15.177:0/1332064894 learned_addr learned my addr 172.21.15.177:0/1332064894 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f7387fff640 1 -- 172.21.15.177:0/1332064894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009400 con 0x7f73881165c0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.032+0000 7f7387fff640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 0x7f73881abde0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f737800c480 tx=0x7f737800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.033+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7378005c10 con 0x7f73881165c0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.033+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73881ac5b0 con 0x7f73881165c0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.033+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7378005d70 con 0x7f73881165c0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.033+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7378007200 con 0x7f73881165c0 2024-03-20T13:34:47.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.033+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73881a5c60 con 0x7f73881165c0 2024-03-20T13:34:47.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.034+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73880627b0 con 0x7f73881165c0 2024-03-20T13:34:47.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.034+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7378007360 con 0x7f73881165c0 2024-03-20T13:34:47.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.034+0000 7f7384ff9640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7374037ea0 0x7f737403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:47.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.034+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3774+0+0 (secure 0 0 0) 0x7f7378049fa0 con 0x7f73881165c0 2024-03-20T13:34:47.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.034+0000 7f73877fe640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7374037ea0 0x7f737403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:47.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.034+0000 7f73877fe640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7374037ea0 0x7f737403a360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f737c036000 tx=0x7f737c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:47.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.039+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f737807d8c0 con 0x7f73881165c0 2024-03-20T13:34:47.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:47.210+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) v1 -- 0x7f738811a370 con 0x7f73881165c0 2024-03-20T13:34:48.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.911+0000 7f7384ff9640 1 -- 172.21.15.177:0/1332064894 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v18) v1 ==== 227+0+0 (secure 0 0 0) 0x7f7378017030 con 0x7f73881165c0 2024-03-20T13:34:48.913 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'default.rgw.buckets.data' created 2024-03-20T13:34:48.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.915+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7374037ea0 msgr2=0x7f737403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:48.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.915+0000 7f738e5cf640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7374037ea0 0x7f737403a360 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f737c036000 tx=0x7f737c008030 comp rx=0 tx=0).stop 2024-03-20T13:34:48.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 msgr2=0x7f73881abde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:48.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 0x7f73881abde0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f737800c480 tx=0x7f737800c940 comp rx=0 tx=0).stop 2024-03-20T13:34:48.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 shutdown_connections 2024-03-20T13:34:48.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7374037ea0 0x7f737403a360 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:48.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 --2- 172.21.15.177:0/1332064894 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f73881165c0 0x7f73881abde0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:48.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 >> 172.21.15.177:0/1332064894 conn(0x7f738806db50 msgr2=0x7f7388118e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:48.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 shutdown_connections 2024-03-20T13:34:48.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:48.916+0000 7f738e5cf640 1 -- 172.21.15.177:0/1332064894 wait complete. 2024-03-20T13:34:48.937 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-03-20T13:34:49.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.040+0000 7fad1337b640 1 Processor -- start 2024-03-20T13:34:49.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.040+0000 7fad1337b640 1 -- start start 2024-03-20T13:34:49.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.040+0000 7fad1337b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fad0c10f190 0x7fad0c10ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:49.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.040+0000 7fad1337b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0c10e7a0 con 0x7fad0c10e2f0 2024-03-20T13:34:49.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.040+0000 7fad1337b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad0c10e930 con 0x7fad0c10f190 2024-03-20T13:34:49.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.040+0000 7fad11117640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fad0c10f190 0x7fad0c10ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:49.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.041+0000 7fad11117640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fad0c10f190 0x7fad0c10ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40598/0 (socket says 172.21.15.177:40598) 2024-03-20T13:34:49.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.041+0000 7fad11117640 1 -- 172.21.15.177:0/3662683733 learned_addr learned my addr 172.21.15.177:0/3662683733 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:49.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.041+0000 7fad11117640 1 -- 172.21.15.177:0/3662683733 >> v1:172.21.15.28:6789/0 conn(0x7fad0c10e2f0 legacy=0x7fad0c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:49.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.041+0000 7fad11117640 1 -- 172.21.15.177:0/3662683733 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad0c10eaa0 con 0x7fad0c10f190 2024-03-20T13:34:49.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad11117640 1 --2- 172.21.15.177:0/3662683733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10f190 0x7fad0c10ddb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad080097f0 tx=0x7fad0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e2470b35c36dc25 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:49.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad03fff640 1 -- 172.21.15.177:0/3662683733 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad080317a0 con 0x7fad0c10f190 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad03fff640 1 -- 172.21.15.177:0/3662683733 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad08031900 con 0x7fad0c10f190 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad03fff640 1 -- 172.21.15.177:0/3662683733 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad08031bc0 con 0x7fad0c10f190 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 -- 172.21.15.177:0/3662683733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10f190 msgr2=0x7fad0c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 --2- 172.21.15.177:0/3662683733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10f190 0x7fad0c10ddb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad080097f0 tx=0x7fad0802b910 comp rx=0 tx=0).stop 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 -- 172.21.15.177:0/3662683733 shutdown_connections 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 --2- 172.21.15.177:0/3662683733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10f190 0x7fad0c10ddb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 -- 172.21.15.177:0/3662683733 >> 172.21.15.177:0/3662683733 conn(0x7fad0c06e9f0 msgr2=0x7fad0c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 -- 172.21.15.177:0/3662683733 shutdown_connections 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.042+0000 7fad1337b640 1 -- 172.21.15.177:0/3662683733 wait complete. 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad1337b640 1 Processor -- start 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad1337b640 1 -- start start 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad1337b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 0x7fad0c1a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad1337b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0c1a4370 con 0x7fad0c10e2f0 2024-03-20T13:34:49.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad11117640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 0x7fad0c1a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:49.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad11117640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 0x7fad0c1a3e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40614/0 (socket says 172.21.15.177:40614) 2024-03-20T13:34:49.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.043+0000 7fad11117640 1 -- 172.21.15.177:0/1418974329 learned_addr learned my addr 172.21.15.177:0/1418974329 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:49.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad11117640 1 -- 172.21.15.177:0/1418974329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080094d0 con 0x7fad0c10e2f0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad11117640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 0x7fad0c1a3e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad080090b0 tx=0x7fad080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad08031ba0 con 0x7fad0c10e2f0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad080443f0 con 0x7fad0c10e2f0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fad08044690 con 0x7fad0c10e2f0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0c1a4570 con 0x7fad0c10e2f0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.044+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0c1a8660 con 0x7fad0c10e2f0 2024-03-20T13:34:49.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.045+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0c0627b0 con 0x7fad0c10e2f0 2024-03-20T13:34:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.045+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fad0804d450 con 0x7fad0c10e2f0 2024-03-20T13:34:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.046+0000 7fad01ffb640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7facf0037ef0 0x7facf003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.046+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4249+0+0 (secure 0 0 0) 0x7fad0802d040 con 0x7fad0c10e2f0 2024-03-20T13:34:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.046+0000 7fad10916640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7facf0037ef0 0x7facf003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:49.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.046+0000 7fad10916640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7facf0037ef0 0x7facf003a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7facfc001560 tx=0x7facfc007a50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:49.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.051+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fad0804b940 con 0x7fad0c10e2f0 2024-03-20T13:34:49.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.223+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) v1 -- 0x7fad0c067570 con 0x7fad0c10e2f0 2024-03-20T13:34:49.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.917+0000 7fad01ffb640 1 -- 172.21.15.177:0/1418974329 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v19) v1 ==== 185+0+0 (secure 0 0 0) 0x7fad0804b350 con 0x7fad0c10e2f0 2024-03-20T13:34:49.918 INFO:teuthology.orchestra.run.smithi177.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-03-20T13:34:49.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.924+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7facf0037ef0 msgr2=0x7facf003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:49.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.924+0000 7fad1337b640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7facf0037ef0 0x7facf003a3b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7facfc001560 tx=0x7facfc007a50 comp rx=0 tx=0).stop 2024-03-20T13:34:49.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.924+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 msgr2=0x7fad0c1a3e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:49.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.924+0000 7fad1337b640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 0x7fad0c1a3e30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fad080090b0 tx=0x7fad080046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:49.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.926+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 shutdown_connections 2024-03-20T13:34:49.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.926+0000 7fad1337b640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7facf0037ef0 0x7facf003a3b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:49.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.926+0000 7fad1337b640 1 --2- 172.21.15.177:0/1418974329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fad0c10e2f0 0x7fad0c1a3e30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:49.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.926+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 >> 172.21.15.177:0/1418974329 conn(0x7fad0c06e9f0 msgr2=0x7fad0c1170b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:49.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.929+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 shutdown_connections 2024-03-20T13:34:49.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:49.930+0000 7fad1337b640 1 -- 172.21.15.177:0/1418974329 wait complete. 2024-03-20T13:34:49.955 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.061+0000 7f1e8335d640 1 Processor -- start 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.061+0000 7f1e8335d640 1 -- start start 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.061+0000 7f1e8335d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e7c10f190 0x7f1e7c10ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.061+0000 7f1e8335d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7c10e7a0 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.061+0000 7f1e8335d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7c10e930 con 0x7f1e7c10f190 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.061+0000 7f1e810f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e7c10f190 0x7f1e7c10ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.062+0000 7f1e810f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e7c10f190 0x7f1e7c10ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40630/0 (socket says 172.21.15.177:40630) 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.062+0000 7f1e810f9640 1 -- 172.21.15.177:0/1986578219 learned_addr learned my addr 172.21.15.177:0/1986578219 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:50.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.062+0000 7f1e808f8640 1 --1- 172.21.15.177:0/1986578219 >> v1:172.21.15.28:6789/0 conn(0x7f1e7c10e2f0 0x7f1e7c1199c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:53242/0 (socket says 172.21.15.177:53242) 2024-03-20T13:34:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.062+0000 7f1e810f9640 1 -- 172.21.15.177:0/1986578219 >> v1:172.21.15.28:6789/0 conn(0x7f1e7c10e2f0 legacy=0x7f1e7c1199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:50.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.062+0000 7f1e810f9640 1 -- 172.21.15.177:0/1986578219 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7c10eaa0 con 0x7f1e7c10f190 2024-03-20T13:34:50.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e810f9640 1 --2- 172.21.15.177:0/1986578219 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10f190 0x7f1e7c10ddb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e7802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c93d3fc9835beba8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e73fff640 1 -- 172.21.15.177:0/1986578219 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e780317a0 con 0x7f1e7c10f190 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e73fff640 1 -- 172.21.15.177:0/1986578219 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e78031900 con 0x7f1e7c10f190 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e73fff640 1 -- 172.21.15.177:0/1986578219 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e78031bc0 con 0x7f1e7c10f190 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 -- 172.21.15.177:0/1986578219 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10f190 msgr2=0x7f1e7c10ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 --2- 172.21.15.177:0/1986578219 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10f190 0x7f1e7c10ddb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e7802b910 comp rx=0 tx=0).stop 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 -- 172.21.15.177:0/1986578219 shutdown_connections 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 --2- 172.21.15.177:0/1986578219 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10f190 0x7f1e7c10ddb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 -- 172.21.15.177:0/1986578219 >> 172.21.15.177:0/1986578219 conn(0x7f1e7c06e9f0 msgr2=0x7f1e7c070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 -- 172.21.15.177:0/1986578219 shutdown_connections 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.063+0000 7f1e8335d640 1 -- 172.21.15.177:0/1986578219 wait complete. 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.064+0000 7f1e8335d640 1 Processor -- start 2024-03-20T13:34:50.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.064+0000 7f1e8335d640 1 -- start start 2024-03-20T13:34:50.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.064+0000 7f1e8335d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 0x7f1e7c1abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:50.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.064+0000 7f1e8335d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e7c1ac360 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e810f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 0x7f1e7c1abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:50.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e810f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 0x7f1e7c1abd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40636/0 (socket says 172.21.15.177:40636) 2024-03-20T13:34:50.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e810f9640 1 -- 172.21.15.177:0/4174478491 learned_addr learned my addr 172.21.15.177:0/4174478491 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:50.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e810f9640 1 -- 172.21.15.177:0/4174478491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e780094d0 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e810f9640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 0x7f1e7c1abd90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e7803ac00 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e7803ad60 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e780443f0 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.065+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e7c1ac500 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.066+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e7c1a5c10 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.066+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e7c0627b0 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.066+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1e7804d450 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.067+0000 7f1e71ffb640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1e60037ea0 0x7f1e6003a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.067+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4260+0+0 (secure 0 0 0) 0x7f1e7802d040 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.067+0000 7f1e808f8640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1e60037ea0 0x7f1e6003a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:50.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.067+0000 7f1e808f8640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1e60037ea0 0x7f1e6003a360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0015f0 tx=0x7f1e6c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:50.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.071+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f1e7804b940 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.242+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) v1 -- 0x7f1e7c10f190 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.921+0000 7f1e71ffb640 1 -- 172.21.15.177:0/4174478491 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v20) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e7804b350 con 0x7f1e7c10e2f0 2024-03-20T13:34:50.922 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'default.rgw.buckets.index' created 2024-03-20T13:34:50.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.924+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1e60037ea0 msgr2=0x7f1e6003a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:50.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.924+0000 7f1e8335d640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1e60037ea0 0x7f1e6003a360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0015f0 tx=0x7f1e6c007a40 comp rx=0 tx=0).stop 2024-03-20T13:34:50.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.924+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 msgr2=0x7f1e7c1abd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:50.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.924+0000 7f1e8335d640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 0x7f1e7c1abd90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1e780097f0 tx=0x7f1e780046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:50.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.925+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 shutdown_connections 2024-03-20T13:34:50.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.925+0000 7f1e8335d640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1e60037ea0 0x7f1e6003a360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:50.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.925+0000 7f1e8335d640 1 --2- 172.21.15.177:0/4174478491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e7c10e2f0 0x7f1e7c1abd90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:50.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.925+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 >> 172.21.15.177:0/4174478491 conn(0x7f1e7c06e9f0 msgr2=0x7f1e7c10f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:50.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.925+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 shutdown_connections 2024-03-20T13:34:50.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:50.925+0000 7f1e8335d640 1 -- 172.21.15.177:0/4174478491 wait complete. 2024-03-20T13:34:50.946 DEBUG:teuthology.orchestra.run.smithi177:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-03-20T13:34:51.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.050+0000 7ff49e9f6640 1 Processor -- start 2024-03-20T13:34:51.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.050+0000 7ff49e9f6640 1 -- start start 2024-03-20T13:34:51.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.050+0000 7ff49e9f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff49810f190 0x7ff49810ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:51.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.050+0000 7ff49e9f6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff49810e7a0 con 0x7ff49810e2f0 2024-03-20T13:34:51.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.050+0000 7ff49e9f6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff49810e930 con 0x7ff49810f190 2024-03-20T13:34:51.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.051+0000 7ff497fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff49810f190 0x7ff49810ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:51.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.051+0000 7ff497fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff49810f190 0x7ff49810ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40652/0 (socket says 172.21.15.177:40652) 2024-03-20T13:34:51.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.051+0000 7ff4977fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff49810e2f0 0x7ff4981199c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:53244/0 (socket says 172.21.15.177:53244) 2024-03-20T13:34:51.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.051+0000 7ff497fff640 1 -- 172.21.15.177:0/1029788740 learned_addr learned my addr 172.21.15.177:0/1029788740 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:51.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.051+0000 7ff497fff640 1 -- 172.21.15.177:0/1029788740 >> v1:172.21.15.28:6789/0 conn(0x7ff49810e2f0 legacy=0x7ff4981199c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:51.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.051+0000 7ff497fff640 1 -- 172.21.15.177:0/1029788740 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff49810eaa0 con 0x7ff49810f190 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff497fff640 1 --2- 172.21.15.177:0/1029788740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810f190 0x7ff49810ddb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097f0 tx=0x7ff48802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58a9ae68f54d86e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff496ffd640 1 -- 172.21.15.177:0/1029788740 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4880317a0 con 0x7ff49810f190 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff496ffd640 1 -- 172.21.15.177:0/1029788740 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff488031900 con 0x7ff49810f190 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff496ffd640 1 -- 172.21.15.177:0/1029788740 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff488031bc0 con 0x7ff49810f190 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1029788740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810f190 msgr2=0x7ff49810ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 --2- 172.21.15.177:0/1029788740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810f190 0x7ff49810ddb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097f0 tx=0x7ff48802b910 comp rx=0 tx=0).stop 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1029788740 shutdown_connections 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 --2- 172.21.15.177:0/1029788740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810f190 0x7ff49810ddb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1029788740 >> 172.21.15.177:0/1029788740 conn(0x7ff49806e9f0 msgr2=0x7ff498070e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1029788740 shutdown_connections 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.052+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1029788740 wait complete. 2024-03-20T13:34:51.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.053+0000 7ff49e9f6640 1 Processor -- start 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.053+0000 7ff49e9f6640 1 -- start start 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.053+0000 7ff49e9f6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 0x7ff49810f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.053+0000 7ff49e9f6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff49810fe80 con 0x7ff49810e2f0 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff497fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 0x7ff49810f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff497fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 0x7ff49810f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40658/0 (socket says 172.21.15.177:40658) 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff497fff640 1 -- 172.21.15.177:0/1137429512 learned_addr learned my addr 172.21.15.177:0/1137429512 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff497fff640 1 -- 172.21.15.177:0/1137429512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4880094d0 con 0x7ff49810e2f0 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff497fff640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 0x7ff49810f8b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097f0 tx=0x7ff4880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:51.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff48803ac00 con 0x7ff49810e2f0 2024-03-20T13:34:51.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff48803ad60 con 0x7ff49810e2f0 2024-03-20T13:34:51.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff498110020 con 0x7ff49810e2f0 2024-03-20T13:34:51.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.054+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4880443f0 con 0x7ff49810e2f0 2024-03-20T13:34:51.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.055+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff498110470 con 0x7ff49810e2f0 2024-03-20T13:34:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.055+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4980627b0 con 0x7ff49810e2f0 2024-03-20T13:34:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.055+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff48804d450 con 0x7ff49810e2f0 2024-03-20T13:34:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.056+0000 7ff494ff9640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff484037ea0 0x7ff48403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:34:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.056+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 4624+0+0 (secure 0 0 0) 0x7ff48802d040 con 0x7ff49810e2f0 2024-03-20T13:34:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.056+0000 7ff4977fe640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff484037ea0 0x7ff48403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:34:51.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.056+0000 7ff4977fe640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff484037ea0 0x7ff48403a360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0015f0 tx=0x7ff48c007a40 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:34:51.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.061+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff48804b940 con 0x7ff49810e2f0 2024-03-20T13:34:51.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.234+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) v1 -- 0x7ff4980675e0 con 0x7ff49810e2f0 2024-03-20T13:34:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.924+0000 7ff494ff9640 1 -- 172.21.15.177:0/1137429512 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v21) v1 ==== 187+0+0 (secure 0 0 0) 0x7ff48804b350 con 0x7ff49810e2f0 2024-03-20T13:34:51.925 INFO:teuthology.orchestra.run.smithi177.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff484037ea0 msgr2=0x7ff48403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff484037ea0 0x7ff48403a360 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff48c0015f0 tx=0x7ff48c007a40 comp rx=0 tx=0).stop 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 msgr2=0x7ff49810f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 0x7ff49810f8b0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097f0 tx=0x7ff4880046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 shutdown_connections 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff484037ea0 0x7ff48403a360 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 --2- 172.21.15.177:0/1137429512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff49810e2f0 0x7ff49810f8b0 secure :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff4880097f0 tx=0x7ff4880046c0 comp rx=0 tx=0).stop 2024-03-20T13:34:51.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.927+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 >> 172.21.15.177:0/1137429512 conn(0x7ff49806e9f0 msgr2=0x7ff4981170b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:34:51.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.928+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 shutdown_connections 2024-03-20T13:34:51.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:34:51.928+0000 7ff49e9f6640 1 -- 172.21.15.177:0/1137429512 wait complete. 2024-03-20T13:34:51.958 DEBUG:tasks.rgw:Pools created 2024-03-20T13:34:51.958 INFO:tasks.rgw:Starting rgw... 2024-03-20T13:34:51.958 INFO:tasks.rgw:rgw client.0 config is {} 2024-03-20T13:34:51.958 INFO:tasks.rgw:Using beast as radosgw frontend 2024-03-20T13:34:51.959 INFO:tasks.rgw.client.0:Restarting daemon 2024-03-20T13:34:51.959 DEBUG:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-03-20T13:34:51.961 INFO:tasks.rgw.client.0:Started 2024-03-20T13:34:51.961 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi177.front.sepia.ceph.com:80/ 2024-03-20T13:34:51.961 DEBUG:teuthology.orchestra.run.smithi177:> curl http://smithi177.front.sepia.ceph.com:80/ 2024-03-20T13:34:51.982 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:34:51.982 INFO:teuthology.orchestra.run.smithi177.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:34:51.982 INFO:teuthology.orchestra.run.smithi177.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:34:51.982 INFO:teuthology.orchestra.run.smithi177.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:34:51.982 INFO:teuthology.orchestra.run.smithi177.stderr:curl: (7) Failed to connect to smithi177.front.sepia.ceph.com port 80: Connection refused 2024-03-20T13:34:52.983 DEBUG:teuthology.orchestra.run.smithi177:> curl http://smithi177.front.sepia.ceph.com:80/ 2024-03-20T13:34:53.005 INFO:teuthology.orchestra.run.smithi177.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:34:53.005 INFO:teuthology.orchestra.run.smithi177.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:34:53.005 INFO:teuthology.orchestra.run.smithi177.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:34:53.006 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:34:53.006 INFO:teuthology.orchestra.run.smithi177.stderr:curl: (7) Failed to connect to smithi177.front.sepia.ceph.com port 80: Connection refused 2024-03-20T13:34:55.008 DEBUG:teuthology.orchestra.run.smithi177:> curl http://smithi177.front.sepia.ceph.com:80/ 2024-03-20T13:34:55.031 INFO:teuthology.orchestra.run.smithi177.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:34:55.031 INFO:teuthology.orchestra.run.smithi177.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:34:55.031 INFO:teuthology.orchestra.run.smithi177.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:34:55.032 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:34:55.032 INFO:teuthology.orchestra.run.smithi177.stderr:curl: (7) Failed to connect to smithi177.front.sepia.ceph.com port 80: Connection refused 2024-03-20T13:34:59.033 DEBUG:teuthology.orchestra.run.smithi177:> curl http://smithi177.front.sepia.ceph.com:80/ 2024-03-20T13:34:59.058 INFO:teuthology.orchestra.run.smithi177.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:34:59.058 INFO:teuthology.orchestra.run.smithi177.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:34:59.058 INFO:teuthology.orchestra.run.smithi177.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-03-20T13:34:59.058 INFO:teuthology.orchestra.run.smithi177.stderr:curl: (7) Failed to connect to smithi177.front.sepia.ceph.com port 80: Connection refused 2024-03-20T13:34:59.059 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-03-20T13:35:07.060 DEBUG:teuthology.orchestra.run.smithi177:> curl http://smithi177.front.sepia.ceph.com:80/ 2024-03-20T13:35:07.084 INFO:teuthology.orchestra.run.smithi177.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-03-20T13:35:07.084 INFO:teuthology.orchestra.run.smithi177.stderr: Dload Upload Total Spent Left Speed 2024-03-20T13:35:07.086 INFO:teuthology.orchestra.run.smithi177.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2024-03-20T13:35:07.087 INFO:teuthology.orchestra.run.smithi177.stdout:anonymous 2024-03-20T13:35:07.088 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-03-20T13:35:07.174 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-03-20T13:35:07.174 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-03-20T13:35:07.174 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-03-20T13:35:07.174 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-03-20T13:35:07.221 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:07.221 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:07.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.219+0000 7f873432f800 1 Processor -- start 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.219+0000 7f873432f800 1 -- start start 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.219+0000 7f873432f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d263e959d0 0x55d263e95df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.219+0000 7f873432f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d263de1cc0 con 0x55d263e96c30 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.219+0000 7f873432f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d263d98500 con 0x55d263e959d0 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.220+0000 7f87300f2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d263e959d0 0x55d263e95df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.220+0000 7f87300f2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d263e959d0 0x55d263e95df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56300/0 (socket says 172.21.15.177:56300) 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.220+0000 7f87300f2640 1 -- 172.21.15.177:0/2102608792 learned_addr learned my addr 172.21.15.177:0/2102608792 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.220+0000 7f87300f2640 1 -- 172.21.15.177:0/2102608792 >> v1:172.21.15.28:6789/0 conn(0x55d263e96c30 legacy=0x55d263e970b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:35:07.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.220+0000 7f87300f2640 1 -- 172.21.15.177:0/2102608792 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d263e964c0 con 0x55d263e959d0 2024-03-20T13:35:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.222+0000 7f87300f2640 1 --2- 172.21.15.177:0/2102608792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263e95df0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8720005fd0 tx=0x7f872001cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4294f6db7962f8d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.222+0000 7f872f0f0640 1 -- 172.21.15.177:0/2102608792 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8720052540 con 0x55d263e959d0 2024-03-20T13:35:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.222+0000 7f872f0f0640 1 -- 172.21.15.177:0/2102608792 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87200526a0 con 0x55d263e959d0 2024-03-20T13:35:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.222+0000 7f872f0f0640 1 -- 172.21.15.177:0/2102608792 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87200529c0 con 0x55d263e959d0 2024-03-20T13:35:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 -- 172.21.15.177:0/2102608792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 msgr2=0x55d263e95df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 --2- 172.21.15.177:0/2102608792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263e95df0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f8720005fd0 tx=0x7f872001cbd0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 -- 172.21.15.177:0/2102608792 shutdown_connections 2024-03-20T13:35:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 --2- 172.21.15.177:0/2102608792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263e95df0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 -- 172.21.15.177:0/2102608792 >> 172.21.15.177:0/2102608792 conn(0x55d263e91030 msgr2=0x55d263e93450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 -- 172.21.15.177:0/2102608792 shutdown_connections 2024-03-20T13:35:07.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.223+0000 7f873432f800 1 -- 172.21.15.177:0/2102608792 wait complete. 2024-03-20T13:35:07.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.236+0000 7f873432f800 1 Processor -- start 2024-03-20T13:35:07.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.236+0000 7f873432f800 1 -- start start 2024-03-20T13:35:07.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.237+0000 7f873432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f86980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.237+0000 7f873432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d263d95a30 con 0x55d263e959d0 2024-03-20T13:35:07.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.237+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f86980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.237+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f86980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56306/0 (socket says 172.21.15.177:56306) 2024-03-20T13:35:07.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.237+0000 7f87300f2640 1 -- 172.21.15.177:0/29285264 learned_addr learned my addr 172.21.15.177:0/29285264 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.237+0000 7f87300f2640 1 -- 172.21.15.177:0/29285264 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872000a1c0 con 0x55d263e959d0 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.238+0000 7f87300f2640 1 --2- 172.21.15.177:0/29285264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f86980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8720007000 tx=0x7f872004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305ea2d468ae83d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.238+0000 7f861e60c640 1 -- 172.21.15.177:0/29285264 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8720061070 con 0x55d263e959d0 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.238+0000 7f861e60c640 1 -- 172.21.15.177:0/29285264 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720052940 con 0x55d263e959d0 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.238+0000 7f861e60c640 1 -- 172.21.15.177:0/29285264 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8720052c00 con 0x55d263e959d0 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- 172.21.15.177:0/29285264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 msgr2=0x55d263f86980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 --2- 172.21.15.177:0/29285264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f86980 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f8720007000 tx=0x7f872004c000 comp rx=0 tx=0).stop 2024-03-20T13:35:07.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- 172.21.15.177:0/29285264 shutdown_connections 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 --2- 172.21.15.177:0/29285264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f86980 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- 172.21.15.177:0/29285264 >> 172.21.15.177:0/29285264 conn(0x55d263e91030 msgr2=0x55d263f875d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- 172.21.15.177:0/29285264 shutdown_connections 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- 172.21.15.177:0/29285264 wait complete. 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 Processor -- start 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- start start 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f94af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.239+0000 7f873432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d263d91210 con 0x55d263e959d0 2024-03-20T13:35:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.240+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f94af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.240+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f94af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56320/0 (socket says 172.21.15.177:56320) 2024-03-20T13:35:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.240+0000 7f87300f2640 1 -- 172.21.15.177:0/1635979021 learned_addr learned my addr 172.21.15.177:0/1635979021 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.242+0000 7f87300f2640 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d263de1cc0 con 0x55d263e959d0 2024-03-20T13:35:07.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.243+0000 7f87300f2640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f94af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f872005f040 tx=0x7f8720003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.243+0000 7f861ce09640 1 -- 172.21.15.177:0/1635979021 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8720061040 con 0x55d263e959d0 2024-03-20T13:35:07.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.243+0000 7f861ce09640 1 -- 172.21.15.177:0/1635979021 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f872005d630 con 0x55d263e959d0 2024-03-20T13:35:07.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.243+0000 7f861ce09640 1 -- 172.21.15.177:0/1635979021 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f872005d910 con 0x55d263e959d0 2024-03-20T13:35:07.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.244+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d263f95030 con 0x55d263e959d0 2024-03-20T13:35:07.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.244+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d263f95570 con 0x55d263e959d0 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f861ce09640 1 -- 172.21.15.177:0/1635979021 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f872005da70 con 0x55d263e959d0 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f861ce09640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86180367e0 0x7f8618038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f861ce09640 1 -- 172.21.15.177:0/1635979021 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f872008dc50 con 0x55d263e959d0 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f872f8f1640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86180367e0 0x7f8618038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263e96c30 0x55d263f9b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263f9bc90 con 0x55d263e96c30 2024-03-20T13:35:07.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f87308f3640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263e96c30 0x55d263f9b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f872f8f1640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86180367e0 0x7f8618038ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f872400a430 tx=0x7f8724005540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.247+0000 7f87308f3640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263e96c30 0x55d263f9b750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f87308f3640 1 -- 172.21.15.177:0/1635979021 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263e96c30 2024-03-20T13:35:07.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263f98e20 con 0x55d263e96c30 2024-03-20T13:35:07.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f87308f3640 1 -- 172.21.15.177:0/1635979021 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87280083e0 con 0x55d263e96c30 2024-03-20T13:35:07.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263f9dcf0 0x55d263fa01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fa0940 con 0x55d263f9dcf0 2024-03-20T13:35:07.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f87300f2640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263f9dcf0 0x55d263fa01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.248+0000 7f87300f2640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263f9dcf0 0x55d263fa01b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.249+0000 7f87300f2640 1 -- 172.21.15.177:0/1635979021 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f872004f070 con 0x55d263f9dcf0 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.249+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263f9c4c0 con 0x55d263e96c30 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.249+0000 7f87308f3640 1 -- 172.21.15.177:0/1635979021 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87280083e0 con 0x55d263e96c30 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.249+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d263fa1d60 0x55d263fa4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.249+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fa4890 con 0x55d263fa1d60 2024-03-20T13:35:07.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.250+0000 7f872f8f1640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d263fa1d60 0x55d263fa4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.250+0000 7f872f8f1640 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d263fa1d60 0x55d263fa4150 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.250+0000 7f872f8f1640 1 -- 172.21.15.177:0/1635979021 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8724010040 con 0x55d263fa1d60 2024-03-20T13:35:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f873432f800 1 Processor -- start 2024-03-20T13:35:07.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f873432f800 1 -- start start 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f873432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 0x55d263fb2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f873432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d263d33c70 con 0x55d263fb29f0 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 0x55d263fb2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 0x55d263fb2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56322/0 (socket says 172.21.15.177:56322) 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f87300f2640 1 -- 172.21.15.177:0/1098254732 learned_addr learned my addr 172.21.15.177:0/1098254732 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.251+0000 7f87300f2640 1 -- 172.21.15.177:0/1098254732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d263fb3350 con 0x55d263fb29f0 2024-03-20T13:35:07.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.252+0000 7f87300f2640 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 0x55d263fb2e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8720052fb0 tx=0x7f8720050f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.252+0000 7f8615ffb640 1 -- 172.21.15.177:0/1098254732 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f872005c380 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.252+0000 7f8615ffb640 1 -- 172.21.15.177:0/1098254732 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720082040 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.252+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d263fb3dc0 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.252+0000 7f8615ffb640 1 -- 172.21.15.177:0/1098254732 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f872005c610 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.252+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d263fb3dc0 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f8615ffb640 1 -- 172.21.15.177:0/1098254732 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f872008d420 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f8615ffb640 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86080367e0 0x7f8608038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f8615ffb640 1 -- 172.21.15.177:0/1098254732 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8720098c80 con 0x55d263fb29f0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f872f8f1640 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86080367e0 0x7f8608038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f873432f800 1 Processor -- start 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f873432f800 1 -- start start 2024-03-20T13:35:07.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.253+0000 7f872f8f1640 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86080367e0 0x7f8608038ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f872400b700 tx=0x7f872400e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.254+0000 7f873432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fbfd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.254+0000 7f873432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d263d095d0 con 0x55d263fbf960 2024-03-20T13:35:07.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.256+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fbfd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.256+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fbfd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56330/0 (socket says 172.21.15.177:56330) 2024-03-20T13:35:07.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.256+0000 7f87300f2640 1 -- 172.21.15.177:0/2295717256 learned_addr learned my addr 172.21.15.177:0/2295717256 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.258+0000 7f87300f2640 1 -- 172.21.15.177:0/2295717256 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d263fc0350 con 0x55d263fbf960 2024-03-20T13:35:07.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.260+0000 7f87300f2640 1 --2- 172.21.15.177:0/2295717256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fbfd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f872005c9b0 tx=0x7f8720087b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82a58940791a0cf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f860f7fe640 1 -- 172.21.15.177:0/2295717256 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87200a0070 con 0x55d263fbf960 2024-03-20T13:35:07.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f860f7fe640 1 -- 172.21.15.177:0/2295717256 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8720071450 con 0x55d263fbf960 2024-03-20T13:35:07.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f860f7fe640 1 -- 172.21.15.177:0/2295717256 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8720051bc0 con 0x55d263fbf960 2024-03-20T13:35:07.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f873432f800 1 -- 172.21.15.177:0/2295717256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 msgr2=0x55d263fbfd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f873432f800 1 --2- 172.21.15.177:0/2295717256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fbfd80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f872005c9b0 tx=0x7f8720087b30 comp rx=0 tx=0).stop 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f873432f800 1 -- 172.21.15.177:0/2295717256 shutdown_connections 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f873432f800 1 --2- 172.21.15.177:0/2295717256 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fbfd80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.261+0000 7f873432f800 1 -- 172.21.15.177:0/2295717256 >> 172.21.15.177:0/2295717256 conn(0x55d263fbbc80 msgr2=0x55d263fb9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f873432f800 1 -- 172.21.15.177:0/2295717256 shutdown_connections 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f873432f800 1 -- 172.21.15.177:0/2295717256 wait complete. 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f873432f800 1 Processor -- start 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f873432f800 1 -- start start 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f873432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fc67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f873432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d263fc6cf0 con 0x55d263fbf960 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fc67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f87300f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fc67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56334/0 (socket says 172.21.15.177:56334) 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.262+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 learned_addr learned my addr 172.21.15.177:0/665941266 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8720091020 con 0x55d263fbf960 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f87300f2640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fc67b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f872005c9b0 tx=0x7f872006c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f860dffb640 1 -- 172.21.15.177:0/665941266 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87200a9050 con 0x55d263fbf960 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f860dffb640 1 -- 172.21.15.177:0/665941266 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87200aa040 con 0x55d263fbf960 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d263fc6ef0 con 0x55d263fbf960 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f860dffb640 1 -- 172.21.15.177:0/665941266 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f87200965c0 con 0x55d263fbf960 2024-03-20T13:35:07.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.263+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d263fc6ef0 con 0x55d263fbf960 2024-03-20T13:35:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f860dffb640 1 -- 172.21.15.177:0/665941266 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8720096720 con 0x55d263fbf960 2024-03-20T13:35:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f860dffb640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86000367e0 0x7f8600038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f860dffb640 1 -- 172.21.15.177:0/665941266 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f87200919a0 con 0x55d263fbf960 2024-03-20T13:35:07.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f872f8f1640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86000367e0 0x7f8600038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263fd1f20 0x55d263fd43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.264+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd4b00 con 0x55d263fd1f20 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f87308f3640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263fd1f20 0x55d263fd43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f872f8f1640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86000367e0 0x7f8600038ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55d263f99180 tx=0x7f8724002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f87308f3640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263fd1f20 0x55d263fd43b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 20 realm 2024-03-20T13:35:07.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd4ed0 con 0x55d263fd1f20 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.265+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5ab0 con 0x55d263fd1f20 2024-03-20T13:35:07.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263fd6460 0x55d263fd8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd8d90 con 0x55d263fd6460 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f87300f2640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263fd6460 0x55d263fd8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.266+0000 7f87300f2640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263fd6460 0x55d263fd8850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f873432f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f873432f800 20 searching for the correct realm 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d263fdad60 0x55d263fdd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdd8a0 con 0x55d263fdad60 2024-03-20T13:35:07.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f872f8f1640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d263fdad60 0x55d263fdd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.267+0000 7f872f8f1640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d263fdad60 0x55d263fdd220 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.268+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.268+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdd8a0 con 0x55d263fd6460 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.268+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.268+0000 7f87300f2640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8720073040 0x7f8720091040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.268+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdd8a0 con 0x7f8720073040 2024-03-20T13:35:07.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.269+0000 7f87308f3640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8720073040 0x7f8720091040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.270+0000 7f87308f3640 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8720073040 0x7f8720091040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.271+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.271+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.271+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.271+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.271+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.271+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.272+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.272+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.272+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.272+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd6460 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.272+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.272+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.273+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.273+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.273+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.273+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.273+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.273+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd6460 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.274+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.275+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.275+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.275+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.275+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.275+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.275+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.276+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd6460 2024-03-20T13:35:07.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.277+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.277+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.277+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.277+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.277+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.277+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.278+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.278+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.278+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.278+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd6460 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.278+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.278+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fdad60 2024-03-20T13:35:07.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x7f8720073040 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd1f20 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd5750 con 0x55d263fd6460 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.279+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:07.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9a40 con 0x55d263fd1f20 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.280+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9a40 con 0x7f8720073040 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 zone default found 2024-03-20T13:35:07.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 4 Realm: () 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 zonegroup default 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fda310 con 0x7f8720073040 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdf6c0 con 0x55d263fdad60 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdfa20 con 0x55d263fdad60 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 started sync module instance, tier type = 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.281+0000 7f873432f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.282+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdefa0 con 0x55d263fd6460 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.283+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.283+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94362109078272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdf350 con 0x55d263fd6460 2024-03-20T13:35:07.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.283+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe0830 con 0x55d263fd1f20 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.284+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94362109078272] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.284+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.284+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94362109084560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe0c50 con 0x55d263fd1f20 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.284+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe15c0 con 0x55d263fdad60 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.286+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94362109084560] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.286+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.286+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94362109085616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe0bd0 con 0x55d263fdad60 2024-03-20T13:35:07.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.286+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe2420 con 0x55d263fd6460 2024-03-20T13:35:07.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.289+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94362109085616] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.289+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.289+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94362109090160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe2c20 con 0x55d263fd6460 2024-03-20T13:35:07.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.289+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe3480 con 0x55d263fd1f20 2024-03-20T13:35:07.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.291+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.291+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94362109095808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe3cd0 con 0x55d263fd1f20 2024-03-20T13:35:07.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.291+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe4780 con 0x7f8720073040 2024-03-20T13:35:07.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.292+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94362109090160] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.292+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94362109095808] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.293+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.293+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94362109100672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe37e0 con 0x7f8720073040 2024-03-20T13:35:07.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.293+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe4fd0 con 0x7f8720073040 2024-03-20T13:35:07.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.294+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94362109100672] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.297+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.297+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94362109093760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe37e0 con 0x7f8720073040 2024-03-20T13:35:07.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.297+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe5620 con 0x7f8720073040 2024-03-20T13:35:07.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94362109093760] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'3 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94362109102816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe55e0 con 0x7f8720073040 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=0 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=1 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=2 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=3 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=4 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=5 2024-03-20T13:35:07.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.300+0000 7f873432f800 20 add_watcher() i=6 2024-03-20T13:35:07.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.303+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94362109102816] v30'4 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.303+0000 7f873432f800 20 add_watcher() i=7 2024-03-20T13:35:07.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.303+0000 7f873432f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:07.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.303+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe8a30 con 0x55d263fd1f20 2024-03-20T13:35:07.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.304+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.304+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94362109104912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe5f10 con 0x55d263fd1f20 2024-03-20T13:35:07.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94362109104912] v30'24 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f85e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:07.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f873432f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:07.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f873432f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:07.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f873432f800 5 note: GC not initialized 2024-03-20T13:35:07.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f85e57e2640 20 reqs_thread_entry: start 2024-03-20T13:35:07.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f873432f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:07.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f873432f800 20 Filter name: none 2024-03-20T13:35:07.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f8556ffd640 20 reqs_thread_entry: start 2024-03-20T13:35:07.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.305+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d26401a090 con 0x55d263fdad60 2024-03-20T13:35:07.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.306+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.306+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d26401a090 con 0x55d263fdad60 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.306+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.306+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d26401a090 con 0x55d263fd1f20 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.306+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.306+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd6460 2024-03-20T13:35:07.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.307+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd6460 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.308+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.309+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.309+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.311+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.311+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.311+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.311+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.312+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.312+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.313+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.313+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.314+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.314+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.314+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.314+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd6460 2024-03-20T13:35:07.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.314+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.314+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd6460 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.315+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.317+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.317+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.317+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.317+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.318+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.318+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.318+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.318+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd6460 2024-03-20T13:35:07.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.318+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.318+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x7f8720073040 2024-03-20T13:35:07.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.319+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.319+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd1f20 2024-03-20T13:35:07.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.319+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.319+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fdad60 2024-03-20T13:35:07.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.320+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.320+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fd9690 con 0x55d263fd6460 2024-03-20T13:35:07.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.320+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.321+0000 7f85e67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:07.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.321+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94362109104912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d26401a050 con 0x55d263fd1f20 2024-03-20T13:35:07.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.322+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94362109104912] v30'25 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.322+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94362109078272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe52e0 con 0x55d263fd6460 2024-03-20T13:35:07.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.325+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94362109078272] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.325+0000 7f873432f800 20 remove_watcher() i=0 2024-03-20T13:35:07.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.325+0000 7f873432f800 2 removed watcher, disabling cache 2024-03-20T13:35:07.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.325+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94362109084560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdeb00 con 0x55d263fd1f20 2024-03-20T13:35:07.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.326+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94362109084560] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.326+0000 7f873432f800 20 remove_watcher() i=1 2024-03-20T13:35:07.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.326+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94362109085616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fdeb00 con 0x55d263fdad60 2024-03-20T13:35:07.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.327+0000 7f872f8f1640 1 -- 172.21.15.177:0/665941266 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94362109085616] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8724010040 con 0x55d263fdad60 2024-03-20T13:35:07.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.327+0000 7f873432f800 20 remove_watcher() i=2 2024-03-20T13:35:07.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.327+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94362109090160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe52e0 con 0x55d263fd6460 2024-03-20T13:35:07.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.329+0000 7f87300f2640 1 -- 172.21.15.177:0/665941266 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94362109090160] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87200b6020 con 0x55d263fd6460 2024-03-20T13:35:07.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.329+0000 7f873432f800 20 remove_watcher() i=3 2024-03-20T13:35:07.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.329+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94362109095808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe1970 con 0x55d263fd1f20 2024-03-20T13:35:07.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.330+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94362109095808] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x55d263fd1f20 2024-03-20T13:35:07.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.330+0000 7f873432f800 20 remove_watcher() i=4 2024-03-20T13:35:07.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.330+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94362109100672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe2f80 con 0x7f8720073040 2024-03-20T13:35:07.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.332+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94362109100672] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.332+0000 7f873432f800 20 remove_watcher() i=5 2024-03-20T13:35:07.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.332+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94362109093760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe2f80 con 0x7f8720073040 2024-03-20T13:35:07.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.333+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94362109093760] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.333+0000 7f873432f800 20 remove_watcher() i=6 2024-03-20T13:35:07.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.333+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94362109102816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d263fe2f80 con 0x7f8720073040 2024-03-20T13:35:07.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.334+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94362109102816] v30'5 uv3 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f87280083e0 con 0x7f8720073040 2024-03-20T13:35:07.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.334+0000 7f873432f800 20 remove_watcher() i=7 2024-03-20T13:35:07.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8720073040 msgr2=0x7f8720091040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8720073040 0x7f8720091040 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263fd1f20 msgr2=0x55d263fd43b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263fd1f20 0x55d263fd43b0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263fd6460 msgr2=0x55d263fd8850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263fd6460 0x55d263fd8850 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d263fdad60 msgr2=0x55d263fdd220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d263fdad60 0x55d263fdd220 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86000367e0 msgr2=0x7f8600038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86000367e0 0x7f8600038ca0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x55d263f99180 tx=0x7f8724002000 comp rx=0 tx=0).stop 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 msgr2=0x55d263fc67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f87308f3640 1 -- 172.21.15.177:0/665941266 reap_dead start 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fc67b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f872005c9b0 tx=0x7f872006c070 comp rx=0 tx=0).stop 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 shutdown_connections 2024-03-20T13:35:07.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/665941266 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fbf960 0x55d263fc67b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 >> 172.21.15.177:0/665941266 conn(0x55d263fbbc80 msgr2=0x55d263fb9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 shutdown_connections 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/665941266 wait complete. 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86080367e0 msgr2=0x7f8608038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86080367e0 0x7f8608038ca0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f872400b700 tx=0x7f872400e000 comp rx=0 tx=0).stop 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 msgr2=0x55d263fb2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 0x55d263fb2e10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8720052fb0 tx=0x7f8720050f10 comp rx=0 tx=0).stop 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 shutdown_connections 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86080367e0 0x7f8608038ca0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 --2- 172.21.15.177:0/1098254732 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263fb29f0 0x55d263fb2e10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 >> 172.21.15.177:0/1098254732 conn(0x55d263fa6a80 msgr2=0x55d263fa6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 shutdown_connections 2024-03-20T13:35:07.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.335+0000 7f873432f800 1 -- 172.21.15.177:0/1098254732 wait complete. 2024-03-20T13:35:07.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d263fa1d60 msgr2=0x55d263fa4150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d263fa1d60 0x55d263fa4150 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263e96c30 msgr2=0x55d263f9b750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d263e96c30 0x55d263f9b750 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263f9dcf0 msgr2=0x55d263fa01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d263f9dcf0 0x55d263fa01b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86180367e0 msgr2=0x7f8618038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86180367e0 0x7f8618038ca0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f872400a430 tx=0x7f8724005540 comp rx=0 tx=0).stop 2024-03-20T13:35:07.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 msgr2=0x55d263f94af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 --2- 172.21.15.177:0/1635979021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d263e959d0 0x55d263f94af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f872005f040 tx=0x7f8720003330 comp rx=0 tx=0).stop 2024-03-20T13:35:07.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f87308f3640 1 -- 172.21.15.177:0/1635979021 reap_dead start 2024-03-20T13:35:07.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 shutdown_connections 2024-03-20T13:35:07.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 >> 172.21.15.177:0/1635979021 conn(0x55d263e91030 msgr2=0x55d263f7fe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 shutdown_connections 2024-03-20T13:35:07.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.336+0000 7f873432f800 1 -- 172.21.15.177:0/1635979021 wait complete. 2024-03-20T13:35:07.355 INFO:teuthology.orchestra.run.smithi177.stdout:[] 2024-03-20T13:35:07.355 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:35:07.356 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-03-20T13:35:07.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-03-20T13:35:07.356 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-03-20T13:35:07.399 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:07.399 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.397+0000 7fde5769d800 1 Processor -- start 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5769d800 1 -- start start 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5769d800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55dca09a4420 0x55dca09a4840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5769d800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dca08f0cd0 con 0x55dca09a4d80 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5769d800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dca08a7500 con 0x55dca09a4420 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5519c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55dca09a4420 0x55dca09a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5499b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55dca09a4d80 0x55dca09a5230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36780/0 (socket says 172.21.15.177:36780) 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.398+0000 7fde5499b640 1 -- 172.21.15.177:0/2282934788 learned_addr learned my addr 172.21.15.177:0/2282934788 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.399+0000 7fde5519c640 1 -- 172.21.15.177:0/2282934788 >> v1:172.21.15.28:6789/0 conn(0x55dca09a4d80 legacy=0x55dca09a5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.399+0000 7fde5519c640 1 -- 172.21.15.177:0/2282934788 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dca0919070 con 0x55dca09a4420 2024-03-20T13:35:07.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.400+0000 7fde5519c640 1 --2- 172.21.15.177:0/2282934788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca09a4840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fde4800a470 tx=0x7fde4801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5936fc04f0abc6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde47fff640 1 -- 172.21.15.177:0/2282934788 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde48052570 con 0x55dca09a4420 2024-03-20T13:35:07.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde47fff640 1 -- 172.21.15.177:0/2282934788 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480526d0 con 0x55dca09a4420 2024-03-20T13:35:07.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde47fff640 1 -- 172.21.15.177:0/2282934788 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde48052990 con 0x55dca09a4420 2024-03-20T13:35:07.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 -- 172.21.15.177:0/2282934788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 msgr2=0x55dca09a4840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 --2- 172.21.15.177:0/2282934788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca09a4840 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fde4800a470 tx=0x7fde4801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:07.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 -- 172.21.15.177:0/2282934788 shutdown_connections 2024-03-20T13:35:07.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 --2- 172.21.15.177:0/2282934788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca09a4840 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 -- 172.21.15.177:0/2282934788 >> 172.21.15.177:0/2282934788 conn(0x55dca09a0040 msgr2=0x55dca09a2460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 -- 172.21.15.177:0/2282934788 shutdown_connections 2024-03-20T13:35:07.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.401+0000 7fde5769d800 1 -- 172.21.15.177:0/2282934788 wait complete. 2024-03-20T13:35:07.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.412+0000 7fde5769d800 1 Processor -- start 2024-03-20T13:35:07.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5769d800 1 -- start start 2024-03-20T13:35:07.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5769d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a97bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5769d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dca08a4a30 con 0x55dca09a4420 2024-03-20T13:35:07.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a97bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a97bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56354/0 (socket says 172.21.15.177:56354) 2024-03-20T13:35:07.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5519c640 1 -- 172.21.15.177:0/3705120827 learned_addr learned my addr 172.21.15.177:0/3705120827 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.413+0000 7fde5519c640 1 -- 172.21.15.177:0/3705120827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde48005d20 con 0x55dca09a4420 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.414+0000 7fde5519c640 1 --2- 172.21.15.177:0/3705120827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a97bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde48055040 tx=0x7fde4804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9642c44d99ee64d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.414+0000 7fdd43606640 1 -- 172.21.15.177:0/3705120827 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde4800a180 con 0x55dca09a4420 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.414+0000 7fdd43606640 1 -- 172.21.15.177:0/3705120827 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4800a300 con 0x55dca09a4420 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.414+0000 7fdd43606640 1 -- 172.21.15.177:0/3705120827 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde480529b0 con 0x55dca09a4420 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- 172.21.15.177:0/3705120827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 msgr2=0x55dca0a97bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 --2- 172.21.15.177:0/3705120827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a97bd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fde48055040 tx=0x7fde4804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- 172.21.15.177:0/3705120827 shutdown_connections 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 --2- 172.21.15.177:0/3705120827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a97bd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- 172.21.15.177:0/3705120827 >> 172.21.15.177:0/3705120827 conn(0x55dca09a0040 msgr2=0x55dca0a934f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- 172.21.15.177:0/3705120827 shutdown_connections 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- 172.21.15.177:0/3705120827 wait complete. 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 Processor -- start 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- start start 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a9f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5769d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dca08a0210 con 0x55dca09a4420 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a9f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a9f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56360/0 (socket says 172.21.15.177:56360) 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.415+0000 7fde5519c640 1 -- 172.21.15.177:0/36386678 learned_addr learned my addr 172.21.15.177:0/36386678 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fde5519c640 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dca0919070 con 0x55dca09a4420 2024-03-20T13:35:07.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fde5519c640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a9f180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde4805f040 tx=0x7fde48002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fdd41e03640 1 -- 172.21.15.177:0/36386678 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde4806a070 con 0x55dca09a4420 2024-03-20T13:35:07.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fdd41e03640 1 -- 172.21.15.177:0/36386678 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4805d420 con 0x55dca09a4420 2024-03-20T13:35:07.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dca0a9f6c0 con 0x55dca09a4420 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fdd41e03640 1 -- 172.21.15.177:0/36386678 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde4805d6c0 con 0x55dca09a4420 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.416+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dca0a9fba0 con 0x55dca09a4420 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fdd41e03640 1 -- 172.21.15.177:0/36386678 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fde4805d820 con 0x55dca09a4420 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fdd41e03640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd3c036790 0x7fdd3c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fdd41e03640 1 -- 172.21.15.177:0/36386678 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fde4808dc50 con 0x55dca09a4420 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fde5499b640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd3c036790 0x7fdd3c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca09a4d80 0x55dca0aa5de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aa6360 con 0x55dca09a4d80 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fde5599d640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca09a4d80 0x55dca0aa5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.417+0000 7fde5499b640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd3c036790 0x7fdd3c038c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000f60 tx=0x7fde4c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5599d640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca09a4d80 0x55dca0aa5de0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5599d640 1 -- 172.21.15.177:0/36386678 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca09a4d80 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aa3530 con 0x55dca09a4d80 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5599d640 1 -- 172.21.15.177:0/36386678 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca09a4d80 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0aa85d0 0x55dca0aaa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aab090 con 0x55dca0aa85d0 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.418+0000 7fde5519c640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0aa85d0 0x55dca0aaa9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5519c640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0aa85d0 0x55dca0aaa9c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5519c640 1 -- 172.21.15.177:0/36386678 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fde48059040 con 0x55dca0aa85d0 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aa7520 con 0x55dca09a4d80 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5599d640 1 -- 172.21.15.177:0/36386678 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca09a4d80 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dca0aac4b0 0x55dca0aae8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aaefe0 con 0x55dca0aac4b0 2024-03-20T13:35:07.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.419+0000 7fde5499b640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dca0aac4b0 0x55dca0aae8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.420+0000 7fde5499b640 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dca0aac4b0 0x55dca0aae8a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.420+0000 7fde5499b640 1 -- 172.21.15.177:0/36386678 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0aac4b0 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5769d800 1 Processor -- start 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5769d800 1 -- start start 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5769d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 0x55dca0abd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5769d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dca0842c70 con 0x55dca0abd1c0 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 0x55dca0abd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 0x55dca0abd5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56372/0 (socket says 172.21.15.177:56372) 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5519c640 1 -- 172.21.15.177:0/3765288367 learned_addr learned my addr 172.21.15.177:0/3765288367 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5519c640 1 -- 172.21.15.177:0/3765288367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dca0abdb20 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.421+0000 7fde5519c640 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 0x55dca0abd5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde4808c000 tx=0x7fde480776a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.422+0000 7fdd3affd640 1 -- 172.21.15.177:0/3765288367 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde48077740 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.422+0000 7fdd3affd640 1 -- 172.21.15.177:0/3765288367 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480778a0 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.422+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dca0abe590 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.422+0000 7fdd3affd640 1 -- 172.21.15.177:0/3765288367 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde48065a10 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.422+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dca0abea50 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.422+0000 7fdd3affd640 1 -- 172.21.15.177:0/3765288367 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fde48065b70 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fdd3affd640 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd30036790 0x7fdd30038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fdd3affd640 1 -- 172.21.15.177:0/3765288367 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fde4805f110 con 0x55dca0abd1c0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fde5499b640 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd30036790 0x7fdd30038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fde5769d800 1 Processor -- start 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fde5769d800 1 -- start start 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fde5499b640 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd30036790 0x7fdd30038c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00bf50 tx=0x7fde4c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fde5769d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0aca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.423+0000 7fde5769d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dca08185d0 con 0x55dca0aca320 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.424+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0aca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.424+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0aca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56374/0 (socket says 172.21.15.177:56374) 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.424+0000 7fde5519c640 1 -- 172.21.15.177:0/939372814 learned_addr learned my addr 172.21.15.177:0/939372814 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.425+0000 7fde5519c640 1 -- 172.21.15.177:0/939372814 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dca0acacf0 con 0x55dca0aca320 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.425+0000 7fde5519c640 1 --2- 172.21.15.177:0/939372814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0aca720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde48078030 tx=0x7fde48060f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4b677af7c29a87 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.425+0000 7fdd38ff9640 1 -- 172.21.15.177:0/939372814 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde480a3070 con 0x55dca0aca320 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.425+0000 7fdd38ff9640 1 -- 172.21.15.177:0/939372814 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde480a4040 con 0x55dca0aca320 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.425+0000 7fdd38ff9640 1 -- 172.21.15.177:0/939372814 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde4807fde0 con 0x55dca0aca320 2024-03-20T13:35:07.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- 172.21.15.177:0/939372814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 msgr2=0x55dca0aca720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 --2- 172.21.15.177:0/939372814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0aca720 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fde48078030 tx=0x7fde48060f70 comp rx=0 tx=0).stop 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- 172.21.15.177:0/939372814 shutdown_connections 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 --2- 172.21.15.177:0/939372814 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0aca720 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- 172.21.15.177:0/939372814 >> 172.21.15.177:0/939372814 conn(0x55dca0ac65f0 msgr2=0x55dca0ac4650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- 172.21.15.177:0/939372814 shutdown_connections 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- 172.21.15.177:0/939372814 wait complete. 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 Processor -- start 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- start start 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0ad10e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.426+0000 7fde5769d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dca0ad1620 con 0x55dca0aca320 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.427+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0ad10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.427+0000 7fde5519c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0ad10e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56380/0 (socket says 172.21.15.177:56380) 2024-03-20T13:35:07.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.427+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 learned_addr learned my addr 172.21.15.177:0/3161238695 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.427+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dca0abe590 con 0x55dca0aca320 2024-03-20T13:35:07.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.428+0000 7fde5519c640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0ad10e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde4807fd60 tx=0x7fde48074ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.428+0000 7fdd26ffd640 1 -- 172.21.15.177:0/3161238695 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde480bb070 con 0x55dca0aca320 2024-03-20T13:35:07.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.428+0000 7fdd26ffd640 1 -- 172.21.15.177:0/3161238695 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde48083b60 con 0x55dca0aca320 2024-03-20T13:35:07.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.428+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dca0abe590 con 0x55dca0aca320 2024-03-20T13:35:07.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.428+0000 7fdd26ffd640 1 -- 172.21.15.177:0/3161238695 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde48083e00 con 0x55dca0aca320 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.428+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dca0abe590 con 0x55dca0aca320 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fdd26ffd640 1 -- 172.21.15.177:0/3161238695 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fde48079450 con 0x55dca0aca320 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fdd26ffd640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd200367e0 0x7fdd20038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fdd26ffd640 1 -- 172.21.15.177:0/3161238695 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fde480c59a0 con 0x55dca0aca320 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fde5499b640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd200367e0 0x7fdd20038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca0adc840 0x55dca0aded00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0adf450 con 0x55dca0adc840 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.429+0000 7fde5599d640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca0adc840 0x55dca0aded00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5499b640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd200367e0 0x7fdd20038ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fde4c001b60 tx=0x7fde4c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5599d640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca0adc840 0x55dca0aded00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 realm 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0adf820 con 0x55dca0adc840 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.430+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae0400 con 0x55dca0adc840 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0ae0db0 0x55dca0ae31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae37f0 con 0x55dca0ae0db0 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5519c640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0ae0db0 0x55dca0ae31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5519c640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0ae0db0 0x55dca0ae31a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 20 searching for the correct realm 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dca0ae5aa0 0x55dca0ae7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae8630 con 0x55dca0ae5aa0 2024-03-20T13:35:07.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.431+0000 7fde5499b640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dca0ae5aa0 0x55dca0ae7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.432+0000 7fde5499b640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dca0ae5aa0 0x55dca0ae7f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.432+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.432+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae8630 con 0x55dca0ae0db0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.432+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.432+0000 7fde5519c640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fde48055c00 0x7fde480ac920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.432+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae8630 con 0x7fde48055c00 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.433+0000 7fde5599d640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fde48055c00 0x7fde480ac920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.433+0000 7fde5599d640 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fde48055c00 0x7fde480ac920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.433+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.433+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.434+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae0db0 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.435+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae0db0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.436+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.437+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.437+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.437+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.437+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.437+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.437+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.438+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae0db0 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.439+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.439+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.439+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.439+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.439+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.439+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.440+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.440+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x7fde48055c00 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.441+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.441+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde50031040 con 0x55dca0ae0db0 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.441+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.441+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde50031040 con 0x55dca0ae5aa0 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.441+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.441+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde4c045040 con 0x7fde48055c00 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde4c045040 con 0x55dca0adc840 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde4c045040 con 0x55dca0ae0db0 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae00a0 con 0x55dca0adc840 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.442+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae3ea0 con 0x55dca0adc840 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae3e70 con 0x7fde48055c00 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 zone default found 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 4 Realm: () 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 zonegroup default 2024-03-20T13:35:07.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae4770 con 0x7fde48055c00 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.443+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae4770 con 0x55dca0ae5aa0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aea450 con 0x55dca0ae5aa0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 20 started sync module instance, tier type = 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.444+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0ae9d30 con 0x55dca0ae0db0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.445+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.445+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94406076962960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aeac50 con 0x55dca0ae0db0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.445+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aeb450 con 0x55dca0adc840 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.448+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.448+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94406076969152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aeba00 con 0x55dca0adc840 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.448+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aec4d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.448+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94406076962960] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.450+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.450+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94406076972976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aec880 con 0x55dca0ae5aa0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.450+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aed2e0 con 0x55dca0ae0db0 2024-03-20T13:35:07.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.450+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94406076969152] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.453+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94406076972976] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.453+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.453+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94406076970208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aed690 con 0x55dca0ae0db0 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.453+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aede90 con 0x55dca0adc840 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.454+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94406076970208] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.454+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.454+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94406076979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aede10 con 0x55dca0adc840 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.454+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aeebc0 con 0x7fde48055c00 2024-03-20T13:35:07.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.455+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94406076979696] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.457+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.457+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94406076981744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aeeaf0 con 0x7fde48055c00 2024-03-20T13:35:07.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.457+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aef5f0 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.459+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.459+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94406076985616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aef570 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.459+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94406076981744] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.459+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aee670 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94406076985616] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'6 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94406076987808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0aee670 con 0x7fde48055c00 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=0 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=1 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=2 2024-03-20T13:35:07.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=3 2024-03-20T13:35:07.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=4 2024-03-20T13:35:07.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=5 2024-03-20T13:35:07.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.460+0000 7fde5769d800 20 add_watcher() i=6 2024-03-20T13:35:07.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.462+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94406076987808] v30'7 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.462+0000 7fde5769d800 20 add_watcher() i=7 2024-03-20T13:35:07.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.462+0000 7fde5769d800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:07.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.462+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0af34b0 con 0x55dca0adc840 2024-03-20T13:35:07.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.462+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.462+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94406076989408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0af08d0 con 0x55dca0adc840 2024-03-20T13:35:07.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.463+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94406076989408] v30'26 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.463+0000 7fdd0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:07.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.463+0000 7fde5769d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:07.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.463+0000 7fde5769d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:07.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.463+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afbc70 con 0x55dca0adc840 2024-03-20T13:35:07.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.464+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.464+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afc130 con 0x7fde48055c00 2024-03-20T13:35:07.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.466+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'10 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.466+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afc130 con 0x55dca0ae5aa0 2024-03-20T13:35:07.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.467+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.467+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afc660 con 0x55dca0adc840 2024-03-20T13:35:07.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.470+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'27 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.470+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afcb90 con 0x55dca0ae0db0 2024-03-20T13:35:07.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.473+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'20 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.473+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afd0c0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.474+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'13 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.474+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afd5f0 con 0x55dca0adc840 2024-03-20T13:35:07.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.476+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.476+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afda90 con 0x7fde48055c00 2024-03-20T13:35:07.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.478+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'13 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.478+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afd0c0 con 0x55dca0ae0db0 2024-03-20T13:35:07.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.479+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.479+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afdc80 con 0x55dca0ae5aa0 2024-03-20T13:35:07.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.480+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.480+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe1b0 con 0x55dca0ae0db0 2024-03-20T13:35:07.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.481+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.481+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe6e0 con 0x7fde48055c00 2024-03-20T13:35:07.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.482+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.482+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afeb80 con 0x55dca0ae0db0 2024-03-20T13:35:07.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.483+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.483+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x7fde48055c00 2024-03-20T13:35:07.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.487+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.487+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0adc840 2024-03-20T13:35:07.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.488+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'28 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.488+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.490+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.490+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae0db0 2024-03-20T13:35:07.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.492+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'22 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.492+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.494+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'10 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.494+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0adc840 2024-03-20T13:35:07.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.497+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'18 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.497+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0adc840 2024-03-20T13:35:07.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.498+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.498+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.499+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.500+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae0db0 2024-03-20T13:35:07.503 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.500+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.503 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.500+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.502+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.502+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.505+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.505+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.506+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'6 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.506+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.508+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'14 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.508+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x7fde48055c00 2024-03-20T13:35:07.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.510+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.510+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.511+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'10 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.511+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x7fde48055c00 2024-03-20T13:35:07.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.512+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'14 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.512+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.513+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'16 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.513+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x7fde48055c00 2024-03-20T13:35:07.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.515+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'20 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.515+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0afe8d0 con 0x55dca0ae0db0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.516+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.516+0000 7fdd0afe5640 20 reqs_thread_entry: start 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.516+0000 7fde5769d800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.516+0000 7fde5769d800 20 Filter name: none 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fdd08fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5769d800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5769d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0ae0db0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5769d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5769d800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-03-20T13:35:07.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.517+0000 7fde5769d800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:35:07.521 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:35:07.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.518+0000 7fdd0bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:07.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.518+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94406076989408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0adc840 2024-03-20T13:35:07.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.519+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94406076989408] v30'30 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.519+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94406076962960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0ae0db0 2024-03-20T13:35:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.519+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94406076962960] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.520+0000 7fde5769d800 20 remove_watcher() i=0 2024-03-20T13:35:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.520+0000 7fde5769d800 2 removed watcher, disabling cache 2024-03-20T13:35:07.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.520+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94406076969152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0adc840 2024-03-20T13:35:07.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.521+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94406076969152] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.521+0000 7fde5769d800 20 remove_watcher() i=1 2024-03-20T13:35:07.523 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.521+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94406076972976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0ae5aa0 2024-03-20T13:35:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.522+0000 7fde5499b640 1 -- 172.21.15.177:0/3161238695 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94406076972976] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde4c006070 con 0x55dca0ae5aa0 2024-03-20T13:35:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.522+0000 7fde5769d800 20 remove_watcher() i=2 2024-03-20T13:35:07.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.523+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94406076970208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0ae0db0 2024-03-20T13:35:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.523+0000 7fde5519c640 1 -- 172.21.15.177:0/3161238695 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94406076970208] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde480bd070 con 0x55dca0ae0db0 2024-03-20T13:35:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.523+0000 7fde5769d800 20 remove_watcher() i=3 2024-03-20T13:35:07.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.523+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94406076979696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x55dca0adc840 2024-03-20T13:35:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.524+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94406076979696] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x55dca0adc840 2024-03-20T13:35:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.524+0000 7fde5769d800 20 remove_watcher() i=4 2024-03-20T13:35:07.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.524+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94406076981744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x7fde48055c00 2024-03-20T13:35:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.526+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94406076981744] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.526+0000 7fde5769d800 20 remove_watcher() i=5 2024-03-20T13:35:07.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.526+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94406076985616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x7fde48055c00 2024-03-20T13:35:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.527+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94406076985616] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.527+0000 7fde5769d800 20 remove_watcher() i=6 2024-03-20T13:35:07.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.527+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94406076987808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dca0b283b0 con 0x7fde48055c00 2024-03-20T13:35:07.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.528+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94406076987808] v30'8 uv6 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fde5000a4a0 con 0x7fde48055c00 2024-03-20T13:35:07.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.528+0000 7fde5769d800 20 remove_watcher() i=7 2024-03-20T13:35:07.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fde48055c00 msgr2=0x7fde480ac920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fde48055c00 0x7fde480ac920 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca0adc840 msgr2=0x55dca0aded00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca0adc840 0x55dca0aded00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0ae0db0 msgr2=0x55dca0ae31a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0ae0db0 0x55dca0ae31a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dca0ae5aa0 msgr2=0x55dca0ae7f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dca0ae5aa0 0x55dca0ae7f60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd200367e0 msgr2=0x7fdd20038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd200367e0 0x7fdd20038ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fde4c001b60 tx=0x7fde4c010000 comp rx=0 tx=0).stop 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 msgr2=0x55dca0ad10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3161238695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0aca320 0x55dca0ad10e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fde4807fd60 tx=0x7fde48074ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5599d640 1 -- 172.21.15.177:0/3161238695 reap_dead start 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 shutdown_connections 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 >> 172.21.15.177:0/3161238695 conn(0x55dca0ac65f0 msgr2=0x55dca0ac3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 shutdown_connections 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3161238695 wait complete. 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd30036790 msgr2=0x7fdd30038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd30036790 0x7fdd30038c50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00bf50 tx=0x7fde4c00f000 comp rx=0 tx=0).stop 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 msgr2=0x55dca0abd5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 0x55dca0abd5e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fde4808c000 tx=0x7fde480776a0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 shutdown_connections 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd30036790 0x7fdd30038c50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 --2- 172.21.15.177:0/3765288367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca0abd1c0 0x55dca0abd5e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 >> 172.21.15.177:0/3765288367 conn(0x55dca0ab1260 msgr2=0x55dca0ab1660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 shutdown_connections 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.529+0000 7fde5769d800 1 -- 172.21.15.177:0/3765288367 wait complete. 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dca0aac4b0 msgr2=0x55dca0aae8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dca0aac4b0 0x55dca0aae8a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca09a4d80 msgr2=0x55dca0aa5de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dca09a4d80 0x55dca0aa5de0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0aa85d0 msgr2=0x55dca0aaa9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dca0aa85d0 0x55dca0aaa9c0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd3c036790 msgr2=0x7fdd3c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdd3c036790 0x7fdd3c038c50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fde4c000f60 tx=0x7fde4c0012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 msgr2=0x55dca0a9f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 --2- 172.21.15.177:0/36386678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dca09a4420 0x55dca0a9f180 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fde4805f040 tx=0x7fde48002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5599d640 1 -- 172.21.15.177:0/36386678 reap_dead start 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 shutdown_connections 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 >> 172.21.15.177:0/36386678 conn(0x55dca09a0040 msgr2=0x55dca0a91d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 shutdown_connections 2024-03-20T13:35:07.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.530+0000 7fde5769d800 1 -- 172.21.15.177:0/36386678 wait complete. 2024-03-20T13:35:07.540 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:35:07.541 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-03-20T13:35:07.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-03-20T13:35:07.541 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-03-20T13:35:07.624 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:07.624 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.622+0000 7ff4b4c9d800 1 Processor -- start 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.622+0000 7ff4b4c9d800 1 -- start start 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.622+0000 7ff4b4c9d800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56433aed8120 0x56433aeda510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.622+0000 7ff4b4c9d800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56433ae1ecd0 con 0x56433aed4610 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.622+0000 7ff4b4c9d800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56433add5500 con 0x56433aed8120 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.623+0000 7ff4b1f9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56433aed8120 0x56433aeda510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.623+0000 7ff4b279c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56433aed4610 0x56433aed6a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36790/0 (socket says 172.21.15.177:36790) 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.623+0000 7ff4b279c640 1 -- 172.21.15.177:0/1354939952 learned_addr learned my addr 172.21.15.177:0/1354939952 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:07.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.623+0000 7ff4b1f9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56433aed8120 0x56433aeda510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56392/0 (socket says 172.21.15.177:56392) 2024-03-20T13:35:07.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.623+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/1354939952 >> v1:172.21.15.28:6789/0 conn(0x56433aed4610 legacy=0x56433aed6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.623+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/1354939952 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433aedba60 con 0x56433aed8120 2024-03-20T13:35:07.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/1354939952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed8120 0x56433aeda510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800a470 tx=0x7ff4a801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbaf257c20d2fd52 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b179a640 1 -- 172.21.15.177:0/1354939952 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a8052570 con 0x56433aed8120 2024-03-20T13:35:07.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b179a640 1 -- 172.21.15.177:0/1354939952 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a80526d0 con 0x56433aed8120 2024-03-20T13:35:07.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b179a640 1 -- 172.21.15.177:0/1354939952 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a8052990 con 0x56433aed8120 2024-03-20T13:35:07.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/1354939952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed8120 msgr2=0x56433aeda510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/1354939952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed8120 0x56433aeda510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4a800a470 tx=0x7ff4a801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:07.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/1354939952 shutdown_connections 2024-03-20T13:35:07.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/1354939952 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed8120 0x56433aeda510 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.625+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/1354939952 >> 172.21.15.177:0/1354939952 conn(0x56433aece040 msgr2=0x56433aed0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.626+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/1354939952 shutdown_connections 2024-03-20T13:35:07.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.626+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/1354939952 wait complete. 2024-03-20T13:35:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.637+0000 7ff4b4c9d800 1 Processor -- start 2024-03-20T13:35:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.637+0000 7ff4b4c9d800 1 -- start start 2024-03-20T13:35:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.637+0000 7ff4b4c9d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afc3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.637+0000 7ff4b4c9d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433add2a30 con 0x56433aed4610 2024-03-20T13:35:07.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.639+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afc3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.639+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afc3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56400/0 (socket says 172.21.15.177:56400) 2024-03-20T13:35:07.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.639+0000 7ff4b279c640 1 -- 172.21.15.177:0/3691668039 learned_addr learned my addr 172.21.15.177:0/3691668039 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.641+0000 7ff4b279c640 1 -- 172.21.15.177:0/3691668039 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4a8005d20 con 0x56433aed4610 2024-03-20T13:35:07.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.643+0000 7ff4b279c640 1 --2- 172.21.15.177:0/3691668039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afc3a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4001bc0 tx=0x7ff4a400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbe3e67ceed5650d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.644+0000 7ff3a0608640 1 -- 172.21.15.177:0/3691668039 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a400e470 con 0x56433aed4610 2024-03-20T13:35:07.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.644+0000 7ff3a0608640 1 -- 172.21.15.177:0/3691668039 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a400e5f0 con 0x56433aed4610 2024-03-20T13:35:07.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.644+0000 7ff3a0608640 1 -- 172.21.15.177:0/3691668039 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a400e950 con 0x56433aed4610 2024-03-20T13:35:07.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3691668039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 msgr2=0x56433afc3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3691668039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afc3a30 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4001bc0 tx=0x7ff4a400b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3691668039 shutdown_connections 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3691668039 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afc3a30 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3691668039 >> 172.21.15.177:0/3691668039 conn(0x56433aece040 msgr2=0x56433afbf350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3691668039 shutdown_connections 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3691668039 wait complete. 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 Processor -- start 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.645+0000 7ff4b4c9d800 1 -- start start 2024-03-20T13:35:07.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b4c9d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afcb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b4c9d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433adce210 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afcb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afcb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56410/0 (socket says 172.21.15.177:56410) 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b279c640 1 -- 172.21.15.177:0/3975979043 learned_addr learned my addr 172.21.15.177:0/3975979043 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b279c640 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433ae1ecd0 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.646+0000 7ff4b279c640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afcb1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400c010 tx=0x7ff4a4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.647+0000 7ff39ee05640 1 -- 172.21.15.177:0/3975979043 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a401f070 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.647+0000 7ff39ee05640 1 -- 172.21.15.177:0/3975979043 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40197c0 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.647+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56433afcb710 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.647+0000 7ff39ee05640 1 -- 172.21.15.177:0/3975979043 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4019ae0 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.647+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56433afcbbf0 con 0x56433aed4610 2024-03-20T13:35:07.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.647+0000 7ff39ee05640 1 -- 172.21.15.177:0/3975979043 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff4a4019c40 con 0x56433aed4610 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff39ee05640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff398036830 0x7ff398038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff39ee05640 1 -- 172.21.15.177:0/3975979043 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff4a404c5a0 con 0x56433aed4610 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff398036830 0x7ff398038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433aed8120 0x56433afd1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433afd2460 con 0x56433aed8120 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b2f9d640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433aed8120 0x56433afd1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff398036830 0x7ff398038cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8054000 tx=0x7ff4a804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b2f9d640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433aed8120 0x56433afd1e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/3975979043 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433aed8120 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.648+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433afcf530 con 0x56433aed8120 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/3975979043 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433aed8120 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433afd46a0 0x56433afd6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433afd7160 con 0x56433afd46a0 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b279c640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433afd46a0 0x56433afd6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b279c640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433afd46a0 0x56433afd6a90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b279c640 1 -- 172.21.15.177:0/3975979043 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433afd46a0 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.649+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433afd35f0 con 0x56433aed8120 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.650+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/3975979043 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433aed8120 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.650+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56433afd8580 0x56433afda970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.650+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433afdb070 con 0x56433afd8580 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.650+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56433afd8580 0x56433afda970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:07.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.650+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56433afd8580 0x56433afda970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:07.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.651+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/3975979043 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff4a8059040 con 0x56433afd8580 2024-03-20T13:35:07.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.651+0000 7ff4b4c9d800 1 Processor -- start 2024-03-20T13:35:07.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.651+0000 7ff4b4c9d800 1 -- start start 2024-03-20T13:35:07.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.651+0000 7ff4b4c9d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 0x56433afe9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:07.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:07.651+0000 7ff4b4c9d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433ad70c70 con 0x56433afe91e0 2024-03-20T13:35:08.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.702+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 0x56433afe9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.702+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 0x56433afe9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56426/0 (socket says 172.21.15.177:56426) 2024-03-20T13:35:08.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.702+0000 7ff4b279c640 1 -- 172.21.15.177:0/2825023818 learned_addr learned my addr 172.21.15.177:0/2825023818 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.705+0000 7ff4b279c640 1 -- 172.21.15.177:0/2825023818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433afe9b40 con 0x56433afe91e0 2024-03-20T13:35:08.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.706+0000 7ff4b279c640 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 0x56433afe9600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4014040 tx=0x7ff4a40494b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.707+0000 7ff397fff640 1 -- 172.21.15.177:0/2825023818 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a403d070 con 0x56433afe91e0 2024-03-20T13:35:08.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.707+0000 7ff397fff640 1 -- 172.21.15.177:0/2825023818 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4016980 con 0x56433afe91e0 2024-03-20T13:35:08.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.707+0000 7ff397fff640 1 -- 172.21.15.177:0/2825023818 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4033040 con 0x56433afe91e0 2024-03-20T13:35:08.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.707+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56433afea5b0 con 0x56433afe91e0 2024-03-20T13:35:08.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.707+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56433afeaa70 con 0x56433afe91e0 2024-03-20T13:35:08.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.708+0000 7ff397fff640 1 -- 172.21.15.177:0/2825023818 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff4a4016c20 con 0x56433afe91e0 2024-03-20T13:35:08.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff397fff640 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff38c036880 0x7ff38c038d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff397fff640 1 -- 172.21.15.177:0/2825023818 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff4a403f030 con 0x56433afe91e0 2024-03-20T13:35:08.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff38c036880 0x7ff38c038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff4b4c9d800 1 Processor -- start 2024-03-20T13:35:08.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff4b4c9d800 1 -- start start 2024-03-20T13:35:08.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff38c036880 0x7ff38c038d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x56433afcf8b0 tx=0x7ff4a8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff4b4c9d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433aed2400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.709+0000 7ff4b4c9d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433ad465d0 con 0x56433aed3d10 2024-03-20T13:35:08.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.710+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433aed2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.710+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433aed2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56430/0 (socket says 172.21.15.177:56430) 2024-03-20T13:35:08.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.710+0000 7ff4b279c640 1 -- 172.21.15.177:0/3596822466 learned_addr learned my addr 172.21.15.177:0/3596822466 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.710+0000 7ff4b279c640 1 -- 172.21.15.177:0/3596822466 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433aed41c0 con 0x56433aed3d10 2024-03-20T13:35:08.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.710+0000 7ff4b279c640 1 --2- 172.21.15.177:0/3596822466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433aed2400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff4a404c010 tx=0x7ff4a400da70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e4cc3230a0bf37f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.711+0000 7ff395ffb640 1 -- 172.21.15.177:0/3596822466 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a40183e0 con 0x56433aed3d10 2024-03-20T13:35:08.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.711+0000 7ff395ffb640 1 -- 172.21.15.177:0/3596822466 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a4023c50 con 0x56433aed3d10 2024-03-20T13:35:08.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.711+0000 7ff395ffb640 1 -- 172.21.15.177:0/3596822466 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4044540 con 0x56433aed3d10 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.711+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3596822466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 msgr2=0x56433aed2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.711+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3596822466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433aed2400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff4a404c010 tx=0x7ff4a400da70 comp rx=0 tx=0).stop 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3596822466 shutdown_connections 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3596822466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433aed2400 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3596822466 >> 172.21.15.177:0/3596822466 conn(0x56433aff26d0 msgr2=0x56433aff0730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3596822466 shutdown_connections 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3596822466 wait complete. 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 Processor -- start 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 -- start start 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433afff530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b4c9d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56433afffa70 con 0x56433aed3d10 2024-03-20T13:35:08.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.712+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433afff530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff4b279c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433afff530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56436/0 (socket says 172.21.15.177:56436) 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 learned_addr learned my addr 172.21.15.177:0/500363872 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56433afeaa70 con 0x56433aed3d10 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff4b279c640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433afff530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4039f30 tx=0x7ff4a4039ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff383fff640 1 -- 172.21.15.177:0/500363872 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4018ad0 con 0x56433aed3d10 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff383fff640 1 -- 172.21.15.177:0/500363872 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4a40183e0 con 0x56433aed3d10 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56433afeaa70 con 0x56433aed3d10 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff383fff640 1 -- 172.21.15.177:0/500363872 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4a4018730 con 0x56433aed3d10 2024-03-20T13:35:08.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.713+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56433afeaa70 con 0x56433aed3d10 2024-03-20T13:35:08.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.714+0000 7ff383fff640 1 -- 172.21.15.177:0/500363872 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff4a40429d0 con 0x56433aed3d10 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.715+0000 7ff383fff640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff37c0367e0 0x7ff37c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.715+0000 7ff383fff640 1 -- 172.21.15.177:0/500363872 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff4a4067040 con 0x56433aed3d10 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.715+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff37c0367e0 0x7ff37c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.715+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff37c0367e0 0x7ff37c038ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8052fd0 tx=0x7ff4a804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.715+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433b00abd0 0x56433b00d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00d7e0 con 0x56433b00abd0 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b2f9d640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433b00abd0 0x56433b00d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b2f9d640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433b00abd0 0x56433b00d090 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b4c9d800 20 realm 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.716+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00dbb0 con 0x56433b00abd0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e790 con 0x56433b00abd0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:08.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433b00f140 0x56433b011530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b011b40 con 0x56433b00f140 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.717+0000 7ff4b279c640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433b00f140 0x56433b011530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b279c640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433b00f140 0x56433b011530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b4c9d800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b4c9d800 20 searching for the correct realm 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56433b013e30 0x56433b0162f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b0169c0 con 0x56433b013e30 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.718+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56433b013e30 0x56433b0162f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.719+0000 7ff4b1f9b640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56433b013e30 0x56433b0162f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.719+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.719+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b0169c0 con 0x56433b00f140 2024-03-20T13:35:08.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.719+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.719+0000 7ff4b279c640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff4a4023330 0x7ff4a404c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.720+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b0169c0 con 0x7ff4a4023330 2024-03-20T13:35:08.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.720+0000 7ff4b2f9d640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff4a4023330 0x7ff4a404c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.720+0000 7ff4b2f9d640 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff4a4023330 0x7ff4a404c800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.721+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.721+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.721+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.721+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.721+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.721+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.722+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.722+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.722+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.722+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00f140 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.722+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.722+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.723+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00f140 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.724+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.724+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.724+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.724+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.724+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.724+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.725+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.725+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.725+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.725+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.725+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.725+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.726+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.726+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.726+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.726+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.727+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.727+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.727+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.727+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00f140 2024-03-20T13:35:08.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.727+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.727+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.728+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.728+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.728+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.728+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b013e30 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.728+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.728+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x7ff4a4023330 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.729+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.729+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff4ac031040 con 0x56433b00f140 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.729+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.729+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff4ac031040 con 0x56433b013e30 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.729+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.729+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff4ac031040 con 0x7ff4a4023330 2024-03-20T13:35:08.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff4ac031040 con 0x56433b00abd0 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff4ac031040 con 0x56433b00f140 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.730+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b00e430 con 0x56433b00abd0 2024-03-20T13:35:08.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b012230 con 0x56433b00abd0 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b012230 con 0x7ff4a4023330 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 zone default found 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 4 Realm: () 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:08.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 zonegroup default 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.731+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b012b00 con 0x7ff4a4023330 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b012b00 con 0x56433b013e30 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b0187e0 con 0x56433b013e30 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 started sync module instance, tier type = 2024-03-20T13:35:08.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.732+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b017c70 con 0x56433b00f140 2024-03-20T13:35:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.734+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.734+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94846752751568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b0183f0 con 0x56433b00f140 2024-03-20T13:35:08.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.734+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b019480 con 0x56433b00abd0 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.735+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94846752751568] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.735+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.735+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94846752754976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b019760 con 0x56433b00abd0 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.735+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01a210 con 0x56433b013e30 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.736+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94846752754976] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.737+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.737+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94846752759056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01a5f0 con 0x56433b013e30 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.737+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01aff0 con 0x56433b00f140 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.738+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.738+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94846752759056] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.738+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94846752764880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01bc90 con 0x56433b00f140 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.738+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01c160 con 0x56433b00abd0 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.739+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94846752764880] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.740+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.740+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94846752756160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01c160 con 0x56433b00abd0 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.740+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01cba0 con 0x7ff4a4023330 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.741+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.741+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94846752769664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01cb60 con 0x7ff4a4023330 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.741+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01dad0 con 0x7ff4a4023330 2024-03-20T13:35:08.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.741+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94846752756160] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.742+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94846752769664] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.742+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.742+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94846752773616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01cf50 con 0x7ff4a4023330 2024-03-20T13:35:08.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.742+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01e0e0 con 0x7ff4a4023330 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'9 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94846752775232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01e500 con 0x7ff4a4023330 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=0 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=1 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=2 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94846752773616] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=3 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=4 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=5 2024-03-20T13:35:08.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.744+0000 7ff4b4c9d800 20 add_watcher() i=6 2024-03-20T13:35:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.745+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94846752775232] v30'10 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.745+0000 7ff4b4c9d800 20 add_watcher() i=7 2024-03-20T13:35:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.745+0000 7ff4b4c9d800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:08.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.745+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b021530 con 0x56433b00abd0 2024-03-20T13:35:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.745+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.745+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94846752776288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01ea30 con 0x56433b00abd0 2024-03-20T13:35:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.746+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94846752776288] v30'31 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.747+0000 7ff368fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.747+0000 7ff4b4c9d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.747+0000 7ff4b4c9d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:08.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.747+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b029c50 con 0x56433b00abd0 2024-03-20T13:35:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.748+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.748+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02a110 con 0x7ff4a4023330 2024-03-20T13:35:08.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.749+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'11 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.749+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02a110 con 0x56433b013e30 2024-03-20T13:35:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.750+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.750+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02aae0 con 0x56433b00abd0 2024-03-20T13:35:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.751+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'32 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.751+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b025b80 con 0x56433b00f140 2024-03-20T13:35:08.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.752+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'23 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.752+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b025b80 con 0x56433b013e30 2024-03-20T13:35:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.754+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'15 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.754+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02bcc0 con 0x56433b00abd0 2024-03-20T13:35:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.755+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.755+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02bcc0 con 0x7ff4a4023330 2024-03-20T13:35:08.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.756+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'15 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.756+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02bd50 con 0x56433b00f140 2024-03-20T13:35:08.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.757+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.758+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02c300 con 0x56433b013e30 2024-03-20T13:35:08.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.759+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.759+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02c830 con 0x56433b00f140 2024-03-20T13:35:08.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.760+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.760+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02cd60 con 0x7ff4a4023330 2024-03-20T13:35:08.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.761+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.761+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02cd60 con 0x56433b00f140 2024-03-20T13:35:08.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.762+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.762+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02cea0 con 0x7ff4a4023330 2024-03-20T13:35:08.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.766+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.766+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02ccd0 con 0x56433b00abd0 2024-03-20T13:35:08.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.766+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.766+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02ccd0 con 0x56433b013e30 2024-03-20T13:35:08.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.767+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.767+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b027d00 con 0x56433b00f140 2024-03-20T13:35:08.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.768+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'25 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.768+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.771+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'11 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.771+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b00abd0 2024-03-20T13:35:08.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.773+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'19 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.773+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b00abd0 2024-03-20T13:35:08.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.782+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'34 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.782+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.783+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.783+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b00f140 2024-03-20T13:35:08.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.784+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.784+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.785+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.785+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.786+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.786+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.787+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'7 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.787+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.789+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.791 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.789+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x7ff4a4023330 2024-03-20T13:35:08.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.792+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.792+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.792+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'11 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.792+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x7ff4a4023330 2024-03-20T13:35:08.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.793+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'16 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.793+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b013e30 2024-03-20T13:35:08.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.795+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'19 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.795+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x7ff4a4023330 2024-03-20T13:35:08.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.797+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'22 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.797+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b028300 con 0x56433b00f140 2024-03-20T13:35:08.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.798+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.798+0000 7ff2e37fe640 20 reqs_thread_entry: start 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 20 Filter name: none 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff2e17fa640 20 reqs_thread_entry: start 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b056c50 con 0x7ff4a4023330 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.799+0000 7ff4b4c9d800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:35:08.802 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:35:08.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.800+0000 7ff368fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:08.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.800+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94846752776288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b02a700 con 0x56433b00abd0 2024-03-20T13:35:08.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.801+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94846752776288] v30'35 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.801+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94846752751568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01e060 con 0x56433b00f140 2024-03-20T13:35:08.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.803+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94846752751568] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.803+0000 7ff4b4c9d800 20 remove_watcher() i=0 2024-03-20T13:35:08.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.803+0000 7ff4b4c9d800 2 removed watcher, disabling cache 2024-03-20T13:35:08.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.803+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94846752754976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01e060 con 0x56433b00abd0 2024-03-20T13:35:08.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.804+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94846752754976] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.804+0000 7ff4b4c9d800 20 remove_watcher() i=1 2024-03-20T13:35:08.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.804+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94846752759056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b018d20 con 0x56433b013e30 2024-03-20T13:35:08.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.805+0000 7ff4b1f9b640 1 -- 172.21.15.177:0/500363872 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94846752759056] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a8059040 con 0x56433b013e30 2024-03-20T13:35:08.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.805+0000 7ff4b4c9d800 20 remove_watcher() i=2 2024-03-20T13:35:08.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.805+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94846752764880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01e060 con 0x56433b00f140 2024-03-20T13:35:08.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.806+0000 7ff4b279c640 1 -- 172.21.15.177:0/500363872 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94846752764880] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4a40175a0 con 0x56433b00f140 2024-03-20T13:35:08.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.806+0000 7ff4b4c9d800 20 remove_watcher() i=3 2024-03-20T13:35:08.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.806+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94846752756160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b019d10 con 0x56433b00abd0 2024-03-20T13:35:08.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.807+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94846752756160] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x56433b00abd0 2024-03-20T13:35:08.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.807+0000 7ff4b4c9d800 20 remove_watcher() i=4 2024-03-20T13:35:08.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.807+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94846752769664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b018d20 con 0x7ff4a4023330 2024-03-20T13:35:08.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.809+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94846752769664] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.809+0000 7ff4b4c9d800 20 remove_watcher() i=5 2024-03-20T13:35:08.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.809+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94846752773616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b01e060 con 0x7ff4a4023330 2024-03-20T13:35:08.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.810+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94846752773616] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.810+0000 7ff4b4c9d800 20 remove_watcher() i=6 2024-03-20T13:35:08.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.810+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94846752775232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56433b019d10 con 0x7ff4a4023330 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94846752775232] v30'11 uv9 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff4ac00a4a0 con 0x7ff4a4023330 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 20 remove_watcher() i=7 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff4a4023330 msgr2=0x7ff4a404c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff4a4023330 0x7ff4a404c800 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433b00abd0 msgr2=0x56433b00d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433b00abd0 0x56433b00d090 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433b00f140 msgr2=0x56433b011530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433b00f140 0x56433b011530 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56433b013e30 msgr2=0x56433b0162f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56433b013e30 0x56433b0162f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff37c0367e0 msgr2=0x7ff37c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff37c0367e0 0x7ff37c038ca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8052fd0 tx=0x7ff4a804f000 comp rx=0 tx=0).stop 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 msgr2=0x56433afff530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/500363872 reap_dead start 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433afff530 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4039f30 tx=0x7ff4a4039ec0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 shutdown_connections 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/500363872 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed3d10 0x56433afff530 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 >> 172.21.15.177:0/500363872 conn(0x56433aff26d0 msgr2=0x56433afefd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 shutdown_connections 2024-03-20T13:35:08.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.811+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/500363872 wait complete. 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff38c036880 msgr2=0x7ff38c038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff38c036880 0x7ff38c038d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x56433afcf8b0 tx=0x7ff4a8005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 msgr2=0x56433afe9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 0x56433afe9600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff4a4014040 tx=0x7ff4a40494b0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 shutdown_connections 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff38c036880 0x7ff38c038d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/2825023818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433afe91e0 0x56433afe9600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 >> 172.21.15.177:0/2825023818 conn(0x56433afdd280 msgr2=0x56433afdd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 shutdown_connections 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/2825023818 wait complete. 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56433afd8580 msgr2=0x56433afda970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56433afd8580 0x56433afda970 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433aed8120 msgr2=0x56433afd1e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56433aed8120 0x56433afd1e90 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433afd46a0 msgr2=0x56433afd6a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56433afd46a0 0x56433afd6a90 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff398036830 msgr2=0x7ff398038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff398036830 0x7ff398038cf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4a8054000 tx=0x7ff4a804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 msgr2=0x56433afcb1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 --2- 172.21.15.177:0/3975979043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56433aed4610 0x56433afcb1d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7ff4a400c010 tx=0x7ff4a4000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b2f9d640 1 -- 172.21.15.177:0/3975979043 reap_dead start 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 shutdown_connections 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 >> 172.21.15.177:0/3975979043 conn(0x56433aece040 msgr2=0x56433afbdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 shutdown_connections 2024-03-20T13:35:08.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.812+0000 7ff4b4c9d800 1 -- 172.21.15.177:0/3975979043 wait complete. 2024-03-20T13:35:08.822 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:35:08.823 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-03-20T13:35:08.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-03-20T13:35:08.823 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-03-20T13:35:08.907 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:08.908 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:08.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.905+0000 7f25bd811800 1 Processor -- start 2024-03-20T13:35:08.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.905+0000 7f25bd811800 1 -- start start 2024-03-20T13:35:08.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25bd811800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5611678565f0 0x5611678589e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25bd811800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5611677a0cd0 con 0x561167858f20 2024-03-20T13:35:08.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25bd811800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561167757500 con 0x5611678565f0 2024-03-20T13:35:08.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25b8e72640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5611678565f0 0x5611678589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25b8e72640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5611678565f0 0x5611678589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56452/0 (socket says 172.21.15.177:56452) 2024-03-20T13:35:08.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25b8671640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x561167858f20 0x56116785b310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36792/0 (socket says 172.21.15.177:36792) 2024-03-20T13:35:08.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25b8e72640 1 -- 172.21.15.177:0/3167561553 learned_addr learned my addr 172.21.15.177:0/3167561553 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25b8e72640 1 -- 172.21.15.177:0/3167561553 >> v1:172.21.15.28:6789/0 conn(0x561167858f20 legacy=0x56116785b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.906+0000 7f25b8e72640 1 -- 172.21.15.177:0/3167561553 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56116785da40 con 0x5611678565f0 2024-03-20T13:35:08.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.908+0000 7f25b8e72640 1 --2- 172.21.15.177:0/3167561553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611678589e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25a800a520 tx=0x7f25a801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc2882f9bebeea86 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25b7e70640 1 -- 172.21.15.177:0/3167561553 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8052570 con 0x5611678565f0 2024-03-20T13:35:08.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25b7e70640 1 -- 172.21.15.177:0/3167561553 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80526d0 con 0x5611678565f0 2024-03-20T13:35:08.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25b7e70640 1 -- 172.21.15.177:0/3167561553 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8052990 con 0x5611678565f0 2024-03-20T13:35:08.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 -- 172.21.15.177:0/3167561553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 msgr2=0x5611678589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 --2- 172.21.15.177:0/3167561553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611678589e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f25a800a520 tx=0x7f25a801cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 -- 172.21.15.177:0/3167561553 shutdown_connections 2024-03-20T13:35:08.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 --2- 172.21.15.177:0/3167561553 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611678589e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 -- 172.21.15.177:0/3167561553 >> 172.21.15.177:0/3167561553 conn(0x561167850040 msgr2=0x561167852460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 -- 172.21.15.177:0/3167561553 shutdown_connections 2024-03-20T13:35:08.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.909+0000 7f25bd811800 1 -- 172.21.15.177:0/3167561553 wait complete. 2024-03-20T13:35:08.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.921+0000 7f25bd811800 1 Processor -- start 2024-03-20T13:35:08.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.921+0000 7f25bd811800 1 -- start start 2024-03-20T13:35:08.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.921+0000 7f25bd811800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611679459e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.921+0000 7f25bd811800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561167754a30 con 0x5611678565f0 2024-03-20T13:35:08.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.922+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611679459e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.922+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611679459e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56460/0 (socket says 172.21.15.177:56460) 2024-03-20T13:35:08.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.922+0000 7f25b8e72640 1 -- 172.21.15.177:0/1155190657 learned_addr learned my addr 172.21.15.177:0/1155190657 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.922+0000 7f25b8e72640 1 -- 172.21.15.177:0/1155190657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8005de0 con 0x5611678565f0 2024-03-20T13:35:08.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.922+0000 7f25b8e72640 1 --2- 172.21.15.177:0/1155190657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611679459e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f25a801cf20 tx=0x7f25a804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=340df3702f9b6711 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f24a6e0d640 1 -- 172.21.15.177:0/1155190657 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8052840 con 0x5611678565f0 2024-03-20T13:35:08.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f24a6e0d640 1 -- 172.21.15.177:0/1155190657 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a80529a0 con 0x5611678565f0 2024-03-20T13:35:08.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f24a6e0d640 1 -- 172.21.15.177:0/1155190657 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8052c80 con 0x5611678565f0 2024-03-20T13:35:08.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f25bd811800 1 -- 172.21.15.177:0/1155190657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 msgr2=0x5611679459e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f25bd811800 1 --2- 172.21.15.177:0/1155190657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611679459e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f25a801cf20 tx=0x7f25a804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:08.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f25bd811800 1 -- 172.21.15.177:0/1155190657 shutdown_connections 2024-03-20T13:35:08.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f25bd811800 1 --2- 172.21.15.177:0/1155190657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x5611679459e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.923+0000 7f25bd811800 1 -- 172.21.15.177:0/1155190657 >> 172.21.15.177:0/1155190657 conn(0x561167850040 msgr2=0x561167941300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25bd811800 1 -- 172.21.15.177:0/1155190657 shutdown_connections 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25bd811800 1 -- 172.21.15.177:0/1155190657 wait complete. 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25bd811800 1 Processor -- start 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25bd811800 1 -- start start 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25bd811800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x561167855f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25bd811800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561167750210 con 0x5611678565f0 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x561167855f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x561167855f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56464/0 (socket says 172.21.15.177:56464) 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.924+0000 7f25b8e72640 1 -- 172.21.15.177:0/1624158912 learned_addr learned my addr 172.21.15.177:0/1624158912 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f25b8e72640 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56116785da40 con 0x5611678565f0 2024-03-20T13:35:08.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f25b8e72640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x561167855f30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25a801ceb0 tx=0x7f25a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f24a560a640 1 -- 172.21.15.177:0/1624158912 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a806c070 con 0x5611678565f0 2024-03-20T13:35:08.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f24a560a640 1 -- 172.21.15.177:0/1624158912 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a805d7c0 con 0x5611678565f0 2024-03-20T13:35:08.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561167854620 con 0x5611678565f0 2024-03-20T13:35:08.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f24a560a640 1 -- 172.21.15.177:0/1624158912 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a805da60 con 0x5611678565f0 2024-03-20T13:35:08.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.925+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561167854b60 con 0x5611678565f0 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.926+0000 7f24a560a640 1 -- 172.21.15.177:0/1624158912 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f25a8059040 con 0x5611678565f0 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.926+0000 7f24a560a640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24a0036790 0x7f24a0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.926+0000 7f24a560a640 1 -- 172.21.15.177:0/1624158912 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f25a808d930 con 0x5611678565f0 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.926+0000 7f25b8671640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24a0036790 0x7f24a0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.926+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561167858f20 0x5611679562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.926+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167956800 con 0x561167858f20 2024-03-20T13:35:08.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25b9673640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561167858f20 0x5611679562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25b8671640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24a0036790 0x7f24a0038c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000f60 tx=0x7f25ac001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25b9673640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561167858f20 0x5611679562c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25b9673640 1 -- 172.21.15.177:0/1624158912 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x561167858f20 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167956b60 con 0x561167858f20 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25b9673640 1 -- 172.21.15.177:0/1624158912 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f25b000a4a0 con 0x561167858f20 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5611679585a0 0x56116795aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.927+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116795b1f0 con 0x5611679585a0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25b8e72640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5611679585a0 0x56116795aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25b8e72640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5611679585a0 0x56116795aa60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25b8e72640 1 -- 172.21.15.177:0/1624158912 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f25a80673f0 con 0x5611679585a0 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167957360 con 0x561167858f20 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25b9673640 1 -- 172.21.15.177:0/1624158912 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f25b000a4a0 con 0x561167858f20 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56116795c610 0x56116795ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.928+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116795f140 con 0x56116795c610 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.929+0000 7f25b8671640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56116795c610 0x56116795ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.929+0000 7f25b8671640 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56116795c610 0x56116795ea00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.929+0000 7f25b8671640 1 -- 172.21.15.177:0/1624158912 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f25ac00f690 con 0x56116795c610 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25bd811800 1 Processor -- start 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25bd811800 1 -- start start 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25bd811800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 0x56116796d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25bd811800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611676f2c70 con 0x56116796d2d0 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 0x56116796d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 0x56116796d6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56466/0 (socket says 172.21.15.177:56466) 2024-03-20T13:35:08.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25b8e72640 1 -- 172.21.15.177:0/996567033 learned_addr learned my addr 172.21.15.177:0/996567033 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.930+0000 7f25b8e72640 1 -- 172.21.15.177:0/996567033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56116796dc30 con 0x56116796d2d0 2024-03-20T13:35:08.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.931+0000 7f25b8e72640 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 0x56116796d6f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25a804efd0 tx=0x7f25a808d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.931+0000 7f249e7fc640 1 -- 172.21.15.177:0/996567033 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8054ea0 con 0x56116796d2d0 2024-03-20T13:35:08.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.931+0000 7f249e7fc640 1 -- 172.21.15.177:0/996567033 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a808be90 con 0x56116796d2d0 2024-03-20T13:35:08.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.931+0000 7f249e7fc640 1 -- 172.21.15.177:0/996567033 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8079b80 con 0x56116796d2d0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.931+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56116796e6a0 con 0x56116796d2d0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.931+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56116796e6a0 con 0x56116796d2d0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f249e7fc640 1 -- 172.21.15.177:0/996567033 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f25a8079ce0 con 0x56116796d2d0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f249e7fc640 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2490036790 0x7f2490038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f249e7fc640 1 -- 172.21.15.177:0/996567033 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f25a8090950 con 0x56116796d2d0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25b8671640 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2490036790 0x7f2490038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25bd811800 1 Processor -- start 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25bd811800 1 -- start start 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25b8671640 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2490036790 0x7f2490038c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561167855400 tx=0x7f25ac00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25bd811800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x56116797a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25bd811800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611676c85d0 con 0x56116797a2f0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x56116797a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x56116797a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56474/0 (socket says 172.21.15.177:56474) 2024-03-20T13:35:08.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.932+0000 7f25b8e72640 1 -- 172.21.15.177:0/1128033182 learned_addr learned my addr 172.21.15.177:0/1128033182 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.933+0000 7f25b8e72640 1 -- 172.21.15.177:0/1128033182 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56116797ace0 con 0x56116797a2f0 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.933+0000 7f25b8e72640 1 --2- 172.21.15.177:0/1128033182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x56116797a710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f25a808d8c0 tx=0x7f25a8077400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75760814da42d5cd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.933+0000 7f248ffff640 1 -- 172.21.15.177:0/1128033182 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a8004420 con 0x56116797a2f0 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.933+0000 7f248ffff640 1 -- 172.21.15.177:0/1128033182 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a805c8c0 con 0x56116797a2f0 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.933+0000 7f248ffff640 1 -- 172.21.15.177:0/1128033182 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a805cb60 con 0x56116797a2f0 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- 172.21.15.177:0/1128033182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 msgr2=0x56116797a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 --2- 172.21.15.177:0/1128033182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x56116797a710 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f25a808d8c0 tx=0x7f25a8077400 comp rx=0 tx=0).stop 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- 172.21.15.177:0/1128033182 shutdown_connections 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 --2- 172.21.15.177:0/1128033182 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x56116797a710 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- 172.21.15.177:0/1128033182 >> 172.21.15.177:0/1128033182 conn(0x5611679765c0 msgr2=0x561167974620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- 172.21.15.177:0/1128033182 shutdown_connections 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- 172.21.15.177:0/1128033182 wait complete. 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 Processor -- start 2024-03-20T13:35:08.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- start start 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x5611679810c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25bd811800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561167981600 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x5611679810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25b8e72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x5611679810c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56476/0 (socket says 172.21.15.177:56476) 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.934+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 learned_addr learned my addr 172.21.15.177:0/758757615 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56116796dc30 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f25b8e72640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x5611679810c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f25a8093040 tx=0x7f25a8094f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f248e7fc640 1 -- 172.21.15.177:0/758757615 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a80904d0 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f248e7fc640 1 -- 172.21.15.177:0/758757615 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a8090630 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56116796dc30 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f248e7fc640 1 -- 172.21.15.177:0/758757615 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f25a80776e0 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.935+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56116796dc30 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.936+0000 7f248e7fc640 1 -- 172.21.15.177:0/758757615 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f25a8077840 con 0x56116797a2f0 2024-03-20T13:35:08.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.936+0000 7f248e7fc640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24840367e0 0x7f2484038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.936+0000 7f248e7fc640 1 -- 172.21.15.177:0/758757615 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f25a80c2c80 con 0x56116797a2f0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.936+0000 7f25b8671640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24840367e0 0x7f2484038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.936+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.936+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56116798c860 0x56116798ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116798f470 con 0x56116798c860 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25b8671640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24840367e0 0x7f2484038ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56116795f500 tx=0x7f25ac010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25b9673640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56116798c860 0x56116798ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25b9673640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56116798c860 0x56116798ed20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 realm 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116798f840 con 0x56116798c860 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.937+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167990420 con 0x56116798c860 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561167990dd0 0x5611679931c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679937d0 con 0x561167990dd0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25b8e72640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561167990dd0 0x5611679931c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25b8e72640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561167990dd0 0x5611679931c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 20 searching for the correct realm 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561167995a80 0x561167997f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.938+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679985c0 con 0x561167995a80 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.939+0000 7f25b8671640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561167995a80 0x561167997f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.939+0000 7f25b8671640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561167995a80 0x561167997f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.939+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.939+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679985c0 con 0x561167990dd0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.940+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.940+0000 7f25b8e72640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f25a80c1060 0x7f25a8070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:08.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.940+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679985c0 con 0x7f25a80c1060 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.941+0000 7f25b9673640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f25a80c1060 0x7f25a8070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.945+0000 7f25b9673640 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f25a80c1060 0x7f25a8070410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.945+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.945+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.945+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.945+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.946+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.946+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.946+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.946+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167990dd0 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.948+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.949+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.949+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167990dd0 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.950+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.951+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.951+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.951+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.951+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.952+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.952+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.952+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.952+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.952+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.952+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.953+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.953+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167990dd0 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.954+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x561167995a80 2024-03-20T13:35:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x7f25a80c1060 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f25b0031040 con 0x561167990dd0 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f25b0031040 con 0x561167995a80 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.955+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f25b0031040 con 0x7f25a80c1060 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.956+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.956+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f25b0031040 con 0x56116798c860 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.956+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.956+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f25b0031040 con 0x561167990dd0 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:08.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679900c0 con 0x56116798c860 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167993ec0 con 0x56116798c860 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.957+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679942a0 con 0x7f25a80c1060 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 20 zone default found 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 4 Realm: () 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 20 zonegroup default 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167994690 con 0x7f25a80c1060 2024-03-20T13:35:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.958+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167994a90 con 0x561167995a80 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799a3e0 con 0x561167995a80 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 started sync module instance, tier type = 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.959+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167999cc0 con 0x561167990dd0 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.960+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.960+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94632752551968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799a070 con 0x561167990dd0 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.960+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799b1f0 con 0x56116798c860 2024-03-20T13:35:08.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.962+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.962+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94632752551968] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.962+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94632752557392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799b170 con 0x56116798c860 2024-03-20T13:35:08.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.962+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799c050 con 0x561167995a80 2024-03-20T13:35:08.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.964+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.964+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94632752561072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799c8a0 con 0x561167995a80 2024-03-20T13:35:08.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.964+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799d320 con 0x561167990dd0 2024-03-20T13:35:08.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.964+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94632752557392] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.965+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94632752561072] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.966+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.966+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94632752565792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799d6d0 con 0x561167990dd0 2024-03-20T13:35:08.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.966+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799df10 con 0x56116798c860 2024-03-20T13:35:08.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.967+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.967+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94632752568880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799e760 con 0x56116798c860 2024-03-20T13:35:08.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.967+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799f1d0 con 0x7f25a80c1060 2024-03-20T13:35:08.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.968+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94632752565792] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.968+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94632752568880] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.969+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.969+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94632752573712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799e1f0 con 0x7f25a80c1060 2024-03-20T13:35:08.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.969+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799e6b0 con 0x7f25a80c1060 2024-03-20T13:35:08.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.970+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.970+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94632752572016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799fab0 con 0x7f25a80c1060 2024-03-20T13:35:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.970+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679a0550 con 0x7f25a80c1060 2024-03-20T13:35:08.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.971+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94632752573712] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94632752572016] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'12 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94632752578608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679a0510 con 0x7f25a80c1060 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=0 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=1 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=2 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=3 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=4 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=5 2024-03-20T13:35:08.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.972+0000 7f25bd811800 20 add_watcher() i=6 2024-03-20T13:35:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.974+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94632752578608] v30'13 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.974+0000 7f25bd811800 20 add_watcher() i=7 2024-03-20T13:35:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.974+0000 7f25bd811800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.974+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799f560 con 0x56116798c860 2024-03-20T13:35:08.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.974+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.974+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94632752559520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679a0d80 con 0x56116798c860 2024-03-20T13:35:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.975+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94632752559520] v30'36 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.975+0000 7f246efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:08.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.975+0000 7f25bd811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.975+0000 7f25bd811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:08.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.975+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679abce0 con 0x56116798c860 2024-03-20T13:35:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.976+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.976+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679abd80 con 0x7f25a80c1060 2024-03-20T13:35:08.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.979+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'12 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.979+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679ac1e0 con 0x561167995a80 2024-03-20T13:35:08.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.980+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.980+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679acbb0 con 0x56116798c860 2024-03-20T13:35:08.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.981+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'37 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.981+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679a7c40 con 0x561167990dd0 2024-03-20T13:35:08.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.982+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'26 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.982+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679ad720 con 0x561167995a80 2024-03-20T13:35:08.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.983+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'17 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.983+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679a77f0 con 0x56116798c860 2024-03-20T13:35:08.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.984+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:08.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.984+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679ae0f0 con 0x7f25a80c1060 2024-03-20T13:35:08.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.985+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'17 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.985+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679ae0f0 con 0x561167990dd0 2024-03-20T13:35:08.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.986+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.986+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679ae6a0 con 0x561167995a80 2024-03-20T13:35:08.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.989+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:08.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.989+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679ae0e0 con 0x561167990dd0 2024-03-20T13:35:08.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.992+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'27 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.992+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x7f25a80c1060 2024-03-20T13:35:08.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.993+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.993+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167990dd0 2024-03-20T13:35:08.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.994+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:08.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.994+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x7f25a80c1060 2024-03-20T13:35:08.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.998+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:08.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.998+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x56116798c860 2024-03-20T13:35:09.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.998+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:09.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.998+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167995a80 2024-03-20T13:35:09.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.999+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:08.999+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167990dd0 2024-03-20T13:35:09.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.000+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'28 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:09.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.000+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167995a80 2024-03-20T13:35:09.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.001+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'12 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.001+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x56116798c860 2024-03-20T13:35:09.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.005+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'20 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:09.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.005+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x56116798c860 2024-03-20T13:35:09.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.005+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'39 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:09.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.005+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167995a80 2024-03-20T13:35:09.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.007+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'21 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.007+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167990dd0 2024-03-20T13:35:09.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.008+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'22 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:09.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.008+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679aed50 con 0x561167995a80 2024-03-20T13:35:09.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.010+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.010+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x561167995a80 2024-03-20T13:35:09.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.013+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.013+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x561167995a80 2024-03-20T13:35:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.015+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'8 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.015+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x561167995a80 2024-03-20T13:35:09.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.018+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'18 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.018+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x7f25a80c1060 2024-03-20T13:35:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.019+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.019+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x561167995a80 2024-03-20T13:35:09.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.020+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'12 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.020+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x7f25a80c1060 2024-03-20T13:35:09.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.021+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'18 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.021+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x561167995a80 2024-03-20T13:35:09.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.022+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'22 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.023+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x7f25a80c1060 2024-03-20T13:35:09.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.024+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'24 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.024+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679adc50 con 0x561167990dd0 2024-03-20T13:35:09.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f246dfe3640 20 reqs_thread_entry: start 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f25bd811800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f25bd811800 20 Filter name: none 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f23df7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f25bd811800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f25bd811800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.025+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679d8c50 con 0x7f25a80c1060 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.026+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.026+0000 7f25bd811800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.026+0000 7f25bd811800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:35:09.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.026+0000 7f25bd811800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:09.029 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:35:09.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.026+0000 7f246efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.026+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94632752559520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5611679acbb0 con 0x56116798c860 2024-03-20T13:35:09.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.027+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94632752559520] v30'40 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:09.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.027+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94632752551968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799b5a0 con 0x561167990dd0 2024-03-20T13:35:09.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.028+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94632752551968] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:09.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.028+0000 7f25bd811800 20 remove_watcher() i=0 2024-03-20T13:35:09.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.028+0000 7f25bd811800 2 removed watcher, disabling cache 2024-03-20T13:35:09.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.028+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94632752557392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167999820 con 0x56116798c860 2024-03-20T13:35:09.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.029+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94632752557392] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:09.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.029+0000 7f25bd811800 20 remove_watcher() i=1 2024-03-20T13:35:09.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.030+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94632752561072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167999820 con 0x561167995a80 2024-03-20T13:35:09.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.031+0000 7f25b8671640 1 -- 172.21.15.177:0/758757615 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94632752561072] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25ac033040 con 0x561167995a80 2024-03-20T13:35:09.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.031+0000 7f25bd811800 20 remove_watcher() i=2 2024-03-20T13:35:09.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.031+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94632752565792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799bbb0 con 0x561167990dd0 2024-03-20T13:35:09.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.032+0000 7f25b8e72640 1 -- 172.21.15.177:0/758757615 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94632752565792] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25a80673f0 con 0x561167990dd0 2024-03-20T13:35:09.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.032+0000 7f25bd811800 20 remove_watcher() i=3 2024-03-20T13:35:09.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.032+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94632752568880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167999820 con 0x56116798c860 2024-03-20T13:35:09.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.034+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94632752568880] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x56116798c860 2024-03-20T13:35:09.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.034+0000 7f25bd811800 20 remove_watcher() i=4 2024-03-20T13:35:09.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.034+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94632752573712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799ce20 con 0x7f25a80c1060 2024-03-20T13:35:09.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.036+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94632752573712] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.036+0000 7f25bd811800 20 remove_watcher() i=5 2024-03-20T13:35:09.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.036+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94632752572016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56116799bbb0 con 0x7f25a80c1060 2024-03-20T13:35:09.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.037+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94632752572016] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.037+0000 7f25bd811800 20 remove_watcher() i=6 2024-03-20T13:35:09.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.037+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94632752578608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561167999820 con 0x7f25a80c1060 2024-03-20T13:35:09.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94632752578608] v30'14 uv12 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f25b000a4a0 con 0x7f25a80c1060 2024-03-20T13:35:09.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 20 remove_watcher() i=7 2024-03-20T13:35:09.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f25a80c1060 msgr2=0x7f25a8070410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f25a80c1060 0x7f25a8070410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56116798c860 msgr2=0x56116798ed20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56116798c860 0x56116798ed20 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561167990dd0 msgr2=0x5611679931c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561167990dd0 0x5611679931c0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561167995a80 msgr2=0x561167997f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561167995a80 0x561167997f40 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24840367e0 msgr2=0x7f2484038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.038+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24840367e0 0x7f2484038ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x56116795f500 tx=0x7f25ac010000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 msgr2=0x5611679810c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25b9673640 1 -- 172.21.15.177:0/758757615 reap_dead start 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x5611679810c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f25a8093040 tx=0x7f25a8094f90 comp rx=0 tx=0).stop 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 shutdown_connections 2024-03-20T13:35:09.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/758757615 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116797a2f0 0x5611679810c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 >> 172.21.15.177:0/758757615 conn(0x5611679765c0 msgr2=0x561167973c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 shutdown_connections 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/758757615 wait complete. 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2490036790 msgr2=0x7f2490038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2490036790 0x7f2490038c50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x561167855400 tx=0x7f25ac00f000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 msgr2=0x56116796d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 0x56116796d6f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f25a804efd0 tx=0x7f25a808d6b0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 shutdown_connections 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2490036790 0x7f2490038c50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/996567033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56116796d2d0 0x56116796d6f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 >> 172.21.15.177:0/996567033 conn(0x561167961370 msgr2=0x561167961770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 shutdown_connections 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/996567033 wait complete. 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56116795c610 msgr2=0x56116795ea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56116795c610 0x56116795ea00 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561167858f20 msgr2=0x5611679562c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561167858f20 0x5611679562c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5611679585a0 msgr2=0x56116795aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.039+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5611679585a0 0x56116795aa60 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24a0036790 msgr2=0x7f24a0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f24a0036790 0x7f24a0038c50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25ac000f60 tx=0x7f25ac001370 comp rx=0 tx=0).stop 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 msgr2=0x561167855f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 --2- 172.21.15.177:0/1624158912 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5611678565f0 0x561167855f30 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f25a801ceb0 tx=0x7f25a8002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25b9673640 1 -- 172.21.15.177:0/1624158912 reap_dead start 2024-03-20T13:35:09.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 shutdown_connections 2024-03-20T13:35:09.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 >> 172.21.15.177:0/1624158912 conn(0x561167850040 msgr2=0x5611679443d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 shutdown_connections 2024-03-20T13:35:09.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.040+0000 7f25bd811800 1 -- 172.21.15.177:0/1624158912 wait complete. 2024-03-20T13:35:09.049 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:35:09.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-03-20T13:35:09.050 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-03-20T13:35:09.050 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-03-20T13:35:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:09.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f755b899800 1 Processor -- start 2024-03-20T13:35:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f755b899800 1 -- start start 2024-03-20T13:35:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f755b899800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x565527ae3e70 0x565527ae6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f755b899800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x565527a2bcd0 con 0x565527adf9e0 2024-03-20T13:35:09.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f755b899800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5655279e2500 con 0x565527ae3e70 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f7559398640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x565527adf9e0 0x565527adfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36798/0 (socket says 172.21.15.177:36798) 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f7559398640 1 -- 172.21.15.177:0/3215073034 learned_addr learned my addr 172.21.15.177:0/3215073034 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 325451825 0 0) 0x565527a2bcd0 con 0x565527adf9e0 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.092+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7544001e10 con 0x565527adf9e0 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1586598593 0 0) 0x7f7544001e10 con 0x565527adf9e0 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 >> v2:172.21.15.28:3300/0 conn(0x565527ae3e70 msgr2=0x565527ae6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 --2- 172.21.15.177:0/3215073034 >> v2:172.21.15.28:3300/0 conn(0x565527ae3e70 0x565527ae6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565527ae7890 con 0x565527adf9e0 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7f754c0015a0 con 0x565527adf9e0 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 >> v1:172.21.15.28:6789/0 conn(0x565527adf9e0 legacy=0x565527adfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 --2- 172.21.15.177:0/3215073034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7544002260 0x7f7544002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655279e2500 con 0x7f7544002260 2024-03-20T13:35:09.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f7559398640 1 --2- 172.21.15.177:0/3215073034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7544002260 0x7f7544002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.093+0000 7f7559398640 1 -- 172.21.15.177:0/3215073034 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544001e10 con 0x7f7544002260 2024-03-20T13:35:09.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.095+0000 7f7559398640 1 --2- 172.21.15.177:0/3215073034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7544002260 0x7f7544002660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f754c0099c0 tx=0x7f754c01d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fe9a618e9a3693 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.095+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c04ba60 con 0x7f7544002260 2024-03-20T13:35:09.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.095+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c04bbc0 con 0x7f7544002260 2024-03-20T13:35:09.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.095+0000 7f754bfff640 1 -- 172.21.15.177:0/3215073034 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c04bea0 con 0x7f7544002260 2024-03-20T13:35:09.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 -- 172.21.15.177:0/3215073034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7544002260 msgr2=0x7f7544002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 --2- 172.21.15.177:0/3215073034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7544002260 0x7f7544002660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f754c0099c0 tx=0x7f754c01d6d0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 -- 172.21.15.177:0/3215073034 shutdown_connections 2024-03-20T13:35:09.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 --2- 172.21.15.177:0/3215073034 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7544002260 0x7f7544002660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 --2- 172.21.15.177:0/3215073034 >> v2:172.21.15.28:3300/0 conn(0x565527ae3e70 0x565527ae6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 -- 172.21.15.177:0/3215073034 >> 172.21.15.177:0/3215073034 conn(0x565527adb040 msgr2=0x565527add460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 -- 172.21.15.177:0/3215073034 shutdown_connections 2024-03-20T13:35:09.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.096+0000 7f755b899800 1 -- 172.21.15.177:0/3215073034 wait complete. 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f755b899800 1 Processor -- start 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f755b899800 1 -- start start 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f755b899800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bcf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f755b899800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655279dfa30 con 0x565527adf9e0 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bcf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bcf480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56486/0 (socket says 172.21.15.177:56486) 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f7559398640 1 -- 172.21.15.177:0/386718421 learned_addr learned my addr 172.21.15.177:0/386718421 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f7559398640 1 -- 172.21.15.177:0/386718421 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565527bcfa50 con 0x565527adf9e0 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f7559398640 1 --2- 172.21.15.177:0/386718421 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bcf480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f754c01de00 tx=0x7f754c04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab46fbda5568598a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.108+0000 7f7447606640 1 -- 172.21.15.177:0/386718421 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c060070 con 0x565527adf9e0 2024-03-20T13:35:09.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f7447606640 1 -- 172.21.15.177:0/386718421 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c001430 con 0x565527adf9e0 2024-03-20T13:35:09.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f7447606640 1 -- 172.21.15.177:0/386718421 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c04ba60 con 0x565527adf9e0 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 -- 172.21.15.177:0/386718421 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 msgr2=0x565527bcf480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 --2- 172.21.15.177:0/386718421 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bcf480 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f754c01de00 tx=0x7f754c04d000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 -- 172.21.15.177:0/386718421 shutdown_connections 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 --2- 172.21.15.177:0/386718421 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bcf480 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 -- 172.21.15.177:0/386718421 >> 172.21.15.177:0/386718421 conn(0x565527adb040 msgr2=0x565527bcada0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 -- 172.21.15.177:0/386718421 shutdown_connections 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.109+0000 7f755b899800 1 -- 172.21.15.177:0/386718421 wait complete. 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f755b899800 1 Processor -- start 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f755b899800 1 -- start start 2024-03-20T13:35:09.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f755b899800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bd5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f755b899800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655279db210 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bd5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bd5a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56496/0 (socket says 172.21.15.177:56496) 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f7559398640 1 -- 172.21.15.177:0/2835608047 learned_addr learned my addr 172.21.15.177:0/2835608047 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f7559398640 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7544001e10 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.110+0000 7f7559398640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bd5a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f754c001ed0 tx=0x7f75440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.111+0000 7f7445e03640 1 -- 172.21.15.177:0/2835608047 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c04b930 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.111+0000 7f7445e03640 1 -- 172.21.15.177:0/2835608047 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c065bb0 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.111+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565527bd5f70 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.111+0000 7f7445e03640 1 -- 172.21.15.177:0/2835608047 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c065d40 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.111+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565527bd6450 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.111+0000 7f7445e03640 1 -- 172.21.15.177:0/2835608047 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f754c05a430 con 0x565527adf9e0 2024-03-20T13:35:09.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7445e03640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7440036790 0x7f7440038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7445e03640 1 -- 172.21.15.177:0/2835608047 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f754c06c070 con 0x565527adf9e0 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7558b97640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7440036790 0x7f7440038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527ae3e70 0x565527bdc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527bdcd30 con 0x565527ae3e70 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7559b99640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527ae3e70 0x565527bdc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7558b97640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7440036790 0x7f7440038c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7550008530 tx=0x7f7550005600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7559b99640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527ae3e70 0x565527bdc760 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f7559b99640 1 -- 172.21.15.177:0/2835608047 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527ae3e70 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.112+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527bd9df0 con 0x565527ae3e70 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f7559b99640 1 -- 172.21.15.177:0/2835608047 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f755400a4a0 con 0x565527ae3e70 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7544002260 0x565527be0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527be1620 con 0x7f7544002260 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f7559398640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7544002260 0x565527be0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f7559398640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7544002260 0x565527be0f80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f7559398640 1 -- 172.21.15.177:0/2835608047 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f754c050070 con 0x7f7544002260 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.113+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527bddef0 con 0x565527ae3e70 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.114+0000 7f7559b99640 1 -- 172.21.15.177:0/2835608047 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f755400a4a0 con 0x565527ae3e70 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.114+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x565527be2a40 0x565527be4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.114+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527be5590 con 0x565527be2a40 2024-03-20T13:35:09.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.114+0000 7f7558b97640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x565527be2a40 0x565527be4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.114+0000 7f7558b97640 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x565527be2a40 0x565527be4e30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f7558b97640 1 -- 172.21.15.177:0/2835608047 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7550014190 con 0x565527be2a40 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f755b899800 1 Processor -- start 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f755b899800 1 -- start start 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f755b899800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 0x565527bf3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f755b899800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56552797dc70 con 0x565527bf3790 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 0x565527bf3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 0x565527bf3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56508/0 (socket says 172.21.15.177:56508) 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.115+0000 7f7559398640 1 -- 172.21.15.177:0/2116570165 learned_addr learned my addr 172.21.15.177:0/2116570165 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.116+0000 7f7559398640 1 -- 172.21.15.177:0/2116570165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565527bf40f0 con 0x565527bf3790 2024-03-20T13:35:09.124 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.116+0000 7f7559398640 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 0x565527bf3bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f754c064990 tx=0x7f754c052ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.116+0000 7f743effd640 1 -- 172.21.15.177:0/2116570165 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c088070 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.116+0000 7f743effd640 1 -- 172.21.15.177:0/2116570165 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c08fa20 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.116+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565527bf4b60 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.116+0000 7f743effd640 1 -- 172.21.15.177:0/2116570165 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c07e040 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.117+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565527bf5020 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.118+0000 7f743effd640 1 -- 172.21.15.177:0/2116570165 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f754c0813b0 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.118+0000 7f743effd640 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7430036790 0x7f7430038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.118+0000 7f743effd640 1 -- 172.21.15.177:0/2116570165 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f754c005240 con 0x565527bf3790 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.118+0000 7f7558b97640 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7430036790 0x7f7430038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f755b899800 1 Processor -- start 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f755b899800 1 -- start start 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f755b899800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c050c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f7558b97640 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7430036790 0x7f7430038c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x565527bd9d50 tx=0x7f755000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f755b899800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5655279535d0 con 0x565527c04ce0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c050c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c050c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56520/0 (socket says 172.21.15.177:56520) 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f7559398640 1 -- 172.21.15.177:0/4165232897 learned_addr learned my addr 172.21.15.177:0/4165232897 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f7559398640 1 -- 172.21.15.177:0/4165232897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565527c05690 con 0x565527c04ce0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.119+0000 7f7559398640 1 --2- 172.21.15.177:0/4165232897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c050c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f754c087fa0 tx=0x7f754c0734f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77569e3b5203f25b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f743cff9640 1 -- 172.21.15.177:0/4165232897 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c09d070 con 0x565527c04ce0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f743cff9640 1 -- 172.21.15.177:0/4165232897 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c09e040 con 0x565527c04ce0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f743cff9640 1 -- 172.21.15.177:0/4165232897 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c063e40 con 0x565527c04ce0 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 -- 172.21.15.177:0/4165232897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 msgr2=0x565527c050c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 --2- 172.21.15.177:0/4165232897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c050c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f754c087fa0 tx=0x7f754c0734f0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 -- 172.21.15.177:0/4165232897 shutdown_connections 2024-03-20T13:35:09.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 --2- 172.21.15.177:0/4165232897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c050c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 -- 172.21.15.177:0/4165232897 >> 172.21.15.177:0/4165232897 conn(0x565527bfcba0 msgr2=0x565527bfac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 -- 172.21.15.177:0/4165232897 shutdown_connections 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 -- 172.21.15.177:0/4165232897 wait complete. 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 Processor -- start 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.120+0000 7f755b899800 1 -- start start 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.121+0000 7f755b899800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c0bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.121+0000 7f755b899800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x565527c0c0c0 con 0x565527c04ce0 2024-03-20T13:35:09.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.122+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c0bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.122+0000 7f7559398640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c0bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56530/0 (socket says 172.21.15.177:56530) 2024-03-20T13:35:09.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.122+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 learned_addr learned my addr 172.21.15.177:0/3910474989 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.123+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565527bf4b60 con 0x565527c04ce0 2024-03-20T13:35:09.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.126+0000 7f7559398640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c0bb80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f754c073530 tx=0x7f754c0a0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.126+0000 7f742effd640 1 -- 172.21.15.177:0/3910474989 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c063e40 con 0x565527c04ce0 2024-03-20T13:35:09.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.126+0000 7f742effd640 1 -- 172.21.15.177:0/3910474989 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f754c064a00 con 0x565527c04ce0 2024-03-20T13:35:09.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.126+0000 7f742effd640 1 -- 172.21.15.177:0/3910474989 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f754c06f780 con 0x565527c04ce0 2024-03-20T13:35:09.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.126+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565527bf4b60 con 0x565527c04ce0 2024-03-20T13:35:09.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.126+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565527bf4b60 con 0x565527c04ce0 2024-03-20T13:35:09.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.128+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f742effd640 1 -- 172.21.15.177:0/3910474989 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f754c06f8e0 con 0x565527c04ce0 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f742effd640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f74240367e0 0x7f7424038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f742effd640 1 -- 172.21.15.177:0/3910474989 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f754c0b6c50 con 0x565527c04ce0 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f7558b97640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f74240367e0 0x7f7424038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527c17270 0x565527c19710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c19e60 con 0x565527c17270 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f7559b99640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527c17270 0x565527c19710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f7558b97640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f74240367e0 0x7f7424038ca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7550014fd0 tx=0x7f7550002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.129+0000 7f7559b99640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527c17270 0x565527c19710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 realm 2024-03-20T13:35:09.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1a230 con 0x565527c17270 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1ade0 con 0x565527c17270 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565527c1b790 0x565527c1db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.130+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1e1d0 con 0x565527c1b790 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f7559398640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565527c1b790 0x565527c1db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f7559398640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565527c1b790 0x565527c1db80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f755b899800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f755b899800 20 searching for the correct realm 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565527c20460 0x565527c22920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c22ff0 con 0x565527c20460 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.132+0000 7f7558b97640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565527c20460 0x565527c22920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.133+0000 7f7558b97640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565527c20460 0x565527c22920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.133+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.133+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c22ff0 con 0x565527c1b790 2024-03-20T13:35:09.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.133+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.133+0000 7f7559398640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f754c0798d0 0x7f754c0b22c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.133+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c22ff0 con 0x7f754c0798d0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f754c0798d0 0x7f754c0b22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f754c0798d0 0x7f754c0b22c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c1b790 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.134+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.136+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c1b790 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.137+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.138+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c1b790 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.139+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.140+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.140+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c20460 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.140+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.140+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x7f754c0798d0 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.140+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.140+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7554031040 con 0x565527c1b790 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7554031040 con 0x565527c20460 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7554031040 con 0x7f754c0798d0 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7554031040 con 0x565527c17270 2024-03-20T13:35:09.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.141+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7554031040 con 0x565527c1b790 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1aa80 con 0x565527c17270 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1e880 con 0x565527c17270 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1e850 con 0x7f754c0798d0 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 zone default found 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 4 Realm: () 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 zonegroup default 2024-03-20T13:35:09.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.142+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1f150 con 0x7f754c0798d0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c1f150 con 0x565527c20460 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c24e10 con 0x565527c20460 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 started sync module instance, tier type = 2024-03-20T13:35:09.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.143+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c246f0 con 0x565527c1b790 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.144+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.144+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923739251280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c25610 con 0x565527c1b790 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.144+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c25e10 con 0x565527c17270 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.147+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.147+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923739257472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c26480 con 0x565527c17270 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.147+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c26f50 con 0x565527c20460 2024-03-20T13:35:09.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.147+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923739251280] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.149+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.149+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923739261488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c27300 con 0x565527c20460 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.149+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c27d60 con 0x565527c1b790 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.149+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923739257472] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.152+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923739261488] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.152+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.152+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923739265104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c28110 con 0x565527c1b790 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.152+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c28950 con 0x565527c17270 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.154+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.154+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923739268208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c291a0 con 0x565527c17270 2024-03-20T13:35:09.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.154+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c29c30 con 0x7f754c0798d0 2024-03-20T13:35:09.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.157+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923739265104] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.158+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.158+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923739273040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c29c30 con 0x7f754c0798d0 2024-03-20T13:35:09.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.158+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2a5e0 con 0x7f754c0798d0 2024-03-20T13:35:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.160+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923739268208] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.160+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923739273040] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.160+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.160+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923739258592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2a100 con 0x7f754c0798d0 2024-03-20T13:35:09.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.160+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2aa70 con 0x7f754c0798d0 2024-03-20T13:35:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'15 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923739258592] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923739276752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2aed0 con 0x7f754c0798d0 2024-03-20T13:35:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=0 2024-03-20T13:35:09.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=1 2024-03-20T13:35:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=2 2024-03-20T13:35:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=3 2024-03-20T13:35:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=4 2024-03-20T13:35:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=5 2024-03-20T13:35:09.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.162+0000 7f755b899800 20 add_watcher() i=6 2024-03-20T13:35:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.163+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923739276752] v30'16 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.163+0000 7f755b899800 20 add_watcher() i=7 2024-03-20T13:35:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.163+0000 7f755b899800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.163+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c28d60 con 0x565527c17270 2024-03-20T13:35:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.163+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.163+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923739277808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c28d60 con 0x565527c17270 2024-03-20T13:35:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.164+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923739277808] v30'41 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.164+0000 7f740f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.164+0000 7f755b899800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.164+0000 7f755b899800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.164+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c367c0 con 0x565527c17270 2024-03-20T13:35:09.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.165+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.165+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c36c80 con 0x7f754c0798d0 2024-03-20T13:35:09.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.167+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'13 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.167+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c36c80 con 0x565527c20460 2024-03-20T13:35:09.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.168+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.169+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2d750 con 0x565527c17270 2024-03-20T13:35:09.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.170+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'42 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.170+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2d2b0 con 0x565527c1b790 2024-03-20T13:35:09.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.172+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'29 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.172+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c2d2b0 con 0x565527c20460 2024-03-20T13:35:09.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.173+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'19 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.173+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c38850 con 0x565527c17270 2024-03-20T13:35:09.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.175+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.175+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c358c0 con 0x7f754c0798d0 2024-03-20T13:35:09.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.177+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'19 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.177+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c358c0 con 0x565527c1b790 2024-03-20T13:35:09.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.178+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.178+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c358c0 con 0x565527c20460 2024-03-20T13:35:09.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.179+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.179+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39590 con 0x565527c1b790 2024-03-20T13:35:09.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.181+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'30 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.181+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39a30 con 0x7f754c0798d0 2024-03-20T13:35:09.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.183+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.183+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39a30 con 0x565527c1b790 2024-03-20T13:35:09.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.184+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.184+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39a30 con 0x7f754c0798d0 2024-03-20T13:35:09.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.186+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.186+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39a30 con 0x565527c17270 2024-03-20T13:35:09.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.187+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'43 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.188+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39a30 con 0x565527c20460 2024-03-20T13:35:09.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.189+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.189+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c39920 con 0x565527c1b790 2024-03-20T13:35:09.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.191+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'31 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.191+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37490 con 0x565527c20460 2024-03-20T13:35:09.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.193+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'13 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.193+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37490 con 0x565527c17270 2024-03-20T13:35:09.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.195+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'21 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.195+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37490 con 0x565527c17270 2024-03-20T13:35:09.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.196+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'44 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.196+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37490 con 0x565527c20460 2024-03-20T13:35:09.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.197+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'24 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.197+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37550 con 0x565527c1b790 2024-03-20T13:35:09.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.198+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'23 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.198+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c20460 2024-03-20T13:35:09.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.200+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.200+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c20460 2024-03-20T13:35:09.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.201+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.201+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c20460 2024-03-20T13:35:09.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.202+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'9 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.202+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c20460 2024-03-20T13:35:09.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.203+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.203+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x7f754c0798d0 2024-03-20T13:35:09.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.205+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.205+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c20460 2024-03-20T13:35:09.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.206+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'13 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.206+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x7f754c0798d0 2024-03-20T13:35:09.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.209+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'20 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.209+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c20460 2024-03-20T13:35:09.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.210+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'25 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.210+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x7f754c0798d0 2024-03-20T13:35:09.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.212+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'26 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.212+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c37db0 con 0x565527c1b790 2024-03-20T13:35:09.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f740e7e4640 20 reqs_thread_entry: start 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 20 Filter name: none 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f737ffff640 20 reqs_thread_entry: start 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c17270 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.213+0000 7f755b899800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:09.215 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, user does not exist 2024-03-20T13:35:09.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.214+0000 7f740f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.214+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923739277808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c17270 2024-03-20T13:35:09.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.215+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94923739277808] v30'45 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.215+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923739251280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c1b790 2024-03-20T13:35:09.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.216+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94923739251280] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.216+0000 7f755b899800 20 remove_watcher() i=0 2024-03-20T13:35:09.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.216+0000 7f755b899800 2 removed watcher, disabling cache 2024-03-20T13:35:09.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.216+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923739257472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c17270 2024-03-20T13:35:09.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.217+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94923739257472] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.217+0000 7f755b899800 20 remove_watcher() i=1 2024-03-20T13:35:09.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.217+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923739261488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c20460 2024-03-20T13:35:09.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.218+0000 7f7558b97640 1 -- 172.21.15.177:0/3910474989 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94923739261488] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7550014190 con 0x565527c20460 2024-03-20T13:35:09.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.218+0000 7f755b899800 20 remove_watcher() i=2 2024-03-20T13:35:09.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.218+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923739265104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c1b790 2024-03-20T13:35:09.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.219+0000 7f7559398640 1 -- 172.21.15.177:0/3910474989 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94923739265104] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f754c0a0070 con 0x565527c1b790 2024-03-20T13:35:09.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.219+0000 7f755b899800 20 remove_watcher() i=3 2024-03-20T13:35:09.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.219+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923739268208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x565527c17270 2024-03-20T13:35:09.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.221+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94923739268208] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x565527c17270 2024-03-20T13:35:09.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.221+0000 7f755b899800 20 remove_watcher() i=4 2024-03-20T13:35:09.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.221+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923739273040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x7f754c0798d0 2024-03-20T13:35:09.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.222+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94923739273040] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.222+0000 7f755b899800 20 remove_watcher() i=5 2024-03-20T13:35:09.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.222+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923739258592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x7f754c0798d0 2024-03-20T13:35:09.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.223+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94923739258592] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.223+0000 7f755b899800 20 remove_watcher() i=6 2024-03-20T13:35:09.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.223+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923739276752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565527c32c80 con 0x7f754c0798d0 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94923739276752] v30'17 uv15 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f755400a4a0 con 0x7f754c0798d0 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 20 remove_watcher() i=7 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f754c0798d0 msgr2=0x7f754c0b22c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f754c0798d0 0x7f754c0b22c0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527c17270 msgr2=0x565527c19710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527c17270 0x565527c19710 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565527c1b790 msgr2=0x565527c1db80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565527c1b790 0x565527c1db80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565527c20460 msgr2=0x565527c22920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.224+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565527c20460 0x565527c22920 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f74240367e0 msgr2=0x7f7424038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f74240367e0 0x7f7424038ca0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f7550014fd0 tx=0x7f7550002000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 msgr2=0x565527c0bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f7559b99640 1 -- 172.21.15.177:0/3910474989 reap_dead start 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c0bb80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f754c073530 tx=0x7f754c0a0000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 shutdown_connections 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/3910474989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527c04ce0 0x565527c0bb80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 >> 172.21.15.177:0/3910474989 conn(0x565527bfcba0 msgr2=0x565527bfa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 shutdown_connections 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/3910474989 wait complete. 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7430036790 msgr2=0x7f7430038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7430036790 0x7f7430038c50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x565527bd9d50 tx=0x7f755000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 msgr2=0x565527bf3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 0x565527bf3bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f754c064990 tx=0x7f754c052ee0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 shutdown_connections 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7430036790 0x7f7430038c50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2116570165 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527bf3790 0x565527bf3bb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 >> 172.21.15.177:0/2116570165 conn(0x565527be7830 msgr2=0x565527be7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 shutdown_connections 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2116570165 wait complete. 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x565527be2a40 msgr2=0x565527be4e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x565527be2a40 0x565527be4e30 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527ae3e70 msgr2=0x565527bdc760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x565527ae3e70 0x565527bdc760 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7544002260 msgr2=0x565527be0f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7544002260 0x565527be0f80 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7440036790 msgr2=0x7f7440038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.225+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7440036790 0x7f7440038c50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7550008530 tx=0x7f7550005600 comp rx=0 tx=0).stop 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 msgr2=0x565527bd5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f755b899800 1 --2- 172.21.15.177:0/2835608047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565527adf9e0 0x565527bd5a30 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f754c001ed0 tx=0x7f75440040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f7559b99640 1 -- 172.21.15.177:0/2835608047 reap_dead start 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 shutdown_connections 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 >> 172.21.15.177:0/2835608047 conn(0x565527adb040 msgr2=0x565527bc96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 shutdown_connections 2024-03-20T13:35:09.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.226+0000 7f755b899800 1 -- 172.21.15.177:0/2835608047 wait complete. 2024-03-20T13:35:09.234 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-03-20T13:35:09.235 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:35:09.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:35:09.235 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-03-20T13:35:09.322 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:09.322 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79e0a31800 1 Processor -- start 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79e0a31800 1 -- start start 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79e0a31800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556271c3ba80 0x556271c3bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79e0a31800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556271b87d70 con 0x556271c3cce0 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79e0a31800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x556271b3e500 con 0x556271c3ba80 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79d5d2f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x556271c3cce0 0x556271c3d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36804/0 (socket says 172.21.15.177:36804) 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79d5d2f640 1 -- 172.21.15.177:0/2700893998 learned_addr learned my addr 172.21.15.177:0/2700893998 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.322+0000 7f79de530640 1 --2- 172.21.15.177:0/2700893998 >> v2:172.21.15.28:3300/0 conn(0x556271c3ba80 0x556271c3bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.323+0000 7f79ddd2f640 1 -- 172.21.15.177:0/2700893998 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 940085527 0 0) 0x556271b87d70 con 0x556271c3cce0 2024-03-20T13:35:09.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.323+0000 7f79ddd2f640 1 -- 172.21.15.177:0/2700893998 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79cc001e10 con 0x556271c3cce0 2024-03-20T13:35:09.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.323+0000 7f79de530640 1 -- 172.21.15.177:0/2700893998 >> v1:172.21.15.28:6789/0 conn(0x556271c3cce0 legacy=0x556271c3d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.323+0000 7f79de530640 1 -- 172.21.15.177:0/2700893998 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556271c3c570 con 0x556271c3ba80 2024-03-20T13:35:09.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79de530640 1 --2- 172.21.15.177:0/2700893998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271c3bea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79d000a470 tx=0x7f79d001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79b032ffd7098311 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79ddd2f640 1 -- 172.21.15.177:0/2700893998 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d004ad60 con 0x556271c3ba80 2024-03-20T13:35:09.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79ddd2f640 1 -- 172.21.15.177:0/2700893998 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0052440 con 0x556271c3ba80 2024-03-20T13:35:09.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79ddd2f640 1 -- 172.21.15.177:0/2700893998 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d0052700 con 0x556271c3ba80 2024-03-20T13:35:09.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 -- 172.21.15.177:0/2700893998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 msgr2=0x556271c3bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2700893998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271c3bea0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79d000a470 tx=0x7f79d001cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:09.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 -- 172.21.15.177:0/2700893998 shutdown_connections 2024-03-20T13:35:09.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2700893998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271c3bea0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 -- 172.21.15.177:0/2700893998 >> 172.21.15.177:0/2700893998 conn(0x556271c37100 msgr2=0x556271c39520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 -- 172.21.15.177:0/2700893998 shutdown_connections 2024-03-20T13:35:09.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.325+0000 7f79e0a31800 1 -- 172.21.15.177:0/2700893998 wait complete. 2024-03-20T13:35:09.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.337+0000 7f79e0a31800 1 Processor -- start 2024-03-20T13:35:09.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.337+0000 7f79e0a31800 1 -- start start 2024-03-20T13:35:09.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.337+0000 7f79e0a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d2cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.337+0000 7f79e0a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556271b3ba30 con 0x556271c3ba80 2024-03-20T13:35:09.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.337+0000 7f79de530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d2cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f79de530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d2cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56548/0 (socket says 172.21.15.177:56548) 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f79de530640 1 -- 172.21.15.177:0/556772047 learned_addr learned my addr 172.21.15.177:0/556772047 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f79de530640 1 -- 172.21.15.177:0/556772047 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d0005d20 con 0x556271c3ba80 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f79de530640 1 --2- 172.21.15.177:0/556772047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d2cd50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79d0055040 tx=0x7f79d004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efcc0a563a48c6f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f78cc608640 1 -- 172.21.15.177:0/556772047 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d000a040 con 0x556271c3ba80 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f78cc608640 1 -- 172.21.15.177:0/556772047 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d000a1a0 con 0x556271c3ba80 2024-03-20T13:35:09.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.338+0000 7f78cc608640 1 -- 172.21.15.177:0/556772047 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d00525b0 con 0x556271c3ba80 2024-03-20T13:35:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- 172.21.15.177:0/556772047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 msgr2=0x556271d2cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 --2- 172.21.15.177:0/556772047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d2cd50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f79d0055040 tx=0x7f79d004c000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- 172.21.15.177:0/556772047 shutdown_connections 2024-03-20T13:35:09.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 --2- 172.21.15.177:0/556772047 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d2cd50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- 172.21.15.177:0/556772047 >> 172.21.15.177:0/556772047 conn(0x556271c37100 msgr2=0x556271d2b160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- 172.21.15.177:0/556772047 shutdown_connections 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- 172.21.15.177:0/556772047 wait complete. 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 Processor -- start 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- start start 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.339+0000 7f79e0a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556271b37210 con 0x556271c3ba80 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f79de530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f79de530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d342a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56556/0 (socket says 172.21.15.177:56556) 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f79de530640 1 -- 172.21.15.177:0/2592051128 learned_addr learned my addr 172.21.15.177:0/2592051128 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f79de530640 1 -- 172.21.15.177:0/2592051128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d004e070 con 0x556271c3ba80 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f79de530640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d342a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005870 tx=0x7f79d0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f78cae05640 1 -- 172.21.15.177:0/2592051128 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d006b070 con 0x556271c3ba80 2024-03-20T13:35:09.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f78cae05640 1 -- 172.21.15.177:0/2592051128 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0052ac0 con 0x556271c3ba80 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556271d347e0 con 0x556271c3ba80 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.340+0000 7f78cae05640 1 -- 172.21.15.177:0/2592051128 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d0052d80 con 0x556271c3ba80 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556271d34d20 con 0x556271c3ba80 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f79e0a31800 1 Processor -- start 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f79e0a31800 1 -- start start 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f78cae05640 1 -- 172.21.15.177:0/2592051128 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f79d0059050 con 0x556271c3ba80 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f79e0a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d27110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f79e0a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556271ad9c70 con 0x556271d28bc0 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.341+0000 7f78cae05640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78c4036790 0x7f78c4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f78cae05640 1 -- 172.21.15.177:0/2592051128 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f79d008cdc0 con 0x556271c3ba80 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79de530640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78c4036790 0x7f78c4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79ded31640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d27110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79ded31640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d27110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56568/0 (socket says 172.21.15.177:56568) 2024-03-20T13:35:09.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79ded31640 1 -- 172.21.15.177:0/2937724683 learned_addr learned my addr 172.21.15.177:0/2937724683 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79de530640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78c4036790 0x7f78c4038c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005400 tx=0x7f79d0005350 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79ded31640 1 -- 172.21.15.177:0/2937724683 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556271d27650 con 0x556271d28bc0 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.342+0000 7f79ded31640 1 --2- 172.21.15.177:0/2937724683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d27110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f79d800a430 tx=0x7f79d800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886410cfa18961ed server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f78c8e01640 1 -- 172.21.15.177:0/2937724683 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d8001650 con 0x556271d28bc0 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f78c8e01640 1 -- 172.21.15.177:0/2937724683 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d80017d0 con 0x556271d28bc0 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f78c8e01640 1 -- 172.21.15.177:0/2937724683 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d8001ab0 con 0x556271d28bc0 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- 172.21.15.177:0/2937724683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 msgr2=0x556271d27110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2937724683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d27110 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f79d800a430 tx=0x7f79d800a8f0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- 172.21.15.177:0/2937724683 shutdown_connections 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2937724683 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d27110 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- 172.21.15.177:0/2937724683 >> 172.21.15.177:0/2937724683 conn(0x556271c3cce0 msgr2=0x556271d3e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- 172.21.15.177:0/2937724683 shutdown_connections 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- 172.21.15.177:0/2937724683 wait complete. 2024-03-20T13:35:09.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 Processor -- start 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- start start 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d4a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.343+0000 7f79e0a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556271aaf5d0 con 0x556271d28bc0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79ded31640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d4a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79ded31640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d4a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56580/0 (socket says 172.21.15.177:56580) 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79ded31640 1 -- 172.21.15.177:0/2854606197 learned_addr learned my addr 172.21.15.177:0/2854606197 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79ded31640 1 -- 172.21.15.177:0/2854606197 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79d800a0e0 con 0x556271d28bc0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79ded31640 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d4a760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79d8000f80 tx=0x7f79d8003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f78c2ffd640 1 -- 172.21.15.177:0/2854606197 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d8010a40 con 0x556271d28bc0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f78c2ffd640 1 -- 172.21.15.177:0/2854606197 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d8010ba0 con 0x556271d28bc0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556271d4aca0 con 0x556271d28bc0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f78c2ffd640 1 -- 172.21.15.177:0/2854606197 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d8010e80 con 0x556271d28bc0 2024-03-20T13:35:09.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.344+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556271d4b100 con 0x556271d28bc0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.345+0000 7f78c2ffd640 1 -- 172.21.15.177:0/2854606197 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f79d8017070 con 0x556271d28bc0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.345+0000 7f78c2ffd640 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78b8036790 0x7f78b8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.345+0000 7f78c2ffd640 1 -- 172.21.15.177:0/2854606197 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f79d804bf00 con 0x556271d28bc0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.345+0000 7f79e0a31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.345+0000 7f79e0a31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.345+0000 7f79d5d2f640 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78b8036790 0x7f78b8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79e0a31800 1 Processor -- start 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79e0a31800 1 -- start start 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79d5d2f640 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78b8036790 0x7f78b8038c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79c8000f60 tx=0x7f79c80010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79e0a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 0x556271d65010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79e0a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556271d65550 con 0x556271d64bf0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79de530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 0x556271d65010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79de530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 0x556271d65010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56596/0 (socket says 172.21.15.177:56596) 2024-03-20T13:35:09.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79de530640 1 -- 172.21.15.177:0/1530968693 learned_addr learned my addr 172.21.15.177:0/1530968693 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.346+0000 7f79de530640 1 -- 172.21.15.177:0/1530968693 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556271d65690 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.347+0000 7f79de530640 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 0x556271d65010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f79d008b180 tx=0x7f79d0078780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.347+0000 7f78a2fe5640 1 -- 172.21.15.177:0/1530968693 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d0066dd0 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.347+0000 7f78a2fe5640 1 -- 172.21.15.177:0/1530968693 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0054030 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.347+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556271d66010 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.347+0000 7f78a2fe5640 1 -- 172.21.15.177:0/1530968693 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79d00542d0 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.347+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556271d664d0 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f78a2fe5640 1 -- 172.21.15.177:0/1530968693 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f79d0054430 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f78a2fe5640 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78200367e0 0x7f7820038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f78a2fe5640 1 -- 172.21.15.177:0/1530968693 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f79d009ec30 con 0x556271d64bf0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f79d5d2f640 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78200367e0 0x7f7820038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f78a0fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556271d71b80 0x556271d73f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556271d74560 con 0x556271d71b80 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f79d5d2f640 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78200367e0 0x7f7820038ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79c8004170 tx=0x7f79c800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f79ded31640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556271d71b80 0x556271d73f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.348+0000 7f79ded31640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556271d71b80 0x556271d73f70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79ded31640 1 -- 172.21.15.177:0/2592051128 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f79d801c900 con 0x556271d71b80 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556271d762d0 0x556271d786c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:2 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556271d78d80 con 0x556271d762d0 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79de530640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556271d762d0 0x556271d786c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79de530640 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556271d762d0 0x556271d786c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79de530640 1 -- 172.21.15.177:0/2592051128 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(2 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv1 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f79d007f040 con 0x556271d762d0 2024-03-20T13:35:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.349+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556271d7d960 con 0x556271d762d0 2024-03-20T13:35:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79de530640 1 -- 172.21.15.177:0/2592051128 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [stat,call,call,writefull 0~874] v30'2 uv2 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f79d007f040 con 0x556271d762d0 2024-03-20T13:35:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78b8036790 msgr2=0x7f78b8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78b8036790 0x7f78b8038c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f79c8000f60 tx=0x7f79c80010a0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 msgr2=0x556271d4a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d4a760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f79d8000f80 tx=0x7f79d8003370 comp rx=0 tx=0).stop 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 shutdown_connections 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78b8036790 0x7f78b8038c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2854606197 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d28bc0 0x556271d4a760 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.351+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 >> 172.21.15.177:0/2854606197 conn(0x556271c3cce0 msgr2=0x556271d3b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 shutdown_connections 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2854606197 wait complete. 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78200367e0 msgr2=0x7f7820038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78200367e0 0x7f7820038ca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79c8004170 tx=0x7f79c800f000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 msgr2=0x556271d65010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 0x556271d65010 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f79d008b180 tx=0x7f79d0078780 comp rx=0 tx=0).stop 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 shutdown_connections 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78200367e0 0x7f7820038ca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/1530968693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271d64bf0 0x556271d65010 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 >> 172.21.15.177:0/1530968693 conn(0x556271d59870 msgr2=0x556271d5a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 shutdown_connections 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/1530968693 wait complete. 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556271d71b80 msgr2=0x556271d73f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556271d71b80 0x556271d73f70 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556271d762d0 msgr2=0x556271d786c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556271d762d0 0x556271d786c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78c4036790 msgr2=0x7f78c4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78c4036790 0x7f78c4038c50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005400 tx=0x7f79d0005350 comp rx=0 tx=0).stop 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 msgr2=0x556271d342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d342a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f79d0005870 tx=0x7f79d0002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 shutdown_connections 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556271d762d0 0x556271d786c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556271d71b80 0x556271d73f70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f78c4036790 0x7f78c4038c50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 --2- 172.21.15.177:0/2592051128 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556271c3ba80 0x556271d342a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 >> 172.21.15.177:0/2592051128 conn(0x556271c37100 msgr2=0x556271d26660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 shutdown_connections 2024-03-20T13:35:09.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.352+0000 7f79e0a31800 1 -- 172.21.15.177:0/2592051128 wait complete. 2024-03-20T13:35:09.365 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:35:09.365 DEBUG:tasks.util.rgw: json result: {'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:35:09.366 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-03-20T13:35:09.367 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-03-20T13:35:09.367 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-03-20T13:35:09.408 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:09.408 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f988c122800 1 Processor -- start 2024-03-20T13:35:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f988c122800 1 -- start start 2024-03-20T13:35:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f988c122800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b601355e60 0x55b601358250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f988c122800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b60129dcc0 con 0x55b6013519d0 2024-03-20T13:35:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f988c122800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b601254500 con 0x55b601355e60 2024-03-20T13:35:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f9887eb7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55b6013519d0 0x55b601351df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36818/0 (socket says 172.21.15.177:36818) 2024-03-20T13:35:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f9887eb7640 1 -- 172.21.15.177:0/2545019564 learned_addr learned my addr 172.21.15.177:0/2545019564 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 695976300 0 0) 0x55b60129dcc0 con 0x55b6013519d0 2024-03-20T13:35:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.407+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9874001e10 con 0x55b6013519d0 2024-03-20T13:35:09.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2473673310 0 0) 0x7f9874001e10 con 0x55b6013519d0 2024-03-20T13:35:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 >> v2:172.21.15.28:3300/0 conn(0x55b601355e60 msgr2=0x55b601358250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:35:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 --2- 172.21.15.177:0/2545019564 >> v2:172.21.15.28:3300/0 conn(0x55b601355e60 0x55b601358250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b601359880 con 0x55b6013519d0 2024-03-20T13:35:09.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7f9878001920 con 0x55b6013519d0 2024-03-20T13:35:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 >> v1:172.21.15.28:6789/0 conn(0x55b6013519d0 legacy=0x55b601351df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 --2- 172.21.15.177:0/2545019564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98740022b0 0x7f98740026b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.408+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b601254500 con 0x7f98740022b0 2024-03-20T13:35:09.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.409+0000 7f9887eb7640 1 --2- 172.21.15.177:0/2545019564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98740022b0 0x7f98740026b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.409+0000 7f9887eb7640 1 -- 172.21.15.177:0/2545019564 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874001e10 con 0x7f98740022b0 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.412+0000 7f9887eb7640 1 --2- 172.21.15.177:0/2545019564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98740022b0 0x7f98740026b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9878006b90 tx=0x7f987801d2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db916806e05fb70 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.412+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98780061a0 con 0x7f98740022b0 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.412+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9878006300 con 0x7f98740022b0 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.412+0000 7f9886eb5640 1 -- 172.21.15.177:0/2545019564 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98780046b0 con 0x7f98740022b0 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 -- 172.21.15.177:0/2545019564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98740022b0 msgr2=0x7f98740026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 --2- 172.21.15.177:0/2545019564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98740022b0 0x7f98740026b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f9878006b90 tx=0x7f987801d2e0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 -- 172.21.15.177:0/2545019564 shutdown_connections 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 --2- 172.21.15.177:0/2545019564 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f98740022b0 0x7f98740026b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 --2- 172.21.15.177:0/2545019564 >> v2:172.21.15.28:3300/0 conn(0x55b601355e60 0x55b601358250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 -- 172.21.15.177:0/2545019564 >> 172.21.15.177:0/2545019564 conn(0x55b60134d030 msgr2=0x55b60134f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 -- 172.21.15.177:0/2545019564 shutdown_connections 2024-03-20T13:35:09.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.413+0000 7f988c122800 1 -- 172.21.15.177:0/2545019564 wait complete. 2024-03-20T13:35:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.424+0000 7f988c122800 1 Processor -- start 2024-03-20T13:35:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.425+0000 7f988c122800 1 -- start start 2024-03-20T13:35:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.425+0000 7f988c122800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b6012c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.425+0000 7f988c122800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b601251a30 con 0x55b6013519d0 2024-03-20T13:35:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.426+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b6012c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.426+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b6012c5c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56628/0 (socket says 172.21.15.177:56628) 2024-03-20T13:35:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.426+0000 7f9887eb7640 1 -- 172.21.15.177:0/4175848586 learned_addr learned my addr 172.21.15.177:0/4175848586 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.427+0000 7f9887eb7640 1 -- 172.21.15.177:0/4175848586 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b601445330 con 0x55b6013519d0 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.429+0000 7f9887eb7640 1 --2- 172.21.15.177:0/4175848586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b6012c5c00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9878044e90 tx=0x7f987804d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88dd8177e94a2c9f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.429+0000 7f9775e0b640 1 -- 172.21.15.177:0/4175848586 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987805b070 con 0x55b6013519d0 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.429+0000 7f9775e0b640 1 -- 172.21.15.177:0/4175848586 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9878059070 con 0x55b6013519d0 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.429+0000 7f9775e0b640 1 -- 172.21.15.177:0/4175848586 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98780017b0 con 0x55b6013519d0 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- 172.21.15.177:0/4175848586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 msgr2=0x55b6012c5c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 --2- 172.21.15.177:0/4175848586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b6012c5c00 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9878044e90 tx=0x7f987804d000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- 172.21.15.177:0/4175848586 shutdown_connections 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 --2- 172.21.15.177:0/4175848586 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b6012c5c00 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- 172.21.15.177:0/4175848586 >> 172.21.15.177:0/4175848586 conn(0x55b60134d030 msgr2=0x55b60143ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- 172.21.15.177:0/4175848586 shutdown_connections 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- 172.21.15.177:0/4175848586 wait complete. 2024-03-20T13:35:09.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 Processor -- start 2024-03-20T13:35:09.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- start start 2024-03-20T13:35:09.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b601442c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f988c122800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b60124d210 con 0x55b6013519d0 2024-03-20T13:35:09.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b601442c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b601442c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56642/0 (socket says 172.21.15.177:56642) 2024-03-20T13:35:09.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.430+0000 7f9887eb7640 1 -- 172.21.15.177:0/331342840 learned_addr learned my addr 172.21.15.177:0/331342840 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f9887eb7640 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9874001e10 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f9887eb7640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b601442c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9878001350 tx=0x7f98740040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f976ffff640 1 -- 172.21.15.177:0/331342840 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987804c8b0 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f976ffff640 1 -- 172.21.15.177:0/331342840 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987805c040 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b601441350 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f976ffff640 1 -- 172.21.15.177:0/331342840 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987804cb80 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.431+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b601441830 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.432+0000 7f976ffff640 1 -- 172.21.15.177:0/331342840 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9878074450 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.432+0000 7f976ffff640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9770036790 0x7f9770038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.432+0000 7f976ffff640 1 -- 172.21.15.177:0/331342840 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f987808c9d0 con 0x55b6013519d0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.432+0000 7f98876b6640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9770036790 0x7f9770038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.432+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601355e60 0x55b601453030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601453570 con 0x55b601355e60 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f98886b8640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601355e60 0x55b601453030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f98876b6640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9770036790 0x7f9770038c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f987000a430 tx=0x7f9870005540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f98886b8640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601355e60 0x55b601453030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f98886b8640 1 -- 172.21.15.177:0/331342840 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601355e60 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014538d0 con 0x55b601355e60 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.433+0000 7f98886b8640 1 -- 172.21.15.177:0/331342840 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f98800083e0 con 0x55b601355e60 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f98740022b0 0x55b601457400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601457b90 con 0x7f98740022b0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f9887eb7640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f98740022b0 0x55b601457400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f9887eb7640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f98740022b0 0x55b601457400 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f9887eb7640 1 -- 172.21.15.177:0/331342840 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9878071070 con 0x7f98740022b0 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014540d0 con 0x55b601355e60 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f98886b8640 1 -- 172.21.15.177:0/331342840 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f98800083e0 con 0x55b601355e60 2024-03-20T13:35:09.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b601458fb0 0x55b60145b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.434+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60145bae0 con 0x55b601458fb0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.435+0000 7f98876b6640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b601458fb0 0x55b60145b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.435+0000 7f98876b6640 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b601458fb0 0x55b60145b3a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f98876b6640 1 -- 172.21.15.177:0/331342840 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9870010040 con 0x55b601458fb0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f988c122800 1 Processor -- start 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f988c122800 1 -- start start 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f988c122800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 0x55b60146a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f988c122800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6011efc70 con 0x55b601469cc0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 0x55b60146a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 0x55b60146a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56652/0 (socket says 172.21.15.177:56652) 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.436+0000 7f9887eb7640 1 -- 172.21.15.177:0/1186158636 learned_addr learned my addr 172.21.15.177:0/1186158636 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.437+0000 7f9887eb7640 1 -- 172.21.15.177:0/1186158636 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b60146a620 con 0x55b601469cc0 2024-03-20T13:35:09.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.438+0000 7f9887eb7640 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 0x55b60146a0e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f987808ad50 tx=0x7f98780547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.439+0000 7f976d7fa640 1 -- 172.21.15.177:0/1186158636 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987808c040 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.439+0000 7f976d7fa640 1 -- 172.21.15.177:0/1186158636 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987807a040 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.439+0000 7f976d7fa640 1 -- 172.21.15.177:0/1186158636 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987806acd0 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.439+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b60146b090 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.439+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b60146b550 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.442+0000 7f976d7fa640 1 -- 172.21.15.177:0/1186158636 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f987808c1a0 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.442+0000 7f976d7fa640 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9760036790 0x7f9760038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.442+0000 7f976d7fa640 1 -- 172.21.15.177:0/1186158636 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9878055070 con 0x55b601469cc0 2024-03-20T13:35:09.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.442+0000 7f98876b6640 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9760036790 0x7f9760038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f988c122800 1 Processor -- start 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f988c122800 1 -- start start 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f98876b6640 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9760036790 0x7f9760038c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f987000b700 tx=0x7f987000e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f988c122800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b601477190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f988c122800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6011c55d0 con 0x55b601476d70 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b601477190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b601477190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56654/0 (socket says 172.21.15.177:56654) 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f9887eb7640 1 -- 172.21.15.177:0/1708471874 learned_addr learned my addr 172.21.15.177:0/1708471874 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f9887eb7640 1 -- 172.21.15.177:0/1708471874 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b601477760 con 0x55b601476d70 2024-03-20T13:35:09.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.443+0000 7f9887eb7640 1 --2- 172.21.15.177:0/1708471874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b601477190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9878084cd0 tx=0x7f987808c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57255161496fcaac server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f9766ffd640 1 -- 172.21.15.177:0/1708471874 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987809a040 con 0x55b601476d70 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f9766ffd640 1 -- 172.21.15.177:0/1708471874 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987806b430 con 0x55b601476d70 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f9766ffd640 1 -- 172.21.15.177:0/1708471874 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f987806ae30 con 0x55b601476d70 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 -- 172.21.15.177:0/1708471874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 msgr2=0x55b601477190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 --2- 172.21.15.177:0/1708471874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b601477190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f9878084cd0 tx=0x7f987808c820 comp rx=0 tx=0).stop 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 -- 172.21.15.177:0/1708471874 shutdown_connections 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 --2- 172.21.15.177:0/1708471874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b601477190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 -- 172.21.15.177:0/1708471874 >> 172.21.15.177:0/1708471874 conn(0x55b601473090 msgr2=0x55b6014710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 -- 172.21.15.177:0/1708471874 shutdown_connections 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 -- 172.21.15.177:0/1708471874 wait complete. 2024-03-20T13:35:09.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 Processor -- start 2024-03-20T13:35:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.444+0000 7f988c122800 1 -- start start 2024-03-20T13:35:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.445+0000 7f988c122800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b60147dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.445+0000 7f988c122800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b60147e150 con 0x55b601476d70 2024-03-20T13:35:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.446+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b60147dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.446+0000 7f9887eb7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b60147dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56668/0 (socket says 172.21.15.177:56668) 2024-03-20T13:35:09.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.446+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 learned_addr learned my addr 172.21.15.177:0/3180084799 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.447+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b60146b090 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.448+0000 7f9887eb7640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b60147dc10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9878084cd0 tx=0x7f9878091ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.449+0000 7f97657fa640 1 -- 172.21.15.177:0/3180084799 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f98780b2070 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.449+0000 7f97657fa640 1 -- 172.21.15.177:0/3180084799 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f987806ae30 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.449+0000 7f97657fa640 1 -- 172.21.15.177:0/3180084799 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9878081d80 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.449+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b60146b090 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.449+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b60146b090 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.450+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.450+0000 7f97657fa640 1 -- 172.21.15.177:0/3180084799 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9878080900 con 0x55b601476d70 2024-03-20T13:35:09.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.450+0000 7f97657fa640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f97500367e0 0x7f9750038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.450+0000 7f98876b6640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f97500367e0 0x7f9750038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.450+0000 7f97657fa640 1 -- 172.21.15.177:0/3180084799 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f98780bc9a0 con 0x55b601476d70 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601489330 0x55b60148b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148bf40 con 0x55b601489330 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f98876b6640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f97500367e0 0x7f9750038ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55b601441dc0 tx=0x7f9870002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f98886b8640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601489330 0x55b60148b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f98886b8640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601489330 0x55b60148b7f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 20 realm 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148c310 con 0x55b601489330 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.451+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cec0 con 0x55b601489330 2024-03-20T13:35:09.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b60148d870 0x55b60148fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014901a0 con 0x55b60148d870 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f9887eb7640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b60148d870 0x55b60148fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f9887eb7640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b60148d870 0x55b60148fc60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 20 searching for the correct realm 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6014921c0 0x55b601494680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.452+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601494d50 con 0x55b6014921c0 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.453+0000 7f98876b6640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6014921c0 0x55b601494680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.453+0000 7f98876b6640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6014921c0 0x55b601494680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.453+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.453+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601494d50 con 0x55b60148d870 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.453+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.453+0000 7f9887eb7640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9878074c20 0x7f98780bc040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.454+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601494d50 con 0x7f9878074c20 2024-03-20T13:35:09.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.455+0000 7f98886b8640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9878074c20 0x7f98780bc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.457+0000 7f98886b8640 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9878074c20 0x7f98780bc040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.458+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.459+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.459+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.459+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.459+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.459+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.460+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.460+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b60148d870 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.461+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.462+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.462+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.462+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.462+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b60148d870 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.462+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.462+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.463+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.463+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.463+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.463+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.463+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.463+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.464+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b60148d870 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.465+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.466+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.466+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.466+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.466+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.467+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.467+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b60148d870 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.467+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.467+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b6014921c0 2024-03-20T13:35:09.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.467+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x7f9878074c20 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b601489330 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60148cb60 con 0x55b60148d870 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:09.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.468+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601490aa0 con 0x55b601489330 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601490e50 con 0x55b601489330 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601490e50 con 0x7f9878074c20 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:09.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 zone default found 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 4 Realm: () 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 zonegroup default 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.469+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014916d0 con 0x7f9878074c20 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014916d0 con 0x55b6014921c0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601496c70 con 0x55b6014921c0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 started sync module instance, tier type = 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:09.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.470+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601496450 con 0x55b60148d870 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.471+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.471+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94240193994672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601496800 con 0x55b60148d870 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.471+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601497bc0 con 0x55b601489330 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.472+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94240193994672] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.472+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.472+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94240194000544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601497f70 con 0x55b601489330 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.472+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014989c0 con 0x55b6014921c0 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.473+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94240194000544] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.474+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.474+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94240194004128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601498d70 con 0x55b6014921c0 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.474+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b601499810 con 0x55b60148d870 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.475+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.475+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94240194004128] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.475+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94240194010048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149a480 con 0x55b60148d870 2024-03-20T13:35:09.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.475+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014970b0 con 0x55b601489330 2024-03-20T13:35:09.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.476+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.476+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94240194013520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149b210 con 0x55b601489330 2024-03-20T13:35:09.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.476+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149bbe0 con 0x7f9878074c20 2024-03-20T13:35:09.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.478+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94240194010048] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.478+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.478+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94240194016992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149bba0 con 0x7f9878074c20 2024-03-20T13:35:09.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.478+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149c610 con 0x7f9878074c20 2024-03-20T13:35:09.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.480+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94240194013520] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.480+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94240194016992] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.480+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.480+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94240194011104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149ad70 con 0x7f9878074c20 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.480+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149cc20 con 0x7f9878074c20 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'18 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94240194011104] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94240194021248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149cba0 con 0x7f9878074c20 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=0 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=1 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=2 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=3 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=4 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=5 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.482+0000 7f988c122800 20 add_watcher() i=6 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.483+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94240194021248] v30'19 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.483+0000 7f988c122800 20 add_watcher() i=7 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.483+0000 7f988c122800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:09.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.483+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014a0070 con 0x55b601489330 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.483+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.483+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94240194022304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b60149d570 con 0x55b601489330 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.484+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94240194022304] v30'46 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.484+0000 7f973dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.484+0000 7f988c122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.484+0000 7f988c122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.484+0000 7f988c122800 5 note: GC not initialized 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.484+0000 7f973cfe1640 20 reqs_thread_entry: start 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f988c122800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f988c122800 20 Filter name: none 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f96b67fc640 20 reqs_thread_entry: start 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2370 con 0x55b601489330 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2370 con 0x55b60148d870 2024-03-20T13:35:09.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2370 con 0x55b601489330 2024-03-20T13:35:09.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.485+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2370 con 0x55b6014921c0 2024-03-20T13:35:09.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2720 con 0x55b6014921c0 2024-03-20T13:35:09.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.486+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.487+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b60148d870 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.488+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.489+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.489+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.489+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.489+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.490+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.490+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.490+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.490+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.491+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.491+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.492+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.492+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b60148d870 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.492+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.492+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.492+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.492+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.493+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.494+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.495+0000 7f973dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.495+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94240194022304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.496+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94240194022304] v30'47 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.496+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94240193994672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b60148d870 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.497+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94240193994672] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.497+0000 7f988c122800 20 remove_watcher() i=0 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.497+0000 7f988c122800 2 removed watcher, disabling cache 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.497+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94240194000544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.498+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94240194000544] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.498+0000 7f988c122800 20 remove_watcher() i=1 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.498+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94240194004128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b6014921c0 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.500+0000 7f98876b6640 1 -- 172.21.15.177:0/3180084799 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94240194004128] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9870010040 con 0x55b6014921c0 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.500+0000 7f988c122800 20 remove_watcher() i=2 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.500+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94240194010048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b60148d870 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.501+0000 7f9887eb7640 1 -- 172.21.15.177:0/3180084799 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94240194010048] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98780b4070 con 0x55b60148d870 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.501+0000 7f988c122800 20 remove_watcher() i=3 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.501+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94240194013520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x55b601489330 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.502+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94240194013520] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x55b601489330 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.502+0000 7f988c122800 20 remove_watcher() i=4 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.502+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94240194016992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.503+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94240194016992] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.503+0000 7f988c122800 20 remove_watcher() i=5 2024-03-20T13:35:09.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.503+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94240194011104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.504+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94240194011104] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.504+0000 7f988c122800 20 remove_watcher() i=6 2024-03-20T13:35:09.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.504+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94240194021248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6014d2af0 con 0x7f9878074c20 2024-03-20T13:35:09.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.505+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94240194021248] v30'20 uv18 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f98800083e0 con 0x7f9878074c20 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.505+0000 7f988c122800 20 remove_watcher() i=7 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9878074c20 msgr2=0x7f98780bc040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9878074c20 0x7f98780bc040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601489330 msgr2=0x55b60148b7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601489330 0x55b60148b7f0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b60148d870 msgr2=0x55b60148fc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b60148d870 0x55b60148fc60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6014921c0 msgr2=0x55b601494680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6014921c0 0x55b601494680 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f97500367e0 msgr2=0x7f9750038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f97500367e0 0x7f9750038ca0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x55b601441dc0 tx=0x7f9870002000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 msgr2=0x55b60147dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/3180084799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601476d70 0x55b60147dc10 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9878084cd0 tx=0x7f9878091ea0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 reap_dead start 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f98886b8640 1 -- 172.21.15.177:0/3180084799 reap_dead start 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 shutdown_connections 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 >> 172.21.15.177:0/3180084799 conn(0x55b601473090 msgr2=0x55b6014710c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 shutdown_connections 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/3180084799 wait complete. 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9760036790 msgr2=0x7f9760038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9760036790 0x7f9760038c50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f987000b700 tx=0x7f987000e000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 msgr2=0x55b60146a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 0x55b60146a0e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f987808ad50 tx=0x7f98780547d0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 shutdown_connections 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9760036790 0x7f9760038c50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 --2- 172.21.15.177:0/1186158636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b601469cc0 0x55b60146a0e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 >> 172.21.15.177:0/1186158636 conn(0x55b60145dd60 msgr2=0x55b60145e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 shutdown_connections 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.506+0000 7f988c122800 1 -- 172.21.15.177:0/1186158636 wait complete. 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b601458fb0 msgr2=0x55b60145b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b601458fb0 0x55b60145b3a0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601355e60 msgr2=0x55b601453030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b601355e60 0x55b601453030 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f98740022b0 msgr2=0x55b601457400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f98740022b0 0x55b601457400 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9770036790 msgr2=0x7f9770038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9770036790 0x7f9770038c50 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f987000a430 tx=0x7f9870005540 comp rx=0 tx=0).stop 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 msgr2=0x55b601442c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 --2- 172.21.15.177:0/331342840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6013519d0 0x55b601442c60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9878001350 tx=0x7f98740040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f98886b8640 1 -- 172.21.15.177:0/331342840 reap_dead start 2024-03-20T13:35:09.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 shutdown_connections 2024-03-20T13:35:09.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 >> 172.21.15.177:0/331342840 conn(0x55b60134d030 msgr2=0x55b60143b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 shutdown_connections 2024-03-20T13:35:09.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.507+0000 7f988c122800 1 -- 172.21.15.177:0/331342840 wait complete. 2024-03-20T13:35:09.517 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[],"summary":[]} 2024-03-20T13:35:09.517 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-03-20T13:35:09.517 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:09.517 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:09.517 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:09.600 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:09.601 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:09.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.599+0000 7f294192f800 1 Processor -- start 2024-03-20T13:35:09.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.599+0000 7f294192f800 1 -- start start 2024-03-20T13:35:09.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.599+0000 7f294192f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563660608400 0x563660608820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.599+0000 7f294192f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563660554cd0 con 0x563660608d60 2024-03-20T13:35:09.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.599+0000 7f294192f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56366050b500 con 0x563660608400 2024-03-20T13:35:09.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.600+0000 7f293d5b3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563660608400 0x563660608820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.600+0000 7f2934db2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x563660608d60 0x563660609210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36824/0 (socket says 172.21.15.177:36824) 2024-03-20T13:35:09.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.600+0000 7f2934db2640 1 -- 172.21.15.177:0/510189604 learned_addr learned my addr 172.21.15.177:0/510189604 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:09.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.600+0000 7f293d5b3640 1 -- 172.21.15.177:0/510189604 >> v1:172.21.15.28:6789/0 conn(0x563660608d60 legacy=0x563660609210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.600+0000 7f293d5b3640 1 -- 172.21.15.177:0/510189604 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56366057d090 con 0x563660608400 2024-03-20T13:35:09.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.602+0000 7f293d5b3640 1 --2- 172.21.15.177:0/510189604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x563660608820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f293000a470 tx=0x7f293001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6034c5ed508b286f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.602+0000 7f293cdb2640 1 -- 172.21.15.177:0/510189604 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930052570 con 0x563660608400 2024-03-20T13:35:09.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.602+0000 7f293cdb2640 1 -- 172.21.15.177:0/510189604 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29300526d0 con 0x563660608400 2024-03-20T13:35:09.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.602+0000 7f293cdb2640 1 -- 172.21.15.177:0/510189604 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930052990 con 0x563660608400 2024-03-20T13:35:09.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 -- 172.21.15.177:0/510189604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 msgr2=0x563660608820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 --2- 172.21.15.177:0/510189604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x563660608820 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f293000a470 tx=0x7f293001cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:09.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 -- 172.21.15.177:0/510189604 shutdown_connections 2024-03-20T13:35:09.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 --2- 172.21.15.177:0/510189604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x563660608820 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 -- 172.21.15.177:0/510189604 >> 172.21.15.177:0/510189604 conn(0x563660604040 msgr2=0x563660606460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 -- 172.21.15.177:0/510189604 shutdown_connections 2024-03-20T13:35:09.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.603+0000 7f294192f800 1 -- 172.21.15.177:0/510189604 wait complete. 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.614+0000 7f294192f800 1 Processor -- start 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.614+0000 7f294192f800 1 -- start start 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.614+0000 7f294192f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x5636606fbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.614+0000 7f294192f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563660508a30 con 0x563660608400 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.615+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x5636606fbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.615+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x5636606fbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56672/0 (socket says 172.21.15.177:56672) 2024-03-20T13:35:09.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.615+0000 7f293d5b3640 1 -- 172.21.15.177:0/3291022789 learned_addr learned my addr 172.21.15.177:0/3291022789 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.615+0000 7f293d5b3640 1 -- 172.21.15.177:0/3291022789 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2930005d20 con 0x563660608400 2024-03-20T13:35:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.615+0000 7f293d5b3640 1 --2- 172.21.15.177:0/3291022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x5636606fbbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2930055040 tx=0x7f293004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4764851d132e249 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f282b606640 1 -- 172.21.15.177:0/3291022789 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f293000a180 con 0x563660608400 2024-03-20T13:35:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f282b606640 1 -- 172.21.15.177:0/3291022789 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293000a300 con 0x563660608400 2024-03-20T13:35:09.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f282b606640 1 -- 172.21.15.177:0/3291022789 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29300529b0 con 0x563660608400 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 -- 172.21.15.177:0/3291022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 msgr2=0x5636606fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 --2- 172.21.15.177:0/3291022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x5636606fbbe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2930055040 tx=0x7f293004c000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 -- 172.21.15.177:0/3291022789 shutdown_connections 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 --2- 172.21.15.177:0/3291022789 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608400 0x5636606fbbe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 -- 172.21.15.177:0/3291022789 >> 172.21.15.177:0/3291022789 conn(0x563660604040 msgr2=0x5636606f7500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 -- 172.21.15.177:0/3291022789 shutdown_connections 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.616+0000 7f294192f800 1 -- 172.21.15.177:0/3291022789 wait complete. 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f294192f800 1 Processor -- start 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f294192f800 1 -- start start 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f294192f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608d60 0x5636607033e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f294192f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563660504210 con 0x563660608d60 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608d60 0x5636607033e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608d60 0x5636607033e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56688/0 (socket says 172.21.15.177:56688) 2024-03-20T13:35:09.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f293d5b3640 1 -- 172.21.15.177:0/1072586536 learned_addr learned my addr 172.21.15.177:0/1072586536 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.617+0000 7f293d5b3640 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56366057d090 con 0x563660608d60 2024-03-20T13:35:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.618+0000 7f293d5b3640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608d60 0x5636607033e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f293005f040 tx=0x7f2930002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.618+0000 7f2829e03640 1 -- 172.21.15.177:0/1072586536 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f293006a070 con 0x563660608d60 2024-03-20T13:35:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.618+0000 7f2829e03640 1 -- 172.21.15.177:0/1072586536 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930052db0 con 0x563660608d60 2024-03-20T13:35:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.618+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563660703920 con 0x563660608d60 2024-03-20T13:35:09.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.618+0000 7f2829e03640 1 -- 172.21.15.177:0/1072586536 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f293005d550 con 0x563660608d60 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.618+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563660703e00 con 0x563660608d60 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f2829e03640 1 -- 172.21.15.177:0/1072586536 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f293005d6b0 con 0x563660608d60 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f2829e03640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2824036790 0x7f2824038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f2829e03640 1 -- 172.21.15.177:0/1072586536 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f293008d940 con 0x563660608d60 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f2934db2640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2824036790 0x7f2824038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660708080 0x56366070a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366070aa60 con 0x563660708080 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f293ddb4640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660708080 0x56366070a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f2934db2640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2824036790 0x7f2824038c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2928000f60 tx=0x7f29280012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.619+0000 7f293ddb4640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660708080 0x56366070a4b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f293ddb4640 1 -- 172.21.15.177:0/1072586536 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660708080 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607077e0 con 0x563660708080 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f293ddb4640 1 -- 172.21.15.177:0/1072586536 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f293800a4a0 con 0x563660708080 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56366070ccd0 0x56366070f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366070f790 con 0x56366070ccd0 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f293d5b3640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56366070ccd0 0x56366070f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.620+0000 7f293d5b3640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56366070ccd0 0x56366070f0c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.621+0000 7f293d5b3640 1 -- 172.21.15.177:0/1072586536 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2930059040 con 0x56366070ccd0 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.621+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366070bc50 con 0x563660708080 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.621+0000 7f293ddb4640 1 -- 172.21.15.177:0/1072586536 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f293800a4a0 con 0x563660708080 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.621+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563660710bb0 0x563660712fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.621+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660713700 con 0x563660710bb0 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.621+0000 7f2934db2640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563660710bb0 0x563660712fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.622+0000 7f2934db2640 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563660710bb0 0x563660712fa0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.622+0000 7f2934db2640 1 -- 172.21.15.177:0/1072586536 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2928006070 con 0x563660710bb0 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.622+0000 7f294192f800 1 Processor -- start 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.622+0000 7f294192f800 1 -- start start 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.622+0000 7f294192f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 0x563660721d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f294192f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5636604a6c70 con 0x563660721900 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 0x563660721d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 0x563660721d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56690/0 (socket says 172.21.15.177:56690) 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f293d5b3640 1 -- 172.21.15.177:0/3827362982 learned_addr learned my addr 172.21.15.177:0/3827362982 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f293d5b3640 1 -- 172.21.15.177:0/3827362982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563660722260 con 0x563660721900 2024-03-20T13:35:09.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f293d5b3640 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 0x563660721d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f293008bdb0 tx=0x7f293006dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f2822ffd640 1 -- 172.21.15.177:0/3827362982 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f293004be60 con 0x563660721900 2024-03-20T13:35:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f2822ffd640 1 -- 172.21.15.177:0/3827362982 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2930080030 con 0x563660721900 2024-03-20T13:35:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563660722cd0 con 0x563660721900 2024-03-20T13:35:09.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f2822ffd640 1 -- 172.21.15.177:0/3827362982 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f293005cac0 con 0x563660721900 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.623+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563660722cd0 con 0x563660721900 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.624+0000 7f2822ffd640 1 -- 172.21.15.177:0/3827362982 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f293005cc20 con 0x563660721900 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.624+0000 7f2822ffd640 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2814036790 0x7f2814038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.624+0000 7f2822ffd640 1 -- 172.21.15.177:0/3827362982 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2930097c40 con 0x563660721900 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.624+0000 7f2934db2640 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2814036790 0x7f2814038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f294192f800 1 Processor -- start 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f294192f800 1 -- start start 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f2934db2640 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2814036790 0x7f2814038c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f292800bf50 tx=0x7f292800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f294192f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x56366072ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f294192f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56366047c5d0 con 0x56366072e7d0 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x56366072ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x56366072ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56700/0 (socket says 172.21.15.177:56700) 2024-03-20T13:35:09.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f293d5b3640 1 -- 172.21.15.177:0/1942693581 learned_addr learned my addr 172.21.15.177:0/1942693581 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f293d5b3640 1 -- 172.21.15.177:0/1942693581 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56366072f1c0 con 0x56366072e7d0 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.625+0000 7f293d5b3640 1 --2- 172.21.15.177:0/1942693581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x56366072ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f293006e910 tx=0x7f293006e6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f86a948e59132d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f2820ff9640 1 -- 172.21.15.177:0/1942693581 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f293005fe90 con 0x56366072e7d0 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f2820ff9640 1 -- 172.21.15.177:0/1942693581 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293008be90 con 0x56366072e7d0 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f2820ff9640 1 -- 172.21.15.177:0/1942693581 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930065780 con 0x56366072e7d0 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 -- 172.21.15.177:0/1942693581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 msgr2=0x56366072ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 --2- 172.21.15.177:0/1942693581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x56366072ebf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f293006e910 tx=0x7f293006e6b0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 -- 172.21.15.177:0/1942693581 shutdown_connections 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 --2- 172.21.15.177:0/1942693581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x56366072ebf0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 -- 172.21.15.177:0/1942693581 >> 172.21.15.177:0/1942693581 conn(0x56366072ab30 msgr2=0x563660728b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 -- 172.21.15.177:0/1942693581 shutdown_connections 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 -- 172.21.15.177:0/1942693581 wait complete. 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 Processor -- start 2024-03-20T13:35:09.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.626+0000 7f294192f800 1 -- start start 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f294192f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x5636607355c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f294192f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563660735b00 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x5636607355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f293d5b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x5636607355c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56710/0 (socket says 172.21.15.177:56710) 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 learned_addr learned my addr 172.21.15.177:0/3573618841 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563660722260 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f293d5b3640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x5636607355c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2930069fd0 tx=0x7f2930083f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f2812ffd640 1 -- 172.21.15.177:0/3573618841 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f29300b5070 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f2812ffd640 1 -- 172.21.15.177:0/3573618841 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f293008d050 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f2812ffd640 1 -- 172.21.15.177:0/3573618841 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2930077920 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.627+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563660722260 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.628+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563660722260 con 0x56366072e7d0 2024-03-20T13:35:09.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.628+0000 7f2812ffd640 1 -- 172.21.15.177:0/3573618841 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2930077b70 con 0x56366072e7d0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.628+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.628+0000 7f2812ffd640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f28080366f0 0x7f2808038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.628+0000 7f2812ffd640 1 -- 172.21.15.177:0/3573618841 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f29300be950 con 0x56366072e7d0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f2934db2640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f28080366f0 0x7f2808038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660740d50 0x563660743210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660743960 con 0x563660740d50 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f293ddb4640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660740d50 0x563660743210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f2934db2640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f28080366f0 0x7f2808038bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2928001b60 tx=0x7f2928010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f293ddb4640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660740d50 0x563660743210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 20 realm 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660743d30 con 0x563660740d50 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.629+0000 7f294192f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607448e0 con 0x563660740d50 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563660745290 0x563660747680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660747bc0 con 0x563660745290 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f293d5b3640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563660745290 0x563660747680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.630+0000 7f293d5b3640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563660745290 0x563660747680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f29300a6020 con 0x563660745290 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f294192f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f294192f800 20 searching for the correct realm 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563660749c00 0x56366074c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074c790 con 0x563660749c00 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f2934db2640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563660749c00 0x56366074c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f2934db2640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563660749c00 0x56366074c0c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.631+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074c790 con 0x563660745290 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.632+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29300a6020 con 0x563660745290 2024-03-20T13:35:09.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.632+0000 7f293d5b3640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2930078060 0x7f29300976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.632+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074c790 con 0x7f2930078060 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.632+0000 7f293ddb4640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2930078060 0x7f29300976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.632+0000 7f293ddb4640 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2930078060 0x7f29300976f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.633+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660745290 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29300a6020 con 0x563660745290 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.634+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660745290 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f29300a6020 con 0x563660745290 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.635+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.636+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.637+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660745290 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660749c00 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.638+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x7f2930078060 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2938031040 con 0x563660745290 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2938031040 con 0x563660749c00 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2938031040 con 0x7f2930078060 2024-03-20T13:35:09.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.639+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2938031040 con 0x563660740d50 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2938031040 con 0x563660745290 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:09.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660744580 con 0x563660740d50 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607484c0 con 0x563660740d50 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.640+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607484c0 con 0x7f2930078060 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:09.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 zone default found 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 4 Realm: () 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 zonegroup default 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660748d40 con 0x7f2930078060 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660748d40 con 0x563660749c00 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.641+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074e5b0 con 0x563660749c00 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 20 started sync module instance, tier type = 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.642+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074da40 con 0x563660745290 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.643+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.643+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94791546494368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074e1c0 con 0x563660745290 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.643+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074f290 con 0x563660740d50 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.644+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94791546494368] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.644+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.644+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94791546497296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074f640 con 0x563660740d50 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.644+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660750030 con 0x563660749c00 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.645+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94791546497296] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.646+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.646+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94791546501904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607503e0 con 0x563660749c00 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.646+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660750e00 con 0x563660745290 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.647+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.647+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94791546507744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660751aa0 con 0x563660745290 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.647+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660752470 con 0x563660740d50 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.647+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94791546501904] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.648+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.648+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94791546511216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660752850 con 0x563660740d50 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.648+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660753200 con 0x7f2930078060 2024-03-20T13:35:09.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.648+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94791546507744] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.649+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94791546511216] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.651+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.651+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94791546498352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660752d20 con 0x7f2930078060 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.651+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607536d0 con 0x7f2930078060 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.653+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94791546498352] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.655+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.655+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94791546508800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660753690 con 0x7f2930078060 2024-03-20T13:35:09.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.655+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660754090 con 0x7f2930078060 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94791546508800] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'21 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94791546515952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660754090 con 0x7f2930078060 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=0 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=1 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=2 2024-03-20T13:35:09.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=3 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=4 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=5 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.658+0000 7f294192f800 20 add_watcher() i=6 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.661+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94791546515952] v30'22 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.661+0000 7f294192f800 20 add_watcher() i=7 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.661+0000 7f294192f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.661+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607574e0 con 0x563660740d50 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.661+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.661+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94791546518976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607549f0 con 0x563660740d50 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94791546518976] v30'48 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f27f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f294192f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:09.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f294192f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f294192f800 5 note: GC not initialized 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f27f27e4640 20 reqs_thread_entry: start 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f294192f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.662+0000 7f294192f800 20 Filter name: none 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.663+0000 7f2763fff640 20 reqs_thread_entry: start 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.663+0000 7f294192f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.663+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660788f90 con 0x563660740d50 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.663+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.663+0000 7f294192f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:could not fetch user info: no user info saved 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.663+0000 7f27f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.664+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94791546518976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660788f50 con 0x563660740d50 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.664+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94791546518976] v30'49 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.664+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94791546494368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660788f50 con 0x563660745290 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.666+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94791546494368] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.666+0000 7f294192f800 20 remove_watcher() i=0 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.666+0000 7f294192f800 2 removed watcher, disabling cache 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.666+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94791546497296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660788f50 con 0x563660740d50 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.668+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94791546497296] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.668+0000 7f294192f800 20 remove_watcher() i=1 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.668+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94791546501904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563660788f50 con 0x563660749c00 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.669+0000 7f2934db2640 1 -- 172.21.15.177:0/3573618841 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94791546501904] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2928006070 con 0x563660749c00 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.669+0000 7f294192f800 20 remove_watcher() i=2 2024-03-20T13:35:09.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.669+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94791546507744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074e910 con 0x563660745290 2024-03-20T13:35:09.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.669+0000 7f293d5b3640 1 -- 172.21.15.177:0/3573618841 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94791546507744] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f29300cb080 con 0x563660745290 2024-03-20T13:35:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.669+0000 7f294192f800 20 remove_watcher() i=3 2024-03-20T13:35:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.669+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94791546511216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074fb10 con 0x563660740d50 2024-03-20T13:35:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.670+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94791546511216] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x563660740d50 2024-03-20T13:35:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.670+0000 7f294192f800 20 remove_watcher() i=4 2024-03-20T13:35:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.670+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94791546498352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5636607511e0 con 0x7f2930078060 2024-03-20T13:35:09.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.671+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94791546498352] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.671+0000 7f294192f800 20 remove_watcher() i=5 2024-03-20T13:35:09.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.671+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94791546508800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074fb10 con 0x7f2930078060 2024-03-20T13:35:09.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.673+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94791546508800] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.673+0000 7f294192f800 20 remove_watcher() i=6 2024-03-20T13:35:09.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.673+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94791546515952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56366074fb10 con 0x7f2930078060 2024-03-20T13:35:09.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.675+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94791546515952] v30'23 uv21 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f293800a4a0 con 0x7f2930078060 2024-03-20T13:35:09.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.675+0000 7f294192f800 20 remove_watcher() i=7 2024-03-20T13:35:09.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.675+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2930078060 msgr2=0x7f29300976f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2930078060 0x7f29300976f0 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660740d50 msgr2=0x563660743210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660740d50 0x563660743210 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563660745290 msgr2=0x563660747680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563660745290 0x563660747680 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563660749c00 msgr2=0x56366074c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563660749c00 0x56366074c0c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f28080366f0 msgr2=0x7f2808038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f28080366f0 0x7f2808038bb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2928001b60 tx=0x7f2928010000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 msgr2=0x5636607355c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f293ddb4640 1 -- 172.21.15.177:0/3573618841 reap_dead start 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x5636607355c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2930069fd0 tx=0x7f2930083f60 comp rx=0 tx=0).stop 2024-03-20T13:35:09.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 shutdown_connections 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3573618841 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56366072e7d0 0x5636607355c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 >> 172.21.15.177:0/3573618841 conn(0x56366072ab30 msgr2=0x563660728190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 shutdown_connections 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3573618841 wait complete. 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2814036790 msgr2=0x7f2814038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2814036790 0x7f2814038c50 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f292800bf50 tx=0x7f292800f000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 msgr2=0x563660721d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 0x563660721d20 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f293008bdb0 tx=0x7f293006dd30 comp rx=0 tx=0).stop 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 shutdown_connections 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2814036790 0x7f2814038c50 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 --2- 172.21.15.177:0/3827362982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660721900 0x563660721d20 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 >> 172.21.15.177:0/3827362982 conn(0x5636607159a0 msgr2=0x563660715da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 shutdown_connections 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/3827362982 wait complete. 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.676+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563660710bb0 msgr2=0x563660712fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563660710bb0 0x563660712fa0 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660708080 msgr2=0x56366070a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563660708080 0x56366070a4b0 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56366070ccd0 msgr2=0x56366070f0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56366070ccd0 0x56366070f0c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2824036790 msgr2=0x7f2824038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2824036790 0x7f2824038c50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2928000f60 tx=0x7f29280012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608d60 msgr2=0x5636607033e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 --2- 172.21.15.177:0/1072586536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563660608d60 0x5636607033e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f293005f040 tx=0x7f2930002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f293ddb4640 1 -- 172.21.15.177:0/1072586536 reap_dead start 2024-03-20T13:35:09.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 shutdown_connections 2024-03-20T13:35:09.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 >> 172.21.15.177:0/1072586536 conn(0x563660604040 msgr2=0x5636606f5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 shutdown_connections 2024-03-20T13:35:09.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.677+0000 7f294192f800 1 -- 172.21.15.177:0/1072586536 wait complete. 2024-03-20T13:35:09.685 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-20T13:35:09.686 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-03-20T13:35:09.686 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-03-20T13:35:09.686 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-03-20T13:35:09.778 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:09.778 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0626c24800 1 Processor -- start 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0626c24800 1 -- start start 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0626c24800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561e299cee10 0x561e299d1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0626c24800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561e29916c70 con 0x561e299ca980 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0626c24800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561e298cd500 con 0x561e299cee10 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0623f22640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561e299cee10 0x561e299d1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0624723640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x561e299ca980 0x561e299cada0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36830/0 (socket says 172.21.15.177:36830) 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0623f22640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561e299cee10 0x561e299d1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56712/0 (socket says 172.21.15.177:56712) 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0624723640 1 -- 172.21.15.177:0/3095672509 learned_addr learned my addr 172.21.15.177:0/3095672509 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0623f22640 1 -- 172.21.15.177:0/3095672509 >> v1:172.21.15.28:6789/0 conn(0x561e299ca980 legacy=0x561e299cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.778+0000 7f0623f22640 1 -- 172.21.15.177:0/3095672509 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e299d2830 con 0x561e299cee10 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.780+0000 7f0623f22640 1 --2- 172.21.15.177:0/3095672509 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299cee10 0x561e299d1200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f061800a470 tx=0x7f061801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31e3d427016bfebf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.780+0000 7f0623721640 1 -- 172.21.15.177:0/3095672509 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0618052570 con 0x561e299cee10 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.780+0000 7f0623721640 1 -- 172.21.15.177:0/3095672509 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06180526d0 con 0x561e299cee10 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.780+0000 7f0623721640 1 -- 172.21.15.177:0/3095672509 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0618052990 con 0x561e299cee10 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 -- 172.21.15.177:0/3095672509 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299cee10 msgr2=0x561e299d1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 --2- 172.21.15.177:0/3095672509 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299cee10 0x561e299d1200 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f061800a470 tx=0x7f061801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:09.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 -- 172.21.15.177:0/3095672509 shutdown_connections 2024-03-20T13:35:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 --2- 172.21.15.177:0/3095672509 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299cee10 0x561e299d1200 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 -- 172.21.15.177:0/3095672509 >> 172.21.15.177:0/3095672509 conn(0x561e299c5fe0 msgr2=0x561e299c8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 -- 172.21.15.177:0/3095672509 shutdown_connections 2024-03-20T13:35:09.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.781+0000 7f0626c24800 1 -- 172.21.15.177:0/3095672509 wait complete. 2024-03-20T13:35:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0626c24800 1 Processor -- start 2024-03-20T13:35:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0626c24800 1 -- start start 2024-03-20T13:35:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0626c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29aba9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0626c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e298caa30 con 0x561e299ca980 2024-03-20T13:35:09.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29aba9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29aba9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56726/0 (socket says 172.21.15.177:56726) 2024-03-20T13:35:09.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.793+0000 7f0624723640 1 -- 172.21.15.177:0/609916813 learned_addr learned my addr 172.21.15.177:0/609916813 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.794+0000 7f0624723640 1 -- 172.21.15.177:0/609916813 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0618005d20 con 0x561e299ca980 2024-03-20T13:35:09.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.794+0000 7f0624723640 1 --2- 172.21.15.177:0/609916813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29aba9d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0614001c80 tx=0x7f061400b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f26fa90737ece10 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.794+0000 7f051260c640 1 -- 172.21.15.177:0/609916813 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0614010070 con 0x561e299ca980 2024-03-20T13:35:09.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.794+0000 7f051260c640 1 -- 172.21.15.177:0/609916813 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400b240 con 0x561e299ca980 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.794+0000 7f051260c640 1 -- 172.21.15.177:0/609916813 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140095b0 con 0x561e299ca980 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- 172.21.15.177:0/609916813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 msgr2=0x561e29aba9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 --2- 172.21.15.177:0/609916813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29aba9d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0614001c80 tx=0x7f061400b850 comp rx=0 tx=0).stop 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- 172.21.15.177:0/609916813 shutdown_connections 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 --2- 172.21.15.177:0/609916813 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29aba9d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- 172.21.15.177:0/609916813 >> 172.21.15.177:0/609916813 conn(0x561e299c5fe0 msgr2=0x561e29ab62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- 172.21.15.177:0/609916813 shutdown_connections 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- 172.21.15.177:0/609916813 wait complete. 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 Processor -- start 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- start start 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29ac0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0626c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e298c6210 con 0x561e299ca980 2024-03-20T13:35:09.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29ac0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29ac0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56738/0 (socket says 172.21.15.177:56738) 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.795+0000 7f0624723640 1 -- 172.21.15.177:0/378308545 learned_addr learned my addr 172.21.15.177:0/378308545 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0624723640 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e29916c70 con 0x561e299ca980 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0624723640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29ac0fa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0614001c80 tx=0x7f06140040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0510e09640 1 -- 172.21.15.177:0/378308545 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f061401d040 con 0x561e299ca980 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0510e09640 1 -- 172.21.15.177:0/378308545 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614016640 con 0x561e299ca980 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0510e09640 1 -- 172.21.15.177:0/378308545 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0614016920 con 0x561e299ca980 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e29ac14e0 con 0x561e299ca980 2024-03-20T13:35:09.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.796+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e29ac19c0 con 0x561e299ca980 2024-03-20T13:35:09.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.797+0000 7f0510e09640 1 -- 172.21.15.177:0/378308545 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0614016a80 con 0x561e299ca980 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.797+0000 7f0510e09640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f050c036790 0x7f050c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.797+0000 7f0510e09640 1 -- 172.21.15.177:0/378308545 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f061404d9a0 con 0x561e299ca980 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.797+0000 7f0623f22640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f050c036790 0x7f050c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.797+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e299cee10 0x561e29ac7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.797+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29ac82c0 con 0x561e299cee10 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0624f24640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e299cee10 0x561e29ac7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0623f22640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f050c036790 0x7f050c038c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0618054000 tx=0x7f061804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0624f24640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e299cee10 0x561e29ac7cf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0624f24640 1 -- 172.21.15.177:0/378308545 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e299cee10 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29ac53a0 con 0x561e299cee10 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0624f24640 1 -- 172.21.15.177:0/378308545 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e299cee10 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29aca530 0x561e29acc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.798+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29acd010 con 0x561e29aca530 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0624723640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29aca530 0x561e29acc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0624723640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29aca530 0x561e29acc920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0624723640 1 -- 172.21.15.177:0/378308545 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f0614021c30 con 0x561e29aca530 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29ac94b0 con 0x561e299cee10 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0624f24640 1 -- 172.21.15.177:0/378308545 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e299cee10 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e29ace430 0x561e29ad0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.799+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29ad0f60 con 0x561e29ace430 2024-03-20T13:35:09.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.800+0000 7f0623f22640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e29ace430 0x561e29ad0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.801+0000 7f0623f22640 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e29ace430 0x561e29ad0820 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.801+0000 7f0623f22640 1 -- 172.21.15.177:0/378308545 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f0618059040 con 0x561e29ace430 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.801+0000 7f0626c24800 1 Processor -- start 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0626c24800 1 -- start start 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0626c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 0x561e29ae3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0626c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e29868c70 con 0x561e29ae3570 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 0x561e29ae3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 0x561e29ae3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56744/0 (socket says 172.21.15.177:56744) 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0624723640 1 -- 172.21.15.177:0/549396373 learned_addr learned my addr 172.21.15.177:0/549396373 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0624723640 1 -- 172.21.15.177:0/549396373 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e29ae3ed0 con 0x561e29ae3570 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0624723640 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 0x561e29ae3990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f061404bd20 tx=0x7f06140149a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0509ffb640 1 -- 172.21.15.177:0/549396373 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140092d0 con 0x561e29ae3570 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0509ffb640 1 -- 172.21.15.177:0/549396373 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06140218c0 con 0x561e29ae3570 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e29ae4940 con 0x561e29ae3570 2024-03-20T13:35:09.808 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0509ffb640 1 -- 172.21.15.177:0/549396373 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0614014da0 con 0x561e29ae3570 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.802+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e29ae4e00 con 0x561e29ae3570 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.803+0000 7f0509ffb640 1 -- 172.21.15.177:0/549396373 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0614040080 con 0x561e29ae3570 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.803+0000 7f0509ffb640 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04fc0367e0 0x7f04fc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.803+0000 7f0509ffb640 1 -- 172.21.15.177:0/549396373 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f061403fc80 con 0x561e29ae3570 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.803+0000 7f0623f22640 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04fc0367e0 0x7f04fc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0626c24800 1 Processor -- start 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0626c24800 1 -- start start 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0623f22640 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04fc0367e0 0x7f04fc038ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x561e29ac52c0 tx=0x7f0618005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0626c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af0a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0626c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e2983e5d0 con 0x561e29af0650 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af0a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af0a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56758/0 (socket says 172.21.15.177:56758) 2024-03-20T13:35:09.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0624723640 1 -- 172.21.15.177:0/4071558382 learned_addr learned my addr 172.21.15.177:0/4071558382 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0624723640 1 -- 172.21.15.177:0/4071558382 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e29af1040 con 0x561e29af0650 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.804+0000 7f0624723640 1 --2- 172.21.15.177:0/4071558382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af0a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f061400b450 tx=0x7f0614040f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b664c0724a574a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f05037fe640 1 -- 172.21.15.177:0/4071558382 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f061400e130 con 0x561e29af0650 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f05037fe640 1 -- 172.21.15.177:0/4071558382 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400e290 con 0x561e29af0650 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f05037fe640 1 -- 172.21.15.177:0/4071558382 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f061404a840 con 0x561e29af0650 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 -- 172.21.15.177:0/4071558382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 msgr2=0x561e29af0a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 --2- 172.21.15.177:0/4071558382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af0a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f061400b450 tx=0x7f0614040f20 comp rx=0 tx=0).stop 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 -- 172.21.15.177:0/4071558382 shutdown_connections 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 --2- 172.21.15.177:0/4071558382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af0a70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 -- 172.21.15.177:0/4071558382 >> 172.21.15.177:0/4071558382 conn(0x561e29aec960 msgr2=0x561e29aea9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 -- 172.21.15.177:0/4071558382 shutdown_connections 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 -- 172.21.15.177:0/4071558382 wait complete. 2024-03-20T13:35:09.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.805+0000 7f0626c24800 1 Processor -- start 2024-03-20T13:35:09.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.806+0000 7f0626c24800 1 -- start start 2024-03-20T13:35:09.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.806+0000 7f0626c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.806+0000 7f0626c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e29af7ab0 con 0x561e29af0650 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.807+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.807+0000 7f0624723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af7570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56762/0 (socket says 172.21.15.177:56762) 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.807+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 learned_addr learned my addr 172.21.15.177:0/2195062444 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.807+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e29ae4940 con 0x561e29af0650 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.808+0000 7f0624723640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af7570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f061400b450 tx=0x7f0614031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.809+0000 7f0501ffb640 1 -- 172.21.15.177:0/2195062444 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0614027710 con 0x561e29af0650 2024-03-20T13:35:09.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.809+0000 7f0501ffb640 1 -- 172.21.15.177:0/2195062444 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0614066070 con 0x561e29af0650 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.809+0000 7f0501ffb640 1 -- 172.21.15.177:0/2195062444 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f06140279a0 con 0x561e29af0650 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.809+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e29ae4940 con 0x561e29af0650 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.809+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e29ae4940 con 0x561e29af0650 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.810+0000 7f0501ffb640 1 -- 172.21.15.177:0/2195062444 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0614040430 con 0x561e29af0650 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.810+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.810+0000 7f0501ffb640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04f4036830 0x7f04f4038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.810+0000 7f0501ffb640 1 -- 172.21.15.177:0/2195062444 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f0614068070 con 0x561e29af0650 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.810+0000 7f0623f22640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04f4036830 0x7f04f4038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e29b02e00 0x561e29b052c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b05a10 con 0x561e29b02e00 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0624f24640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e29b02e00 0x561e29b052c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0623f22640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04f4036830 0x7f04f4038cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x561e29ad1320 tx=0x7f061804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0624f24640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e29b02e00 0x561e29b052c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 20 realm 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b05de0 con 0x561e29b02e00 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.811+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06990 con 0x561e29b02e00 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29b07340 0x561e29b09730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b09d80 con 0x561e29b07340 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0624723640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29b07340 0x561e29b09730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.812+0000 7f0624723640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29b07340 0x561e29b09730 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0626c24800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0626c24800 20 searching for the correct realm 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e29b0c070 0x561e29b0e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0ebb0 con 0x561e29b0c070 2024-03-20T13:35:09.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0623f22640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e29b0c070 0x561e29b0e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0623f22640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e29b0c070 0x561e29b0e530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.813+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0ebb0 con 0x561e29b07340 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.814+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.814+0000 7f0624723640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f0614079040 0x7f0614059170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.814+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0ebb0 con 0x7f0614079040 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.814+0000 7f0624f24640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f0614079040 0x7f0614059170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.814+0000 7f0624f24640 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f0614079040 0x7f0614059170 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.815+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b07340 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.816+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b07340 2024-03-20T13:35:09.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.817+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.818+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.819+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b07340 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.820+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.820+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.820+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.820+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.820+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.820+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b0c070 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x7f0614079040 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f061c031040 con 0x561e29b07340 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f061c031040 con 0x561e29b0c070 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.821+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f061c031040 con 0x7f0614079040 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f061c031040 con 0x561e29b02e00 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f061c031040 con 0x561e29b07340 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:09.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b06630 con 0x561e29b02e00 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.822+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0a470 con 0x561e29b02e00 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0a440 con 0x7f0614079040 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 zone default found 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 4 Realm: () 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 zonegroup default 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0ad40 con 0x7f0614079040 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.823+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0ad40 con 0x561e29b0c070 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b109d0 con 0x561e29b0c070 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 20 started sync module instance, tier type = 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.824+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b0fe60 con 0x561e29b07340 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.825+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.825+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94687548473872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b10630 con 0x561e29b07340 2024-03-20T13:35:09.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.825+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b116b0 con 0x561e29b02e00 2024-03-20T13:35:09.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.827+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.827+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94687548477904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b11f40 con 0x561e29b02e00 2024-03-20T13:35:09.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.827+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b129f0 con 0x561e29b0c070 2024-03-20T13:35:09.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.827+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94687548473872] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.828+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94687548477904] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.829+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.829+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94687548482800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b11a60 con 0x561e29b0c070 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.829+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b133b0 con 0x561e29b07340 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.830+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.830+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94687548485872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b13a90 con 0x561e29b07340 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.830+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b14540 con 0x561e29b02e00 2024-03-20T13:35:09.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.831+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94687548482800] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.832+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94687548485872] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.832+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.832+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94687548489792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b13a50 con 0x561e29b02e00 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.832+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b13680 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.833+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94687548489792] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.833+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.833+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94687548476720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b14e10 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.833+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b15780 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.834+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94687548476720] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.834+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.835+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94687548491888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b15780 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.835+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b16130 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94687548491888] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'24 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94687548496976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b16310 con 0x7f0614079040 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=0 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=1 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=2 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=3 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=4 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=5 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.836+0000 7f0626c24800 20 add_watcher() i=6 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.837+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94687548496976] v30'25 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.837+0000 7f0626c24800 20 add_watcher() i=7 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.837+0000 7f0626c24800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.837+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b196d0 con 0x561e29b02e00 2024-03-20T13:35:09.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.838+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.843 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.838+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94687548498432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b16bd0 con 0x561e29b02e00 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.839+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94687548498432] v30'50 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.839+0000 7f04dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.839+0000 7f0626c24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.839+0000 7f0626c24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.839+0000 7f0626c24800 5 note: GC not initialized 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.839+0000 7f04d9fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 Filter name: none 2024-03-20T13:35:09.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f04d37fe640 20 reqs_thread_entry: start 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4b4a0 con 0x561e29b02e00 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4b4a0 con 0x561e29b02e00 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 197+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.840+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b49b80 con 0x7f0614079040 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0626c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0626c24800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0626c24800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0626c24800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0626c24800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.841+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4a420 con 0x561e29b02e00 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~357] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0626c24800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:09.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0626c24800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0626c24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 94687548710784 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4a3a0 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== watch-notify(notify (1) cookie 94687548489792 notify 128849018880 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f061c03d040 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f05037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94687548489792 notifier 4285 bl.length()=533 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(66 notify.4 [notify cookie 94687548710784 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f05037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f05037fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f05037fe640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f04e8003e90 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.842+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.843+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== watch-notify(notify_complete (2) cookie 94687548710784 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f061c0435e0 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.843+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4a3d0 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 239+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0626c24800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0626c24800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0626c24800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 94687548710704 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4ee70 con 0x561e29b07340 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== watch-notify(notify (1) cookie 94687548485872 notify 128849018880 ret 0) v3 ==== 211+0+0 (crc 0 0 0) 0x561e29af1040 con 0x561e29b07340 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f05037fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94687548485872 notifier 4285 bl.length()=169 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f05037fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f05037fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(69 notify.3 [notify cookie 94687548710704 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f05037fe640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f04e8003e90 con 0x561e29b07340 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== watch-notify(notify_complete (2) cookie 94687548710704 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561e29ae3ed0 con 0x561e29b07340 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.844+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4ce50 con 0x7f0614079040 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0626c24800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0626c24800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0626c24800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 94687548725696 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b4f290 con 0x561e29b07340 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== watch-notify(notify (1) cookie 94687548485872 notify 128849018881 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x561e29ae3ed0 con 0x561e29b07340 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0502ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94687548485872 notifier 4285 bl.length()=177 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0502ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(72 notify.3 [notify cookie 94687548725696 out=8b] v0'0 uv24 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0502ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-03-20T13:35:09.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.848+0000 7f0502ffd640 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f044c0033f0 con 0x561e29b07340 2024-03-20T13:35:09.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.849+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== watch-notify(notify_complete (2) cookie 94687548725696 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x561e29ac19c0 con 0x561e29b07340 2024-03-20T13:35:09.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.849+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.854 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.849+0000 7f04dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.849+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94687548498432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b19130 con 0x561e29b02e00 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.850+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 94687548498432] v30'51 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.850+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94687548473872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b16200 con 0x561e29b07340 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.851+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 94687548473872] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.851+0000 7f0626c24800 20 remove_watcher() i=0 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.851+0000 7f0626c24800 2 removed watcher, disabling cache 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.851+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94687548477904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b10210 con 0x561e29b02e00 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.853+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 94687548477904] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.853+0000 7f0626c24800 20 remove_watcher() i=1 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.853+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94687548482800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b10210 con 0x561e29b0c070 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.854+0000 7f0623f22640 1 -- 172.21.15.177:0/2195062444 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 94687548482800] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f0618059040 con 0x561e29b0c070 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.854+0000 7f0626c24800 20 remove_watcher() i=2 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.854+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94687548485872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b124f0 con 0x561e29b07340 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.854+0000 7f0624723640 1 -- 172.21.15.177:0/2195062444 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 94687548485872] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061405c070 con 0x561e29b07340 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.854+0000 7f0626c24800 20 remove_watcher() i=3 2024-03-20T13:35:09.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.854+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94687548489792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b130f0 con 0x561e29b02e00 2024-03-20T13:35:09.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.856+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 94687548489792] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x561e29b02e00 2024-03-20T13:35:09.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.856+0000 7f0626c24800 20 remove_watcher() i=4 2024-03-20T13:35:09.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.856+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94687548476720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b124f0 con 0x7f0614079040 2024-03-20T13:35:09.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.857+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 94687548476720] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.857+0000 7f0626c24800 20 remove_watcher() i=5 2024-03-20T13:35:09.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.857+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94687548491888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b130f0 con 0x7f0614079040 2024-03-20T13:35:09.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.859+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 94687548491888] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.859+0000 7f0626c24800 20 remove_watcher() i=6 2024-03-20T13:35:09.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.859+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94687548496976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e29b124f0 con 0x7f0614079040 2024-03-20T13:35:09.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 94687548496976] v30'26 uv24 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f061c00a4a0 con 0x7f0614079040 2024-03-20T13:35:09.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 20 remove_watcher() i=7 2024-03-20T13:35:09.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f0614079040 msgr2=0x7f0614059170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f0614079040 0x7f0614059170 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e29b02e00 msgr2=0x561e29b052c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e29b02e00 0x561e29b052c0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29b07340 msgr2=0x561e29b09730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29b07340 0x561e29b09730 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e29b0c070 msgr2=0x561e29b0e530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e29b0c070 0x561e29b0e530 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04f4036830 msgr2=0x7f04f4038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04f4036830 0x7f04f4038cf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x561e29ad1320 tx=0x7f061804f000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0624f24640 1 -- 172.21.15.177:0/2195062444 reap_dead start 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 msgr2=0x561e29af7570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af7570 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f061400b450 tx=0x7f0614031ef0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 shutdown_connections 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/2195062444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29af0650 0x561e29af7570 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 >> 172.21.15.177:0/2195062444 conn(0x561e29aec960 msgr2=0x561e29aea990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 shutdown_connections 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/2195062444 wait complete. 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04fc0367e0 msgr2=0x7f04fc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04fc0367e0 0x7f04fc038ca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x561e29ac52c0 tx=0x7f0618005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 msgr2=0x561e29ae3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 0x561e29ae3990 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f061404bd20 tx=0x7f06140149a0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 shutdown_connections 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f04fc0367e0 0x7f04fc038ca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 --2- 172.21.15.177:0/549396373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e29ae3570 0x561e29ae3990 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 >> 172.21.15.177:0/549396373 conn(0x561e29ad3200 msgr2=0x561e29ad3600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 shutdown_connections 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.861+0000 7f0626c24800 1 -- 172.21.15.177:0/549396373 wait complete. 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e29ace430 msgr2=0x561e29ad0820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e29ace430 0x561e29ad0820 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e299cee10 msgr2=0x561e29ac7cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e299cee10 0x561e29ac7cf0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29aca530 msgr2=0x561e29acc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e29aca530 0x561e29acc920 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f050c036790 msgr2=0x7f050c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f050c036790 0x7f050c038c50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0618054000 tx=0x7f061804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 msgr2=0x561e29ac0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 --2- 172.21.15.177:0/378308545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e299ca980 0x561e29ac0fa0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f0614001c80 tx=0x7f06140040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0624f24640 1 -- 172.21.15.177:0/378308545 reap_dead start 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 shutdown_connections 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 >> 172.21.15.177:0/378308545 conn(0x561e299c5fe0 msgr2=0x561e29ab4b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 shutdown_connections 2024-03-20T13:35:09.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.862+0000 7f0626c24800 1 -- 172.21.15.177:0/378308545 wait complete. 2024-03-20T13:35:09.875 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:09.875 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-03-20T13:35:09.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-03-20T13:35:09.876 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-03-20T13:35:09.923 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:09.923 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.922+0000 7f683e726800 1 Processor -- start 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.922+0000 7f683e726800 1 -- start start 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.922+0000 7f683e726800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5648e773ca00 0x5648e773ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f683e726800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5648e7688d70 con 0x5648e773dc60 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f683e726800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5648e763f500 con 0x5648e773ca00 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f683a3cf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5648e773ca00 0x5648e773ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f6831bce640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5648e773dc60 0x5648e773e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36836/0 (socket says 172.21.15.177:36836) 2024-03-20T13:35:09.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f6831bce640 1 -- 172.21.15.177:0/2798364304 learned_addr learned my addr 172.21.15.177:0/2798364304 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:09.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f683a3cf640 1 -- 172.21.15.177:0/2798364304 >> v1:172.21.15.28:6789/0 conn(0x5648e773dc60 legacy=0x5648e773e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.923+0000 7f683a3cf640 1 -- 172.21.15.177:0/2798364304 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e773d4f0 con 0x5648e773ca00 2024-03-20T13:35:09.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.926+0000 7f683a3cf640 1 --2- 172.21.15.177:0/2798364304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e773ce20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f682c00a600 tx=0x7f682c01ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=468684c7b8d5c71b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.927+0000 7f6839bce640 1 -- 172.21.15.177:0/2798364304 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c00a200 con 0x5648e773ca00 2024-03-20T13:35:09.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.927+0000 7f6839bce640 1 -- 172.21.15.177:0/2798364304 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c00a360 con 0x5648e773ca00 2024-03-20T13:35:09.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.927+0000 7f6839bce640 1 -- 172.21.15.177:0/2798364304 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c0086e0 con 0x5648e773ca00 2024-03-20T13:35:09.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.927+0000 7f683e726800 1 -- 172.21.15.177:0/2798364304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 msgr2=0x5648e773ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.927+0000 7f683e726800 1 --2- 172.21.15.177:0/2798364304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e773ce20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f682c00a600 tx=0x7f682c01ec40 comp rx=0 tx=0).stop 2024-03-20T13:35:09.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.928+0000 7f683e726800 1 -- 172.21.15.177:0/2798364304 shutdown_connections 2024-03-20T13:35:09.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.928+0000 7f683e726800 1 --2- 172.21.15.177:0/2798364304 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e773ce20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.928+0000 7f683e726800 1 -- 172.21.15.177:0/2798364304 >> 172.21.15.177:0/2798364304 conn(0x5648e7738060 msgr2=0x5648e773a480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.928+0000 7f683e726800 1 -- 172.21.15.177:0/2798364304 shutdown_connections 2024-03-20T13:35:09.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.928+0000 7f683e726800 1 -- 172.21.15.177:0/2798364304 wait complete. 2024-03-20T13:35:09.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.939+0000 7f683e726800 1 Processor -- start 2024-03-20T13:35:09.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.939+0000 7f683e726800 1 -- start start 2024-03-20T13:35:09.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.939+0000 7f683e726800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e782bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.939+0000 7f683e726800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e763ca30 con 0x5648e773ca00 2024-03-20T13:35:09.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.940+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e782bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.940+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e782bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56794/0 (socket says 172.21.15.177:56794) 2024-03-20T13:35:09.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.940+0000 7f683a3cf640 1 -- 172.21.15.177:0/2071302534 learned_addr learned my addr 172.21.15.177:0/2071302534 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.940+0000 7f683a3cf640 1 -- 172.21.15.177:0/2071302534 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c005d20 con 0x5648e773ca00 2024-03-20T13:35:09.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.941+0000 7f683a3cf640 1 --2- 172.21.15.177:0/2071302534 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e782bcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f682c056040 tx=0x7f682c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c55884ef57b3925 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.941+0000 7f6728608640 1 -- 172.21.15.177:0/2071302534 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c008590 con 0x5648e773ca00 2024-03-20T13:35:09.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.941+0000 7f6728608640 1 -- 172.21.15.177:0/2071302534 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c0086f0 con 0x5648e773ca00 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.941+0000 7f6728608640 1 -- 172.21.15.177:0/2071302534 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c008990 con 0x5648e773ca00 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- 172.21.15.177:0/2071302534 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 msgr2=0x5648e782bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 --2- 172.21.15.177:0/2071302534 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e782bcd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f682c056040 tx=0x7f682c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- 172.21.15.177:0/2071302534 shutdown_connections 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 --2- 172.21.15.177:0/2071302534 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e782bcd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- 172.21.15.177:0/2071302534 >> 172.21.15.177:0/2071302534 conn(0x5648e7738060 msgr2=0x5648e78275f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- 172.21.15.177:0/2071302534 shutdown_connections 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- 172.21.15.177:0/2071302534 wait complete. 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 Processor -- start 2024-03-20T13:35:09.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- start start 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e7833360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.942+0000 7f683e726800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e7638210 con 0x5648e773ca00 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.943+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e7833360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.943+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e7833360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56808/0 (socket says 172.21.15.177:56808) 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.943+0000 7f683a3cf640 1 -- 172.21.15.177:0/2121680033 learned_addr learned my addr 172.21.15.177:0/2121680033 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.943+0000 7f683a3cf640 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f682c050070 con 0x5648e773ca00 2024-03-20T13:35:09.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.944+0000 7f683a3cf640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e7833360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f682c046a10 tx=0x7f682c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.944+0000 7f6726e05640 1 -- 172.21.15.177:0/2121680033 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c008590 con 0x5648e773ca00 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.944+0000 7f6726e05640 1 -- 172.21.15.177:0/2121680033 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c060680 con 0x5648e773ca00 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.944+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648e78338a0 con 0x5648e773ca00 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.944+0000 7f6726e05640 1 -- 172.21.15.177:0/2121680033 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c060920 con 0x5648e773ca00 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.944+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648e7833de0 con 0x5648e773ca00 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f6726e05640 1 -- 172.21.15.177:0/2121680033 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f682c067040 con 0x5648e773ca00 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f6726e05640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6720036790 0x7f6720038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f6726e05640 1 -- 172.21.15.177:0/2121680033 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f682c08f460 con 0x5648e773ca00 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f6831bce640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6720036790 0x7f6720038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e773dc60 0x5648e7839fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e783a500 con 0x5648e773dc60 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f683abd0640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e773dc60 0x5648e7839fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f6831bce640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6720036790 0x7f6720038c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6824000f60 tx=0x7f68240012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.945+0000 7f683abd0640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e773dc60 0x5648e7839fc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683abd0640 1 -- 172.21.15.177:0/2121680033 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e773dc60 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7837710 con 0x5648e773dc60 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683abd0640 1 -- 172.21.15.177:0/2121680033 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e773dc60 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e783c770 0x5648e783eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e783f250 con 0x5648e783c770 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683a3cf640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e783c770 0x5648e783eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.946+0000 7f683a3cf640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e783c770 0x5648e783eb60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.947+0000 7f683a3cf640 1 -- 172.21.15.177:0/2121680033 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f682c04cdb0 con 0x5648e783c770 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.947+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e783b630 con 0x5648e773dc60 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.947+0000 7f683abd0640 1 -- 172.21.15.177:0/2121680033 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e773dc60 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.947+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5648e7840670 0x5648e7842a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.947+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7843100 con 0x5648e7840670 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.947+0000 7f6831bce640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5648e7840670 0x5648e7842a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.948+0000 7f6831bce640 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5648e7840670 0x5648e7842a60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.948+0000 7f6831bce640 1 -- 172.21.15.177:0/2121680033 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6824006070 con 0x5648e7840670 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.948+0000 7f683e726800 1 Processor -- start 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.948+0000 7f683e726800 1 -- start start 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.948+0000 7f683e726800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 0x5648e7855b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.948+0000 7f683e726800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e75dac70 con 0x5648e7855710 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.949+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 0x5648e7855b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.949+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 0x5648e7855b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56822/0 (socket says 172.21.15.177:56822) 2024-03-20T13:35:09.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.949+0000 7f683a3cf640 1 -- 172.21.15.177:0/898771492 learned_addr learned my addr 172.21.15.177:0/898771492 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.949+0000 7f683a3cf640 1 -- 172.21.15.177:0/898771492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e7856070 con 0x5648e7855710 2024-03-20T13:35:09.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.950+0000 7f683a3cf640 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 0x5648e7855b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f682c08d8b0 tx=0x7f682c05dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.950+0000 7f671ffff640 1 -- 172.21.15.177:0/898771492 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c082040 con 0x5648e7855710 2024-03-20T13:35:09.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.950+0000 7f671ffff640 1 -- 172.21.15.177:0/898771492 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c08c3a0 con 0x5648e7855710 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.950+0000 7f671ffff640 1 -- 172.21.15.177:0/898771492 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c05d7e0 con 0x5648e7855710 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.950+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648e7856ae0 con 0x5648e7855710 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.950+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648e7856fa0 con 0x5648e7855710 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f671ffff640 1 -- 172.21.15.177:0/898771492 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f682c054810 con 0x5648e7855710 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f671ffff640 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f67140367e0 0x7f6714038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f671ffff640 1 -- 172.21.15.177:0/898771492 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f682c055240 con 0x5648e7855710 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f6831bce640 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f67140367e0 0x7f6714038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f683e726800 1 Processor -- start 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f683e726800 1 -- start start 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.952+0000 7f6831bce640 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f67140367e0 0x7f6714038ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f682400bf50 tx=0x7f682400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683e726800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7862dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683e726800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e75b05d0 con 0x5648e78629a0 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7862dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7862dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56836/0 (socket says 172.21.15.177:56836) 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683a3cf640 1 -- 172.21.15.177:0/507487982 learned_addr learned my addr 172.21.15.177:0/507487982 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683a3cf640 1 -- 172.21.15.177:0/507487982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e7863390 con 0x5648e78629a0 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f683a3cf640 1 --2- 172.21.15.177:0/507487982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7862dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f682c060b20 tx=0x7f682c08f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b87cd587355cda19 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.953+0000 7f671dffb640 1 -- 172.21.15.177:0/507487982 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c072450 con 0x5648e78629a0 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f671dffb640 1 -- 172.21.15.177:0/507487982 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c09f040 con 0x5648e78629a0 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f671dffb640 1 -- 172.21.15.177:0/507487982 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c05fdb0 con 0x5648e78629a0 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- 172.21.15.177:0/507487982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 msgr2=0x5648e7862dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 --2- 172.21.15.177:0/507487982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7862dc0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f682c060b20 tx=0x7f682c08f880 comp rx=0 tx=0).stop 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- 172.21.15.177:0/507487982 shutdown_connections 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 --2- 172.21.15.177:0/507487982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7862dc0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- 172.21.15.177:0/507487982 >> 172.21.15.177:0/507487982 conn(0x5648e785ec70 msgr2=0x5648e785ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- 172.21.15.177:0/507487982 shutdown_connections 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- 172.21.15.177:0/507487982 wait complete. 2024-03-20T13:35:09.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 Processor -- start 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- start start 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7869860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.954+0000 7f683e726800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5648e7869da0 con 0x5648e78629a0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7869860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683a3cf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7869860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56840/0 (socket says 172.21.15.177:56840) 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 learned_addr learned my addr 172.21.15.177:0/1411432394 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5648e7856fa0 con 0x5648e78629a0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683a3cf640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7869860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f682c0469e0 tx=0x7f682c04ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f670bfff640 1 -- 172.21.15.177:0/1411432394 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c055050 con 0x5648e78629a0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f670bfff640 1 -- 172.21.15.177:0/1411432394 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682c05fdb0 con 0x5648e78629a0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f670bfff640 1 -- 172.21.15.177:0/1411432394 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f682c07eb60 con 0x5648e78629a0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5648e7856fa0 con 0x5648e78629a0 2024-03-20T13:35:09.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.955+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5648e7856fa0 con 0x5648e78629a0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.956+0000 7f670bfff640 1 -- 172.21.15.177:0/1411432394 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f682c07ed10 con 0x5648e78629a0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.956+0000 7f670bfff640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6704036790 0x7f6704038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.956+0000 7f670bfff640 1 -- 172.21.15.177:0/1411432394 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f682c0b8c40 con 0x5648e78629a0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.956+0000 7f6831bce640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6704036790 0x7f6704038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f6831bce640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6704036790 0x7f6704038c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6824001b60 tx=0x7f6824010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e7875010 0x5648e78774d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7877c20 con 0x5648e7875010 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683abd0640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e7875010 0x5648e78774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683abd0640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e7875010 0x5648e78774d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 20 realm 2024-03-20T13:35:09.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.957+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7877ff0 con 0x5648e7875010 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878bd0 con 0x5648e7875010 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e7879580 0x5648e787b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e787bf30 con 0x5648e7879580 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683a3cf640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e7879580 0x5648e787b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.958+0000 7f683a3cf640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e7879580 0x5648e787b970 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f683e726800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f683e726800 20 searching for the correct realm 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5648e787e240 0x5648e7880700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7880dd0 con 0x5648e787e240 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f6831bce640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5648e787e240 0x5648e7880700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.959+0000 7f6831bce640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5648e787e240 0x5648e7880700 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.960+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.960+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7880dd0 con 0x5648e7879580 2024-03-20T13:35:09.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.960+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.960+0000 7f683a3cf640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f682c0b7020 0x7f682c0556c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.960+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7880dd0 con 0x7f682c0b7020 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.960+0000 7f683abd0640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f682c0b7020 0x7f682c0556c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.961+0000 7f683abd0640 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f682c0b7020 0x7f682c0556c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.961+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.961+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.961+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.961+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7879580 2024-03-20T13:35:09.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.962+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.963+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7879580 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.964+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.965+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.966+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.966+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.966+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.966+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7879580 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.966+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.966+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e787e240 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x7f682c0b7020 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.967+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6834031040 con 0x5648e7879580 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6834031040 con 0x5648e787e240 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6824045040 con 0x7f682c0b7020 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6824045040 con 0x5648e7875010 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.968+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6824045040 con 0x5648e7879580 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:09.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7878870 con 0x5648e7875010 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e787c640 con 0x5648e7875010 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.969+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e787c5f0 con 0x7f682c0b7020 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:09.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 zone default found 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 4 Realm: () 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 zonegroup default 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e787cec0 con 0x7f682c0b7020 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e787cec0 con 0x5648e787e240 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7882bf0 con 0x5648e787e240 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 started sync module instance, tier type = 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.970+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7882080 con 0x5648e7879580 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.971+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.971+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94871122093024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7882800 con 0x5648e7879580 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.971+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78838d0 con 0x5648e7875010 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.973+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.973+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94871122097136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7884120 con 0x5648e7875010 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.973+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7884bd0 con 0x5648e787e240 2024-03-20T13:35:09.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.973+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94871122093024] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.974+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94871122097136] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.975+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.975+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94871122095952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7884120 con 0x5648e787e240 2024-03-20T13:35:09.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.975+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7885480 con 0x5648e7879580 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.976+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94871122095952] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.976+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.976+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94871122099328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7885cd0 con 0x5648e7879580 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.976+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7886640 con 0x5648e7875010 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.978+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.978+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94871122109312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7886da0 con 0x5648e7875010 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.978+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7887870 con 0x7f682c0b7020 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.980+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94871122099328] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.983+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94871122109312] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.983+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.983+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94871122113360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7887830 con 0x7f682c0b7020 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.983+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7886970 con 0x7f682c0b7020 2024-03-20T13:35:09.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.984+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94871122113360] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.986+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.986+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94871122106416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78880c0 con 0x7f682c0b7020 2024-03-20T13:35:09.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.986+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7888a30 con 0x7f682c0b7020 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'27 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94871122118032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7888e90 con 0x7f682c0b7020 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=0 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=1 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=2 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=3 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=4 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=5 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94871122106416] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683e726800 20 add_watcher() i=6 2024-03-20T13:35:09.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.987+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94871122118032] v30'28 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.988+0000 7f683e726800 20 add_watcher() i=7 2024-03-20T13:35:09.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.988+0000 7f683e726800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:09.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.988+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7887c20 con 0x5648e7875010 2024-03-20T13:35:09.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.988+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.988+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94871122119088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e7887c20 con 0x5648e7875010 2024-03-20T13:35:09.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94871122119088] v30'52 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f66f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f683e726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f683e726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f683e726800 5 note: GC not initialized 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f666b7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f683e726800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f683e726800 20 Filter name: none 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.989+0000 7f66697fa640 20 reqs_thread_entry: start 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bde10 con 0x7f682c0b7020 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:35:09.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bde10 con 0x5648e7875010 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+23 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 20 rados_obj.operate() r=0 bl.length=7 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 20 rados->read ofs=0 len=0 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.990+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bc530 con 0x5648e7875010 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.991+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 foo [call out=48b,read 0~357 out=357b] v0'0 uv1 ondisk = 0) v8 ==== 189+0+405 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.991+0000 7f683e726800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.991+0000 7f683e726800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x11 2024-03-20T13:35:09.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.991+0000 7f683e726800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:09.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.991+0000 7f683e726800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-03-20T13:35:09.995 INFO:teuthology.orchestra.run.smithi177.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-03-20T13:35:09.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.992+0000 7f66f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:09.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.992+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94871122119088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x5648e7875010 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.992+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94871122119088] v30'53 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.992+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94871122093024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x5648e7879580 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.993+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94871122093024] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.993+0000 7f683e726800 20 remove_watcher() i=0 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.993+0000 7f683e726800 2 removed watcher, disabling cache 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.993+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94871122097136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x5648e7875010 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.995+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94871122097136] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.995+0000 7f683e726800 20 remove_watcher() i=1 2024-03-20T13:35:09.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.995+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94871122095952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x5648e787e240 2024-03-20T13:35:09.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.996+0000 7f6831bce640 1 -- 172.21.15.177:0/1411432394 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94871122095952] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6824006070 con 0x5648e787e240 2024-03-20T13:35:09.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.996+0000 7f683e726800 20 remove_watcher() i=2 2024-03-20T13:35:09.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.996+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94871122099328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x5648e7879580 2024-03-20T13:35:09.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.997+0000 7f683a3cf640 1 -- 172.21.15.177:0/1411432394 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94871122099328] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f682c0b4070 con 0x5648e7879580 2024-03-20T13:35:09.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.997+0000 7f683e726800 20 remove_watcher() i=3 2024-03-20T13:35:09.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.997+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94871122109312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x5648e7875010 2024-03-20T13:35:09.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.998+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94871122109312] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x5648e7875010 2024-03-20T13:35:09.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.998+0000 7f683e726800 20 remove_watcher() i=4 2024-03-20T13:35:09.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.998+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94871122113360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x7f682c0b7020 2024-03-20T13:35:10.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.999+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94871122113360] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:10.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.999+0000 7f683e726800 20 remove_watcher() i=5 2024-03-20T13:35:10.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:09.999+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94871122106416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x7f682c0b7020 2024-03-20T13:35:10.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.000+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94871122106416] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:10.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.000+0000 7f683e726800 20 remove_watcher() i=6 2024-03-20T13:35:10.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.000+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94871122118032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5648e78bd160 con 0x7f682c0b7020 2024-03-20T13:35:10.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94871122118032] v30'29 uv27 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f683400a4a0 con 0x7f682c0b7020 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 20 remove_watcher() i=7 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f682c0b7020 msgr2=0x7f682c0556c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f682c0b7020 0x7f682c0556c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e7875010 msgr2=0x5648e78774d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e7875010 0x5648e78774d0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e7879580 msgr2=0x5648e787b970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e7879580 0x5648e787b970 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5648e787e240 msgr2=0x5648e7880700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5648e787e240 0x5648e7880700 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6704036790 msgr2=0x7f6704038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6704036790 0x7f6704038c50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6824001b60 tx=0x7f6824010000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 msgr2=0x5648e7869860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683abd0640 1 -- 172.21.15.177:0/1411432394 reap_dead start 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7869860 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f682c0469e0 tx=0x7f682c04ef20 comp rx=0 tx=0).stop 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 shutdown_connections 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/1411432394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e78629a0 0x5648e7869860 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 >> 172.21.15.177:0/1411432394 conn(0x5648e785ec70 msgr2=0x5648e785c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 shutdown_connections 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/1411432394 wait complete. 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f67140367e0 msgr2=0x7f6714038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f67140367e0 0x7f6714038ca0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f682400bf50 tx=0x7f682400f000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 msgr2=0x5648e7855b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.001+0000 7f683e726800 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 0x5648e7855b30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f682c08d8b0 tx=0x7f682c05dde0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 shutdown_connections 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f67140367e0 0x7f6714038ca0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/898771492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e7855710 0x5648e7855b30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 >> 172.21.15.177:0/898771492 conn(0x5648e78453a0 msgr2=0x5648e78457a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 shutdown_connections 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/898771492 wait complete. 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5648e7840670 msgr2=0x5648e7842a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5648e7840670 0x5648e7842a60 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e773dc60 msgr2=0x5648e7839fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5648e773dc60 0x5648e7839fc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e783c770 msgr2=0x5648e783eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5648e783c770 0x5648e783eb60 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6720036790 msgr2=0x7f6720038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6720036790 0x7f6720038c50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6824000f60 tx=0x7f68240012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 msgr2=0x5648e7833360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 --2- 172.21.15.177:0/2121680033 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5648e773ca00 0x5648e7833360 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f682c046a10 tx=0x7f682c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683abd0640 1 -- 172.21.15.177:0/2121680033 reap_dead start 2024-03-20T13:35:10.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 shutdown_connections 2024-03-20T13:35:10.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 >> 172.21.15.177:0/2121680033 conn(0x5648e7738060 msgr2=0x5648e7825e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 shutdown_connections 2024-03-20T13:35:10.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.002+0000 7f683e726800 1 -- 172.21.15.177:0/2121680033 wait complete. 2024-03-20T13:35:10.011 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-03-20T13:35:10.011 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.012 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.012 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e9d80f800 1 Processor -- start 2024-03-20T13:35:10.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e9d80f800 1 -- start start 2024-03-20T13:35:10.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e9d80f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c7e81a85f0 0x55c7e81aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e9d80f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c7e80f2cd0 con 0x55c7e81aaf20 2024-03-20T13:35:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e9d80f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c7e80a9500 con 0x55c7e81a85f0 2024-03-20T13:35:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e98f4c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c7e81a85f0 0x55c7e81aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.054+0000 7f5e98f4c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c7e81a85f0 0x55c7e81aa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56854/0 (socket says 172.21.15.177:56854) 2024-03-20T13:35:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.055+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1498402988 learned_addr learned my addr 172.21.15.177:0/1498402988 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.055+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1498402988 >> v1:172.21.15.28:6789/0 conn(0x55c7e81aaf20 legacy=0x55c7e81ad310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:35:10.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.055+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1498402988 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e81afa40 con 0x55c7e81a85f0 2024-03-20T13:35:10.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/1498402988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e81aa9e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00a520 tx=0x7f5e8c01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a422b315355038 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e937fe640 1 -- 172.21.15.177:0/1498402988 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c052570 con 0x55c7e81a85f0 2024-03-20T13:35:10.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e937fe640 1 -- 172.21.15.177:0/1498402988 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c0526d0 con 0x55c7e81a85f0 2024-03-20T13:35:10.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e937fe640 1 -- 172.21.15.177:0/1498402988 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c052990 con 0x55c7e81a85f0 2024-03-20T13:35:10.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1498402988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 msgr2=0x55c7e81aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1498402988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e81aa9e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00a520 tx=0x7f5e8c01ce40 comp rx=0 tx=0).stop 2024-03-20T13:35:10.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1498402988 shutdown_connections 2024-03-20T13:35:10.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1498402988 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e81aa9e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1498402988 >> 172.21.15.177:0/1498402988 conn(0x55c7e81a2040 msgr2=0x55c7e81a4460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1498402988 shutdown_connections 2024-03-20T13:35:10.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.057+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1498402988 wait complete. 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.069+0000 7f5e9d80f800 1 Processor -- start 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.069+0000 7f5e9d80f800 1 -- start start 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.069+0000 7f5e9d80f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e8297a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.069+0000 7f5e9d80f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e80a6a30 con 0x55c7e81a85f0 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e8297a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e8297a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56860/0 (socket says 172.21.15.177:56860) 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5e98f4c640 1 -- 172.21.15.177:0/2607221175 learned_addr learned my addr 172.21.15.177:0/2607221175 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5e98f4c640 1 -- 172.21.15.177:0/2607221175 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c005de0 con 0x55c7e81a85f0 2024-03-20T13:35:10.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/2607221175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e8297a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01ce80 tx=0x7f5e8c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2613f81939bb2c95 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5d86e05640 1 -- 172.21.15.177:0/2607221175 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c052840 con 0x55c7e81a85f0 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5d86e05640 1 -- 172.21.15.177:0/2607221175 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c0529a0 con 0x55c7e81a85f0 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.070+0000 7f5d86e05640 1 -- 172.21.15.177:0/2607221175 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c052c80 con 0x55c7e81a85f0 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 -- 172.21.15.177:0/2607221175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 msgr2=0x55c7e8297a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/2607221175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e8297a70 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01ce80 tx=0x7f5e8c04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 -- 172.21.15.177:0/2607221175 shutdown_connections 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/2607221175 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e8297a70 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 -- 172.21.15.177:0/2607221175 >> 172.21.15.177:0/2607221175 conn(0x55c7e81a2040 msgr2=0x55c7e8293390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 -- 172.21.15.177:0/2607221175 shutdown_connections 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 -- 172.21.15.177:0/2607221175 wait complete. 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 Processor -- start 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 -- start start 2024-03-20T13:35:10.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.071+0000 7f5e9d80f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e829f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.072+0000 7f5e9d80f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e80a2210 con 0x55c7e81a85f0 2024-03-20T13:35:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.073+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e829f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.073+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e829f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56876/0 (socket says 172.21.15.177:56876) 2024-03-20T13:35:10.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.073+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1364743637 learned_addr learned my addr 172.21.15.177:0/1364743637 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.074+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e81afa40 con 0x55c7e81a85f0 2024-03-20T13:35:10.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.076+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e829f050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01ce10 tx=0x7f5e8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.077+0000 7f5d85602640 1 -- 172.21.15.177:0/1364743637 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c06c070 con 0x55c7e81a85f0 2024-03-20T13:35:10.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.077+0000 7f5d85602640 1 -- 172.21.15.177:0/1364743637 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c05d7c0 con 0x55c7e81a85f0 2024-03-20T13:35:10.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.077+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7e829f590 con 0x55c7e81a85f0 2024-03-20T13:35:10.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.077+0000 7f5d85602640 1 -- 172.21.15.177:0/1364743637 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c05da80 con 0x55c7e81a85f0 2024-03-20T13:35:10.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.077+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7e829fad0 con 0x55c7e81a85f0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.079+0000 7f5d85602640 1 -- 172.21.15.177:0/1364743637 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e8c059040 con 0x55c7e81a85f0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.079+0000 7f5d85602640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d800367e0 0x7f5d80038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.079+0000 7f5d85602640 1 -- 172.21.15.177:0/1364743637 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5e8c08d930 con 0x55c7e81a85f0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.079+0000 7f5e93fff640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d800367e0 0x7f5d80038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e81aaf20 0x55c7e82a5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82a63b0 con 0x55c7e81aaf20 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9974d640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e81aaf20 0x55c7e82a5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e93fff640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d800367e0 0x7f5d80038ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400a430 tx=0x7f5e84005540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9974d640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e81aaf20 0x55c7e82a5e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9974d640 1 -- 172.21.15.177:0/1364743637 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e81aaf20 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82a3410 con 0x55c7e81aaf20 2024-03-20T13:35:10.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9974d640 1 -- 172.21.15.177:0/1364743637 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e81aaf20 2024-03-20T13:35:10.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82a85c0 0x55c7e82aa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.080+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ab000 con 0x55c7e82a85c0 2024-03-20T13:35:10.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82a85c0 0x55c7e82aa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82a85c0 0x55c7e82aa9b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1364743637 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82a85c0 2024-03-20T13:35:10.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82a7540 con 0x55c7e81aaf20 2024-03-20T13:35:10.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e9974d640 1 -- 172.21.15.177:0/1364743637 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e81aaf20 2024-03-20T13:35:10.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c7e82ac420 0x55c7e82ae810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.081+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82aef70 con 0x55c7e82ac420 2024-03-20T13:35:10.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.083+0000 7f5e93fff640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c7e82ac420 0x55c7e82ae810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.086+0000 7f5e93fff640 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c7e82ac420 0x55c7e82ae810 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e93fff640 1 -- 172.21.15.177:0/1364743637 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82ac420 2024-03-20T13:35:10.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e9d80f800 1 Processor -- start 2024-03-20T13:35:10.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e9d80f800 1 -- start start 2024-03-20T13:35:10.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e9d80f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 0x55c7e82bd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e9d80f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e8044c70 con 0x55c7e82bd130 2024-03-20T13:35:10.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 0x55c7e82bd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 0x55c7e82bd550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56892/0 (socket says 172.21.15.177:56892) 2024-03-20T13:35:10.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.087+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1280952756 learned_addr learned my addr 172.21.15.177:0/1280952756 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5e98f4c640 1 -- 172.21.15.177:0/1280952756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e82bda90 con 0x55c7e82bd130 2024-03-20T13:35:10.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 0x55c7e82bd550 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0447f0 tx=0x7f5e8c079d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5d7e7fc640 1 -- 172.21.15.177:0/1280952756 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c08bea0 con 0x55c7e82bd130 2024-03-20T13:35:10.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5d7e7fc640 1 -- 172.21.15.177:0/1280952756 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c07d460 con 0x55c7e82bd130 2024-03-20T13:35:10.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5d7e7fc640 1 -- 172.21.15.177:0/1280952756 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c07d8b0 con 0x55c7e82bd130 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7e82be500 con 0x55c7e82bd130 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.088+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7e82be500 con 0x55c7e82bd130 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5d7e7fc640 1 -- 172.21.15.177:0/1280952756 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e8c07da10 con 0x55c7e82bd130 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5d7e7fc640 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5d7e7fc640 1 -- 172.21.15.177:0/1280952756 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5e8c097cf0 con 0x55c7e82bd130 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5e93fff640 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5e9d80f800 1 Processor -- start 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5e9d80f800 1 -- start start 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.089+0000 7f5e93fff640 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400b700 tx=0x7f5e8400e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e9d80f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e9d80f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e801a5d0 con 0x55c7e82c9fc0 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82ca3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56904/0 (socket says 172.21.15.177:56904) 2024-03-20T13:35:10.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e98f4c640 1 -- 172.21.15.177:0/720526445 learned_addr learned my addr 172.21.15.177:0/720526445 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e98f4c640 1 -- 172.21.15.177:0/720526445 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e82ca9b0 con 0x55c7e82c9fc0 2024-03-20T13:35:10.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/720526445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82ca3e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c04efb0 tx=0x7f5e8c07cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4726b9d8624c9004 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5d6ffff640 1 -- 172.21.15.177:0/720526445 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c07ddf0 con 0x55c7e82c9fc0 2024-03-20T13:35:10.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5d6ffff640 1 -- 172.21.15.177:0/720526445 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c085be0 con 0x55c7e82c9fc0 2024-03-20T13:35:10.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.090+0000 7f5d6ffff640 1 -- 172.21.15.177:0/720526445 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c085e80 con 0x55c7e82c9fc0 2024-03-20T13:35:10.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- 172.21.15.177:0/720526445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 msgr2=0x55c7e82ca3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/720526445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82ca3e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c04efb0 tx=0x7f5e8c07cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- 172.21.15.177:0/720526445 shutdown_connections 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/720526445 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82ca3e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- 172.21.15.177:0/720526445 >> 172.21.15.177:0/720526445 conn(0x55c7e82c6320 msgr2=0x55c7e82c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- 172.21.15.177:0/720526445 shutdown_connections 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- 172.21.15.177:0/720526445 wait complete. 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 Processor -- start 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- start start 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.091+0000 7f5e9d80f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7e82d1300 con 0x55c7e82c9fc0 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e98f4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82d0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56916/0 (socket says 172.21.15.177:56916) 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 learned_addr learned my addr 172.21.15.177:0/242786448 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7e82bda90 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82d0dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c08a9c0 tx=0x7f5e8c084480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5d6e7fc640 1 -- 172.21.15.177:0/242786448 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c0b7070 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5d6e7fc640 1 -- 172.21.15.177:0/242786448 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c0af040 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c7e82bda90 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5d6e7fc640 1 -- 172.21.15.177:0/242786448 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c054790 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.092+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c7e82bda90 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.093+0000 7f5d6e7fc640 1 -- 172.21.15.177:0/242786448 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e8c0a6020 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.093+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.093+0000 7f5d6e7fc640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d64036740 0x7f5d64038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.093+0000 7f5d6e7fc640 1 -- 172.21.15.177:0/242786448 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5e8c0b4c30 con 0x55c7e82c9fc0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e93fff640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d64036740 0x7f5d64038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e82dc580 0x55c7e82dea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82df190 con 0x55c7e82dc580 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9974d640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e82dc580 0x55c7e82dea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e93fff640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d64036740 0x7f5d64038c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55c7e82a3370 tx=0x7f5e84002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9974d640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e82dc580 0x55c7e82dea40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 20 realm 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82df560 con 0x55c7e82dc580 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:10.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.094+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e0110 con 0x55c7e82dc580 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82e0ac0 0x55c7e82e2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e33f0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82e0ac0 0x55c7e82e2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82e0ac0 0x55c7e82e2eb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.095+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e9d80f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:10.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e9d80f800 20 searching for the correct realm 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c7e82e53d0 0x55c7e82e7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e7f60 con 0x55c7e82e53d0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e93fff640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c7e82e53d0 0x55c7e82e7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e93fff640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c7e82e53d0 0x55c7e82e7890 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.096+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e7f60 con 0x55c7e82e0ac0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.097+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.097+0000 7f5e98f4c640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e8c0840a0 0x7f5e8c0a08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.097+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e7f60 con 0x7f5e8c0840a0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.097+0000 7f5e9974d640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e8c0840a0 0x7f5e8c0a08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.097+0000 7f5e9974d640 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e8c0840a0 0x7f5e8c0a08b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.098+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.099+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.100+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.101+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.102+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82dc580 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x55c7e82e53d0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.103+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfdb0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.104+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.104+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5e94031040 con 0x55c7e82e0ac0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.104+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.104+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5e94031040 con 0x55c7e82e53d0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.104+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.104+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5e94031040 con 0x7f5e8c0840a0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5e94031040 con 0x55c7e82dc580 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5e94031040 con 0x55c7e82e0ac0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:10.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82dfd90 con 0x55c7e82dc580 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.105+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e3cf0 con 0x55c7e82dc580 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e3cf0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 zone default found 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 4 Realm: () 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 zonegroup default 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e45c0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.106+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e49a0 con 0x55c7e82e53d0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e45c0 con 0x55c7e82e53d0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 20 started sync module instance, tier type = 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.107+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e9660 con 0x55c7e82e0ac0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.108+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.108+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94317082218944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e9a10 con 0x55c7e82e0ac0 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.108+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eaab0 con 0x55c7e82dc580 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.109+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.109+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94317082224016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eb340 con 0x55c7e82dc580 2024-03-20T13:35:10.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.109+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ebdf0 con 0x55c7e82e53d0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.111+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94317082224016] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.111+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94317082218944] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.113+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.113+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94317082222464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eae60 con 0x55c7e82e53d0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.113+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ec7b0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.114+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.114+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94317082233616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ed3d0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.114+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82edd40 con 0x55c7e82dc580 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.115+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94317082222464] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.116+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94317082233616] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.119+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.119+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94317082228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82edd40 con 0x55c7e82dc580 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.119+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ee590 con 0x7f5e8c0840a0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.120+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94317082228976] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.120+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.120+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94317082239728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82edd40 con 0x7f5e8c0840a0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.120+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eef50 con 0x7f5e8c0840a0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.121+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.121+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94317082241712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ef3b0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.121+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82efe50 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94317082239728] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'30 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94317082245424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82efe10 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 20 add_watcher() i=0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 20 add_watcher() i=1 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 20 add_watcher() i=2 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 20 add_watcher() i=3 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 20 add_watcher() i=4 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9d80f800 20 add_watcher() i=5 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.122+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94317082241712] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.123+0000 7f5e9d80f800 20 add_watcher() i=6 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.123+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94317082245424] v30'31 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.123+0000 7f5e9d80f800 20 add_watcher() i=7 2024-03-20T13:35:10.128 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.123+0000 7f5e9d80f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.123+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eeed0 con 0x55c7e82dc580 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.124+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.124+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94317082237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eeed0 con 0x55c7e82dc580 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94317082237088] v30'54 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 5 note: GC not initialized 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5d4dfe3640 20 reqs_thread_entry: start 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 20 Filter name: none 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5cbf7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.125+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e83246e0 con 0x55c7e82dc580 2024-03-20T13:35:10.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.126+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.126+0000 7f5e9d80f800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:10.130 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.127+0000 7f5d4efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.127+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94317082237088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82f06d0 con 0x55c7e82dc580 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.128+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94317082237088] v30'55 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.128+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94317082218944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ed8a0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.129+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94317082218944] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.129+0000 7f5e9d80f800 20 remove_watcher() i=0 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.129+0000 7f5e9d80f800 2 removed watcher, disabling cache 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.129+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94317082224016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ed8a0 con 0x55c7e82dc580 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.130+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94317082224016] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.130+0000 7f5e9d80f800 20 remove_watcher() i=1 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.130+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94317082222464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ed8a0 con 0x55c7e82e53d0 2024-03-20T13:35:10.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.131+0000 7f5e93fff640 1 -- 172.21.15.177:0/242786448 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94317082222464] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e84010040 con 0x55c7e82e53d0 2024-03-20T13:35:10.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.131+0000 7f5e9d80f800 20 remove_watcher() i=2 2024-03-20T13:35:10.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.131+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94317082233616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e91c0 con 0x55c7e82e0ac0 2024-03-20T13:35:10.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.131+0000 7f5e98f4c640 1 -- 172.21.15.177:0/242786448 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94317082233616] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c06f370 con 0x55c7e82e0ac0 2024-03-20T13:35:10.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.132+0000 7f5e9d80f800 20 remove_watcher() i=3 2024-03-20T13:35:10.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.132+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94317082228976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82e91c0 con 0x55c7e82dc580 2024-03-20T13:35:10.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.132+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94317082228976] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x55c7e82dc580 2024-03-20T13:35:10.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.132+0000 7f5e9d80f800 20 remove_watcher() i=4 2024-03-20T13:35:10.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.132+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94317082239728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eb8f0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.133+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94317082239728] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.133+0000 7f5e9d80f800 20 remove_watcher() i=5 2024-03-20T13:35:10.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.133+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94317082241712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82ee2f0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.135+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94317082241712] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.135+0000 7f5e9d80f800 20 remove_watcher() i=6 2024-03-20T13:35:10.136 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.135+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94317082245424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c7e82eeab0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.135+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94317082245424] v30'32 uv30 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e9400a4a0 con 0x7f5e8c0840a0 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.135+0000 7f5e9d80f800 20 remove_watcher() i=7 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e8c0840a0 msgr2=0x7f5e8c0a08b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e8c0840a0 0x7f5e8c0a08b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e82dc580 msgr2=0x55c7e82dea40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e82dc580 0x55c7e82dea40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82e0ac0 msgr2=0x55c7e82e2eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82e0ac0 0x55c7e82e2eb0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c7e82e53d0 msgr2=0x55c7e82e7890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c7e82e53d0 0x55c7e82e7890 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d64036740 msgr2=0x7f5d64038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d64036740 0x7f5d64038c00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55c7e82a3370 tx=0x7f5e84002000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9974d640 1 -- 172.21.15.177:0/242786448 reap_dead start 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 msgr2=0x55c7e82d0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82d0dc0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c08a9c0 tx=0x7f5e8c084480 comp rx=0 tx=0).stop 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 shutdown_connections 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/242786448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82c9fc0 0x55c7e82d0dc0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 >> 172.21.15.177:0/242786448 conn(0x55c7e82c6320 msgr2=0x55c7e82c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 shutdown_connections 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/242786448 wait complete. 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 msgr2=0x7f5d70038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400b700 tx=0x7f5e8400e000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 msgr2=0x55c7e82bd550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 0x55c7e82bd550 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0447f0 tx=0x7f5e8c079d40 comp rx=0 tx=0).stop 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 shutdown_connections 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1280952756 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e82bd130 0x55c7e82bd550 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 >> 172.21.15.177:0/1280952756 conn(0x55c7e82b11d0 msgr2=0x55c7e82b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 shutdown_connections 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.136+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1280952756 wait complete. 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c7e82ac420 msgr2=0x55c7e82ae810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c7e82ac420 0x55c7e82ae810 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e81aaf20 msgr2=0x55c7e82a5e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c7e81aaf20 0x55c7e82a5e70 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82a85c0 msgr2=0x55c7e82aa9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c7e82a85c0 0x55c7e82aa9b0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d800367e0 msgr2=0x7f5d80038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d800367e0 0x7f5d80038ca0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400a430 tx=0x7f5e84005540 comp rx=0 tx=0).stop 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 msgr2=0x55c7e829f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 --2- 172.21.15.177:0/1364743637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c7e81a85f0 0x55c7e829f050 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01ce10 tx=0x7f5e8c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9974d640 1 -- 172.21.15.177:0/1364743637 reap_dead start 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 shutdown_connections 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 >> 172.21.15.177:0/1364743637 conn(0x55c7e81a2040 msgr2=0x55c7e8296460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 shutdown_connections 2024-03-20T13:35:10.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.137+0000 7f5e9d80f800 1 -- 172.21.15.177:0/1364743637 wait complete. 2024-03-20T13:35:10.146 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:10.146 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-03-20T13:35:10.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-03-20T13:35:10.147 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-03-20T13:35:10.231 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:10.231 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:10.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.230+0000 7fb5edd1f800 1 Processor -- start 2024-03-20T13:35:10.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.230+0000 7fb5edd1f800 1 -- start start 2024-03-20T13:35:10.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.230+0000 7fb5edd1f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56092a9085f0 0x56092a90a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.230+0000 7fb5edd1f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56092a852cd0 con 0x56092a90af20 2024-03-20T13:35:10.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.230+0000 7fb5edd1f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56092a809500 con 0x56092a9085f0 2024-03-20T13:35:10.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e91eb640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56092a90af20 0x56092a90d310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36844/0 (socket says 172.21.15.177:36844) 2024-03-20T13:35:10.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e91eb640 1 -- 172.21.15.177:0/3048132888 learned_addr learned my addr 172.21.15.177:0/3048132888 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:10.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/3048132888 >> v2:172.21.15.28:3300/0 conn(0x56092a9085f0 0x56092a90a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1575932281 0 0) 0x56092a852cd0 con 0x56092a90af20 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d8001e10 con 0x56092a90af20 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2468800661 0 0) 0x7fb5d8001e10 con 0x56092a90af20 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 >> v2:172.21.15.28:3300/0 conn(0x56092a9085f0 msgr2=0x56092a90a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 --2- 172.21.15.177:0/3048132888 >> v2:172.21.15.28:3300/0 conn(0x56092a9085f0 0x56092a90a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56092a90fa40 con 0x56092a90af20 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7fb5d40015a0 con 0x56092a90af20 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 >> v1:172.21.15.28:6789/0 conn(0x56092a90af20 legacy=0x56092a90d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 --2- 172.21.15.177:0/3048132888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d8002260 0x7fb5d8002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092a809500 con 0x7fb5d8002260 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.231+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/3048132888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d8002260 0x7fb5d8002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.232+0000 7fb5e99ec640 1 -- 172.21.15.177:0/3048132888 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d8001e10 con 0x7fb5d8002260 2024-03-20T13:35:10.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/3048132888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d8002260 0x7fb5d8002660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c600 tx=0x7fb5e401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafa4c7f0182dce0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e40555b0 con 0x7fb5d8002260 2024-03-20T13:35:10.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e404e070 con 0x7fb5d8002260 2024-03-20T13:35:10.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5e89ea640 1 -- 172.21.15.177:0/3048132888 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4055880 con 0x7fb5d8002260 2024-03-20T13:35:10.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3048132888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d8002260 msgr2=0x7fb5d8002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3048132888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d8002260 0x7fb5d8002660 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c600 tx=0x7fb5e401ce40 comp rx=0 tx=0).stop 2024-03-20T13:35:10.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3048132888 shutdown_connections 2024-03-20T13:35:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3048132888 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb5d8002260 0x7fb5d8002660 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3048132888 >> v2:172.21.15.28:3300/0 conn(0x56092a9085f0 0x56092a90a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3048132888 >> 172.21.15.177:0/3048132888 conn(0x56092a902040 msgr2=0x56092a904460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3048132888 shutdown_connections 2024-03-20T13:35:10.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.234+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3048132888 wait complete. 2024-03-20T13:35:10.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.246+0000 7fb5edd1f800 1 Processor -- start 2024-03-20T13:35:10.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.246+0000 7fb5edd1f800 1 -- start start 2024-03-20T13:35:10.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.246+0000 7fb5edd1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9f7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.246+0000 7fb5edd1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092a806a30 con 0x56092a9085f0 2024-03-20T13:35:10.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.248+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9f7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.248+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9f7620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56946/0 (socket says 172.21.15.177:56946) 2024-03-20T13:35:10.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.248+0000 7fb5e99ec640 1 -- 172.21.15.177:0/1280839343 learned_addr learned my addr 172.21.15.177:0/1280839343 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.249+0000 7fb5e99ec640 1 -- 172.21.15.177:0/1280839343 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56092a9f7bf0 con 0x56092a9085f0 2024-03-20T13:35:10.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.251+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/1280839343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9f7620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4044ac0 tx=0x7fb5e404c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7542f29b27813254 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.251+0000 7fb4d7e07640 1 -- 172.21.15.177:0/1280839343 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e405b070 con 0x56092a9085f0 2024-03-20T13:35:10.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.251+0000 7fb4d7e07640 1 -- 172.21.15.177:0/1280839343 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4056240 con 0x56092a9085f0 2024-03-20T13:35:10.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.251+0000 7fb4d7e07640 1 -- 172.21.15.177:0/1280839343 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4056640 con 0x56092a9085f0 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1280839343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 msgr2=0x56092a9f7620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/1280839343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9f7620 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4044ac0 tx=0x7fb5e404c070 comp rx=0 tx=0).stop 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1280839343 shutdown_connections 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/1280839343 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9f7620 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1280839343 >> 172.21.15.177:0/1280839343 conn(0x56092a902040 msgr2=0x56092a9f2f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1280839343 shutdown_connections 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1280839343 wait complete. 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 Processor -- start 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.252+0000 7fb5edd1f800 1 -- start start 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5edd1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9fed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5edd1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092a802210 con 0x56092a9085f0 2024-03-20T13:35:10.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9fed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9fed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56952/0 (socket says 172.21.15.177:56952) 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5e99ec640 1 -- 172.21.15.177:0/3633508734 learned_addr learned my addr 172.21.15.177:0/3633508734 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5e99ec640 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5d8001e10 con 0x56092a9085f0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9fed40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c210 tx=0x7fb5d80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb4d6604640 1 -- 172.21.15.177:0/3633508734 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4056c50 con 0x56092a9085f0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb4d6604640 1 -- 172.21.15.177:0/3633508734 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4056db0 con 0x56092a9085f0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56092a9ff280 con 0x56092a9085f0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.253+0000 7fb4d6604640 1 -- 172.21.15.177:0/3633508734 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e40555d0 con 0x56092a9085f0 2024-03-20T13:35:10.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.254+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56092a9ff7c0 con 0x56092a9085f0 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.254+0000 7fb4d6604640 1 -- 172.21.15.177:0/3633508734 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb5e4003040 con 0x56092a9085f0 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb4d6604640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4d00367e0 0x7fb4d0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb4d6604640 1 -- 172.21.15.177:0/3633508734 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb5e4050070 con 0x56092a9085f0 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4d00367e0 0x7fb4d0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092a90af20 0x56092aa05b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa060f0 con 0x56092a90af20 2024-03-20T13:35:10.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5ea1ed640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092a90af20 0x56092aa05b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4d00367e0 0x7fb4d0038ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40011e0 tx=0x7fb5d40013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5ea1ed640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092a90af20 0x56092aa05b60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/3633508734 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092a90af20 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.255+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa03100 con 0x56092a90af20 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/3633508734 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092a90af20 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fb5d8002260 0x56092aa0a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa0aa30 con 0x7fb5d8002260 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fb5d8002260 0x56092aa0a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fb5d8002260 0x56092aa0a340 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5e99ec640 1 -- 172.21.15.177:0/3633508734 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb5e4070070 con 0x7fb5d8002260 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.256+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa072b0 con 0x56092a90af20 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.257+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/3633508734 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092a90af20 2024-03-20T13:35:10.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.257+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56092aa0be50 0x56092aa0e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.257+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa0e980 con 0x56092aa0be50 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.257+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56092aa0be50 0x56092aa0e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.258+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56092aa0be50 0x56092aa0e240 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.258+0000 7fb5e91eb640 1 -- 172.21.15.177:0/3633508734 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb5d400f7d0 con 0x56092aa0be50 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.258+0000 7fb5edd1f800 1 Processor -- start 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.258+0000 7fb5edd1f800 1 -- start start 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.258+0000 7fb5edd1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 0x56092aa1cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.258+0000 7fb5edd1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092a7a4c70 con 0x56092aa1cae0 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.259+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 0x56092aa1cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.259+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 0x56092aa1cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56962/0 (socket says 172.21.15.177:56962) 2024-03-20T13:35:10.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.259+0000 7fb5e99ec640 1 -- 172.21.15.177:0/303496657 learned_addr learned my addr 172.21.15.177:0/303496657 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.259+0000 7fb5e99ec640 1 -- 172.21.15.177:0/303496657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56092aa1d440 con 0x56092aa1cae0 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.260+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 0x56092aa1cf00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4069fd0 tx=0x7fb5e405f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.260+0000 7fb4cf7fe640 1 -- 172.21.15.177:0/303496657 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4060570 con 0x56092aa1cae0 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.261+0000 7fb4cf7fe640 1 -- 172.21.15.177:0/303496657 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e405f900 con 0x56092aa1cae0 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.261+0000 7fb4cf7fe640 1 -- 172.21.15.177:0/303496657 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e408db80 con 0x56092aa1cae0 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.261+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56092aa1deb0 con 0x56092aa1cae0 2024-03-20T13:35:10.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.261+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56092aa1e370 con 0x56092aa1cae0 2024-03-20T13:35:10.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb4cf7fe640 1 -- 172.21.15.177:0/303496657 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb5e408a3a0 con 0x56092aa1cae0 2024-03-20T13:35:10.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb4cf7fe640 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4c40367e0 0x7fb4c4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb4cf7fe640 1 -- 172.21.15.177:0/303496657 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb5e4097c40 con 0x56092aa1cae0 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4c40367e0 0x7fb4c4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb5edd1f800 1 Processor -- start 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb5edd1f800 1 -- start start 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4c40367e0 0x7fb4c4038ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x56092aa03480 tx=0x7fb5d4006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb5edd1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa2bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.263+0000 7fb5edd1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092a77a5d0 con 0x56092aa2bb00 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.264+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa2bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.264+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa2bf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56974/0 (socket says 172.21.15.177:56974) 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.264+0000 7fb5e99ec640 1 -- 172.21.15.177:0/1019477713 learned_addr learned my addr 172.21.15.177:0/1019477713 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.264+0000 7fb5e99ec640 1 -- 172.21.15.177:0/1019477713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56092aa2c4f0 con 0x56092aa2bb00 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/1019477713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa2bf20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5e408aa70 tx=0x7fb5e407d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c49cd83b180b54c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb4cd7fa640 1 -- 172.21.15.177:0/1019477713 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e409f070 con 0x56092aa2bb00 2024-03-20T13:35:10.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb4cd7fa640 1 -- 172.21.15.177:0/1019477713 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e4060cb0 con 0x56092aa2bb00 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb4cd7fa640 1 -- 172.21.15.177:0/1019477713 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4080d40 con 0x56092aa2bb00 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1019477713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 msgr2=0x56092aa2bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/1019477713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa2bf20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb5e408aa70 tx=0x7fb5e407d630 comp rx=0 tx=0).stop 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1019477713 shutdown_connections 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/1019477713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa2bf20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1019477713 >> 172.21.15.177:0/1019477713 conn(0x56092a906640 msgr2=0x56092a906a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1019477713 shutdown_connections 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.265+0000 7fb5edd1f800 1 -- 172.21.15.177:0/1019477713 wait complete. 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5edd1f800 1 Processor -- start 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5edd1f800 1 -- start start 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5edd1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa32d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5edd1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56092aa332a0 con 0x56092aa2bb00 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa32d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5e99ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa32d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56986/0 (socket says 172.21.15.177:56986) 2024-03-20T13:35:10.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.266+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 learned_addr learned my addr 172.21.15.177:0/480061617 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56092aa1deb0 con 0x56092aa2bb00 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa32d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5e407d7f0 tx=0x7fb5e4073f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb4bb7fe640 1 -- 172.21.15.177:0/480061617 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e40aa070 con 0x56092aa2bb00 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb4bb7fe640 1 -- 172.21.15.177:0/480061617 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5e406adc0 con 0x56092aa2bb00 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56092aa1deb0 con 0x56092aa2bb00 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb4bb7fe640 1 -- 172.21.15.177:0/480061617 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb5e4073540 con 0x56092aa2bb00 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.267+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56092aa1deb0 con 0x56092aa2bb00 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.268+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.269+0000 7fb4bb7fe640 1 -- 172.21.15.177:0/480061617 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb5e4073790 con 0x56092aa2bb00 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.269+0000 7fb4bb7fe640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4b4036790 0x7fb4b4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.269+0000 7fb4bb7fe640 1 -- 172.21.15.177:0/480061617 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb5e40b0cb0 con 0x56092aa2bb00 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.269+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4b4036790 0x7fb4b4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.269+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092aa3e530 0x56092aa409f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.269+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41140 con 0x56092aa3e530 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5ea1ed640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092aa3e530 0x56092aa409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4b4036790 0x7fb4b4038c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x56092aa07df0 tx=0x7fb5d4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5ea1ed640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092aa3e530 0x56092aa409f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 realm 2024-03-20T13:35:10.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41510 con 0x56092aa3e530 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.270+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa420c0 con 0x56092aa3e530 2024-03-20T13:35:10.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56092aa42a70 0x56092aa44e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa454b0 con 0x56092aa42a70 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56092aa42a70 0x56092aa44e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56092aa42a70 0x56092aa44e60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 20 searching for the correct realm 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56092aa477c0 0x56092aa49c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4a300 con 0x56092aa477c0 2024-03-20T13:35:10.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.271+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56092aa477c0 0x56092aa49c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.272+0000 7fb5e91eb640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56092aa477c0 0x56092aa49c80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.272+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.272+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4a300 con 0x56092aa42a70 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.272+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.272+0000 7fb5e99ec640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb5e40b9060 0x7fb5e4078960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.272+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4a300 con 0x7fb5e40b9060 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.273+0000 7fb5ea1ed640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb5e40b9060 0x7fb5e4078960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.273+0000 7fb5ea1ed640 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb5e40b9060 0x7fb5e4078960 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.273+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.274+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa42a70 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.275+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa42a70 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.276+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.277+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.277+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.277+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.277+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.277+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.277+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.278+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.278+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.278+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.278+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa42a70 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.279+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.280+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.280+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.280+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.280+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.281+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.281+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa42a70 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.281+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.281+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa477c0 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.282+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.282+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x7fb5e40b9060 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.282+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.282+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa3e530 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa41d60 con 0x56092aa42a70 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:10.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa45bc0 con 0x56092aa3e530 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa45f70 con 0x56092aa3e530 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.283+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa45f70 con 0x7fb5e40b9060 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 20 zone default found 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 4 Realm: () 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 20 zonegroup default 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa46840 con 0x7fb5e40b9060 2024-03-20T13:35:10.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.285+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4c120 con 0x56092aa477c0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4c480 con 0x56092aa477c0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 20 started sync module instance, tier type = 2024-03-20T13:35:10.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.286+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4ba00 con 0x56092aa42a70 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.287+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.287+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94597370131808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4cc80 con 0x56092aa42a70 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.287+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4d480 con 0x56092aa3e530 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.288+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94597370131808] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.288+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.288+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94597370138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4d8a0 con 0x56092aa3e530 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.288+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4e0a0 con 0x56092aa477c0 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.289+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94597370138592] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.289+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.289+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94597370139648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4e400 con 0x56092aa477c0 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.289+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4ee80 con 0x56092aa42a70 2024-03-20T13:35:10.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.290+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.290+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94597370147376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4faf0 con 0x56092aa42a70 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.290+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa504c0 con 0x56092aa3e530 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.291+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94597370139648] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.291+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.291+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94597370150848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa50480 con 0x56092aa3e530 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.291+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94597370147376] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.291+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa50ef0 con 0x7fb5e40b9060 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.292+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94597370150848] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.293+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.293+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94597370153424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4f6a0 con 0x7fb5e40b9060 2024-03-20T13:35:10.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.293+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa514c0 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.294+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94597370153424] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.294+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.294+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94597370141392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa514c0 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.294+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa51e30 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94597370157456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa52250 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=0 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94597370141392] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=1 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=2 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=3 2024-03-20T13:35:10.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=4 2024-03-20T13:35:10.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=5 2024-03-20T13:35:10.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.295+0000 7fb5edd1f800 20 add_watcher() i=6 2024-03-20T13:35:10.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.297+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94597370157456] v30'34 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.297+0000 7fb5edd1f800 20 add_watcher() i=7 2024-03-20T13:35:10.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.297+0000 7fb5edd1f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:10.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.297+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa52250 con 0x56092aa3e530 2024-03-20T13:35:10.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.297+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.297+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94597370158512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa52b40 con 0x56092aa3e530 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.298+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94597370158512] v30'56 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.298+0000 7fb49b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.298+0000 7fb5edd1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.298+0000 7fb5edd1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 5 note: GC not initialized 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb49a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 20 Filter name: none 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb40bfff640 20 reqs_thread_entry: start 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:10.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa870e0 con 0x56092aa3e530 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.299+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa89600 con 0x56092aa42a70 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.300+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.300+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa8cd80 con 0x56092aa3e530 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v30'2 uv2 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5edd1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5edd1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5edd1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94597370399264 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa89aa0 con 0x56092aa3e530 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94597370150848 notify 128849018881 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fb5dc00a6b0 con 0x56092aa3e530 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb4cd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 94597370150848 notifier 4305 bl.length()=533 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb4cd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb4cd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(65 notify.4 [notify cookie 94597370399264 out=8b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb4cd7fa640 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb4ac003e90 con 0x56092aa3e530 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.301+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94597370399264 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb5dc00a840 con 0x56092aa3e530 2024-03-20T13:35:10.312 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.302+0000 7fb49b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.302+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94597370158512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa54dd0 con 0x56092aa3e530 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.303+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94597370158512] v30'57 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.303+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94597370131808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa51db0 con 0x56092aa42a70 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.304+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94597370131808] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.304+0000 7fb5edd1f800 20 remove_watcher() i=0 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.304+0000 7fb5edd1f800 2 removed watcher, disabling cache 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.304+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94597370138592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa51db0 con 0x56092aa3e530 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.305+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94597370138592] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.305+0000 7fb5edd1f800 20 remove_watcher() i=1 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.305+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94597370139648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4cfe0 con 0x56092aa477c0 2024-03-20T13:35:10.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.306+0000 7fb5e91eb640 1 -- 172.21.15.177:0/480061617 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94597370139648] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5d4033040 con 0x56092aa477c0 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.306+0000 7fb5edd1f800 20 remove_watcher() i=2 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.306+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94597370147376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa51db0 con 0x56092aa42a70 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.307+0000 7fb5e99ec640 1 -- 172.21.15.177:0/480061617 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94597370147376] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5e4093070 con 0x56092aa42a70 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.307+0000 7fb5edd1f800 20 remove_watcher() i=3 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.307+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94597370150848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4f230 con 0x56092aa3e530 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.308+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94597370150848] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x56092aa3e530 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.308+0000 7fb5edd1f800 20 remove_watcher() i=4 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.308+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94597370153424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa51db0 con 0x7fb5e40b9060 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.309+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94597370153424] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.309+0000 7fb5edd1f800 20 remove_watcher() i=5 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.309+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94597370141392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4ffc0 con 0x7fb5e40b9060 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.311+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94597370141392] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.311+0000 7fb5edd1f800 20 remove_watcher() i=6 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.311+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94597370157456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56092aa4f230 con 0x7fb5e40b9060 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94597370157456] v30'35 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb5dc0083e0 con 0x7fb5e40b9060 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 20 remove_watcher() i=7 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb5e40b9060 msgr2=0x7fb5e4078960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb5e40b9060 0x7fb5e4078960 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092aa3e530 msgr2=0x56092aa409f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092aa3e530 0x56092aa409f0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56092aa42a70 msgr2=0x56092aa44e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56092aa42a70 0x56092aa44e60 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56092aa477c0 msgr2=0x56092aa49c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56092aa477c0 0x56092aa49c80 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4b4036790 msgr2=0x7fb4b4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4b4036790 0x7fb4b4038c50 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x56092aa07df0 tx=0x7fb5d4010000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 msgr2=0x56092aa32d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/480061617 reap_dead start 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa32d60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb5e407d7f0 tx=0x7fb5e4073f30 comp rx=0 tx=0).stop 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 shutdown_connections 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/480061617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa2bb00 0x56092aa32d60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 >> 172.21.15.177:0/480061617 conn(0x56092a906640 msgr2=0x56092aa23550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 shutdown_connections 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/480061617 wait complete. 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4c40367e0 msgr2=0x7fb4c4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4c40367e0 0x7fb4c4038ca0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x56092aa03480 tx=0x7fb5d4006000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 msgr2=0x56092aa1cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.312+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 0x56092aa1cf00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4069fd0 tx=0x7fb5e405f7d0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 shutdown_connections 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4c40367e0 0x7fb4c4038ca0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/303496657 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092aa1cae0 0x56092aa1cf00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 >> 172.21.15.177:0/303496657 conn(0x56092aa10b80 msgr2=0x56092aa10f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 shutdown_connections 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/303496657 wait complete. 2024-03-20T13:35:10.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56092aa0be50 msgr2=0x56092aa0e240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56092aa0be50 0x56092aa0e240 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092a90af20 msgr2=0x56092aa05b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56092a90af20 0x56092aa05b60 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fb5d8002260 msgr2=0x56092aa0a340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fb5d8002260 0x56092aa0a340 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4d00367e0 msgr2=0x7fb4d0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb4d00367e0 0x7fb4d0038ca0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb5d40011e0 tx=0x7fb5d40013b0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 msgr2=0x56092a9fed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 --2- 172.21.15.177:0/3633508734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56092a9085f0 0x56092a9fed40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb5e400c210 tx=0x7fb5d80040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5ea1ed640 1 -- 172.21.15.177:0/3633508734 reap_dead start 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 shutdown_connections 2024-03-20T13:35:10.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 >> 172.21.15.177:0/3633508734 conn(0x56092a902040 msgr2=0x56092a9f17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 shutdown_connections 2024-03-20T13:35:10.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.313+0000 7fb5edd1f800 1 -- 172.21.15.177:0/3633508734 wait complete. 2024-03-20T13:35:10.326 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:10.326 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.326 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.326 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:10.369 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:10.369 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40a380f800 1 Processor -- start 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40a380f800 1 -- start start 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40a380f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56226533ee70 0x562265341260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40a380f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562265286cd0 con 0x56226533a9e0 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40a380f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56226523d500 con 0x56226533ee70 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40966e3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56226533ee70 0x562265341260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40966e3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56226533ee70 0x562265341260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:56988/0 (socket says 172.21.15.177:56988) 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f409eee4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56226533a9e0 0x56226533ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36850/0 (socket says 172.21.15.177:36850) 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40966e3640 1 -- 172.21.15.177:0/574432810 learned_addr learned my addr 172.21.15.177:0/574432810 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40966e3640 1 -- 172.21.15.177:0/574432810 >> v1:172.21.15.28:6789/0 conn(0x56226533a9e0 legacy=0x56226533ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.369+0000 7f40966e3640 1 -- 172.21.15.177:0/574432810 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562265342890 con 0x56226533ee70 2024-03-20T13:35:10.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.371+0000 7f40966e3640 1 --2- 172.21.15.177:0/574432810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533ee70 0x562265341260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f408800a6b0 tx=0x7f408801eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9760be704397133 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.371+0000 7f409e6e3640 1 -- 172.21.15.177:0/574432810 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f408800a200 con 0x56226533ee70 2024-03-20T13:35:10.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.371+0000 7f409e6e3640 1 -- 172.21.15.177:0/574432810 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800a360 con 0x56226533ee70 2024-03-20T13:35:10.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.371+0000 7f409e6e3640 1 -- 172.21.15.177:0/574432810 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40880086e0 con 0x56226533ee70 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 -- 172.21.15.177:0/574432810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533ee70 msgr2=0x562265341260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 --2- 172.21.15.177:0/574432810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533ee70 0x562265341260 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f408800a6b0 tx=0x7f408801eda0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 -- 172.21.15.177:0/574432810 shutdown_connections 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 --2- 172.21.15.177:0/574432810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533ee70 0x562265341260 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 -- 172.21.15.177:0/574432810 >> 172.21.15.177:0/574432810 conn(0x562265336040 msgr2=0x562265338460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 -- 172.21.15.177:0/574432810 shutdown_connections 2024-03-20T13:35:10.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.372+0000 7f40a380f800 1 -- 172.21.15.177:0/574432810 wait complete. 2024-03-20T13:35:10.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.384+0000 7f40a380f800 1 Processor -- start 2024-03-20T13:35:10.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.384+0000 7f40a380f800 1 -- start start 2024-03-20T13:35:10.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.384+0000 7f40a380f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x56226542db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.384+0000 7f40a380f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56226523aa30 con 0x56226533a9e0 2024-03-20T13:35:10.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.385+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x56226542db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.385+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x56226542db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57002/0 (socket says 172.21.15.177:57002) 2024-03-20T13:35:10.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.385+0000 7f409eee4640 1 -- 172.21.15.177:0/360325768 learned_addr learned my addr 172.21.15.177:0/360325768 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.387+0000 7f409eee4640 1 -- 172.21.15.177:0/360325768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088005de0 con 0x56226533a9e0 2024-03-20T13:35:10.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.389+0000 7f409eee4640 1 --2- 172.21.15.177:0/360325768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x56226542db90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4090001cb0 tx=0x7f409000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f013ddc5903df3fc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.390+0000 7f3f8ce09640 1 -- 172.21.15.177:0/360325768 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090014070 con 0x56226533a9e0 2024-03-20T13:35:10.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.390+0000 7f3f8ce09640 1 -- 172.21.15.177:0/360325768 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409000f450 con 0x56226533a9e0 2024-03-20T13:35:10.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.390+0000 7f3f8ce09640 1 -- 172.21.15.177:0/360325768 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409000f750 con 0x56226533a9e0 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 -- 172.21.15.177:0/360325768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 msgr2=0x56226542db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 --2- 172.21.15.177:0/360325768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x56226542db90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4090001cb0 tx=0x7f409000b600 comp rx=0 tx=0).stop 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 -- 172.21.15.177:0/360325768 shutdown_connections 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 --2- 172.21.15.177:0/360325768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x56226542db90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 -- 172.21.15.177:0/360325768 >> 172.21.15.177:0/360325768 conn(0x562265336040 msgr2=0x5622654250a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 -- 172.21.15.177:0/360325768 shutdown_connections 2024-03-20T13:35:10.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 -- 172.21.15.177:0/360325768 wait complete. 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 Processor -- start 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.391+0000 7f40a380f800 1 -- start start 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f40a380f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x562265435280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f40a380f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562265236210 con 0x56226533a9e0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x562265435280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x562265435280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57004/0 (socket says 172.21.15.177:57004) 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f409eee4640 1 -- 172.21.15.177:0/972833664 learned_addr learned my addr 172.21.15.177:0/972833664 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f409eee4640 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562265286cd0 con 0x56226533a9e0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f409eee4640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x562265435280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x56226542e920 tx=0x7f4090000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f3f8b606640 1 -- 172.21.15.177:0/972833664 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090014070 con 0x56226533a9e0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f3f8b606640 1 -- 172.21.15.177:0/972833664 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090020070 con 0x56226533a9e0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.392+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5622654357c0 con 0x56226533a9e0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.393+0000 7f3f8b606640 1 -- 172.21.15.177:0/972833664 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f40900199a0 con 0x56226533a9e0 2024-03-20T13:35:10.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.393+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562265435ca0 con 0x56226533a9e0 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.393+0000 7f3f8b606640 1 -- 172.21.15.177:0/972833664 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4090019bd0 con 0x56226533a9e0 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.393+0000 7f3f8b606640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f840367e0 0x7f3f84038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.393+0000 7f3f8b606640 1 -- 172.21.15.177:0/972833664 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4090008030 con 0x56226533a9e0 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f40966e3640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f840367e0 0x7f3f84038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56226533ee70 0x56226543bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226543c5d0 con 0x56226533ee70 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f409f6e5640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56226533ee70 0x56226543bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f40966e3640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f840367e0 0x7f3f84038ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4088056000 tx=0x7f408800a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f409f6e5640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56226533ee70 0x56226543bfb0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f409f6e5640 1 -- 172.21.15.177:0/972833664 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x56226533ee70 2024-03-20T13:35:10.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.394+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265439680 con 0x56226533ee70 2024-03-20T13:35:10.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f409f6e5640 1 -- 172.21.15.177:0/972833664 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f409800a4a0 con 0x56226533ee70 2024-03-20T13:35:10.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56226543e840 0x562265440c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265441300 con 0x56226543e840 2024-03-20T13:35:10.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f409eee4640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56226543e840 0x562265440c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f409eee4640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56226543e840 0x562265440c30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f409eee4640 1 -- 172.21.15.177:0/972833664 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4090016070 con 0x56226543e840 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.395+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226543d7c0 con 0x56226533ee70 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.396+0000 7f409f6e5640 1 -- 172.21.15.177:0/972833664 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f409800a4a0 con 0x56226533ee70 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.396+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562265442720 0x562265444b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.396+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265445270 con 0x562265442720 2024-03-20T13:35:10.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.397+0000 7f40966e3640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562265442720 0x562265444b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.399+0000 7f40966e3640 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562265442720 0x562265444b10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.400+0000 7f40966e3640 1 -- 172.21.15.177:0/972833664 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f40880088d0 con 0x562265442720 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.400+0000 7f40a380f800 1 Processor -- start 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.400+0000 7f40a380f800 1 -- start start 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.400+0000 7f40a380f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 0x562265453890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.400+0000 7f40a380f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622651d8c70 con 0x562265453470 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 0x562265453890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 0x562265453890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57014/0 (socket says 172.21.15.177:57014) 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f409eee4640 1 -- 172.21.15.177:0/3854335576 learned_addr learned my addr 172.21.15.177:0/3854335576 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f409eee4640 1 -- 172.21.15.177:0/3854335576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562265453dd0 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f409eee4640 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 0x562265453890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f409004c010 tx=0x7f409000eed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f3f88e01640 1 -- 172.21.15.177:0/3854335576 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090036070 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f3f88e01640 1 -- 172.21.15.177:0/3854335576 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40900490e0 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562265454840 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f3f88e01640 1 -- 172.21.15.177:0/3854335576 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090049380 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.401+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562265454d00 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f3f88e01640 1 -- 172.21.15.177:0/3854335576 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4090044980 con 0x562265453470 2024-03-20T13:35:10.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f3f88e01640 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f78036790 0x7f3f78038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f3f88e01640 1 -- 172.21.15.177:0/3854335576 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f409003cc50 con 0x562265453470 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f40966e3640 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f78036790 0x7f3f78038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f40a380f800 1 Processor -- start 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f40a380f800 1 -- start start 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f40966e3640 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f78036790 0x7f3f78038c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5622654395d0 tx=0x7f4088005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f40a380f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265460b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.402+0000 7f40a380f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622651ae5d0 con 0x562265460700 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.403+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265460b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.403+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265460b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57018/0 (socket says 172.21.15.177:57018) 2024-03-20T13:35:10.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.403+0000 7f409eee4640 1 -- 172.21.15.177:0/467350530 learned_addr learned my addr 172.21.15.177:0/467350530 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.403+0000 7f409eee4640 1 -- 172.21.15.177:0/467350530 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622654610f0 con 0x562265460700 2024-03-20T13:35:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.403+0000 7f409eee4640 1 --2- 172.21.15.177:0/467350530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265460b20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4090001480 tx=0x7f40900173f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e36de034fa09b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.404+0000 7f3f827fc640 1 -- 172.21.15.177:0/467350530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090032d10 con 0x562265460700 2024-03-20T13:35:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.404+0000 7f3f827fc640 1 -- 172.21.15.177:0/467350530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090032e70 con 0x562265460700 2024-03-20T13:35:10.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.404+0000 7f3f827fc640 1 -- 172.21.15.177:0/467350530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090017b50 con 0x562265460700 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.404+0000 7f40a380f800 1 -- 172.21.15.177:0/467350530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 msgr2=0x562265460b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.404+0000 7f40a380f800 1 --2- 172.21.15.177:0/467350530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265460b20 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f4090001480 tx=0x7f40900173f0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 -- 172.21.15.177:0/467350530 shutdown_connections 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 --2- 172.21.15.177:0/467350530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265460b20 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 -- 172.21.15.177:0/467350530 >> 172.21.15.177:0/467350530 conn(0x56226545c9d0 msgr2=0x56226545aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 -- 172.21.15.177:0/467350530 shutdown_connections 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 -- 172.21.15.177:0/467350530 wait complete. 2024-03-20T13:35:10.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 Processor -- start 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 -- start start 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265467630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f40a380f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562265467b70 con 0x562265460700 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265467630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f409eee4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265467630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57024/0 (socket says 172.21.15.177:57024) 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.405+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 learned_addr learned my addr 172.21.15.177:0/2668498233 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562265454d00 con 0x562265460700 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f409eee4640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265467630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4090003dd0 tx=0x7f4090010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f3f80ff9640 1 -- 172.21.15.177:0/2668498233 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f409001b620 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f3f80ff9640 1 -- 172.21.15.177:0/2668498233 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4090018570 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f3f80ff9640 1 -- 172.21.15.177:0/2668498233 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4090044560 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562265454d00 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.406+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562265454d00 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f3f80ff9640 1 -- 172.21.15.177:0/2668498233 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f40900110d0 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f3f80ff9640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f68036790 0x7f3f68038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f3f80ff9640 1 -- 172.21.15.177:0/2668498233 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4090076c80 con 0x562265460700 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f40966e3640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f68036790 0x7f3f68038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562265472eb0 0x562265475350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265475aa0 con 0x562265472eb0 2024-03-20T13:35:10.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.407+0000 7f409f6e5640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562265472eb0 0x562265475350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40966e3640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f68036790 0x7f3f68038c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f408800a330 tx=0x7f4088052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f409f6e5640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562265472eb0 0x562265475350 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 realm 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265475e70 con 0x562265472eb0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:10.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.408+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265476a20 con 0x562265472eb0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5622654773d0 0x5622654797c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265479d00 con 0x5622654773d0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f409eee4640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5622654773d0 0x5622654797c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f409eee4640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5622654773d0 0x5622654797c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 20 searching for the correct realm 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56226547bd00 0x56226547e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547e890 con 0x56226547bd00 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.409+0000 7f40966e3640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56226547bd00 0x56226547e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.410+0000 7f40966e3640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56226547bd00 0x56226547e1c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.410+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.410+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547e890 con 0x5622654773d0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.410+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.410+0000 7f409eee4640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4090075060 0x7f409001d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.410+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547e890 con 0x7f4090075060 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.411+0000 7f409f6e5640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4090075060 0x7f409001d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.411+0000 7f409f6e5640 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4090075060 0x7f409001d040 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.411+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.411+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.412+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x5622654773d0 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.413+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x5622654773d0 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.414+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.415+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x5622654773d0 2024-03-20T13:35:10.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.416+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.417+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.417+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.417+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.417+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x56226547bd00 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.417+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.417+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x7f4090075060 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.418+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.418+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4098031040 con 0x5622654773d0 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.418+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.418+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4098031040 con 0x56226547bd00 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.418+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.418+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4098031040 con 0x7f4090075060 2024-03-20T13:35:10.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4098031040 con 0x562265472eb0 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4098031040 con 0x5622654773d0 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654766c0 con 0x562265472eb0 2024-03-20T13:35:10.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.419+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547a600 con 0x562265472eb0 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547a600 con 0x7f4090075060 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 zone default found 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 4 Realm: () 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 zonegroup default 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547ae80 con 0x7f4090075060 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.420+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547ae80 con 0x56226547bd00 2024-03-20T13:35:10.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547b2b0 con 0x56226547bd00 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 20 started sync module instance, tier type = 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.421+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56226547ff90 con 0x5622654773d0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.422+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.422+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94705728092912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265480340 con 0x5622654773d0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.422+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265481310 con 0x562265472eb0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.423+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94705728092912] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.423+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.423+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94705728096112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654816c0 con 0x562265472eb0 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.423+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654820f0 con 0x56226547bd00 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.424+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94705728096112] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.424+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.424+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94705728101360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654824d0 con 0x56226547bd00 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.424+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265482ea0 con 0x5622654773d0 2024-03-20T13:35:10.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.425+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94705728101360] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.425+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.425+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94705728097792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265483720 con 0x5622654773d0 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.425+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265484090 con 0x562265472eb0 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.426+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.426+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94705728109552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654844f0 con 0x562265472eb0 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.426+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265484fa0 con 0x7f4090075060 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.426+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94705728097792] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.427+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.427+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94705728113312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265484f60 con 0x7f4090075060 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.427+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485980 con 0x7f4090075060 2024-03-20T13:35:10.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.427+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94705728109552] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.428+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94705728113312] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.428+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.429+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94705728107136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265484010 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.429+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485f90 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94705728107136] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'36 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94705728115904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485f90 con 0x7f4090075060 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=0 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=1 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=2 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=3 2024-03-20T13:35:10.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=4 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=5 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.430+0000 7f40a380f800 20 add_watcher() i=6 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.432+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94705728115904] v30'37 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.432+0000 7f40a380f800 20 add_watcher() i=7 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.432+0000 7f40a380f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.432+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265489230 con 0x562265472eb0 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.432+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.432+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94705728117856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265486520 con 0x562265472eb0 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.433+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94705728117856] v30'58 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.433+0000 7f3f557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.433+0000 7f40a380f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.433+0000 7f40a380f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.433+0000 7f40a380f800 5 note: GC not initialized 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.433+0000 7f3ecffff640 20 reqs_thread_entry: start 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f40a380f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f40a380f800 20 Filter name: none 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f3ecdffb640 20 reqs_thread_entry: start 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f40a380f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654bacf0 con 0x562265472eb0 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.434+0000 7f40a380f800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:10.448 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:10.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.435+0000 7f3f557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.435+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94705728117856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5622654886d0 con 0x562265472eb0 2024-03-20T13:35:10.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.436+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94705728117856] v30'59 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.436+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94705728092912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485c60 con 0x5622654773d0 2024-03-20T13:35:10.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.437+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94705728092912] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.437+0000 7f40a380f800 20 remove_watcher() i=0 2024-03-20T13:35:10.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.437+0000 7f40a380f800 2 removed watcher, disabling cache 2024-03-20T13:35:10.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.437+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94705728096112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485c60 con 0x562265472eb0 2024-03-20T13:35:10.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.438+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94705728096112] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.438+0000 7f40a380f800 20 remove_watcher() i=1 2024-03-20T13:35:10.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.438+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94705728101360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265480770 con 0x56226547bd00 2024-03-20T13:35:10.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.439+0000 7f40966e3640 1 -- 172.21.15.177:0/2668498233 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94705728101360] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f40880088d0 con 0x56226547bd00 2024-03-20T13:35:10.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.439+0000 7f40a380f800 20 remove_watcher() i=2 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.440+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94705728097792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485c60 con 0x5622654773d0 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.440+0000 7f409eee4640 1 -- 172.21.15.177:0/2668498233 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94705728097792] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4090016070 con 0x5622654773d0 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.440+0000 7f40a380f800 20 remove_watcher() i=3 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.440+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94705728109552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265480e00 con 0x562265472eb0 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.441+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94705728109552] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x562265472eb0 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.441+0000 7f40a380f800 20 remove_watcher() i=4 2024-03-20T13:35:10.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.441+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94705728113312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485c60 con 0x7f4090075060 2024-03-20T13:35:10.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.443+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94705728113312] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.443+0000 7f40a380f800 20 remove_watcher() i=5 2024-03-20T13:35:10.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.443+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94705728107136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265483bf0 con 0x7f4090075060 2024-03-20T13:35:10.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.444+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94705728107136] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.444+0000 7f40a380f800 20 remove_watcher() i=6 2024-03-20T13:35:10.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.444+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94705728115904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562265485c60 con 0x7f4090075060 2024-03-20T13:35:10.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94705728115904] v30'38 uv36 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f409800a4a0 con 0x7f4090075060 2024-03-20T13:35:10.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 20 remove_watcher() i=7 2024-03-20T13:35:10.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4090075060 msgr2=0x7f409001d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4090075060 0x7f409001d040 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562265472eb0 msgr2=0x562265475350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562265472eb0 0x562265475350 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5622654773d0 msgr2=0x5622654797c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5622654773d0 0x5622654797c0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56226547bd00 msgr2=0x56226547e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.445+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56226547bd00 0x56226547e1c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f68036790 msgr2=0x7f3f68038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f68036790 0x7f3f68038c50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f408800a330 tx=0x7f4088052000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 msgr2=0x562265467630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/2668498233 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265460700 0x562265467630 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4090003dd0 tx=0x7f4090010ef0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 reap_dead start 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f409f6e5640 1 -- 172.21.15.177:0/2668498233 reap_dead start 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 shutdown_connections 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 >> 172.21.15.177:0/2668498233 conn(0x56226545c9d0 msgr2=0x56226545a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 shutdown_connections 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/2668498233 wait complete. 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f78036790 msgr2=0x7f3f78038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f78036790 0x7f3f78038c50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x5622654395d0 tx=0x7f4088005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 msgr2=0x562265453890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 0x562265453890 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f409004c010 tx=0x7f409000eed0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 shutdown_connections 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f78036790 0x7f3f78038c50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/3854335576 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562265453470 0x562265453890 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 >> 172.21.15.177:0/3854335576 conn(0x562265447510 msgr2=0x562265447910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 shutdown_connections 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/3854335576 wait complete. 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562265442720 msgr2=0x562265444b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562265442720 0x562265444b10 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56226533ee70 msgr2=0x56226543bfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56226533ee70 0x56226543bfb0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56226543e840 msgr2=0x562265440c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.446+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56226543e840 0x562265440c30 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f840367e0 msgr2=0x7f3f84038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3f840367e0 0x7f3f84038ca0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4088056000 tx=0x7f408800a000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 msgr2=0x562265435280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 --2- 172.21.15.177:0/972833664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56226533a9e0 0x562265435280 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x56226542e920 tx=0x7f4090000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f409f6e5640 1 -- 172.21.15.177:0/972833664 reap_dead start 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 shutdown_connections 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 >> 172.21.15.177:0/972833664 conn(0x562265336040 msgr2=0x5622654238e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 shutdown_connections 2024-03-20T13:35:10.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.447+0000 7f40a380f800 1 -- 172.21.15.177:0/972833664 wait complete. 2024-03-20T13:35:10.465 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:10.465 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-03-20T13:35:10.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-03-20T13:35:10.466 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-03-20T13:35:10.540 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:10.541 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.539+0000 7f8c6152b800 1 Processor -- start 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.539+0000 7f8c6152b800 1 -- start start 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.539+0000 7f8c6152b800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561b3d5599e0 0x561b3d559e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.539+0000 7f8c6152b800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561b3d4a5cd0 con 0x561b3d55ac40 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.539+0000 7f8c6152b800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561b3d45c500 con 0x561b3d5599e0 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c5c956640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x561b3d55ac40 0x561b3d55b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36866/0 (socket says 172.21.15.177:36866) 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c5c956640 1 -- 172.21.15.177:0/3606655518 learned_addr learned my addr 172.21.15.177:0/3606655518 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1299657346 0 0) 0x561b3d4a5cd0 con 0x561b3d55ac40 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c4c001e10 con 0x561b3d55ac40 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1330967100 0 0) 0x7f8c4c001e10 con 0x561b3d55ac40 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 >> v2:172.21.15.28:3300/0 conn(0x561b3d5599e0 msgr2=0x561b3d559e00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:35:10.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 --2- 172.21.15.177:0/3606655518 >> v2:172.21.15.28:3300/0 conn(0x561b3d5599e0 0x561b3d559e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b3d55a4d0 con 0x561b3d55ac40 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7f8c480015a0 con 0x561b3d55ac40 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 >> v1:172.21.15.28:6789/0 conn(0x561b3d55ac40 legacy=0x561b3d55b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 --2- 172.21.15.177:0/3606655518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c4c002260 0x7f8c4c002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d45c500 con 0x7f8c4c002260 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.540+0000 7f8c5d157640 1 --2- 172.21.15.177:0/3606655518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c4c002260 0x7f8c4c002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.541+0000 7f8c5d157640 1 -- 172.21.15.177:0/3606655518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c001e10 con 0x7f8c4c002260 2024-03-20T13:35:10.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c5d157640 1 --2- 172.21.15.177:0/3606655518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c4c002260 0x7f8c4c002660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800a480 tx=0x7f8c5801cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88891baba0f9b88 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c580535a0 con 0x7f8c4c002260 2024-03-20T13:35:10.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58053720 con 0x7f8c4c002260 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c57fff640 1 -- 172.21.15.177:0/3606655518 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c58053a00 con 0x7f8c4c002260 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 -- 172.21.15.177:0/3606655518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c4c002260 msgr2=0x7f8c4c002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 --2- 172.21.15.177:0/3606655518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c4c002260 0x7f8c4c002660 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800a480 tx=0x7f8c5801cc30 comp rx=0 tx=0).stop 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 -- 172.21.15.177:0/3606655518 shutdown_connections 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 --2- 172.21.15.177:0/3606655518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c4c002260 0x7f8c4c002660 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 --2- 172.21.15.177:0/3606655518 >> v2:172.21.15.28:3300/0 conn(0x561b3d5599e0 0x561b3d559e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 -- 172.21.15.177:0/3606655518 >> 172.21.15.177:0/3606655518 conn(0x561b3d555040 msgr2=0x561b3d557460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 -- 172.21.15.177:0/3606655518 shutdown_connections 2024-03-20T13:35:10.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.543+0000 7f8c6152b800 1 -- 172.21.15.177:0/3606655518 wait complete. 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.555+0000 7f8c6152b800 1 Processor -- start 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.555+0000 7f8c6152b800 1 -- start start 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.555+0000 7f8c6152b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d649950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.555+0000 7f8c6152b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d459a30 con 0x561b3d5599e0 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.556+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d649950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.556+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d649950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57048/0 (socket says 172.21.15.177:57048) 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.556+0000 7f8c5d157640 1 -- 172.21.15.177:0/1412229479 learned_addr learned my addr 172.21.15.177:0/1412229479 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.556+0000 7f8c5d157640 1 -- 172.21.15.177:0/1412229479 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b3d649f20 con 0x561b3d5599e0 2024-03-20T13:35:10.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.556+0000 7f8c5d157640 1 --2- 172.21.15.177:0/1412229479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d649950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800a420 tx=0x7f8c5804c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6db044e6683796e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8b4b606640 1 -- 172.21.15.177:0/1412229479 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5805a050 con 0x561b3d5599e0 2024-03-20T13:35:10.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8b4b606640 1 -- 172.21.15.177:0/1412229479 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58058030 con 0x561b3d5599e0 2024-03-20T13:35:10.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8b4b606640 1 -- 172.21.15.177:0/1412229479 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c58053cd0 con 0x561b3d5599e0 2024-03-20T13:35:10.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 -- 172.21.15.177:0/1412229479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 msgr2=0x561b3d649950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 --2- 172.21.15.177:0/1412229479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d649950 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8c5800a420 tx=0x7f8c5804c070 comp rx=0 tx=0).stop 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 -- 172.21.15.177:0/1412229479 shutdown_connections 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 --2- 172.21.15.177:0/1412229479 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d649950 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 -- 172.21.15.177:0/1412229479 >> 172.21.15.177:0/1412229479 conn(0x561b3d555040 msgr2=0x561b3d645270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 -- 172.21.15.177:0/1412229479 shutdown_connections 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.557+0000 7f8c6152b800 1 -- 172.21.15.177:0/1412229479 wait complete. 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.558+0000 7f8c6152b800 1 Processor -- start 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.558+0000 7f8c6152b800 1 -- start start 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.558+0000 7f8c6152b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d64e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.558+0000 7f8c6152b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d455210 con 0x561b3d5599e0 2024-03-20T13:35:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.559+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d64e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.559+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d64e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57056/0 (socket says 172.21.15.177:57056) 2024-03-20T13:35:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.559+0000 7f8c5d157640 1 -- 172.21.15.177:0/4207966252 learned_addr learned my addr 172.21.15.177:0/4207966252 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.560+0000 7f8c5d157640 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c001e10 con 0x561b3d5599e0 2024-03-20T13:35:10.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.561+0000 7f8c5d157640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d64e890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8c580536f0 tx=0x7f8c4c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.562+0000 7f8b49e03640 1 -- 172.21.15.177:0/4207966252 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5805a040 con 0x561b3d5599e0 2024-03-20T13:35:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.562+0000 7f8b49e03640 1 -- 172.21.15.177:0/4207966252 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5805b040 con 0x561b3d5599e0 2024-03-20T13:35:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.562+0000 7f8b49e03640 1 -- 172.21.15.177:0/4207966252 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5800a190 con 0x561b3d5599e0 2024-03-20T13:35:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.562+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b3d64cf80 con 0x561b3d5599e0 2024-03-20T13:35:10.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.562+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b3d64d4c0 con 0x561b3d5599e0 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.563+0000 7f8b49e03640 1 -- 172.21.15.177:0/4207966252 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c58066040 con 0x561b3d5599e0 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8b49e03640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b44036880 0x7f8b44038d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8b49e03640 1 -- 172.21.15.177:0/4207966252 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8c5808cdd0 con 0x561b3d5599e0 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c5c956640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b44036880 0x7f8b44038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d55ac40 0x561b3d65b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d64dc80 con 0x561b3d55ac40 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c5d958640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d55ac40 0x561b3d65b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c5c956640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b44036880 0x7f8b44038d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800b2d0 tx=0x7f8c480013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c5d958640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d55ac40 0x561b3d65b440 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c5d958640 1 -- 172.21.15.177:0/4207966252 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d55ac40 2024-03-20T13:35:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.564+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d64d7f0 con 0x561b3d55ac40 2024-03-20T13:35:10.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c5d958640 1 -- 172.21.15.177:0/4207966252 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d55ac40 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f8c4c002260 0x561b3d65f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d65ff40 con 0x7f8c4c002260 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c5d157640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f8c4c002260 0x561b3d65f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c5d157640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f8c4c002260 0x561b3d65f870 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c5d157640 1 -- 172.21.15.177:0/4207966252 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f8c5805d070 con 0x7f8c4c002260 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.565+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d65c7e0 con 0x561b3d55ac40 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.566+0000 7f8c5d958640 1 -- 172.21.15.177:0/4207966252 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d55ac40 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.566+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561b3d661340 0x561b3d663730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.566+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d663e70 con 0x561b3d661340 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.566+0000 7f8c5c956640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561b3d661340 0x561b3d663730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.566+0000 7f8c5c956640 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561b3d661340 0x561b3d663730 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c5c956640 1 -- 172.21.15.177:0/4207966252 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8c4800f7f0 con 0x561b3d661340 2024-03-20T13:35:10.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c6152b800 1 Processor -- start 2024-03-20T13:35:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c6152b800 1 -- start start 2024-03-20T13:35:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c6152b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 0x561b3d672490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c6152b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d3f7c70 con 0x561b3d672070 2024-03-20T13:35:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 0x561b3d672490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 0x561b3d672490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57070/0 (socket says 172.21.15.177:57070) 2024-03-20T13:35:10.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c5d157640 1 -- 172.21.15.177:0/2827436765 learned_addr learned my addr 172.21.15.177:0/2827436765 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.567+0000 7f8c5d157640 1 -- 172.21.15.177:0/2827436765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b3d6729d0 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.568+0000 7f8c5d157640 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 0x561b3d672490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8c580058b0 tx=0x7f8c5806ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.568+0000 7f8b42ffd640 1 -- 172.21.15.177:0/2827436765 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c58052600 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.568+0000 7f8b42ffd640 1 -- 172.21.15.177:0/2827436765 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5808f020 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.568+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b3d673440 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.568+0000 7f8b42ffd640 1 -- 172.21.15.177:0/2827436765 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c58052890 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.568+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b3d673900 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8b42ffd640 1 -- 172.21.15.177:0/2827436765 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c58092030 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8b42ffd640 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b380367e0 0x7f8b38038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8b42ffd640 1 -- 172.21.15.177:0/2827436765 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8c58090070 con 0x561b3d672070 2024-03-20T13:35:10.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c5c956640 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b380367e0 0x7f8b38038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c6152b800 1 Processor -- start 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c6152b800 1 -- start start 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c5c956640 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b380367e0 0x7f8b38038ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x561b3d64d730 tx=0x7f8c48006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c6152b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d67f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c6152b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d3cd5d0 con 0x561b3d67f2a0 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.569+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d67f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d67f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57078/0 (socket says 172.21.15.177:57078) 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8c5d157640 1 -- 172.21.15.177:0/2631597194 learned_addr learned my addr 172.21.15.177:0/2631597194 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8c5d157640 1 -- 172.21.15.177:0/2631597194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b3d67fc90 con 0x561b3d67f2a0 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8c5d157640 1 --2- 172.21.15.177:0/2631597194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d67f6c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c5807b9a0 tx=0x7f8c5807b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e604b5d2e6712c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8b40ff9640 1 -- 172.21.15.177:0/2631597194 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c58055db0 con 0x561b3d67f2a0 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8b40ff9640 1 -- 172.21.15.177:0/2631597194 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c58081040 con 0x561b3d67f2a0 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8b40ff9640 1 -- 172.21.15.177:0/2631597194 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5806f4f0 con 0x561b3d67f2a0 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8c6152b800 1 -- 172.21.15.177:0/2631597194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 msgr2=0x561b3d67f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.570+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2631597194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d67f6c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8c5807b9a0 tx=0x7f8c5807b4e0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 -- 172.21.15.177:0/2631597194 shutdown_connections 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2631597194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d67f6c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 -- 172.21.15.177:0/2631597194 >> 172.21.15.177:0/2631597194 conn(0x561b3d67b5b0 msgr2=0x561b3d679610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 -- 172.21.15.177:0/2631597194 shutdown_connections 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 -- 172.21.15.177:0/2631597194 wait complete. 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 Processor -- start 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 -- start start 2024-03-20T13:35:10.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d6860e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c6152b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561b3d686620 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d6860e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c5d157640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d6860e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57082/0 (socket says 172.21.15.177:57082) 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.571+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 learned_addr learned my addr 172.21.15.177:0/2991658176 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561b3d673900 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8c5d157640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d6860e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c5807bbd0 tx=0x7f8c58078f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8b2effd640 1 -- 172.21.15.177:0/2991658176 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5807be50 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8b2effd640 1 -- 172.21.15.177:0/2991658176 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5806f8c0 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561b3d673900 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8b2effd640 1 -- 172.21.15.177:0/2991658176 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c5807fac0 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.572+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561b3d673900 con 0x561b3d67f2a0 2024-03-20T13:35:10.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8b2effd640 1 -- 172.21.15.177:0/2991658176 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c580a2070 con 0x561b3d67f2a0 2024-03-20T13:35:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8b2effd640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b28036790 0x7f8b28038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8b2effd640 1 -- 172.21.15.177:0/2991658176 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8c5809f040 con 0x561b3d67f2a0 2024-03-20T13:35:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8c5c956640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b28036790 0x7f8b28038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d691800 0x561b3d693cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d694410 con 0x561b3d691800 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8c5c956640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b28036790 0x7f8b28038c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x561b3d65d320 tx=0x7f8c48010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.573+0000 7f8c5d958640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d691800 0x561b3d693cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c5d958640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d691800 0x561b3d693cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 realm 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6947e0 con 0x561b3d691800 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d695060 con 0x561b3d691800 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.574+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561b3d6960d0 0x561b3d6984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d698ad0 con 0x561b3d6960d0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c5d157640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561b3d6960d0 0x561b3d6984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c5d157640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561b3d6960d0 0x561b3d6984c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 20 searching for the correct realm 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561b3d69ad80 0x561b3d69d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d69d8c0 con 0x561b3d69ad80 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.575+0000 7f8c5c956640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561b3d69ad80 0x561b3d69d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.576+0000 7f8c5c956640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561b3d69ad80 0x561b3d69d240 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.576+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.576+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d69d8c0 con 0x561b3d6960d0 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.576+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.576+0000 7f8c5d157640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c580787a0 0x7f8c58075a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.576+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d69d8c0 con 0x7f8c580787a0 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.577+0000 7f8c5d958640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c580787a0 0x7f8c58075a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.577+0000 7f8c5d958640 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c580787a0 0x7f8c58075a20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.577+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.577+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d6960d0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.578+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.579+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.579+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.579+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.579+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.579+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d6960d0 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.580+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.581+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.582+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.582+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.582+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.582+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.582+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.582+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d6960d0 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d69ad80 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.583+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x7f8c580787a0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8c50031040 con 0x561b3d6960d0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8c50031040 con 0x561b3d69ad80 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8c50031040 con 0x7f8c580787a0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.584+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8c50031040 con 0x561b3d691800 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8c50031040 con 0x561b3d6960d0 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6953c0 con 0x561b3d691800 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.585+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6991c0 con 0x561b3d691800 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d699190 con 0x7f8c580787a0 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 zone default found 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 4 Realm: () 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:10.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 zonegroup default 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d699a90 con 0x7f8c580787a0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.586+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d699a90 con 0x561b3d69ad80 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d69f6e0 con 0x561b3d69ad80 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 20 started sync module instance, tier type = 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.587+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d69eb70 con 0x561b3d6960d0 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.588+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.588+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94674994458400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d69f340 con 0x561b3d6960d0 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.588+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a04f0 con 0x561b3d691800 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.589+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94674994458400] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.589+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.589+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94674994462800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a0910 con 0x561b3d691800 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.589+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a1280 con 0x561b3d69ad80 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.590+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94674994462800] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.590+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.590+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94674994463856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a0890 con 0x561b3d69ad80 2024-03-20T13:35:10.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.590+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a2090 con 0x561b3d6960d0 2024-03-20T13:35:10.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.591+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.591+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94674994471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a2cb0 con 0x561b3d6960d0 2024-03-20T13:35:10.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.591+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a3620 con 0x561b3d691800 2024-03-20T13:35:10.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.592+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94674994463856] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.592+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.592+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94674994475392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a35a0 con 0x561b3d691800 2024-03-20T13:35:10.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.592+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a43a0 con 0x7f8c580787a0 2024-03-20T13:35:10.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.592+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94674994471920] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.593+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94674994475392] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.594+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.594+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94674994472976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a4360 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.594+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a3fc0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.595+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94674994472976] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.595+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.595+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94674994477488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a3fc0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.595+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a5230 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'39 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94674994482576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a56d0 con 0x7f8c580787a0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=0 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=1 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=2 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=3 2024-03-20T13:35:10.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=4 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=5 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94674994477488] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.596+0000 7f8c6152b800 20 add_watcher() i=6 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.597+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94674994482576] v30'40 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.597+0000 7f8c6152b800 20 add_watcher() i=7 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.597+0000 7f8c6152b800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.597+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a4780 con 0x561b3d691800 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.597+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.597+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94674994483632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a4730 con 0x561b3d691800 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.598+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94674994483632] v30'60 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.598+0000 7f8b137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:10.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 5 note: GC not initialized 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8b127e4640 20 reqs_thread_entry: start 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 20 Filter name: none 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8a83fff640 20 reqs_thread_entry: start 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6da600 con 0x561b3d691800 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv2 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.599+0000 7f8c6152b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.600+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6dcb20 con 0x561b3d6960d0 2024-03-20T13:35:10.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.600+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.600+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6e02a0 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~357] v30'3 uv3 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c6152b800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c6152b800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c6152b800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94674994724672 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6dcfc0 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94674994475392 notify 128849018882 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f8c5003d040 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8b40ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94674994475392 notifier 4318 bl.length()=533 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8b40ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8b40ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8b40ff9640 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8b20003e90 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(65 notify.4 [notify cookie 94674994724672 out=8b] v0'0 uv39 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.601+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.602+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94674994724672 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f8c50018de0 con 0x561b3d691800 2024-03-20T13:35:10.616 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:10.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.602+0000 7f8b137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.602+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94674994483632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6d93a0 con 0x561b3d691800 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.603+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94674994483632] v30'61 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.603+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94674994458400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a51b0 con 0x561b3d6960d0 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.604+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94674994458400] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.604+0000 7f8c6152b800 20 remove_watcher() i=0 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.604+0000 7f8c6152b800 2 removed watcher, disabling cache 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.604+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94674994462800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a51b0 con 0x561b3d691800 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.605+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94674994462800] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.605+0000 7f8c6152b800 20 remove_watcher() i=1 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.605+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94674994463856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a0050 con 0x561b3d69ad80 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.606+0000 7f8c5c956640 1 -- 172.21.15.177:0/2991658176 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94674994463856] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c48033040 con 0x561b3d69ad80 2024-03-20T13:35:10.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.606+0000 7f8c6152b800 20 remove_watcher() i=2 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.606+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94674994471920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a51b0 con 0x561b3d6960d0 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.607+0000 7f8c5d157640 1 -- 172.21.15.177:0/2991658176 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94674994471920] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c580ab040 con 0x561b3d6960d0 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.607+0000 7f8c6152b800 20 remove_watcher() i=3 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.607+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94674994475392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a23f0 con 0x561b3d691800 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.608+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94674994475392] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x561b3d691800 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.608+0000 7f8c6152b800 20 remove_watcher() i=4 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.608+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94674994472976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a51b0 con 0x7f8c580787a0 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.610+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94674994472976] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.610+0000 7f8c6152b800 20 remove_watcher() i=5 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.610+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94674994477488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a3180 con 0x7f8c580787a0 2024-03-20T13:35:10.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.612+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94674994477488] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.612+0000 7f8c6152b800 20 remove_watcher() i=6 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.612+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94674994482576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561b3d6a51b0 con 0x7f8c580787a0 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94674994482576] v30'41 uv39 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c5000a4a0 con 0x7f8c580787a0 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 20 remove_watcher() i=7 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c580787a0 msgr2=0x7f8c58075a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c580787a0 0x7f8c58075a20 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d691800 msgr2=0x561b3d693cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d691800 0x561b3d693cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561b3d6960d0 msgr2=0x561b3d6984c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561b3d6960d0 0x561b3d6984c0 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561b3d69ad80 msgr2=0x561b3d69d240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561b3d69ad80 0x561b3d69d240 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b28036790 msgr2=0x7f8b28038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b28036790 0x7f8b28038c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x561b3d65d320 tx=0x7f8c48010000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c5d958640 1 -- 172.21.15.177:0/2991658176 reap_dead start 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 msgr2=0x561b3d6860e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d6860e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f8c5807bbd0 tx=0x7f8c58078f40 comp rx=0 tx=0).stop 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 shutdown_connections 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2991658176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d67f2a0 0x561b3d6860e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 >> 172.21.15.177:0/2991658176 conn(0x561b3d67b5b0 msgr2=0x561b3d6795e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 shutdown_connections 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2991658176 wait complete. 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b380367e0 msgr2=0x7f8b38038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.614+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b380367e0 0x7f8b38038ca0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x561b3d64d730 tx=0x7f8c48006000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 msgr2=0x561b3d672490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 0x561b3d672490 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8c580058b0 tx=0x7f8c5806ff90 comp rx=0 tx=0).stop 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 shutdown_connections 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b380367e0 0x7f8b38038ca0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/2827436765 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d672070 0x561b3d672490 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 >> 172.21.15.177:0/2827436765 conn(0x561b3d666110 msgr2=0x561b3d666510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 shutdown_connections 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/2827436765 wait complete. 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561b3d661340 msgr2=0x561b3d663730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561b3d661340 0x561b3d663730 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d55ac40 msgr2=0x561b3d65b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561b3d55ac40 0x561b3d65b440 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f8c4c002260 msgr2=0x561b3d65f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f8c4c002260 0x561b3d65f870 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b44036880 msgr2=0x7f8b44038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b44036880 0x7f8b44038d40 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f8c4800b2d0 tx=0x7f8c480013b0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 msgr2=0x561b3d64e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 --2- 172.21.15.177:0/4207966252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561b3d5599e0 0x561b3d64e890 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f8c580536f0 tx=0x7f8c4c0040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c5d958640 1 -- 172.21.15.177:0/4207966252 reap_dead start 2024-03-20T13:35:10.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 shutdown_connections 2024-03-20T13:35:10.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 >> 172.21.15.177:0/4207966252 conn(0x561b3d555040 msgr2=0x561b3d643b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 shutdown_connections 2024-03-20T13:35:10.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.615+0000 7f8c6152b800 1 -- 172.21.15.177:0/4207966252 wait complete. 2024-03-20T13:35:10.630 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:10.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.630 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:10.714 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:10.714 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:10.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.713+0000 7ff703f42800 1 Processor -- start 2024-03-20T13:35:10.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff703f42800 1 -- start start 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff703f42800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563c0745adf0 0x563c0745d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff703f42800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563c073a1cd0 con 0x563c073c9e80 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff703f42800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x563c07358500 con 0x563c0745adf0 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff6f7443640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563c0745adf0 0x563c0745d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff6ffc44640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x563c073c9e80 0x563c074596a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36876/0 (socket says 172.21.15.177:36876) 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff6f7443640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563c0745adf0 0x563c0745d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57086/0 (socket says 172.21.15.177:57086) 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff6ffc44640 1 -- 172.21.15.177:0/1684631373 learned_addr learned my addr 172.21.15.177:0/1684631373 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff6f7443640 1 -- 172.21.15.177:0/1684631373 >> v1:172.21.15.28:6789/0 conn(0x563c073c9e80 legacy=0x563c074596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.714+0000 7ff6f7443640 1 -- 172.21.15.177:0/1684631373 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0745e9c0 con 0x563c0745adf0 2024-03-20T13:35:10.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.716+0000 7ff6f7443640 1 --2- 172.21.15.177:0/1684631373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0745adf0 0x563c0745d2b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800a470 tx=0x7ff6e801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8196a5b88c5ba14d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.716+0000 7ff6ff443640 1 -- 172.21.15.177:0/1684631373 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8052570 con 0x563c0745adf0 2024-03-20T13:35:10.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.716+0000 7ff6ff443640 1 -- 172.21.15.177:0/1684631373 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e80526d0 con 0x563c0745adf0 2024-03-20T13:35:10.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.716+0000 7ff6ff443640 1 -- 172.21.15.177:0/1684631373 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6e8052990 con 0x563c0745adf0 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 -- 172.21.15.177:0/1684631373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0745adf0 msgr2=0x563c0745d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 --2- 172.21.15.177:0/1684631373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0745adf0 0x563c0745d2b0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7ff6e800a470 tx=0x7ff6e801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 -- 172.21.15.177:0/1684631373 shutdown_connections 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 --2- 172.21.15.177:0/1684631373 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0745adf0 0x563c0745d2b0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 -- 172.21.15.177:0/1684631373 >> 172.21.15.177:0/1684631373 conn(0x563c07451040 msgr2=0x563c07453460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 -- 172.21.15.177:0/1684631373 shutdown_connections 2024-03-20T13:35:10.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.717+0000 7ff703f42800 1 -- 172.21.15.177:0/1684631373 wait complete. 2024-03-20T13:35:10.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.728+0000 7ff703f42800 1 Processor -- start 2024-03-20T13:35:10.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.728+0000 7ff703f42800 1 -- start start 2024-03-20T13:35:10.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.729+0000 7ff703f42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07546a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.729+0000 7ff703f42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c07355a30 con 0x563c073c9e80 2024-03-20T13:35:10.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.729+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07546a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.729+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07546a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57092/0 (socket says 172.21.15.177:57092) 2024-03-20T13:35:10.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.729+0000 7ff6ffc44640 1 -- 172.21.15.177:0/233453456 learned_addr learned my addr 172.21.15.177:0/233453456 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.729+0000 7ff6ffc44640 1 -- 172.21.15.177:0/233453456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e8005d20 con 0x563c073c9e80 2024-03-20T13:35:10.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.730+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/233453456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07546a60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001c50 tx=0x7ff6f000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f98d00774bb584 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.730+0000 7ff5ede0b640 1 -- 172.21.15.177:0/233453456 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f000e470 con 0x563c073c9e80 2024-03-20T13:35:10.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.730+0000 7ff5ede0b640 1 -- 172.21.15.177:0/233453456 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f000e5d0 con 0x563c073c9e80 2024-03-20T13:35:10.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.730+0000 7ff5ede0b640 1 -- 172.21.15.177:0/233453456 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f000e8d0 con 0x563c073c9e80 2024-03-20T13:35:10.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- 172.21.15.177:0/233453456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 msgr2=0x563c07546a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 --2- 172.21.15.177:0/233453456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07546a60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001c50 tx=0x7ff6f000b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- 172.21.15.177:0/233453456 shutdown_connections 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 --2- 172.21.15.177:0/233453456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07546a60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- 172.21.15.177:0/233453456 >> 172.21.15.177:0/233453456 conn(0x563c07451040 msgr2=0x563c07542380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- 172.21.15.177:0/233453456 shutdown_connections 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- 172.21.15.177:0/233453456 wait complete. 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 Processor -- start 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- start start 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07456fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.731+0000 7ff703f42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c07351210 con 0x563c073c9e80 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07456fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07456fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57094/0 (socket says 172.21.15.177:57094) 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff6ffc44640 1 -- 172.21.15.177:0/2195884203 learned_addr learned my addr 172.21.15.177:0/2195884203 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff6ffc44640 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c073a1cd0 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07456fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001c50 tx=0x7ff6f0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff5e7fff640 1 -- 172.21.15.177:0/2195884203 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f001f070 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c074556c0 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff5e7fff640 1 -- 172.21.15.177:0/2195884203 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0018850 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff5e7fff640 1 -- 172.21.15.177:0/2195884203 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0018af0 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.732+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c07455ba0 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.733+0000 7ff5e7fff640 1 -- 172.21.15.177:0/2195884203 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff6f0018c50 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.733+0000 7ff5e7fff640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5e8036790 0x7ff5e8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.733+0000 7ff5e7fff640 1 -- 172.21.15.177:0/2195884203 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff6f004c540 con 0x563c073c9e80 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.733+0000 7ff6f7443640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5e8036790 0x7ff5e8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0745adf0 0x563c07557470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075579b0 con 0x563c0745adf0 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff700445640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0745adf0 0x563c07557470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff6f7443640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5e8036790 0x7ff5e8038c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8054000 tx=0x7ff6e804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff700445640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0745adf0 0x563c07557470 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff700445640 1 -- 172.21.15.177:0/2195884203 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0745adf0 2024-03-20T13:35:10.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.734+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07557d10 con 0x563c0745adf0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff700445640 1 -- 172.21.15.177:0/2195884203 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0745adf0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075597d0 0x563c0755bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0755c3d0 con 0x563c075597d0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075597d0 0x563c0755bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075597d0 0x563c0755bc40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff6ffc44640 1 -- 172.21.15.177:0/2195884203 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff6f0014070 con 0x563c075597d0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.735+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07558510 con 0x563c0745adf0 2024-03-20T13:35:10.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.736+0000 7ff700445640 1 -- 172.21.15.177:0/2195884203 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0745adf0 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.736+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563c0755d7f0 0x563c0755fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.736+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07560370 con 0x563c0755d7f0 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.736+0000 7ff6f7443640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563c0755d7f0 0x563c0755fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.736+0000 7ff6f7443640 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563c0755d7f0 0x563c0755fbe0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.736+0000 7ff6f7443640 1 -- 172.21.15.177:0/2195884203 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff6e8059040 con 0x563c0755d7f0 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff703f42800 1 Processor -- start 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff703f42800 1 -- start start 2024-03-20T13:35:10.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff703f42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 0x563c0756e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff703f42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c072f3c70 con 0x563c0756e470 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 0x563c0756e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 0x563c0756e890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57100/0 (socket says 172.21.15.177:57100) 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff6ffc44640 1 -- 172.21.15.177:0/2576095839 learned_addr learned my addr 172.21.15.177:0/2576095839 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.737+0000 7ff6ffc44640 1 -- 172.21.15.177:0/2576095839 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0756edd0 con 0x563c0756e470 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.738+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 0x563c0756e890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6f004a7f0 tx=0x7ff6f002cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.738+0000 7ff5e57fa640 1 -- 172.21.15.177:0/2576095839 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f00233c0 con 0x563c0756e470 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.738+0000 7ff5e57fa640 1 -- 172.21.15.177:0/2576095839 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0023520 con 0x563c0756e470 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.738+0000 7ff5e57fa640 1 -- 172.21.15.177:0/2576095839 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f00237e0 con 0x563c0756e470 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.738+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c0756f840 con 0x563c0756e470 2024-03-20T13:35:10.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.738+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c0756f840 con 0x563c0756e470 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff5e57fa640 1 -- 172.21.15.177:0/2576095839 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff6f0044160 con 0x563c0756e470 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff5e57fa640 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5d8036790 0x7ff5d8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff5e57fa640 1 -- 172.21.15.177:0/2576095839 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff6f004b000 con 0x563c0756e470 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff6f7443640 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5d8036790 0x7ff5d8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff703f42800 1 Processor -- start 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff703f42800 1 -- start start 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff6f7443640 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5d8036790 0x7ff5d8038c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x563c07456160 tx=0x7ff6e8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff703f42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c0757b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.739+0000 7ff703f42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c072c95d0 con 0x563c0757b390 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c0757b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c0757b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57108/0 (socket says 172.21.15.177:57108) 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff6ffc44640 1 -- 172.21.15.177:0/4126752323 learned_addr learned my addr 172.21.15.177:0/4126752323 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff6ffc44640 1 -- 172.21.15.177:0/4126752323 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0757bd80 con 0x563c0757b390 2024-03-20T13:35:10.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/4126752323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c0757b7b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6f004ff20 tx=0x7ff6f00447e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d924f778b32562 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff5deffd640 1 -- 172.21.15.177:0/4126752323 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0037e30 con 0x563c0757b390 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff5deffd640 1 -- 172.21.15.177:0/4126752323 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f00448c0 con 0x563c0757b390 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.740+0000 7ff5deffd640 1 -- 172.21.15.177:0/4126752323 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f002d3f0 con 0x563c0757b390 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- 172.21.15.177:0/4126752323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 msgr2=0x563c0757b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 --2- 172.21.15.177:0/4126752323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c0757b7b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff6f004ff20 tx=0x7ff6f00447e0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- 172.21.15.177:0/4126752323 shutdown_connections 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 --2- 172.21.15.177:0/4126752323 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c0757b7b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- 172.21.15.177:0/4126752323 >> 172.21.15.177:0/4126752323 conn(0x563c07577660 msgr2=0x563c075756c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- 172.21.15.177:0/4126752323 shutdown_connections 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- 172.21.15.177:0/4126752323 wait complete. 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 Processor -- start 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- start start 2024-03-20T13:35:10.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c07582320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.741+0000 7ff703f42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c07582860 con 0x563c0757b390 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.742+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c07582320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.742+0000 7ff6ffc44640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c07582320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57110/0 (socket says 172.21.15.177:57110) 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.742+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 learned_addr learned my addr 172.21.15.177:0/800369017 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.742+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c0756edd0 con 0x563c0757b390 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.742+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c07582320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0018f70 tx=0x7ff6f004feb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.743+0000 7ff5dd7fa640 1 -- 172.21.15.177:0/800369017 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f0044a30 con 0x563c0757b390 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.743+0000 7ff5dd7fa640 1 -- 172.21.15.177:0/800369017 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f004c820 con 0x563c0757b390 2024-03-20T13:35:10.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.743+0000 7ff5dd7fa640 1 -- 172.21.15.177:0/800369017 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff6f004cae0 con 0x563c0757b390 2024-03-20T13:35:10.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.743+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563c0756edd0 con 0x563c0757b390 2024-03-20T13:35:10.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.743+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c0756edd0 con 0x563c0757b390 2024-03-20T13:35:10.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff5dd7fa640 1 -- 172.21.15.177:0/800369017 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff6f006a020 con 0x563c0757b390 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff5dd7fa640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5c8036790 0x7ff5c8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff5dd7fa640 1 -- 172.21.15.177:0/800369017 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff6f006ec60 con 0x563c0757b390 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff6f7443640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5c8036790 0x7ff5c8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0758dba0 0x563c07590040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07590790 con 0x563c0758dba0 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.744+0000 7ff700445640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0758dba0 0x563c07590040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff6f7443640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5c8036790 0x7ff5c8038c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8000c00 tx=0x7ff6e804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff700445640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0758dba0 0x563c07590040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 realm 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07590b60 con 0x563c0758dba0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07591710 con 0x563c0758dba0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.745+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075920c0 0x563c075944b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07594a30 con 0x563c075920c0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075920c0 0x563c075944b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075920c0 0x563c075944b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff703f42800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff703f42800 20 searching for the correct realm 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563c075969d0 0x563c07598e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07599560 con 0x563c075969d0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.746+0000 7ff6f7443640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563c075969d0 0x563c07598e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.747+0000 7ff6f7443640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563c075969d0 0x563c07598e90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.747+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.747+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07599560 con 0x563c075920c0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.747+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.747+0000 7ff6ffc44640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff6f0063070 0x7ff6f0058660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.747+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07599560 con 0x7ff6f0063070 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.748+0000 7ff700445640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff6f0063070 0x7ff6f0058660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.748+0000 7ff700445640 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff6f0063070 0x7ff6f0058660 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.748+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.748+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.749+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.749+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.749+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.749+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.749+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.749+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.750+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.750+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075920c0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.750+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.750+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.750+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.750+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075920c0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.751+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.752+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.753+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.754+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.754+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075920c0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.754+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.754+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.754+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.754+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.755+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.755+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c075969d0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.755+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.755+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x7ff6f0063070 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.755+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff6f8031040 con 0x563c075920c0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff6f8031040 con 0x563c075969d0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff6f8031040 con 0x7ff6f0063070 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.756+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff6f8031040 con 0x563c0758dba0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff6f8031040 con 0x563c075920c0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075913b0 con 0x563c0758dba0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07595300 con 0x563c0758dba0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.757+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07595300 con 0x7ff6f0063070 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 20 zone default found 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 4 Realm: () 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 20 zonegroup default 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07595bd0 con 0x7ff6f0063070 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.758+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c07595bd0 con 0x563c075969d0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759b380 con 0x563c075969d0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 20 started sync module instance, tier type = 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.759+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759ac60 con 0x563c075920c0 2024-03-20T13:35:10.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.760+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.760+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94815821342656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759b010 con 0x563c075920c0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.760+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759c190 con 0x563c0758dba0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.761+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94815821342656] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.761+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.761+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94815821348080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759c5b0 con 0x563c0758dba0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.762+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759cf20 con 0x563c075969d0 2024-03-20T13:35:10.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.763+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94815821348080] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.763+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.763+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94815821349136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759c530 con 0x563c075969d0 2024-03-20T13:35:10.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.763+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759dd30 con 0x563c075920c0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.764+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.764+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94815821355632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759e490 con 0x563c075920c0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.764+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759ef60 con 0x563c0758dba0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.765+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94815821355632] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.765+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94815821349136] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.767+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.767+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94815821359680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759ef20 con 0x563c0758dba0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.767+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759f7b0 con 0x7ff6f0063070 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.768+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94815821359680] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.769+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.769+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94815821353600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759f3c0 con 0x7ff6f0063070 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.769+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759fe40 con 0x7ff6f0063070 2024-03-20T13:35:10.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.772+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.772+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94815821363520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a02e0 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.772+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94815821353600] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.772+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759ef40 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'42 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94815821367440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759ef40 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=0 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=1 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=2 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=3 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=4 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=5 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94815821363520] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.773+0000 7ff703f42800 20 add_watcher() i=6 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.774+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94815821367440] v30'43 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.774+0000 7ff703f42800 20 add_watcher() i=7 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.774+0000 7ff703f42800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.774+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759fed0 con 0x563c0758dba0 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.774+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.774+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94815821368496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a1620 con 0x563c0758dba0 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.775+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94815821368496] v30'62 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.775+0000 7ff5b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.775+0000 7ff703f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.775+0000 7ff703f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff703f42800 5 note: GC not initialized 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff5b4fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff703f42800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:10.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff703f42800 20 Filter name: none 2024-03-20T13:35:10.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff52e7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:10.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff703f42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075d5790 con 0x563c0758dba0 2024-03-20T13:35:10.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.776+0000 7ff703f42800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:10.784 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:10.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.777+0000 7ff5b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.777+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94815821368496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a35a0 con 0x563c0758dba0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.778+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94815821368496] v30'63 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.778+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94815821342656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a0cb0 con 0x563c075920c0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.779+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94815821342656] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.779+0000 7ff703f42800 20 remove_watcher() i=0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.779+0000 7ff703f42800 2 removed watcher, disabling cache 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.779+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94815821348080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a0cb0 con 0x563c0758dba0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.781+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94815821348080] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.781+0000 7ff703f42800 20 remove_watcher() i=1 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.781+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94815821349136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759bcf0 con 0x563c075969d0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.782+0000 7ff6f7443640 1 -- 172.21.15.177:0/800369017 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94815821349136] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6e8059040 con 0x563c075969d0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.782+0000 7ff703f42800 20 remove_watcher() i=2 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.782+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94815821355632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a0cb0 con 0x563c075920c0 2024-03-20T13:35:10.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.783+0000 7ff6ffc44640 1 -- 172.21.15.177:0/800369017 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94815821355632] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f003d020 con 0x563c075920c0 2024-03-20T13:35:10.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.783+0000 7ff703f42800 20 remove_watcher() i=3 2024-03-20T13:35:10.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.783+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94815821359680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759da70 con 0x563c0758dba0 2024-03-20T13:35:10.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.784+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94815821359680] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x563c0758dba0 2024-03-20T13:35:10.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.784+0000 7ff703f42800 20 remove_watcher() i=4 2024-03-20T13:35:10.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.784+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94815821353600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a0cb0 con 0x7ff6f0063070 2024-03-20T13:35:10.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.786+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94815821353600] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.786+0000 7ff703f42800 20 remove_watcher() i=5 2024-03-20T13:35:10.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.786+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94815821363520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c0759da70 con 0x7ff6f0063070 2024-03-20T13:35:10.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.787+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94815821363520] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.787+0000 7ff703f42800 20 remove_watcher() i=6 2024-03-20T13:35:10.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.787+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94815821367440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563c075a0cb0 con 0x7ff6f0063070 2024-03-20T13:35:10.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94815821367440] v30'44 uv42 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff6f800a4a0 con 0x7ff6f0063070 2024-03-20T13:35:10.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 20 remove_watcher() i=7 2024-03-20T13:35:10.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff6f0063070 msgr2=0x7ff6f0058660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff6f0063070 0x7ff6f0058660 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0758dba0 msgr2=0x563c07590040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0758dba0 0x563c07590040 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075920c0 msgr2=0x563c075944b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075920c0 0x563c075944b0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563c075969d0 msgr2=0x563c07598e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563c075969d0 0x563c07598e90 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.788+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5c8036790 msgr2=0x7ff5c8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5c8036790 0x7ff5c8038c50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8000c00 tx=0x7ff6e804f000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 msgr2=0x563c07582320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/800369017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0757b390 0x563c07582320 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0018f70 tx=0x7ff6f004feb0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 reap_dead start 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff700445640 1 -- 172.21.15.177:0/800369017 reap_dead start 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 shutdown_connections 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 >> 172.21.15.177:0/800369017 conn(0x563c07577660 msgr2=0x563c07574cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 shutdown_connections 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/800369017 wait complete. 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5d8036790 msgr2=0x7ff5d8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5d8036790 0x7ff5d8038c50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x563c07456160 tx=0x7ff6e8005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 msgr2=0x563c0756e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 0x563c0756e890 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff6f004a7f0 tx=0x7ff6f002cd70 comp rx=0 tx=0).stop 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 shutdown_connections 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5d8036790 0x7ff5d8038c50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2576095839 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c0756e470 0x563c0756e890 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 >> 172.21.15.177:0/2576095839 conn(0x563c07562510 msgr2=0x563c07562910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 shutdown_connections 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2576095839 wait complete. 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563c0755d7f0 msgr2=0x563c0755fbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563c0755d7f0 0x563c0755fbe0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0745adf0 msgr2=0x563c07557470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563c0745adf0 0x563c07557470 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075597d0 msgr2=0x563c0755bc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563c075597d0 0x563c0755bc40 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5e8036790 msgr2=0x7ff5e8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff5e8036790 0x7ff5e8038c50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff6e8054000 tx=0x7ff6e804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 msgr2=0x563c07456fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff703f42800 1 --2- 172.21.15.177:0/2195884203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563c073c9e80 0x563c07456fd0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7ff6f0001c50 tx=0x7ff6f0000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.789+0000 7ff700445640 1 -- 172.21.15.177:0/2195884203 reap_dead start 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.790+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 shutdown_connections 2024-03-20T13:35:10.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.790+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 >> 172.21.15.177:0/2195884203 conn(0x563c07451040 msgr2=0x563c07540c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.790+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 shutdown_connections 2024-03-20T13:35:10.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.790+0000 7ff703f42800 1 -- 172.21.15.177:0/2195884203 wait complete. 2024-03-20T13:35:10.799 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:10.799 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-03-20T13:35:10.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-03-20T13:35:10.799 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-03-20T13:35:10.887 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:10.887 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:10.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.886+0000 7fee6dc10800 1 Processor -- start 2024-03-20T13:35:10.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.886+0000 7fee6dc10800 1 -- start start 2024-03-20T13:35:10.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.886+0000 7fee6dc10800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f37824ee90 0x55f378251280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.886+0000 7fee6dc10800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f378196d70 con 0x55f37824aa00 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.886+0000 7fee6dc10800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f37814d500 con 0x55f37824ee90 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee69296640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55f37824aa00 0x55f37824ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36882/0 (socket says 172.21.15.177:36882) 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee69296640 1 -- 172.21.15.177:0/2248967236 learned_addr learned my addr 172.21.15.177:0/2248967236 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1868214706 0 0) 0x55f378196d70 con 0x55f37824aa00 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee54001e10 con 0x55f37824aa00 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1979436167 0 0) 0x7fee54001e10 con 0x55f37824aa00 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 >> v2:172.21.15.28:3300/0 conn(0x55f37824ee90 msgr2=0x55f378251280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 --2- 172.21.15.177:0/2248967236 >> v2:172.21.15.28:3300/0 conn(0x55f37824ee90 0x55f378251280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3782528b0 con 0x55f37824aa00 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7fee5c0015a0 con 0x55f37824aa00 2024-03-20T13:35:10.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 >> v1:172.21.15.28:6789/0 conn(0x55f37824aa00 legacy=0x55f37824ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.887+0000 7fee5bfff640 1 --2- 172.21.15.177:0/2248967236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee54002260 0x7fee54002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.888+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37814d500 con 0x7fee54002260 2024-03-20T13:35:10.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.888+0000 7fee69296640 1 --2- 172.21.15.177:0/2248967236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee54002260 0x7fee54002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.889+0000 7fee69296640 1 -- 172.21.15.177:0/2248967236 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54001e10 con 0x7fee54002260 2024-03-20T13:35:10.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.891+0000 7fee69296640 1 --2- 172.21.15.177:0/2248967236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee54002260 0x7fee54002660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0099c0 tx=0x7fee5c01d6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fcb49b617a2bd1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c04ba60 con 0x7fee54002260 2024-03-20T13:35:10.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c04bbc0 con 0x7fee54002260 2024-03-20T13:35:10.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee5bfff640 1 -- 172.21.15.177:0/2248967236 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c04bea0 con 0x7fee54002260 2024-03-20T13:35:10.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 -- 172.21.15.177:0/2248967236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee54002260 msgr2=0x7fee54002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 --2- 172.21.15.177:0/2248967236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee54002260 0x7fee54002660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fee5c0099c0 tx=0x7fee5c01d6d0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 -- 172.21.15.177:0/2248967236 shutdown_connections 2024-03-20T13:35:10.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 --2- 172.21.15.177:0/2248967236 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fee54002260 0x7fee54002660 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 --2- 172.21.15.177:0/2248967236 >> v2:172.21.15.28:3300/0 conn(0x55f37824ee90 0x55f378251280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 -- 172.21.15.177:0/2248967236 >> 172.21.15.177:0/2248967236 conn(0x55f378246060 msgr2=0x55f378248480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 -- 172.21.15.177:0/2248967236 shutdown_connections 2024-03-20T13:35:10.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.892+0000 7fee6dc10800 1 -- 172.21.15.177:0/2248967236 wait complete. 2024-03-20T13:35:10.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.904+0000 7fee6dc10800 1 Processor -- start 2024-03-20T13:35:10.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.904+0000 7fee6dc10800 1 -- start start 2024-03-20T13:35:10.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.904+0000 7fee6dc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f37833a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.904+0000 7fee6dc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f37814aa30 con 0x55f37824aa00 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f37833a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f37833a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57138/0 (socket says 172.21.15.177:57138) 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fee69296640 1 -- 172.21.15.177:0/3023227721 learned_addr learned my addr 172.21.15.177:0/3023227721 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fee69296640 1 -- 172.21.15.177:0/3023227721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f37833ab30 con 0x55f37824aa00 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fee69296640 1 --2- 172.21.15.177:0/3023227721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f37833a560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee5c01de00 tx=0x7fee5c04d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d795c433f4b4c0a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fed57606640 1 -- 172.21.15.177:0/3023227721 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c04ba60 con 0x55f37824aa00 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fed57606640 1 -- 172.21.15.177:0/3023227721 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c001430 con 0x55f37824aa00 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.905+0000 7fed57606640 1 -- 172.21.15.177:0/3023227721 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c05f480 con 0x55f37824aa00 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 -- 172.21.15.177:0/3023227721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 msgr2=0x55f37833a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 --2- 172.21.15.177:0/3023227721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f37833a560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fee5c01de00 tx=0x7fee5c04d000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 -- 172.21.15.177:0/3023227721 shutdown_connections 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 --2- 172.21.15.177:0/3023227721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f37833a560 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 -- 172.21.15.177:0/3023227721 >> 172.21.15.177:0/3023227721 conn(0x55f378246060 msgr2=0x55f378335e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 -- 172.21.15.177:0/3023227721 shutdown_connections 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 -- 172.21.15.177:0/3023227721 wait complete. 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 Processor -- start 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.906+0000 7fee6dc10800 1 -- start start 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee6dc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f3781bed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee6dc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378146210 con 0x55f37824aa00 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f3781bed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f3781bed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57150/0 (socket says 172.21.15.177:57150) 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee69296640 1 -- 172.21.15.177:0/1897307136 learned_addr learned my addr 172.21.15.177:0/1897307136 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee69296640 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee54001e10 con 0x55f37824aa00 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee69296640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f3781bed10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001ed0 tx=0x7fee540040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fed55e03640 1 -- 172.21.15.177:0/1897307136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c05fe90 con 0x55f37824aa00 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fed55e03640 1 -- 172.21.15.177:0/1897307136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c05f480 con 0x55f37824aa00 2024-03-20T13:35:10.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.907+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f378345970 con 0x55f37824aa00 2024-03-20T13:35:10.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.908+0000 7fed55e03640 1 -- 172.21.15.177:0/1897307136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c04ba60 con 0x55f37824aa00 2024-03-20T13:35:10.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.908+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f378345eb0 con 0x55f37824aa00 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.908+0000 7fed55e03640 1 -- 172.21.15.177:0/1897307136 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fee5c071020 con 0x55f37824aa00 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.908+0000 7fed55e03640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed50036790 0x7fed50038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fed55e03640 1 -- 172.21.15.177:0/1897307136 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fee5c08f0f0 con 0x55f37824aa00 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee68a95640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed50036790 0x7fed50038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f37824ee90 0x55f378349a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37834a010 con 0x55f37824ee90 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee69a97640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f37824ee90 0x55f378349a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee68a95640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed50036790 0x7fed50038c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee60008530 tx=0x7fee60005600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee69a97640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f37824ee90 0x55f378349a40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee69a97640 1 -- 172.21.15.177:0/1897307136 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f37824ee90 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.909+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378346fe0 con 0x55f37824ee90 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee69a97640 1 -- 172.21.15.177:0/1897307136 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f37824ee90 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fee54002260 0x55f37834e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37834e8d0 con 0x7fee54002260 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee69296640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fee54002260 0x55f37834e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee69296640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fee54002260 0x55f37834e230 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee69296640 1 -- 172.21.15.177:0/1897307136 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fee5c065020 con 0x7fee54002260 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.910+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37834b1a0 con 0x55f37824ee90 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.911+0000 7fee69a97640 1 -- 172.21.15.177:0/1897307136 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f37824ee90 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.911+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f37834fcf0 0x55f3783520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.911+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378352840 con 0x55f37834fcf0 2024-03-20T13:35:10.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.911+0000 7fee68a95640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f37834fcf0 0x55f3783520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.911+0000 7fee68a95640 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f37834fcf0 0x55f3783520e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.912+0000 7fee68a95640 1 -- 172.21.15.177:0/1897307136 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fee60014190 con 0x55f37834fcf0 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.912+0000 7fee6dc10800 1 Processor -- start 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.912+0000 7fee6dc10800 1 -- start start 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee6dc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 0x55f378341970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee6dc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3780e8c70 con 0x55f378343500 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 0x55f378341970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 0x55f378341970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57160/0 (socket says 172.21.15.177:57160) 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee69296640 1 -- 172.21.15.177:0/1001019208 learned_addr learned my addr 172.21.15.177:0/1001019208 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee69296640 1 -- 172.21.15.177:0/1001019208 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f378341eb0 con 0x55f378343500 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee69296640 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 0x55f378341970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06b010 tx=0x7fee5c06ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fed4effd640 1 -- 172.21.15.177:0/1001019208 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c085030 con 0x55f378343500 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fed4effd640 1 -- 172.21.15.177:0/1001019208 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c068790 con 0x55f378343500 2024-03-20T13:35:10.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f378342100 con 0x55f378343500 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.913+0000 7fed4effd640 1 -- 172.21.15.177:0/1001019208 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c068a30 con 0x55f378343500 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.914+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3783425c0 con 0x55f378343500 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.914+0000 7fed4effd640 1 -- 172.21.15.177:0/1001019208 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fee5c08d870 con 0x55f378343500 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.914+0000 7fed4effd640 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed40036740 0x7fed40038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.914+0000 7fed4effd640 1 -- 172.21.15.177:0/1001019208 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fee5c086070 con 0x55f378343500 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.914+0000 7fee68a95640 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed40036740 0x7fed40038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee6dc10800 1 Processor -- start 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee6dc10800 1 -- start start 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee68a95640 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed40036740 0x7fed40038c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55f378346f40 tx=0x7fee6000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee6dc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378370130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee6dc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3780be5d0 con 0x55f37836fd30 2024-03-20T13:35:10.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378370130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378370130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57170/0 (socket says 172.21.15.177:57170) 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee69296640 1 -- 172.21.15.177:0/920522438 learned_addr learned my addr 172.21.15.177:0/920522438 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee69296640 1 -- 172.21.15.177:0/920522438 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f378370700 con 0x55f37836fd30 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.915+0000 7fee69296640 1 --2- 172.21.15.177:0/920522438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378370130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee5c066660 tx=0x7fee5c0663d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c4dfacd95e2483c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fed4cff9640 1 -- 172.21.15.177:0/920522438 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c0a6070 con 0x55f37836fd30 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fed4cff9640 1 -- 172.21.15.177:0/920522438 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c074420 con 0x55f37836fd30 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fed4cff9640 1 -- 172.21.15.177:0/920522438 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c090d20 con 0x55f37836fd30 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 -- 172.21.15.177:0/920522438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 msgr2=0x55f378370130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 --2- 172.21.15.177:0/920522438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378370130 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fee5c066660 tx=0x7fee5c0663d0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 -- 172.21.15.177:0/920522438 shutdown_connections 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 --2- 172.21.15.177:0/920522438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378370130 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 -- 172.21.15.177:0/920522438 >> 172.21.15.177:0/920522438 conn(0x55f37836c000 msgr2=0x55f37836a060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 -- 172.21.15.177:0/920522438 shutdown_connections 2024-03-20T13:35:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 -- 172.21.15.177:0/920522438 wait complete. 2024-03-20T13:35:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 Processor -- start 2024-03-20T13:35:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.916+0000 7fee6dc10800 1 -- start start 2024-03-20T13:35:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.917+0000 7fee6dc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378376b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.917+0000 7fee6dc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f378377060 con 0x55f37836fd30 2024-03-20T13:35:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.919+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378376b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.919+0000 7fee69296640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378376b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57172/0 (socket says 172.21.15.177:57172) 2024-03-20T13:35:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.919+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 learned_addr learned my addr 172.21.15.177:0/136387220 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.921+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f378342100 con 0x55f37836fd30 2024-03-20T13:35:10.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.922+0000 7fee69296640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378376b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee5c068e10 tx=0x7fee5c069eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.923+0000 7fed3effd640 1 -- 172.21.15.177:0/136387220 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c0b2070 con 0x55f37836fd30 2024-03-20T13:35:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.924+0000 7fed3effd640 1 -- 172.21.15.177:0/136387220 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee5c093d00 con 0x55f37836fd30 2024-03-20T13:35:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.924+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f378342100 con 0x55f37836fd30 2024-03-20T13:35:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.924+0000 7fed3effd640 1 -- 172.21.15.177:0/136387220 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fee5c093e70 con 0x55f37836fd30 2024-03-20T13:35:10.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.924+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f378342100 con 0x55f37836fd30 2024-03-20T13:35:10.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.925+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.926+0000 7fed3effd640 1 -- 172.21.15.177:0/136387220 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fee5c04eac0 con 0x55f37836fd30 2024-03-20T13:35:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fed3effd640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed34036830 0x7fed34038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fed3effd640 1 -- 172.21.15.177:0/136387220 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fee5c0b7c50 con 0x55f37836fd30 2024-03-20T13:35:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee68a95640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed34036830 0x7fed34038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f378382210 0x55f3783846d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378384e20 con 0x55f378382210 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee69a97640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f378382210 0x55f3783846d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee68a95640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed34036830 0x7fed34038cf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee60014fd0 tx=0x7fee60002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee69a97640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f378382210 0x55f3783846d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee6dc10800 20 realm 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.927+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783851f0 con 0x55f378382210 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:10.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385da0 con 0x55f378382210 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f378386750 0x55f378388b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378389190 con 0x55f378386750 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee69296640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f378386750 0x55f378388b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.928+0000 7fee69296640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f378386750 0x55f378388b40 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee6dc10800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee6dc10800 20 searching for the correct realm 2024-03-20T13:35:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f37838b440 0x55f37838d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838dfd0 con 0x55f37838b440 2024-03-20T13:35:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee68a95640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f37838b440 0x55f37838d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee68a95640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f37838b440 0x55f37838d900 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.929+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.930+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838dfd0 con 0x55f378386750 2024-03-20T13:35:10.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.930+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.930+0000 7fee69296640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee5c0b6030 0x7fee5c090470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:10.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.930+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838dfd0 con 0x7fee5c0b6030 2024-03-20T13:35:10.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.930+0000 7fee69a97640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee5c0b6030 0x7fee5c090470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:10.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.933+0000 7fee69a97640 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee5c0b6030 0x7fee5c090470 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:10.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.934+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.934+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.934+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.934+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.934+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.934+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.935+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.935+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378386750 2024-03-20T13:35:10.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.936+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.937+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.937+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.937+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.937+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378386750 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.938+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.938+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.938+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.938+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.938+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.938+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.939+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.939+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.939+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.939+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.939+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.939+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.940+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.940+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.940+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.940+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.940+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378386750 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.941+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.942+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.942+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f37838b440 2024-03-20T13:35:10.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.942+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.942+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x7fee5c0b6030 2024-03-20T13:35:10.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.942+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.942+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fee64031040 con 0x55f378386750 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fee64031040 con 0x55f37838b440 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fee64031040 con 0x7fee5c0b6030 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fee64031040 con 0x55f378382210 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.943+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fee64031040 con 0x55f378386750 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:10.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378385a40 con 0x55f378382210 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378389840 con 0x55f378382210 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.944+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378389840 con 0x7fee5c0b6030 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 20 zone default found 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 4 Realm: () 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 20 zonegroup default 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838a150 con 0x7fee5c0b6030 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838a150 con 0x55f37838b440 2024-03-20T13:35:10.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.945+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838fdf0 con 0x55f37838b440 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 20 started sync module instance, tier type = 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.946+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838f6d0 con 0x55f378386750 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.947+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.947+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94504182411824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838fa80 con 0x55f378386750 2024-03-20T13:35:10.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.947+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378390a90 con 0x55f378382210 2024-03-20T13:35:10.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.948+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94504182411824] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.948+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.948+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94504182415696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378390b30 con 0x55f378382210 2024-03-20T13:35:10.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.948+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783915e0 con 0x55f37838b440 2024-03-20T13:35:10.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.950+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.950+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94504182419680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378391e60 con 0x55f37838b440 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.950+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378392930 con 0x55f378386750 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.950+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94504182415696] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.951+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.951+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94504182424592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378392ce0 con 0x55f378386750 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.951+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783936d0 con 0x55f378382210 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.951+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94504182419680] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.952+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.952+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94504182428080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378393690 con 0x55f378382210 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.952+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378394190 con 0x7fee5c0b6030 2024-03-20T13:35:10.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.952+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94504182424592] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.953+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94504182428080] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.954+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.954+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94504182421952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378394190 con 0x7fee5c0b6030 2024-03-20T13:35:10.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.954+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783949e0 con 0x7fee5c0b6030 2024-03-20T13:35:10.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.957+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94504182421952] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.957+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.957+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94504182430928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378394190 con 0x7fee5c0b6030 2024-03-20T13:35:10.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.957+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378394ff0 con 0x7fee5c0b6030 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'45 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94504182430928] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94504182434640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378394f70 con 0x7fee5c0b6030 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=0 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=1 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=2 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=3 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=4 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=5 2024-03-20T13:35:10.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.958+0000 7fee6dc10800 20 add_watcher() i=6 2024-03-20T13:35:10.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.960+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94504182434640] v30'46 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.960+0000 7fee6dc10800 20 add_watcher() i=7 2024-03-20T13:35:10.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.960+0000 7fee6dc10800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:10.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.960+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378398470 con 0x55f378382210 2024-03-20T13:35:10.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.960+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.960+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94504182432944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378395950 con 0x55f378382210 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94504182432944] v30'64 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fed1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fee6dc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fee6dc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fee6dc10800 5 note: GC not initialized 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fed1e7e4640 20 reqs_thread_entry: start 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.961+0000 7fee6dc10800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 20 Filter name: none 2024-03-20T13:35:10.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fec8ffff640 20 reqs_thread_entry: start 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783ca440 con 0x55f378382210 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783ca940 con 0x7fee5c0b6030 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.962+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.963+0000 7fee6dc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:10.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.963+0000 7fee6dc10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:35:10.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.963+0000 7fee6dc10800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:10.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.963+0000 7fee6dc10800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:35:10.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.963+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~459 in=459b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783d02c0 con 0x55f378382210 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~459] v30'4 uv4 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee6dc10800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee6dc10800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee6dc10800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94504182676928 in=647b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783cbdf0 con 0x55f378382210 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94504182428080 notify 128849018883 ret 0) v3 ==== 677+0+0 (crc 0 0 0) 0x7fee6403d040 con 0x55f378382210 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fed4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94504182428080 notifier 4331 bl.length()=635 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(65 notify.4 [notify cookie 94504182676928 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fed4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fed4cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fed4cff9640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fed2c003e90 con 0x55f378382210 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94504182676928 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fee64018e60 con 0x55f378382210 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.964+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783cfdc0 con 0x7fee5c0b6030 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee6dc10800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee6dc10800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee6dc10800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94504182676928 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783cbe70 con 0x55f37838b440 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== watch-notify(notify (1) cookie 94504182419680 notify 128849018880 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fee60032070 con 0x55f37838b440 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fed4cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018880 cookie 94504182419680 notifier 4331 bl.length()=177 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fed4cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:35:10.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fed4cff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:10.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fed4cff9640 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fed2c003e90 con 0x55f37838b440 2024-03-20T13:35:10.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.966+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(68 notify.2 [notify cookie 94504182676928 out=8b] v0'0 uv45 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.967+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== watch-notify(notify_complete (2) cookie 94504182676928 notify 128849018880 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fee6002c9f0 con 0x55f37838b440 2024-03-20T13:35:10.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.967+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.970 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.967+0000 7fed1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.967+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94504182432944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783cf530 con 0x55f378382210 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.968+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94504182432944] v30'65 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.968+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94504182411824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f378394470 con 0x55f378386750 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.969+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94504182411824] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.969+0000 7fee6dc10800 20 remove_watcher() i=0 2024-03-20T13:35:10.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.969+0000 7fee6dc10800 2 removed watcher, disabling cache 2024-03-20T13:35:10.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.969+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94504182415696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838f230 con 0x55f378382210 2024-03-20T13:35:10.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.971+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94504182415696] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.971+0000 7fee6dc10800 20 remove_watcher() i=1 2024-03-20T13:35:10.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.971+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94504182419680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838f230 con 0x55f37838b440 2024-03-20T13:35:10.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.972+0000 7fee68a95640 1 -- 172.21.15.177:0/136387220 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94504182419680] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee60014190 con 0x55f37838b440 2024-03-20T13:35:10.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.972+0000 7fee6dc10800 20 remove_watcher() i=2 2024-03-20T13:35:10.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.972+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94504182424592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838f230 con 0x55f378386750 2024-03-20T13:35:10.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.973+0000 7fee69296640 1 -- 172.21.15.177:0/136387220 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94504182424592] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee5c065020 con 0x55f378386750 2024-03-20T13:35:10.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.973+0000 7fee6dc10800 20 remove_watcher() i=3 2024-03-20T13:35:10.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.973+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94504182428080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838f230 con 0x55f378382210 2024-03-20T13:35:10.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.974+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94504182428080] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x55f378382210 2024-03-20T13:35:10.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.974+0000 7fee6dc10800 20 remove_watcher() i=4 2024-03-20T13:35:10.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.974+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94504182421952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783931b0 con 0x7fee5c0b6030 2024-03-20T13:35:10.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.976+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94504182421952] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.976+0000 7fee6dc10800 20 remove_watcher() i=5 2024-03-20T13:35:10.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.976+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94504182430928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f37838f230 con 0x7fee5c0b6030 2024-03-20T13:35:10.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.978+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94504182430928] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.978+0000 7fee6dc10800 20 remove_watcher() i=6 2024-03-20T13:35:10.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.978+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94504182434640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3783919c0 con 0x7fee5c0b6030 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94504182434640] v30'47 uv45 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fee6400a4a0 con 0x7fee5c0b6030 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 20 remove_watcher() i=7 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee5c0b6030 msgr2=0x7fee5c090470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fee5c0b6030 0x7fee5c090470 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f378382210 msgr2=0x55f3783846d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f378382210 0x55f3783846d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f378386750 msgr2=0x55f378388b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f378386750 0x55f378388b40 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f37838b440 msgr2=0x55f37838d900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f37838b440 0x55f37838d900 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed34036830 msgr2=0x7fed34038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed34036830 0x7fed34038cf0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fee60014fd0 tx=0x7fee60002000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 msgr2=0x55f378376b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 --2- 172.21.15.177:0/136387220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37836fd30 0x55f378376b20 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fee5c068e10 tx=0x7fee5c069eb0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 reap_dead start 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee69a97640 1 -- 172.21.15.177:0/136387220 reap_dead start 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 shutdown_connections 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 >> 172.21.15.177:0/136387220 conn(0x55f37836c000 msgr2=0x55f378369660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 shutdown_connections 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.980+0000 7fee6dc10800 1 -- 172.21.15.177:0/136387220 wait complete. 2024-03-20T13:35:10.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed40036740 msgr2=0x7fed40038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed40036740 0x7fed40038c00 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x55f378346f40 tx=0x7fee6000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 msgr2=0x55f378341970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 0x55f378341970 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fee5c06b010 tx=0x7fee5c06ad30 comp rx=0 tx=0).stop 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 shutdown_connections 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed40036740 0x7fed40038c00 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1001019208 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f378343500 0x55f378341970 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 >> 172.21.15.177:0/1001019208 conn(0x55f378354ae0 msgr2=0x55f378354ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 shutdown_connections 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1001019208 wait complete. 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f37834fcf0 msgr2=0x55f3783520e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f37834fcf0 0x55f3783520e0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f37824ee90 msgr2=0x55f378349a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f37824ee90 0x55f378349a40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fee54002260 msgr2=0x55f37834e230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fee54002260 0x55f37834e230 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed50036790 msgr2=0x7fed50038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fed50036790 0x7fed50038c50 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fee60008530 tx=0x7fee60005600 comp rx=0 tx=0).stop 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 msgr2=0x55f3781bed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 --2- 172.21.15.177:0/1897307136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f37824aa00 0x55f3781bed10 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fee5c001ed0 tx=0x7fee540040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee69a97640 1 -- 172.21.15.177:0/1897307136 reap_dead start 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 shutdown_connections 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 >> 172.21.15.177:0/1897307136 conn(0x55f378246060 msgr2=0x55f3783347a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 shutdown_connections 2024-03-20T13:35:10.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:10.981+0000 7fee6dc10800 1 -- 172.21.15.177:0/1897307136 wait complete. 2024-03-20T13:35:10.990 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:10.991 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.991 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:10.991 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f626432f800 1 Processor -- start 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f626432f800 1 -- start start 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f626432f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x562b75e8a9e0 0x562b75e8ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f626432f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562b75dd6cd0 con 0x562b75e8bc40 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f626432f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x562b75d8d500 con 0x562b75e8a9e0 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f625ffb3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x562b75e8a9e0 0x562b75e8ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f625ffb3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x562b75e8a9e0 0x562b75e8ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57180/0 (socket says 172.21.15.177:57180) 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f625f7b2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x562b75e8bc40 0x562b75e8c0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36892/0 (socket says 172.21.15.177:36892) 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.033+0000 7f625ffb3640 1 -- 172.21.15.177:0/1993377333 learned_addr learned my addr 172.21.15.177:0/1993377333 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.034+0000 7f625ffb3640 1 -- 172.21.15.177:0/1993377333 >> v1:172.21.15.28:6789/0 conn(0x562b75e8bc40 legacy=0x562b75e8c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.034+0000 7f625ffb3640 1 -- 172.21.15.177:0/1993377333 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b75e8b4d0 con 0x562b75e8a9e0 2024-03-20T13:35:11.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.034+0000 7f625efb1640 1 -- 172.21.15.177:0/1993377333 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128471439 0 0) 0x562b75dd6cd0 con 0x562b75e8bc40 2024-03-20T13:35:11.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.035+0000 7f625ffb3640 1 --2- 172.21.15.177:0/1993377333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75e8ae00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f625000a520 tx=0x7f625001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d603a87fbc54591 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f625efb1640 1 -- 172.21.15.177:0/1993377333 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6250052570 con 0x562b75e8a9e0 2024-03-20T13:35:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f625efb1640 1 -- 172.21.15.177:0/1993377333 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62500526d0 con 0x562b75e8a9e0 2024-03-20T13:35:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f625efb1640 1 -- 172.21.15.177:0/1993377333 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6250052990 con 0x562b75e8a9e0 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 -- 172.21.15.177:0/1993377333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 msgr2=0x562b75e8ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 --2- 172.21.15.177:0/1993377333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75e8ae00 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f625000a520 tx=0x7f625001cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 -- 172.21.15.177:0/1993377333 shutdown_connections 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 --2- 172.21.15.177:0/1993377333 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75e8ae00 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 -- 172.21.15.177:0/1993377333 >> 172.21.15.177:0/1993377333 conn(0x562b75e86040 msgr2=0x562b75e88460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 -- 172.21.15.177:0/1993377333 shutdown_connections 2024-03-20T13:35:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.036+0000 7f626432f800 1 -- 172.21.15.177:0/1993377333 wait complete. 2024-03-20T13:35:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f626432f800 1 Processor -- start 2024-03-20T13:35:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f626432f800 1 -- start start 2024-03-20T13:35:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f626432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75dfecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f626432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b75d8aa30 con 0x562b75e8a9e0 2024-03-20T13:35:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75dfecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75dfecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57188/0 (socket says 172.21.15.177:57188) 2024-03-20T13:35:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.048+0000 7f625ffb3640 1 -- 172.21.15.177:0/862618035 learned_addr learned my addr 172.21.15.177:0/862618035 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.049+0000 7f625ffb3640 1 -- 172.21.15.177:0/862618035 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250005de0 con 0x562b75e8a9e0 2024-03-20T13:35:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.049+0000 7f625ffb3640 1 --2- 172.21.15.177:0/862618035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75dfecb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6250055040 tx=0x7f625004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdacbb39d7c0303a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.049+0000 7f614de0b640 1 -- 172.21.15.177:0/862618035 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6250052570 con 0x562b75e8a9e0 2024-03-20T13:35:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.049+0000 7f614de0b640 1 -- 172.21.15.177:0/862618035 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6250052840 con 0x562b75e8a9e0 2024-03-20T13:35:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.049+0000 7f614de0b640 1 -- 172.21.15.177:0/862618035 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6250052b20 con 0x562b75e8a9e0 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- 172.21.15.177:0/862618035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 msgr2=0x562b75dfecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 --2- 172.21.15.177:0/862618035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75dfecb0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6250055040 tx=0x7f625004c000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- 172.21.15.177:0/862618035 shutdown_connections 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 --2- 172.21.15.177:0/862618035 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75dfecb0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- 172.21.15.177:0/862618035 >> 172.21.15.177:0/862618035 conn(0x562b75e86040 msgr2=0x562b75f763f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- 172.21.15.177:0/862618035 shutdown_connections 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- 172.21.15.177:0/862618035 wait complete. 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 Processor -- start 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- start start 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75f830f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.050+0000 7f626432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b75d86210 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75f830f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75f830f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57196/0 (socket says 172.21.15.177:57196) 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f625ffb3640 1 -- 172.21.15.177:0/2126272051 learned_addr learned my addr 172.21.15.177:0/2126272051 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f625ffb3640 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f625004e070 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f625ffb3640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75f830f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f625005f040 tx=0x7f6250002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f6147fff640 1 -- 172.21.15.177:0/2126272051 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f625005d480 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b75f83630 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f6147fff640 1 -- 172.21.15.177:0/2126272051 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625006e070 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.051+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b75f83b70 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.052+0000 7f6147fff640 1 -- 172.21.15.177:0/2126272051 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f625005d710 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.052+0000 7f6147fff640 1 -- 172.21.15.177:0/2126272051 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6250070030 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.052+0000 7f6147fff640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6148036790 0x7f6148038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.052+0000 7f6147fff640 1 -- 172.21.15.177:0/2126272051 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f625008e2c0 con 0x562b75e8a9e0 2024-03-20T13:35:11.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.052+0000 7f625f7b2640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6148036790 0x7f6148038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75e8bc40 0x562b75f89d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75f8a290 con 0x562b75e8bc40 2024-03-20T13:35:11.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f62607b4640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75e8bc40 0x562b75f89d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f625f7b2640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6148036790 0x7f6148038c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6254000c00 tx=0x7f62540013b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f62607b4640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75e8bc40 0x562b75f89d50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f62607b4640 1 -- 172.21.15.177:0/2126272051 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75e8bc40 2024-03-20T13:35:11.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75f87450 con 0x562b75e8bc40 2024-03-20T13:35:11.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.053+0000 7f62607b4640 1 -- 172.21.15.177:0/2126272051 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75e8bc40 2024-03-20T13:35:11.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75f8c4f0 0x562b75f8e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75f8efb0 con 0x562b75f8c4f0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f625ffb3640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75f8c4f0 0x562b75f8e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f625ffb3640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75f8c4f0 0x562b75f8e8e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f625ffb3640 1 -- 172.21.15.177:0/2126272051 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f625008e050 con 0x562b75f8c4f0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75f8b470 con 0x562b75e8bc40 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f62607b4640 1 -- 172.21.15.177:0/2126272051 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75e8bc40 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562b75f903d0 0x562b75f927c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.054+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75f92eb0 con 0x562b75f903d0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.055+0000 7f625f7b2640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562b75f903d0 0x562b75f927c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.055+0000 7f625f7b2640 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562b75f903d0 0x562b75f927c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.056+0000 7f625f7b2640 1 -- 172.21.15.177:0/2126272051 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f625400bde0 con 0x562b75f903d0 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.056+0000 7f626432f800 1 Processor -- start 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.056+0000 7f626432f800 1 -- start start 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.056+0000 7f626432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 0x562b75f7a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f626432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b75d28c70 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 0x562b75f7a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 0x562b75f7a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57198/0 (socket says 172.21.15.177:57198) 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f625ffb3640 1 -- 172.21.15.177:0/1270611565 learned_addr learned my addr 172.21.15.177:0/1270611565 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f625ffb3640 1 -- 172.21.15.177:0/1270611565 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b75f7ae40 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f625ffb3640 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 0x562b75f7a900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f625008c7b0 tx=0x7f625005d9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f61457fa640 1 -- 172.21.15.177:0/1270611565 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f625007c6e0 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f61457fa640 1 -- 172.21.15.177:0/1270611565 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625007c840 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b75f7b030 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f61457fa640 1 -- 172.21.15.177:0/1270611565 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f625008c280 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.057+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b75f7b030 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.058+0000 7f61457fa640 1 -- 172.21.15.177:0/1270611565 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6250059040 con 0x562b75f7c490 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.058+0000 7f61457fa640 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6138036790 0x7f6138038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.058+0000 7f61457fa640 1 -- 172.21.15.177:0/1270611565 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6250098c80 con 0x562b75f7c490 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.058+0000 7f625f7b2640 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6138036790 0x7f6138038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.059+0000 7f626432f800 1 Processor -- start 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.059+0000 7f626432f800 1 -- start start 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.059+0000 7f625f7b2640 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6138036790 0x7f6138038c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x562b75f877d0 tx=0x7f6254006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.059+0000 7f626432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.059+0000 7f626432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b75cfe5d0 con 0x562b75fb0110 2024-03-20T13:35:11.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.060+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.060+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57202/0 (socket says 172.21.15.177:57202) 2024-03-20T13:35:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.060+0000 7f625ffb3640 1 -- 172.21.15.177:0/287099700 learned_addr learned my addr 172.21.15.177:0/287099700 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.062+0000 7f625ffb3640 1 -- 172.21.15.177:0/287099700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b75fb0b00 con 0x562b75fb0110 2024-03-20T13:35:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.063+0000 7f625ffb3640 1 --2- 172.21.15.177:0/287099700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb0530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6250073f50 tx=0x7f625005ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a195a0ba468256b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f613effd640 1 -- 172.21.15.177:0/287099700 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6250006380 con 0x562b75fb0110 2024-03-20T13:35:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f613effd640 1 -- 172.21.15.177:0/287099700 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625008ee30 con 0x562b75fb0110 2024-03-20T13:35:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f613effd640 1 -- 172.21.15.177:0/287099700 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6250068a30 con 0x562b75fb0110 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 -- 172.21.15.177:0/287099700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 msgr2=0x562b75fb0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 --2- 172.21.15.177:0/287099700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb0530 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6250073f50 tx=0x7f625005ca00 comp rx=0 tx=0).stop 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 -- 172.21.15.177:0/287099700 shutdown_connections 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 --2- 172.21.15.177:0/287099700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb0530 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 -- 172.21.15.177:0/287099700 >> 172.21.15.177:0/287099700 conn(0x562b75fac420 msgr2=0x562b75faa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 -- 172.21.15.177:0/287099700 shutdown_connections 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.064+0000 7f626432f800 1 -- 172.21.15.177:0/287099700 wait complete. 2024-03-20T13:35:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f626432f800 1 Processor -- start 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f626432f800 1 -- start start 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f626432f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f626432f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b75fb75d0 con 0x562b75fb0110 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f625ffb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57206/0 (socket says 172.21.15.177:57206) 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 learned_addr learned my addr 172.21.15.177:0/1213311209 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.065+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6250081040 con 0x562b75fb0110 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.066+0000 7f625ffb3640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb7090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6250068420 tx=0x7f625005afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.066+0000 7f613d7fa640 1 -- 172.21.15.177:0/1213311209 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f625005cc40 con 0x562b75fb0110 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.066+0000 7f613d7fa640 1 -- 172.21.15.177:0/1213311209 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f625005cda0 con 0x562b75fb0110 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.066+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562b75fb77d0 con 0x562b75fb0110 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.066+0000 7f613d7fa640 1 -- 172.21.15.177:0/1213311209 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f625008e6d0 con 0x562b75fb0110 2024-03-20T13:35:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.066+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b75fb77d0 con 0x562b75fb0110 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f613d7fa640 1 -- 172.21.15.177:0/1213311209 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f62500b2050 con 0x562b75fb0110 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f613d7fa640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6128036790 0x7f6128038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f613d7fa640 1 -- 172.21.15.177:0/1213311209 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f62500a6040 con 0x562b75fb0110 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f625f7b2640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6128036790 0x7f6128038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75fc29c0 0x562b75fc4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc55b0 con 0x562b75fc29c0 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.067+0000 7f62607b4640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75fc29c0 0x562b75fc4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f625f7b2640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6128036790 0x7f6128038c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x562b75f93270 tx=0x7f6254023040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f62607b4640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75fc29c0 0x562b75fc4e60 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 realm 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc5980 con 0x562b75fc29c0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.068+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6560 con 0x562b75fc29c0 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75fc6f10 0x562b75fc9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc9840 con 0x562b75fc6f10 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f625ffb3640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75fc6f10 0x562b75fc9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f625ffb3640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75fc6f10 0x562b75fc9300 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f62500bd070 con 0x562b75fc6f10 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 20 searching for the correct realm 2024-03-20T13:35:11.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562b75fcb800 0x562b75fcdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fce390 con 0x562b75fcb800 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.069+0000 7f625f7b2640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562b75fcb800 0x562b75fcdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.070+0000 7f625f7b2640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562b75fcb800 0x562b75fcdcc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.070+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.070+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fce390 con 0x562b75fc6f10 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.070+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62500bd070 con 0x562b75fc6f10 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.070+0000 7f625ffb3640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f62500c0020 0x7f62500c5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.070+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fce390 con 0x7f62500c0020 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.071+0000 7f62607b4640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f62500c0020 0x7f62500c5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.071+0000 7f62607b4640 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f62500c0020 0x7f62500c5a20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.071+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.071+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.071+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.071+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc6f10 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62500bd070 con 0x562b75fc6f10 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.072+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.073+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc6f10 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f62500bd070 con 0x562b75fc6f10 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.074+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.075+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc6f10 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.076+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fcb800 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x7f62500c0020 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6258031040 con 0x562b75fc6f10 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.077+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6258031040 con 0x562b75fcb800 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6258031040 con 0x7f62500c0020 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6258031040 con 0x562b75fc29c0 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6258031040 con 0x562b75fc6f10 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f626432f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f626432f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:11.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f626432f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f626432f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f626432f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.078+0000 7f626432f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fc6200 con 0x562b75fc29c0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fca100 con 0x562b75fc29c0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.079+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fca100 con 0x7f62500c0020 2024-03-20T13:35:11.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 20 zone default found 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 4 Realm: () 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 20 zonegroup default 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fca9d0 con 0x7f62500c0020 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.080+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fca9d0 con 0x562b75fcb800 2024-03-20T13:35:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd01b0 con 0x562b75fcb800 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 20 started sync module instance, tier type = 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.081+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fcfa90 con 0x562b75fc6f10 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.082+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.082+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94744663094768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fcfe40 con 0x562b75fc6f10 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.082+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd0fc0 con 0x562b75fc29c0 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.083+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94744663094768] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.083+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.083+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94744663100192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd13e0 con 0x562b75fc29c0 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.083+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd1d50 con 0x562b75fcb800 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.084+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94744663100192] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.084+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.085+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94744663101248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd1360 con 0x562b75fcb800 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.085+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd2bb0 con 0x562b75fc6f10 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.086+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.086+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94744663109392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd37d0 con 0x562b75fc6f10 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.086+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd41c0 con 0x562b75fc29c0 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.086+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94744663101248] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.087+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94744663109392] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.087+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.087+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94744663110448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd2100 con 0x562b75fc29c0 2024-03-20T13:35:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.087+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd4b80 con 0x7f62500c0020 2024-03-20T13:35:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.088+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.088+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94744663110448] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.088+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94744663115488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd4fa0 con 0x7f62500c0020 2024-03-20T13:35:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.088+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5470 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.089+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94744663115488] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.089+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.089+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94744663112864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5650 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.089+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5e50 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94744663112864] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'48 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94744663119440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5f10 con 0x7f62500c0020 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=0 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=1 2024-03-20T13:35:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=2 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=3 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=4 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=5 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.090+0000 7f626432f800 20 add_watcher() i=6 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.091+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94744663119440] v30'49 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.091+0000 7f626432f800 20 add_watcher() i=7 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.091+0000 7f626432f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.091+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd91d0 con 0x562b75fc29c0 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.091+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.091+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94744663120864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd64a0 con 0x562b75fc29c0 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.092+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94744663120864] v30'66 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.092+0000 7f6115fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:11.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 5 note: GC not initialized 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f6114fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 20 Filter name: none 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f608e7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.093+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b7600acb0 con 0x562b75fc29c0 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.094+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.094+0000 7f626432f800 20 rados_obj.operate() r=0 bl.length=459 2024-03-20T13:35:11.101 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.094+0000 7f6115fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.094+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94744663120864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd85f0 con 0x562b75fc29c0 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.095+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94744663120864] v30'67 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.095+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94744663094768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5be0 con 0x562b75fc6f10 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.096+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94744663094768] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.096+0000 7f626432f800 20 remove_watcher() i=0 2024-03-20T13:35:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.096+0000 7f626432f800 2 removed watcher, disabling cache 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.096+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94744663100192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5be0 con 0x562b75fc29c0 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.097+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94744663100192] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.097+0000 7f626432f800 20 remove_watcher() i=1 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.097+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94744663101248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd0b20 con 0x562b75fcb800 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.099+0000 7f625f7b2640 1 -- 172.21.15.177:0/1213311209 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94744663101248] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6254033040 con 0x562b75fcb800 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.099+0000 7f626432f800 20 remove_watcher() i=2 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.099+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94744663109392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5be0 con 0x562b75fc6f10 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.100+0000 7f625ffb3640 1 -- 172.21.15.177:0/1213311209 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94744663109392] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f62500d3080 con 0x562b75fc6f10 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.100+0000 7f626432f800 20 remove_watcher() i=3 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.100+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94744663110448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd2f10 con 0x562b75fc29c0 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.101+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94744663110448] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x562b75fc29c0 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.101+0000 7f626432f800 20 remove_watcher() i=4 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.101+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94744663115488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5be0 con 0x7f62500c0020 2024-03-20T13:35:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.102+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94744663115488] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.102+0000 7f626432f800 20 remove_watcher() i=5 2024-03-20T13:35:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.102+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94744663112864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd46e0 con 0x7f62500c0020 2024-03-20T13:35:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.103+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94744663112864] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.103+0000 7f626432f800 20 remove_watcher() i=6 2024-03-20T13:35:11.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.103+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94744663119440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562b75fd5be0 con 0x7f62500c0020 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94744663119440] v30'50 uv48 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f625800a4a0 con 0x7f62500c0020 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 20 remove_watcher() i=7 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f62500c0020 msgr2=0x7f62500c5a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f62500c0020 0x7f62500c5a20 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75fc29c0 msgr2=0x562b75fc4e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75fc29c0 0x562b75fc4e60 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75fc6f10 msgr2=0x562b75fc9300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75fc6f10 0x562b75fc9300 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562b75fcb800 msgr2=0x562b75fcdcc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.104+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562b75fcb800 0x562b75fcdcc0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6128036790 msgr2=0x7f6128038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6128036790 0x7f6128038c50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x562b75f93270 tx=0x7f6254023040 comp rx=0 tx=0).stop 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 msgr2=0x562b75fb7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f62607b4640 1 -- 172.21.15.177:0/1213311209 reap_dead start 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb7090 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6250068420 tx=0x7f625005afd0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 shutdown_connections 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1213311209 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75fb0110 0x562b75fb7090 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 >> 172.21.15.177:0/1213311209 conn(0x562b75fac420 msgr2=0x562b75faa450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 shutdown_connections 2024-03-20T13:35:11.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1213311209 wait complete. 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6138036790 msgr2=0x7f6138038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6138036790 0x7f6138038c50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x562b75f877d0 tx=0x7f6254006000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 msgr2=0x562b75f7a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 0x562b75f7a900 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f625008c7b0 tx=0x7f625005d9b0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 shutdown_connections 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6138036790 0x7f6138038c50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/1270611565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75f7c490 0x562b75f7a900 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 >> 172.21.15.177:0/1270611565 conn(0x562b75f95150 msgr2=0x562b75f95550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 shutdown_connections 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/1270611565 wait complete. 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562b75f903d0 msgr2=0x562b75f927c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562b75f903d0 0x562b75f927c0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75e8bc40 msgr2=0x562b75f89d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562b75e8bc40 0x562b75f89d50 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75f8c4f0 msgr2=0x562b75f8e8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.105+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562b75f8c4f0 0x562b75f8e8e0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6148036790 msgr2=0x7f6148038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6148036790 0x7f6148038c50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f6254000c00 tx=0x7f62540013b0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 msgr2=0x562b75f830f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 --2- 172.21.15.177:0/2126272051 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562b75e8a9e0 0x562b75f830f0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f625005f040 tx=0x7f6250002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f62607b4640 1 -- 172.21.15.177:0/2126272051 reap_dead start 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 shutdown_connections 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 >> 172.21.15.177:0/2126272051 conn(0x562b75e86040 msgr2=0x562b75f74c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 shutdown_connections 2024-03-20T13:35:11.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.106+0000 7f626432f800 1 -- 172.21.15.177:0/2126272051 wait complete. 2024-03-20T13:35:11.115 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:11.115 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-03-20T13:35:11.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-03-20T13:35:11.115 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-03-20T13:35:11.200 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:11.200 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.199+0000 7fa8bfb22800 1 Processor -- start 2024-03-20T13:35:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.199+0000 7fa8bfb22800 1 -- start start 2024-03-20T13:35:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.199+0000 7fa8bfb22800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x557863d04e70 0x557863d07260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.200+0000 7fa8bfb22800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557863c4ccd0 con 0x557863d009e0 2024-03-20T13:35:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.200+0000 7fa8bfb22800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x557863c03500 con 0x557863d04e70 2024-03-20T13:35:11.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.200+0000 7fa8b30b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x557863d04e70 0x557863d07260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.200+0000 7fa8b30b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x557863d04e70 0x557863d07260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57212/0 (socket says 172.21.15.177:57212) 2024-03-20T13:35:11.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.200+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1296528279 learned_addr learned my addr 172.21.15.177:0/1296528279 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.200+0000 7fa8bb8b7640 1 --1- 172.21.15.177:0/1296528279 >> v1:172.21.15.28:6789/0 conn(0x557863d009e0 0x557863d00e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36904/0 (socket says 172.21.15.177:36904) 2024-03-20T13:35:11.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.201+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1296528279 >> v1:172.21.15.28:6789/0 conn(0x557863d009e0 legacy=0x557863d00e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.201+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1296528279 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557863d08890 con 0x557863d04e70 2024-03-20T13:35:11.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.201+0000 7fa8bb0b6640 1 -- 172.21.15.177:0/1296528279 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3748804021 0 0) 0x557863c4ccd0 con 0x557863d009e0 2024-03-20T13:35:11.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.205+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1296528279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d04e70 0x557863d07260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400a520 tx=0x7fa8a401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfec9d7fcf017d2e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.205+0000 7fa8bb0b6640 1 -- 172.21.15.177:0/1296528279 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a4052570 con 0x557863d04e70 2024-03-20T13:35:11.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.205+0000 7fa8bb0b6640 1 -- 172.21.15.177:0/1296528279 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a40526d0 con 0x557863d04e70 2024-03-20T13:35:11.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.205+0000 7fa8bb0b6640 1 -- 172.21.15.177:0/1296528279 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8a4052990 con 0x557863d04e70 2024-03-20T13:35:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1296528279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d04e70 msgr2=0x557863d07260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1296528279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d04e70 0x557863d07260 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fa8a400a520 tx=0x7fa8a401cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1296528279 shutdown_connections 2024-03-20T13:35:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1296528279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d04e70 0x557863d07260 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1296528279 >> 172.21.15.177:0/1296528279 conn(0x557863cfc040 msgr2=0x557863cfe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1296528279 shutdown_connections 2024-03-20T13:35:11.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.206+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1296528279 wait complete. 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.217+0000 7fa8bfb22800 1 Processor -- start 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bfb22800 1 -- start start 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bfb22800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863df3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bfb22800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557863c00a30 con 0x557863d009e0 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863df3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863df3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57216/0 (socket says 172.21.15.177:57216) 2024-03-20T13:35:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/3601562849 learned_addr learned my addr 172.21.15.177:0/3601562849 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.218+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/3601562849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a4005de0 con 0x557863d009e0 2024-03-20T13:35:11.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/3601562849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863df3b70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00b240 tx=0x7fa8ac00b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feb25786e25d050 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa7a9e0b640 1 -- 172.21.15.177:0/3601562849 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac014070 con 0x557863d009e0 2024-03-20T13:35:11.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa7a9e0b640 1 -- 172.21.15.177:0/3601562849 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00d500 con 0x557863d009e0 2024-03-20T13:35:11.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa7a9e0b640 1 -- 172.21.15.177:0/3601562849 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac00d820 con 0x557863d009e0 2024-03-20T13:35:11.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3601562849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 msgr2=0x557863df3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3601562849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863df3b70 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00b240 tx=0x7fa8ac00b700 comp rx=0 tx=0).stop 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3601562849 shutdown_connections 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3601562849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863df3b70 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3601562849 >> 172.21.15.177:0/3601562849 conn(0x557863cfc040 msgr2=0x557863deb080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3601562849 shutdown_connections 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.219+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3601562849 wait complete. 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.220+0000 7fa8bfb22800 1 Processor -- start 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.220+0000 7fa8bfb22800 1 -- start start 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.220+0000 7fa8bfb22800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863dfb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.220+0000 7fa8bfb22800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557863bfc210 con 0x557863d009e0 2024-03-20T13:35:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863dfb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863dfb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57230/0 (socket says 172.21.15.177:57230) 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1315652131 learned_addr learned my addr 172.21.15.177:0/1315652131 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac001ba0 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863dfb2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000f60 tx=0x7fa8ac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa7a3fff640 1 -- 172.21.15.177:0/1315652131 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac019870 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa7a3fff640 1 -- 172.21.15.177:0/1315652131 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac020070 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557863dfb7f0 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa7a3fff640 1 -- 172.21.15.177:0/1315652131 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac019b20 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.221+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557863dfbcd0 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.222+0000 7fa7a3fff640 1 -- 172.21.15.177:0/1315652131 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa8ac00d040 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.222+0000 7fa7a3fff640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7a4036790 0x7fa7a4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.222+0000 7fa7a3fff640 1 -- 172.21.15.177:0/1315652131 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa8ac00a040 con 0x557863d009e0 2024-03-20T13:35:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7a4036790 0x7fa7a4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863d04e70 0x557863e01f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e02530 con 0x557863d04e70 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8bc0b8640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863d04e70 0x557863e01f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7a4036790 0x7fa7a4038c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4054000 tx=0x7fa8a404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8bc0b8640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863d04e70 0x557863e01f60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1315652131 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863d04e70 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.223+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863dff6b0 con 0x557863d04e70 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1315652131 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863d04e70 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e047a0 0x557863e06b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e07280 con 0x557863e047a0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e047a0 0x557863e06b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e047a0 0x557863e06b90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1315652131 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e047a0 2024-03-20T13:35:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.224+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e03720 con 0x557863d04e70 2024-03-20T13:35:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.225+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1315652131 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863d04e70 2024-03-20T13:35:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.225+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557863e086a0 0x557863e0aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.225+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e0b1d0 con 0x557863e086a0 2024-03-20T13:35:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.225+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557863e086a0 0x557863e0aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.225+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557863e086a0 0x557863e0aa90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1315652131 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e086a0 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bfb22800 1 Processor -- start 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bfb22800 1 -- start start 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bfb22800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 0x557863e19720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bfb22800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557863b9ec70 con 0x557863e19300 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 0x557863e19720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 0x557863e19720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57240/0 (socket says 172.21.15.177:57240) 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/3259811203 learned_addr learned my addr 172.21.15.177:0/3259811203 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.226+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/3259811203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557863e19c60 con 0x557863e19300 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.227+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 0x557863e19720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00ffd0 tx=0x7fa8ac045e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.227+0000 7fa7a17fa640 1 -- 172.21.15.177:0/3259811203 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac018e10 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.227+0000 7fa7a17fa640 1 -- 172.21.15.177:0/3259811203 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac01bc60 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.227+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557863e1a6d0 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.227+0000 7fa7a17fa640 1 -- 172.21.15.177:0/3259811203 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac044320 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.227+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557863e1ab90 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa7a17fa640 1 -- 172.21.15.177:0/3259811203 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa8ac044480 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa7a17fa640 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa794036790 0x7fa794038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa7a17fa640 1 -- 172.21.15.177:0/3259811203 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa8ac040040 con 0x557863e19300 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa794036790 0x7fa794038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa8bfb22800 1 Processor -- start 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa8bfb22800 1 -- start start 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.228+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa794036790 0x7fa794038c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x557863dff5d0 tx=0x7fa8a4005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bfb22800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e268b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bfb22800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557863b745d0 con 0x557863e26490 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e268b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e268b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57256/0 (socket says 172.21.15.177:57256) 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/3400055360 learned_addr learned my addr 172.21.15.177:0/3400055360 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/3400055360 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557863e26e80 con 0x557863e26490 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/3400055360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e268b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00fb00 tx=0x7fa8ac0447f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a3e7abcaede9e9e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa79affd640 1 -- 172.21.15.177:0/3400055360 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac05c070 con 0x557863e26490 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa79affd640 1 -- 172.21.15.177:0/3400055360 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac030450 con 0x557863e26490 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.229+0000 7fa79affd640 1 -- 172.21.15.177:0/3400055360 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac030810 con 0x557863e26490 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3400055360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 msgr2=0x557863e268b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3400055360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e268b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00fb00 tx=0x7fa8ac0447f0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3400055360 shutdown_connections 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3400055360 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e268b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3400055360 >> 172.21.15.177:0/3400055360 conn(0x557863e22710 msgr2=0x557863e20770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3400055360 shutdown_connections 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3400055360 wait complete. 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 Processor -- start 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- start start 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e2d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.230+0000 7fa8bfb22800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557863e2d850 con 0x557863e26490 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.231+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e2d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.231+0000 7fa8bb8b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e2d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57258/0 (socket says 172.21.15.177:57258) 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.231+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 learned_addr learned my addr 172.21.15.177:0/1088631886 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8ac050020 con 0x557863e26490 2024-03-20T13:35:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e2d310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00fb00 tx=0x7fa8ac012f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa7997fa640 1 -- 172.21.15.177:0/1088631886 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac05c070 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa7997fa640 1 -- 172.21.15.177:0/1088631886 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac030810 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557863e2da50 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa7997fa640 1 -- 172.21.15.177:0/1088631886 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa8ac049730 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.232+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557863e2da50 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.233+0000 7fa7997fa640 1 -- 172.21.15.177:0/1088631886 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa8ac069020 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.233+0000 7fa7997fa640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7840366f0 0x7fa784038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.233+0000 7fa7997fa640 1 -- 172.21.15.177:0/1088631886 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa8ac06dc60 con 0x557863e26490 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.233+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7840366f0 0x7fa784038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.233+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863e38d60 0x557863e3b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3b970 con 0x557863e38d60 2024-03-20T13:35:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7840366f0 0x7fa784038bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4052fd0 tx=0x7fa8a404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bc0b8640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863e38d60 0x557863e3b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bc0b8640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863e38d60 0x557863e3b220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 20 realm 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3bd40 con 0x557863e38d60 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.234+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c920 con 0x557863e38d60 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e3d2d0 0x557863e3f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3fc80 con 0x557863e3d2d0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e3d2d0 0x557863e3f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e3d2d0 0x557863e3f6c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.235+0000 7fa8bfb22800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8bfb22800 20 searching for the correct realm 2024-03-20T13:35:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557863e41f70 0x557863e44430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e44b00 con 0x557863e41f70 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557863e41f70 0x557863e44430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8b30b6640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557863e41f70 0x557863e44430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.236+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e44b00 con 0x557863e3d2d0 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bb8b7640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa8ac027c50 0x7fa8ac0183d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e44b00 con 0x7fa8ac027c50 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bc0b8640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa8ac027c50 0x7fa8ac0183d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bc0b8640 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa8ac027c50 0x7fa8ac0183d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.237+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.238+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.238+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.238+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.238+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.238+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.238+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e3d2d0 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.239+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e3d2d0 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.240+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.241+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.242+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.242+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.242+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.242+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.242+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.242+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.243+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.243+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e3d2d0 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.243+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.243+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.243+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.243+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.244+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.244+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e41f70 2024-03-20T13:35:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.244+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.244+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x7fa8ac027c50 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.245+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.245+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa8b4031040 con 0x557863e3d2d0 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.245+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.245+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa8b4031040 con 0x557863e41f70 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.246+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.246+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa8b4031040 con 0x7fa8ac027c50 2024-03-20T13:35:11.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa8b4031040 con 0x557863e38d60 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa8b4031040 con 0x557863e3d2d0 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e3c5c0 con 0x557863e38d60 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.247+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e40370 con 0x557863e38d60 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e40370 con 0x7fa8ac027c50 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 zone default found 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 4 Realm: () 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:11.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 zonegroup default 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e40bf0 con 0x7fa8ac027c50 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e40ff0 con 0x557863e41f70 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.248+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e46920 con 0x557863e41f70 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 20 started sync module instance, tier type = 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.249+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e45db0 con 0x557863e3d2d0 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.250+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.250+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93975560348048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e45a20 con 0x557863e3d2d0 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.250+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e47600 con 0x557863e38d60 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.251+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93975560348048] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.251+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.251+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93975560350848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e479b0 con 0x557863e38d60 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.251+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e48400 con 0x557863e41f70 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.252+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93975560350848] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.253+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.253+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93975560355552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e487b0 con 0x557863e41f70 2024-03-20T13:35:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.253+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e491c0 con 0x557863e3d2d0 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.253+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.254+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93975560359040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e49a10 con 0x557863e3d2d0 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.254+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e4a4e0 con 0x557863e38d60 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.254+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93975560359040] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.255+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.255+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93975560363968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e49a10 con 0x557863e38d60 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.255+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e4af30 con 0x7fa8ac027c50 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.256+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93975560363968] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.257+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.257+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93975560366640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e49a10 con 0x7fa8ac027c50 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.257+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e4b950 con 0x7fa8ac027c50 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.258+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.258+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93975560369232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e4bdb0 con 0x7fa8ac027c50 2024-03-20T13:35:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.258+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e4c880 con 0x7fa8ac027c50 2024-03-20T13:35:11.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.258+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93975560366640] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.259+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93975560369232] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'51 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93975560373088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e4b910 con 0x7fa8ac027c50 2024-03-20T13:35:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=0 2024-03-20T13:35:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=1 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93975560355552] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=2 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=3 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=4 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=5 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.260+0000 7fa8bfb22800 20 add_watcher() i=6 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.262+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93975560373088] v30'52 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.262+0000 7fa8bfb22800 20 add_watcher() i=7 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.262+0000 7fa8bfb22800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.262+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e470a0 con 0x557863e38d60 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.262+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.262+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93975560361328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e470a0 con 0x557863e38d60 2024-03-20T13:35:11.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93975560361328] v30'68 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa8bfb22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa8bfb22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa8bfb22800 5 note: GC not initialized 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa770fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.263+0000 7fa8bfb22800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 20 Filter name: none 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa6ea7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e81150 con 0x557863e38d60 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~459 out=459b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+582 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 20 rados_obj.operate() r=0 bl.length=459 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.264+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e86f40 con 0x557863e38d60 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'5 uv5 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bfb22800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bfb22800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bfb22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93975560612448 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e83b10 con 0x557863e38d60 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 93975560363968 notify 128849018884 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fa8b403d040 con 0x557863e38d60 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa79affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 93975560363968 notifier 4345 bl.length()=533 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa79affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa79affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 93975560612448 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.265+0000 7fa79affd640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa780003e90 con 0x557863e38d60 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 93975560612448 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa8b4018dd0 con 0x557863e38d60 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8bfb22800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify cookie 93975560612448 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e83b10 con 0x557863e41f70 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== watch-notify(notify (1) cookie 93975560355552 notify 128849018881 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x557863d08890 con 0x557863e41f70 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa79affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018881 cookie 93975560355552 notifier 4345 bl.length()=170 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa79affd640 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa780003e90 con 0x557863e41f70 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(66 notify.2 [notify cookie 93975560612448 out=8b] v0'0 uv51 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.266+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(67 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.267+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== watch-notify(notify_complete (2) cookie 93975560612448 notify 128849018881 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa8a404e070 con 0x557863e41f70 2024-03-20T13:35:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.267+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:68 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e81650 con 0x7fa8ac027c50 2024-03-20T13:35:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.268+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(68 p5YnriCv1nAtykxBrupQ [delete] v30'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.274 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.269+0000 7fa771fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.269+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93975560361328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e35bc0 con 0x557863e38d60 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.270+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93975560361328] v30'69 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.270+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93975560348048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e49570 con 0x557863e3d2d0 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.270+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93975560348048] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.270+0000 7fa8bfb22800 20 remove_watcher() i=0 2024-03-20T13:35:11.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.270+0000 7fa8bfb22800 2 removed watcher, disabling cache 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.271+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93975560350848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e46190 con 0x557863e38d60 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.272+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93975560350848] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.272+0000 7fa8bfb22800 20 remove_watcher() i=1 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.272+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93975560355552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e46190 con 0x557863e41f70 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.273+0000 7fa8b30b6640 1 -- 172.21.15.177:0/1088631886 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93975560355552] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8a4052b40 con 0x557863e41f70 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.273+0000 7fa8bfb22800 20 remove_watcher() i=2 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.273+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93975560359040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e47ee0 con 0x557863e3d2d0 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.274+0000 7fa8bb8b7640 1 -- 172.21.15.177:0/1088631886 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93975560359040] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8ac016070 con 0x557863e3d2d0 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.274+0000 7fa8bfb22800 20 remove_watcher() i=3 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.274+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93975560363968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e46190 con 0x557863e38d60 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.275+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93975560363968] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x557863e38d60 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.275+0000 7fa8bfb22800 20 remove_watcher() i=4 2024-03-20T13:35:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.275+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93975560366640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e48c80 con 0x7fa8ac027c50 2024-03-20T13:35:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.276+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93975560366640] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.276+0000 7fa8bfb22800 20 remove_watcher() i=5 2024-03-20T13:35:11.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.276+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93975560369232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e47ee0 con 0x7fa8ac027c50 2024-03-20T13:35:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.277+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93975560369232] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.277+0000 7fa8bfb22800 20 remove_watcher() i=6 2024-03-20T13:35:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.277+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93975560373088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557863e46190 con 0x7fa8ac027c50 2024-03-20T13:35:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93975560373088] v30'53 uv51 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa8b400a4a0 con 0x7fa8ac027c50 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 20 remove_watcher() i=7 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa8ac027c50 msgr2=0x7fa8ac0183d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa8ac027c50 0x7fa8ac0183d0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863e38d60 msgr2=0x557863e3b220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863e38d60 0x557863e3b220 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e3d2d0 msgr2=0x557863e3f6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e3d2d0 0x557863e3f6c0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557863e41f70 msgr2=0x557863e44430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557863e41f70 0x557863e44430 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7840366f0 msgr2=0x7fa784038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7840366f0 0x7fa784038bb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4052fd0 tx=0x7fa8a404f000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 msgr2=0x557863e2d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1088631886 reap_dead start 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e2d310 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00fb00 tx=0x7fa8ac012f00 comp rx=0 tx=0).stop 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 shutdown_connections 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1088631886 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e26490 0x557863e2d310 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 >> 172.21.15.177:0/1088631886 conn(0x557863e22710 msgr2=0x557863e1fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 shutdown_connections 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.278+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1088631886 wait complete. 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa794036790 msgr2=0x7fa794038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa794036790 0x7fa794038c50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x557863dff5d0 tx=0x7fa8a4005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 msgr2=0x557863e19720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 0x557863e19720 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00ffd0 tx=0x7fa8ac045e60 comp rx=0 tx=0).stop 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 shutdown_connections 2024-03-20T13:35:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa794036790 0x7fa794038c50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/3259811203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863e19300 0x557863e19720 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 >> 172.21.15.177:0/3259811203 conn(0x557863e0d3a0 msgr2=0x557863e0d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 shutdown_connections 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/3259811203 wait complete. 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557863e086a0 msgr2=0x557863e0aa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557863e086a0 0x557863e0aa90 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863d04e70 msgr2=0x557863e01f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557863d04e70 0x557863e01f60 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e047a0 msgr2=0x557863e06b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557863e047a0 0x557863e06b90 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7a4036790 msgr2=0x7fa7a4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa7a4036790 0x7fa7a4038c50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa8a4054000 tx=0x7fa8a404e000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 msgr2=0x557863dfb2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 --2- 172.21.15.177:0/1315652131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557863d009e0 0x557863dfb2b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac000f60 tx=0x7fa8ac000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bc0b8640 1 -- 172.21.15.177:0/1315652131 reap_dead start 2024-03-20T13:35:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 shutdown_connections 2024-03-20T13:35:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 >> 172.21.15.177:0/1315652131 conn(0x557863cfc040 msgr2=0x557863de98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 shutdown_connections 2024-03-20T13:35:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.279+0000 7fa8bfb22800 1 -- 172.21.15.177:0/1315652131 wait complete. 2024-03-20T13:35:11.288 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:11.289 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-03-20T13:35:11.289 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-03-20T13:35:11.289 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-03-20T13:35:11.333 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:11.333 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:11.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c58b2f800 1 Processor -- start 2024-03-20T13:35:11.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c58b2f800 1 -- start start 2024-03-20T13:35:11.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c58b2f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55dfa3be3080 0x55dfa3be5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c58b2f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dfa3b29cd0 con 0x55dfa3bdf570 2024-03-20T13:35:11.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c58b2f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dfa3ae0500 con 0x55dfa3be3080 2024-03-20T13:35:11.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c4ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55dfa3be3080 0x55dfa3be5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c548c5640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55dfa3bdf570 0x55dfa3be1960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36912/0 (socket says 172.21.15.177:36912) 2024-03-20T13:35:11.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.333+0000 7f4c548c5640 1 -- 172.21.15.177:0/728085101 learned_addr learned my addr 172.21.15.177:0/728085101 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:11.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.334+0000 7f4c4f7fe640 1 -- 172.21.15.177:0/728085101 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2242640127 0 0) 0x55dfa3b29cd0 con 0x55dfa3bdf570 2024-03-20T13:35:11.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.334+0000 7f4c4f7fe640 1 -- 172.21.15.177:0/728085101 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c44001e10 con 0x55dfa3bdf570 2024-03-20T13:35:11.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.334+0000 7f4c4ffff640 1 -- 172.21.15.177:0/728085101 >> v1:172.21.15.28:6789/0 conn(0x55dfa3bdf570 legacy=0x55dfa3be1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.334+0000 7f4c4ffff640 1 -- 172.21.15.177:0/728085101 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfa3be69c0 con 0x55dfa3be3080 2024-03-20T13:35:11.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.335+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/728085101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3be3080 0x55dfa3be5470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a470 tx=0x7f4c4001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37b88509076acc0e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c4f7fe640 1 -- 172.21.15.177:0/728085101 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4004ad60 con 0x55dfa3be3080 2024-03-20T13:35:11.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c4f7fe640 1 -- 172.21.15.177:0/728085101 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c40052440 con 0x55dfa3be3080 2024-03-20T13:35:11.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c4f7fe640 1 -- 172.21.15.177:0/728085101 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c40052700 con 0x55dfa3be3080 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 -- 172.21.15.177:0/728085101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3be3080 msgr2=0x55dfa3be5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/728085101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3be3080 0x55dfa3be5470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f4c4000a470 tx=0x7f4c4001cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 -- 172.21.15.177:0/728085101 shutdown_connections 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/728085101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3be3080 0x55dfa3be5470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 -- 172.21.15.177:0/728085101 >> 172.21.15.177:0/728085101 conn(0x55dfa3bd9040 msgr2=0x55dfa3bdb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 -- 172.21.15.177:0/728085101 shutdown_connections 2024-03-20T13:35:11.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.336+0000 7f4c58b2f800 1 -- 172.21.15.177:0/728085101 wait complete. 2024-03-20T13:35:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.348+0000 7f4c58b2f800 1 Processor -- start 2024-03-20T13:35:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.348+0000 7f4c58b2f800 1 -- start start 2024-03-20T13:35:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.348+0000 7f4c58b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.348+0000 7f4c58b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfa3adda30 con 0x55dfa3bdf570 2024-03-20T13:35:11.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cce8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57270/0 (socket says 172.21.15.177:57270) 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4c548c5640 1 -- 172.21.15.177:0/3898322056 learned_addr learned my addr 172.21.15.177:0/3898322056 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4c548c5640 1 -- 172.21.15.177:0/3898322056 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c40005d20 con 0x55dfa3bdf570 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4c548c5640 1 --2- 172.21.15.177:0/3898322056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cce8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c48001c50 tx=0x7f4c4800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8062a94519258c2e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4b42e05640 1 -- 172.21.15.177:0/3898322056 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4800e470 con 0x55dfa3bdf570 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4b42e05640 1 -- 172.21.15.177:0/3898322056 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4800e5d0 con 0x55dfa3bdf570 2024-03-20T13:35:11.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.349+0000 7f4b42e05640 1 -- 172.21.15.177:0/3898322056 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4800e8b0 con 0x55dfa3bdf570 2024-03-20T13:35:11.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3898322056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 msgr2=0x55dfa3cce8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3898322056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cce8c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4c48001c50 tx=0x7f4c4800b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3898322056 shutdown_connections 2024-03-20T13:35:11.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3898322056 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cce8c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3898322056 >> 172.21.15.177:0/3898322056 conn(0x55dfa3bd9040 msgr2=0x55dfa3cca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3898322056 shutdown_connections 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.350+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3898322056 wait complete. 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c58b2f800 1 Processor -- start 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c58b2f800 1 -- start start 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c58b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cd5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c58b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfa3ad9210 con 0x55dfa3bdf570 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cd5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cd5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57274/0 (socket says 172.21.15.177:57274) 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c548c5640 1 -- 172.21.15.177:0/3982824342 learned_addr learned my addr 172.21.15.177:0/3982824342 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c548c5640 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44001e10 con 0x55dfa3bdf570 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.351+0000 7f4c548c5640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cd5fd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4c48000c00 tx=0x7f4c48000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.352+0000 7f4b41602640 1 -- 172.21.15.177:0/3982824342 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4801f070 con 0x55dfa3bdf570 2024-03-20T13:35:11.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.352+0000 7f4b41602640 1 -- 172.21.15.177:0/3982824342 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48018830 con 0x55dfa3bdf570 2024-03-20T13:35:11.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.352+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dfa3cd6510 con 0x55dfa3bdf570 2024-03-20T13:35:11.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.352+0000 7f4b41602640 1 -- 172.21.15.177:0/3982824342 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c48018ad0 con 0x55dfa3bdf570 2024-03-20T13:35:11.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.352+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfa3cd69f0 con 0x55dfa3bdf570 2024-03-20T13:35:11.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4b41602640 1 -- 172.21.15.177:0/3982824342 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4c48018c30 con 0x55dfa3bdf570 2024-03-20T13:35:11.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4b41602640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b3c0367e0 0x7f4b3c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4b41602640 1 -- 172.21.15.177:0/3982824342 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4c4804c370 con 0x55dfa3bdf570 2024-03-20T13:35:11.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b3c0367e0 0x7f4b3c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3be3080 0x55dfa3cdcc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3cdd240 con 0x55dfa3be3080 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4c550c6640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3be3080 0x55dfa3cdcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b3c0367e0 0x7f4b3c038ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c40054000 tx=0x7f4c4004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.353+0000 7f4c550c6640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3be3080 0x55dfa3cdcc70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c550c6640 1 -- 172.21.15.177:0/3982824342 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3be3080 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3cda360 con 0x55dfa3be3080 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c550c6640 1 -- 172.21.15.177:0/3982824342 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3be3080 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3cdf480 0x55dfa3ce1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3ce1f40 con 0x55dfa3cdf480 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c548c5640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3cdf480 0x55dfa3ce1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.354+0000 7f4c548c5640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3cdf480 0x55dfa3ce1870 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.355+0000 7f4c548c5640 1 -- 172.21.15.177:0/3982824342 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3cdf480 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.355+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3cde400 con 0x55dfa3be3080 2024-03-20T13:35:11.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.355+0000 7f4c550c6640 1 -- 172.21.15.177:0/3982824342 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3be3080 2024-03-20T13:35:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.355+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dfa3ce3340 0x55dfa3ce5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.355+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3ce5e90 con 0x55dfa3ce3340 2024-03-20T13:35:11.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.357+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dfa3ce3340 0x55dfa3ce5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.360+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dfa3ce3340 0x55dfa3ce5730 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.360+0000 7f4c4ffff640 1 -- 172.21.15.177:0/3982824342 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3ce3340 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c58b2f800 1 Processor -- start 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c58b2f800 1 -- start start 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c58b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 0x55dfa3bdd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c58b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfa3a7bc70 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 0x55dfa3bdd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 0x55dfa3bdd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57290/0 (socket says 172.21.15.177:57290) 2024-03-20T13:35:11.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.361+0000 7f4c548c5640 1 -- 172.21.15.177:0/2267549462 learned_addr learned my addr 172.21.15.177:0/2267549462 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4c548c5640 1 -- 172.21.15.177:0/2267549462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfa3bddaa0 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4c548c5640 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 0x55dfa3bdd560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c4804a780 tx=0x7f4c4804adc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4b3a7fc640 1 -- 172.21.15.177:0/2267549462 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c48022bc0 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4b3a7fc640 1 -- 172.21.15.177:0/2267549462 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48022d20 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dfa3bddc90 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4b3a7fc640 1 -- 172.21.15.177:0/2267549462 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4802d440 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.362+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfa3bddc90 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4b3a7fc640 1 -- 172.21.15.177:0/2267549462 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4c4802d5a0 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4b3a7fc640 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b2c036740 0x7f4b2c038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4b3a7fc640 1 -- 172.21.15.177:0/2267549462 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4c4804de10 con 0x55dfa3bdf0f0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b2c036740 0x7f4b2c038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c58b2f800 1 Processor -- start 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c58b2f800 1 -- start start 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b2c036740 0x7f4b2c038c00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55dfa3cda2a0 tx=0x7f4c40005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c58b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c58b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfa3a515d0 con 0x55dfa3d031c0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.363+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d035e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57300/0 (socket says 172.21.15.177:57300) 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.364+0000 7f4c548c5640 1 -- 172.21.15.177:0/1513441212 learned_addr learned my addr 172.21.15.177:0/1513441212 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.364+0000 7f4c548c5640 1 -- 172.21.15.177:0/1513441212 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dfa3d03bb0 con 0x55dfa3d031c0 2024-03-20T13:35:11.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.364+0000 7f4c548c5640 1 --2- 172.21.15.177:0/1513441212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d035e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4c4804dff0 tx=0x7f4c480244e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef0bc9302171310 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.364+0000 7f4b2bfff640 1 -- 172.21.15.177:0/1513441212 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c4802d850 con 0x55dfa3d031c0 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.364+0000 7f4b2bfff640 1 -- 172.21.15.177:0/1513441212 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c48024b70 con 0x55dfa3d031c0 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.364+0000 7f4b2bfff640 1 -- 172.21.15.177:0/1513441212 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c48043f90 con 0x55dfa3d031c0 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- 172.21.15.177:0/1513441212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 msgr2=0x55dfa3d035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/1513441212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d035e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4c4804dff0 tx=0x7f4c480244e0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- 172.21.15.177:0/1513441212 shutdown_connections 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/1513441212 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d035e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- 172.21.15.177:0/1513441212 >> 172.21.15.177:0/1513441212 conn(0x55dfa3cff440 msgr2=0x55dfa3cfd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- 172.21.15.177:0/1513441212 shutdown_connections 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- 172.21.15.177:0/1513441212 wait complete. 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 Processor -- start 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- start start 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d0a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c58b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dfa3d0a600 con 0x55dfa3d031c0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d0a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c548c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d0a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57312/0 (socket says 172.21.15.177:57312) 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.365+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 learned_addr learned my addr 172.21.15.177:0/81662539 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4803a030 con 0x55dfa3d031c0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4c548c5640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d0a0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4c4804dff0 tx=0x7f4c4801eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4b2a7fc640 1 -- 172.21.15.177:0/81662539 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c480444b0 con 0x55dfa3d031c0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4b2a7fc640 1 -- 172.21.15.177:0/81662539 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c480245e0 con 0x55dfa3d031c0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4b2a7fc640 1 -- 172.21.15.177:0/81662539 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4c48024880 con 0x55dfa3d031c0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dfa3d0a800 con 0x55dfa3d031c0 2024-03-20T13:35:11.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.366+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dfa3d0a800 con 0x55dfa3d031c0 2024-03-20T13:35:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.367+0000 7f4b2a7fc640 1 -- 172.21.15.177:0/81662539 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4c4805f070 con 0x55dfa3d031c0 2024-03-20T13:35:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.367+0000 7f4b2a7fc640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b20036790 0x7f4b20038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.367+0000 7f4b2a7fc640 1 -- 172.21.15.177:0/81662539 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f4c4806cc40 con 0x55dfa3d031c0 2024-03-20T13:35:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.367+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b20036790 0x7f4b20038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3d15b00 0x55dfa3d17fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d18710 con 0x55dfa3d15b00 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c550c6640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3d15b00 0x55dfa3d17fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b20036790 0x7f4b20038c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55dfa3ce6250 tx=0x7f4c4005e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c550c6640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3d15b00 0x55dfa3d17fc0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 20 realm 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d18ae0 con 0x55dfa3d15b00 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.368+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d196c0 con 0x55dfa3d15b00 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3d1a070 0x55dfa3d1c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d1ca70 con 0x55dfa3d1a070 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c548c5640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3d1a070 0x55dfa3d1c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.369+0000 7f4c548c5640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3d1a070 0x55dfa3d1c460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c58b2f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c58b2f800 20 searching for the correct realm 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dfa3d1ed20 0x55dfa3d211e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d21860 con 0x55dfa3d1ed20 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dfa3d1ed20 0x55dfa3d211e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.370+0000 7f4c4ffff640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dfa3d1ed20 0x55dfa3d211e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d21860 con 0x55dfa3d1a070 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c548c5640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4c48036030 0x7f4c48066910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d21860 con 0x7f4c48036030 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c550c6640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4c48036030 0x7f4c48066910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.371+0000 7f4c550c6640 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4c48036030 0x7f4c48066910 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.372+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1a070 2024-03-20T13:35:11.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.373+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1a070 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.374+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.375+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1a070 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.376+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.377+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.377+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.377+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.377+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d1ed20 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.377+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.377+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x7f4c48036030 2024-03-20T13:35:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c50031040 con 0x55dfa3d1a070 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c50031040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c50031040 con 0x7f4c48036030 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.378+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c50031040 con 0x55dfa3d15b00 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4c50031040 con 0x55dfa3d1a070 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:11.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d19360 con 0x55dfa3d15b00 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d1d160 con 0x55dfa3d15b00 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.379+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d1d130 con 0x7f4c48036030 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 zone default found 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 4 Realm: () 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 zonegroup default 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d1da30 con 0x7f4c48036030 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d1da30 con 0x55dfa3d1ed20 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.380+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d23680 con 0x55dfa3d1ed20 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.381+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.381+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.381+0000 7f4c58b2f800 20 started sync module instance, tier type = 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.381+0000 7f4c58b2f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.381+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d22b10 con 0x55dfa3d1a070 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.382+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.382+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94419014528624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d23290 con 0x55dfa3d1a070 2024-03-20T13:35:11.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.382+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d24320 con 0x55dfa3d15b00 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.383+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94419014528624] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.383+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.383+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94419014532032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d246d0 con 0x55dfa3d15b00 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.383+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d25120 con 0x55dfa3d1ed20 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.384+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94419014532032] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.384+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.384+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94419014536192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d254d0 con 0x55dfa3d1ed20 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.384+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d25f70 con 0x55dfa3d1a070 2024-03-20T13:35:11.524 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.385+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.385+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94419014542112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d26be0 con 0x55dfa3d1a070 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.385+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d275b0 con 0x55dfa3d15b00 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.386+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94419014536192] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.386+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94419014542112] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.386+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.386+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94419014543168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d24060 con 0x55dfa3d15b00 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.387+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d27e30 con 0x7f4c48036030 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.388+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94419014543168] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.388+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.388+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94419014545584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d27de0 con 0x7f4c48036030 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.388+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28830 con 0x7f4c48036030 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.389+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94419014545584] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.389+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.389+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94419014550352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28a10 con 0x7f4c48036030 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.389+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d29210 con 0x7f4c48036030 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94419014550352] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'54 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94419014552080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d292d0 con 0x7f4c48036030 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=0 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=1 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=2 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=3 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=4 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=5 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.390+0000 7f4c58b2f800 20 add_watcher() i=6 2024-03-20T13:35:11.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.391+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94419014552080] v30'55 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.391+0000 7f4c58b2f800 20 add_watcher() i=7 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.391+0000 7f4c58b2f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.391+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d2c5f0 con 0x55dfa3d15b00 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.392+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.392+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94419014553504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d29860 con 0x55dfa3d15b00 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94419014553504] v30'70 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4b0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 5 note: GC not initialized 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4b09fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 20 Filter name: none 2024-03-20T13:35:11.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4a7b7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.393+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d5e590 con 0x55dfa3d15b00 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d5ea90 con 0x55dfa3d15b00 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.394+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d64430 con 0x55dfa3d15b00 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~513] v30'6 uv6 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c58b2f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c58b2f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c58b2f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94419014794992 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d5ff40 con 0x55dfa3d15b00 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== watch-notify(notify (1) cookie 94419014543168 notify 128849018885 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7f4c5003d040 con 0x55dfa3d15b00 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4b2bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94419014543168 notifier 4352 bl.length()=689 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify cookie 94419014794992 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4b2bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:11.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4b2bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.395+0000 7f4b2bfff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4b18003e90 con 0x55dfa3d15b00 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.396+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.396+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== watch-notify(notify_complete (2) cookie 94419014794992 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4c50018e40 con 0x55dfa3d15b00 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.396+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d63ef0 con 0x55dfa3d15b00 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c58b2f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c58b2f800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c58b2f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94419014794992 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d5ff40 con 0x55dfa3d1a070 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== watch-notify(notify (1) cookie 94419014528624 notify 128849018882 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x55dfa3d03bb0 con 0x55dfa3d1a070 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4b2bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94419014528624 notifier 4352 bl.length()=166 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4b2bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-03-20T13:35:11.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4b2bfff640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-03-20T13:35:11.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4b2bfff640 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f4b18003e90 con 0x55dfa3d1a070 2024-03-20T13:35:11.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(68 notify.0 [notify cookie 94419014794992 out=8b] v0'0 uv54 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.397+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.398+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== watch-notify(notify_complete (2) cookie 94419014794992 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55dfa3bddaa0 con 0x55dfa3d1a070 2024-03-20T13:35:11.531 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"NSXaSB7zDV7gcGdIbJ852PISWI3ZRDWkFfYx93dd"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.398+0000 7f4b0afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.398+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94419014553504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d63250 con 0x55dfa3d15b00 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.399+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94419014553504] v30'71 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.399+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94419014528624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28fa0 con 0x55dfa3d1a070 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.400+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94419014528624] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.400+0000 7f4c58b2f800 20 remove_watcher() i=0 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.400+0000 7f4c58b2f800 2 removed watcher, disabling cache 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.400+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94419014532032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28fa0 con 0x55dfa3d15b00 2024-03-20T13:35:11.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.401+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94419014532032] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.401+0000 7f4c58b2f800 20 remove_watcher() i=1 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.401+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94419014536192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d23bc0 con 0x55dfa3d1ed20 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.402+0000 7f4c4ffff640 1 -- 172.21.15.177:0/81662539 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94419014536192] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c40065040 con 0x55dfa3d1ed20 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.402+0000 7f4c58b2f800 20 remove_watcher() i=2 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.402+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94419014542112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28fa0 con 0x55dfa3d1a070 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.403+0000 7f4c548c5640 1 -- 172.21.15.177:0/81662539 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94419014542112] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c48014070 con 0x55dfa3d1a070 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.403+0000 7f4c58b2f800 20 remove_watcher() i=3 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.403+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94419014543168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d26320 con 0x55dfa3d15b00 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.404+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94419014543168] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x55dfa3d15b00 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.404+0000 7f4c58b2f800 20 remove_watcher() i=4 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.404+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94419014545584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28fa0 con 0x7f4c48036030 2024-03-20T13:35:11.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.405+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94419014545584] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.405+0000 7f4c58b2f800 20 remove_watcher() i=5 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.405+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94419014550352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d270b0 con 0x7f4c48036030 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.406+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94419014550352] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.406+0000 7f4c58b2f800 20 remove_watcher() i=6 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.406+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94419014552080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55dfa3d28fa0 con 0x7f4c48036030 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94419014552080] v30'56 uv54 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4c5000a4a0 con 0x7f4c48036030 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 20 remove_watcher() i=7 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4c48036030 msgr2=0x7f4c48066910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4c48036030 0x7f4c48066910 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3d15b00 msgr2=0x55dfa3d17fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3d15b00 0x55dfa3d17fc0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3d1a070 msgr2=0x55dfa3d1c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3d1a070 0x55dfa3d1c460 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dfa3d1ed20 msgr2=0x55dfa3d211e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dfa3d1ed20 0x55dfa3d211e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b20036790 msgr2=0x7f4b20038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b20036790 0x7f4b20038c50 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55dfa3ce6250 tx=0x7f4c4005e040 comp rx=0 tx=0).stop 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 msgr2=0x55dfa3d0a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c550c6640 1 -- 172.21.15.177:0/81662539 reap_dead start 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d0a0c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4c4804dff0 tx=0x7f4c4801eee0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 shutdown_connections 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/81662539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3d031c0 0x55dfa3d0a0c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 >> 172.21.15.177:0/81662539 conn(0x55dfa3cff440 msgr2=0x55dfa3cfcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 shutdown_connections 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/81662539 wait complete. 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b2c036740 msgr2=0x7f4b2c038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b2c036740 0x7f4b2c038c00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x55dfa3cda2a0 tx=0x7f4c40005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 msgr2=0x55dfa3bdd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 0x55dfa3bdd560 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4c4804a780 tx=0x7f4c4804adc0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 shutdown_connections 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b2c036740 0x7f4b2c038c00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/2267549462 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf0f0 0x55dfa3bdd560 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.408+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 >> 172.21.15.177:0/2267549462 conn(0x55dfa3ce80c0 msgr2=0x55dfa3ce84c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 shutdown_connections 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/2267549462 wait complete. 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dfa3ce3340 msgr2=0x55dfa3ce5730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dfa3ce3340 0x55dfa3ce5730 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3be3080 msgr2=0x55dfa3cdcc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dfa3be3080 0x55dfa3cdcc70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3cdf480 msgr2=0x55dfa3ce1870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dfa3cdf480 0x55dfa3ce1870 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b3c0367e0 msgr2=0x7f4b3c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4b3c0367e0 0x7f4b3c038ca0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4c40054000 tx=0x7f4c4004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 msgr2=0x55dfa3cd5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 --2- 172.21.15.177:0/3982824342 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dfa3bdf570 0x55dfa3cd5fd0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4c48000c00 tx=0x7f4c48000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c550c6640 1 -- 172.21.15.177:0/3982824342 reap_dead start 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 shutdown_connections 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 >> 172.21.15.177:0/3982824342 conn(0x55dfa3bd9040 msgr2=0x55dfa3cc8a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 shutdown_connections 2024-03-20T13:35:11.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.409+0000 7f4c58b2f800 1 -- 172.21.15.177:0/3982824342 wait complete. 2024-03-20T13:35:11.542 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'NSXaSB7zDV7gcGdIbJ852PISWI3ZRDWkFfYx93dd'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:11.543 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-03-20T13:35:11.543 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-03-20T13:35:11.543 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-03-20T13:35:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fe92c800 1 Processor -- start 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fe92c800 1 -- start start 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fe92c800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5647016df590 0x5647016e1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fe92c800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564701629d70 con 0x5647016e1ec0 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fe92c800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5647015e0500 con 0x5647016df590 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fa5f7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5647016df590 0x5647016e1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fa5f7640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5647016df590 0x5647016e1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57324/0 (socket says 172.21.15.177:57324) 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/3971715767 learned_addr learned my addr 172.21.15.177:0/3971715767 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/3971715767 >> v1:172.21.15.28:6789/0 conn(0x5647016e1ec0 legacy=0x5647016e42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:35:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.590+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/3971715767 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647016e69e0 con 0x5647016df590 2024-03-20T13:35:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.592+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/3971715767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647016e1980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00a520 tx=0x7fa1ec01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be25d6f2d3f14b7a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1f95f5640 1 -- 172.21.15.177:0/3971715767 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec052570 con 0x5647016df590 2024-03-20T13:35:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1f95f5640 1 -- 172.21.15.177:0/3971715767 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0526d0 con 0x5647016df590 2024-03-20T13:35:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1f95f5640 1 -- 172.21.15.177:0/3971715767 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec052990 con 0x5647016df590 2024-03-20T13:35:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3971715767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 msgr2=0x5647016e1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/3971715767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647016e1980 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00a520 tx=0x7fa1ec01ce40 comp rx=0 tx=0).stop 2024-03-20T13:35:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3971715767 shutdown_connections 2024-03-20T13:35:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/3971715767 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647016e1980 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3971715767 >> 172.21.15.177:0/3971715767 conn(0x5647016d9060 msgr2=0x5647016db480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3971715767 shutdown_connections 2024-03-20T13:35:11.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.593+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3971715767 wait complete. 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fe92c800 1 Processor -- start 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fe92c800 1 -- start start 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fe92c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017ceb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fe92c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647015dda30 con 0x5647016df590 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017ceb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017ceb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57334/0 (socket says 172.21.15.177:57334) 2024-03-20T13:35:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.605+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1125952634 learned_addr learned my addr 172.21.15.177:0/1125952634 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.606+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1125952634 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec005de0 con 0x5647016df590 2024-03-20T13:35:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.606+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/1125952634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017ceb40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec055040 tx=0x7fa1ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e0abcc46db3e13d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.606+0000 7fa0e8608640 1 -- 172.21.15.177:0/1125952634 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec052840 con 0x5647016df590 2024-03-20T13:35:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.606+0000 7fa0e8608640 1 -- 172.21.15.177:0/1125952634 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0529c0 con 0x5647016df590 2024-03-20T13:35:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.606+0000 7fa0e8608640 1 -- 172.21.15.177:0/1125952634 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec052ca0 con 0x5647016df590 2024-03-20T13:35:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1125952634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 msgr2=0x5647017ceb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1125952634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017ceb40 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec055040 tx=0x7fa1ec04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1125952634 shutdown_connections 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1125952634 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017ceb40 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1125952634 >> 172.21.15.177:0/1125952634 conn(0x5647016d9060 msgr2=0x5647017ca460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1125952634 shutdown_connections 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1125952634 wait complete. 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 Processor -- start 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- start start 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017d6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fe92c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647015d9210 con 0x5647016df590 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017d6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017d6190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57344/0 (socket says 172.21.15.177:57344) 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.607+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/2173016614 learned_addr learned my addr 172.21.15.177:0/2173016614 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647016e69e0 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017d6190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec01ce10 tx=0x7fa1ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa0e6e05640 1 -- 172.21.15.177:0/2173016614 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec06c070 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa0e6e05640 1 -- 172.21.15.177:0/2173016614 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec05d690 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647017d66d0 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa0e6e05640 1 -- 172.21.15.177:0/2173016614 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec05d970 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.608+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647017d6c10 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa0e6e05640 1 -- 172.21.15.177:0/2173016614 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa1ec059040 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa0e6e05640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0e00367e0 0x7fa0e0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa0e6e05640 1 -- 172.21.15.177:0/2173016614 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa1ec08d820 con 0x5647016df590 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0e00367e0 0x7fa0e0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5647016e1ec0 0x5647017dcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647017dd4f0 con 0x5647016e1ec0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.609+0000 7fa1fadf8640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5647016e1ec0 0x5647017dcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fadf8640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5647016e1ec0 0x5647017dcfb0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0e00367e0 0x7fa0e0038ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0002e70 tx=0x7fa1f00023a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fadf8640 1 -- 172.21.15.177:0/2173016614 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x5647016e1ec0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647017da510 con 0x5647016e1ec0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fadf8640 1 -- 172.21.15.177:0/2173016614 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1f400a4a0 con 0x5647016e1ec0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5647017df500 0x5647017e19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647017e2150 con 0x5647017df500 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.610+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5647017df500 0x5647017e19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.611+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5647017df500 0x5647017e19c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.611+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/2173016614 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa1ec05dad0 con 0x5647017df500 2024-03-20T13:35:11.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.611+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647017ddd20 con 0x5647016e1ec0 2024-03-20T13:35:11.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.611+0000 7fa1fadf8640 1 -- 172.21.15.177:0/2173016614 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1f400a4a0 con 0x5647016e1ec0 2024-03-20T13:35:11.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.611+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5647017e3570 0x5647017e5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.611+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647017e60c0 con 0x5647017e3570 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.612+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5647017e3570 0x5647017e5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.612+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5647017e3570 0x5647017e5960 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.612+0000 7fa1f9df6640 1 -- 172.21.15.177:0/2173016614 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa1f0010610 con 0x5647017e3570 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.613+0000 7fa1fe92c800 1 Processor -- start 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.613+0000 7fa1fe92c800 1 -- start start 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.613+0000 7fa1fe92c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 0x5647017f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.613+0000 7fa1fe92c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470157bc70 con 0x5647017f4250 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.614+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 0x5647017f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.614+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 0x5647017f4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57352/0 (socket says 172.21.15.177:57352) 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.614+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/3199351604 learned_addr learned my addr 172.21.15.177:0/3199351604 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.615+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/3199351604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647017f4bb0 con 0x5647017f4250 2024-03-20T13:35:11.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.615+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 0x5647017f4670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec08bf10 tx=0x7fa1ec06f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.616+0000 7fa0dffff640 1 -- 172.21.15.177:0/3199351604 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec079d90 con 0x5647017f4250 2024-03-20T13:35:11.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.616+0000 7fa0dffff640 1 -- 172.21.15.177:0/3199351604 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec08dac0 con 0x5647017f4250 2024-03-20T13:35:11.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.616+0000 7fa0dffff640 1 -- 172.21.15.177:0/3199351604 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec08dda0 con 0x5647017f4250 2024-03-20T13:35:11.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.616+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647017f5620 con 0x5647017f4250 2024-03-20T13:35:11.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.616+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647017f5620 con 0x5647017f4250 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.618+0000 7fa0dffff640 1 -- 172.21.15.177:0/3199351604 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa1ec0793b0 con 0x5647017f4250 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa0dffff640 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0d40367e0 0x7fa0d4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa0dffff640 1 -- 172.21.15.177:0/3199351604 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa1ec097c40 con 0x5647017f4250 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0d40367e0 0x7fa0d4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fe92c800 1 Processor -- start 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fe92c800 1 -- start start 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0d40367e0 0x7fa0d4038ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000bfe0 tx=0x7fa1f0006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fe92c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x5647016defa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fe92c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647015515d0 con 0x5647016deb80 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x5647016defa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x5647016defa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57366/0 (socket says 172.21.15.177:57366) 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.619+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/47211194 learned_addr learned my addr 172.21.15.177:0/47211194 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/47211194 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647016dd380 con 0x5647016deb80 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/47211194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x5647016defa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec06fc00 tx=0x7fa1ec087db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b2b88c181a5e0c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa0ddffb640 1 -- 172.21.15.177:0/47211194 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec08b8c0 con 0x5647016deb80 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa0ddffb640 1 -- 172.21.15.177:0/47211194 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec08ba20 con 0x5647016deb80 2024-03-20T13:35:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa0ddffb640 1 -- 172.21.15.177:0/47211194 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec08d1e0 con 0x5647016deb80 2024-03-20T13:35:11.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 -- 172.21.15.177:0/47211194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 msgr2=0x5647016defa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/47211194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x5647016defa0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec06fc00 tx=0x7fa1ec087db0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 -- 172.21.15.177:0/47211194 shutdown_connections 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/47211194 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x5647016defa0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 -- 172.21.15.177:0/47211194 >> 172.21.15.177:0/47211194 conn(0x5647017fd4c0 msgr2=0x5647017fb520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 -- 172.21.15.177:0/47211194 shutdown_connections 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.620+0000 7fa1fe92c800 1 -- 172.21.15.177:0/47211194 wait complete. 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fe92c800 1 Processor -- start 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fe92c800 1 -- start start 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fe92c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x56470180a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fe92c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56470180a830 con 0x5647016deb80 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x56470180a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fa5f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x56470180a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57382/0 (socket says 172.21.15.177:57382) 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.621+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 learned_addr learned my addr 172.21.15.177:0/1450744624 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.622+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647017f4bb0 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.622+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x56470180a2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec078a50 tx=0x7fa1ec002e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.622+0000 7fa0cbfff640 1 -- 172.21.15.177:0/1450744624 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec0ae070 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.623+0000 7fa0cbfff640 1 -- 172.21.15.177:0/1450744624 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec07bd70 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.623+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5647017f4bb0 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.623+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647017f4bb0 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.623+0000 7fa0cbfff640 1 -- 172.21.15.177:0/1450744624 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa1ec087730 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.623+0000 7fa0cbfff640 1 -- 172.21.15.177:0/1450744624 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa1ec08b220 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa0cbfff640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0c4036790 0x7fa0c4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa0cbfff640 1 -- 172.21.15.177:0/1450744624 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa1ec0bdc30 con 0x5647016deb80 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0c4036790 0x7fa0c4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564701815a40 0x564701817f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701818650 con 0x564701815a40 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1fadf8640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564701815a40 0x564701817f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0c4036790 0x7fa0c4038c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5647017da4b0 tx=0x7fa1f0011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.624+0000 7fa1fadf8640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564701815a40 0x564701817f00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 realm 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701818a20 con 0x564701815a40 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:11.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701819600 con 0x564701815a40 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564701819fb0 0x56470181c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.625+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470181c9b0 con 0x564701819fb0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564701819fb0 0x56470181c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564701819fb0 0x56470181c3a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fe92c800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fe92c800 20 searching for the correct realm 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56470181ec60 0x564701821120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018217a0 con 0x56470181ec60 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56470181ec60 0x564701821120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.626+0000 7fa1f9df6640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56470181ec60 0x564701821120 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.627+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0010610 con 0x56470181ec60 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.627+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018217a0 con 0x564701819fb0 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.627+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.627+0000 7fa1fa5f7640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa1ec0a8040 0x7fa1ec002810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.627+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018217a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.627+0000 7fa1fadf8640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa1ec0a8040 0x7fa1ec002810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.628+0000 7fa1fadf8640 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa1ec0a8040 0x7fa1ec002810 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.628+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.628+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.629+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701819fb0 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.630+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701819fb0 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.631+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.632+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701819fb0 2024-03-20T13:35:11.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.633+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.634+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.634+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x56470181ec60 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.634+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.634+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.635+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.635+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa1f4031040 con 0x564701819fb0 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.635+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.635+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa1f4031040 con 0x56470181ec60 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.635+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.635+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa1f4031040 con 0x7fa1ec0a8040 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa1f4031040 con 0x564701815a40 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa1f4031040 con 0x564701819fb0 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018192a0 con 0x564701815a40 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.636+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470181d0a0 con 0x564701815a40 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470181d0a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 zone default found 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 4 Realm: () 2024-03-20T13:35:11.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 zonegroup default 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470181de60 con 0x7fa1ec0a8040 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470181de60 con 0x56470181ec60 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.637+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018235c0 con 0x56470181ec60 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 20 started sync module instance, tier type = 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.638+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701822a50 con 0x564701819fb0 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.639+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.639+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94862967975344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018231d0 con 0x564701819fb0 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.639+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701824260 con 0x564701815a40 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.640+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94862967975344] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.640+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.640+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94862967978752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701824640 con 0x564701815a40 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.640+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018250e0 con 0x56470181ec60 2024-03-20T13:35:11.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.642+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.642+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94862967978752] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.642+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94862967983040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701825490 con 0x56470181ec60 2024-03-20T13:35:11.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.642+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701825ec0 con 0x564701819fb0 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.643+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94862967983040] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.643+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.643+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94862967980000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701826710 con 0x564701819fb0 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.643+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701827080 con 0x564701815a40 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.644+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.644+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94862967991264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018274a0 con 0x564701815a40 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.644+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701827ef0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.644+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94862967980000] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.645+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.645+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94862967994832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701827eb0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.645+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018288d0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.645+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94862967991264] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.646+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94862967994832] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.646+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.646+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94862967988848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701827000 con 0x7fa1ec0a8040 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.646+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701828db0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'57 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94862967998672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701828d30 con 0x7fa1ec0a8040 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=0 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=1 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=2 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=3 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=4 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=5 2024-03-20T13:35:11.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94862967988848] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.648+0000 7fa1fe92c800 20 add_watcher() i=6 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.650+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94862967998672] v30'58 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.650+0000 7fa1fe92c800 20 add_watcher() i=7 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.650+0000 7fa1fe92c800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.650+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701828410 con 0x564701815a40 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.650+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.650+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94862968000784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701828410 con 0x564701815a40 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.651+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94862968000784] v30'72 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.651+0000 7fa0b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.651+0000 7fa1fe92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.651+0000 7fa1fe92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.651+0000 7fa1fe92c800 5 note: GC not initialized 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa02b7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:11.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 20 Filter name: none 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa0297fa640 20 reqs_thread_entry: start 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470185e190 con 0x564701815a40 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv6 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.652+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5647018642b0 con 0x564701815a40 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v30'7 uv7 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fe92c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fe92c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fe92c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94862968241520 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470185fba0 con 0x564701815a40 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94862967991264 notify 128849018886 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7fa1f403d040 con 0x564701815a40 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa0ddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94862967991264 notifier 4358 bl.length()=689 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 94862968241520 out=8b] v0'0 uv57 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa0ddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa0ddffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa0ddffb640 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa0c0003e90 con 0x564701815a40 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.654+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94862968241520 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa1f4018db0 con 0x564701815a40 2024-03-20T13:35:11.662 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:11.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.655+0000 7fa0b0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.655+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94862968000784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56470185ee10 con 0x564701815a40 2024-03-20T13:35:11.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.656+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94862968000784] v30'73 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.656+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94862967975344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701829110 con 0x564701819fb0 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.657+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94862967975344] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.657+0000 7fa1fe92c800 20 remove_watcher() i=0 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.657+0000 7fa1fe92c800 2 removed watcher, disabling cache 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.657+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94862967978752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701829110 con 0x564701815a40 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.658+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94862967978752] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.658+0000 7fa1fe92c800 20 remove_watcher() i=1 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.658+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94862967983040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701823b00 con 0x56470181ec60 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.659+0000 7fa1f9df6640 1 -- 172.21.15.177:0/1450744624 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94862967983040] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f0040040 con 0x56470181ec60 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.659+0000 7fa1fe92c800 20 remove_watcher() i=2 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.659+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94862967980000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701824bc0 con 0x564701819fb0 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.660+0000 7fa1fa5f7640 1 -- 172.21.15.177:0/1450744624 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94862967980000] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1ec0a5070 con 0x564701819fb0 2024-03-20T13:35:11.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.660+0000 7fa1fe92c800 20 remove_watcher() i=3 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.660+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94862967991264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701824bc0 con 0x564701815a40 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.661+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94862967991264] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x564701815a40 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.661+0000 7fa1fe92c800 20 remove_watcher() i=4 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.661+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94862967994832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701826be0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.662+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94862967994832] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.662+0000 7fa1fe92c800 20 remove_watcher() i=5 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.662+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94862967988848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701824bc0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.663+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94862967988848] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.663+0000 7fa1fe92c800 20 remove_watcher() i=6 2024-03-20T13:35:11.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.663+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94862967998672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564701826be0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94862967998672] v30'59 uv57 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa1f400a4a0 con 0x7fa1ec0a8040 2024-03-20T13:35:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 20 remove_watcher() i=7 2024-03-20T13:35:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa1ec0a8040 msgr2=0x7fa1ec002810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa1ec0a8040 0x7fa1ec002810 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564701815a40 msgr2=0x564701817f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564701815a40 0x564701817f00 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564701819fb0 msgr2=0x56470181c3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564701819fb0 0x56470181c3a0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56470181ec60 msgr2=0x564701821120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56470181ec60 0x564701821120 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0c4036790 msgr2=0x7fa0c4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0c4036790 0x7fa0c4038c50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x5647017da4b0 tx=0x7fa1f0011000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 msgr2=0x56470180a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fadf8640 1 -- 172.21.15.177:0/1450744624 reap_dead start 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.664+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x56470180a2f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec078a50 tx=0x7fa1ec002e70 comp rx=0 tx=0).stop 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 shutdown_connections 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/1450744624 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016deb80 0x56470180a2f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 >> 172.21.15.177:0/1450744624 conn(0x5647017fd4c0 msgr2=0x5647017fab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 shutdown_connections 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/1450744624 wait complete. 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0d40367e0 msgr2=0x7fa0d4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0d40367e0 0x7fa0d4038ca0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa1f000bfe0 tx=0x7fa1f0006000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 msgr2=0x5647017f4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 0x5647017f4670 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec08bf10 tx=0x7fa1ec06f9f0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 shutdown_connections 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0d40367e0 0x7fa0d4038ca0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/3199351604 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647017f4250 0x5647017f4670 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 >> 172.21.15.177:0/3199351604 conn(0x5647017e82f0 msgr2=0x5647017e86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 shutdown_connections 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/3199351604 wait complete. 2024-03-20T13:35:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5647017e3570 msgr2=0x5647017e5960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5647017e3570 0x5647017e5960 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5647016e1ec0 msgr2=0x5647017dcfb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5647016e1ec0 0x5647017dcfb0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5647017df500 msgr2=0x5647017e19c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5647017df500 0x5647017e19c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0e00367e0 msgr2=0x7fa0e0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa0e00367e0 0x7fa0e0038ca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa1f0002e70 tx=0x7fa1f00023a0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 msgr2=0x5647017d6190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 --2- 172.21.15.177:0/2173016614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5647016df590 0x5647017d6190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec01ce10 tx=0x7fa1ec002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fadf8640 1 -- 172.21.15.177:0/2173016614 reap_dead start 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 shutdown_connections 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.665+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 >> 172.21.15.177:0/2173016614 conn(0x5647016d9060 msgr2=0x5647017c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.666+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 shutdown_connections 2024-03-20T13:35:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.666+0000 7fa1fe92c800 1 -- 172.21.15.177:0/2173016614 wait complete. 2024-03-20T13:35:11.675 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:11.675 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:11.675 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:11.675 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.717+0000 7f138d322800 1 Processor -- start 2024-03-20T13:35:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.717+0000 7f138d322800 1 -- start start 2024-03-20T13:35:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f138d322800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c8b6d04e70 0x55c8b6d07260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f138d322800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c8b6c4ccd0 con 0x55c8b6d009e0 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f138d322800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c8b6c03500 con 0x55c8b6d04e70 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f13888b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c8b6d04e70 0x55c8b6d07260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f13890b7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55c8b6d009e0 0x55c8b6d00e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36924/0 (socket says 172.21.15.177:36924) 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f13890b7640 1 -- 172.21.15.177:0/152534941 learned_addr learned my addr 172.21.15.177:0/152534941 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f137bfff640 1 -- 172.21.15.177:0/152534941 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 910178530 0 0) 0x55c8b6c4ccd0 con 0x55c8b6d009e0 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f137bfff640 1 -- 172.21.15.177:0/152534941 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1374001e10 con 0x55c8b6d009e0 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f13888b6640 1 -- 172.21.15.177:0/152534941 >> v1:172.21.15.28:6789/0 conn(0x55c8b6d009e0 legacy=0x55c8b6d00e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.718+0000 7f13888b6640 1 -- 172.21.15.177:0/152534941 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b6d08890 con 0x55c8b6d04e70 2024-03-20T13:35:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.720+0000 7f13888b6640 1 --2- 172.21.15.177:0/152534941 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d04e70 0x55c8b6d07260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f138000a470 tx=0x7f138001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90e1cc5b6d174d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.720+0000 7f137bfff640 1 -- 172.21.15.177:0/152534941 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f138004ad60 con 0x55c8b6d04e70 2024-03-20T13:35:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.720+0000 7f137bfff640 1 -- 172.21.15.177:0/152534941 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1380052440 con 0x55c8b6d04e70 2024-03-20T13:35:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.720+0000 7f137bfff640 1 -- 172.21.15.177:0/152534941 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13800526e0 con 0x55c8b6d04e70 2024-03-20T13:35:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 -- 172.21.15.177:0/152534941 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d04e70 msgr2=0x55c8b6d07260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 --2- 172.21.15.177:0/152534941 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d04e70 0x55c8b6d07260 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f138000a470 tx=0x7f138001cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 -- 172.21.15.177:0/152534941 shutdown_connections 2024-03-20T13:35:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 --2- 172.21.15.177:0/152534941 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d04e70 0x55c8b6d07260 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 -- 172.21.15.177:0/152534941 >> 172.21.15.177:0/152534941 conn(0x55c8b6cfc040 msgr2=0x55c8b6cfe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 -- 172.21.15.177:0/152534941 shutdown_connections 2024-03-20T13:35:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.721+0000 7f138d322800 1 -- 172.21.15.177:0/152534941 wait complete. 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.732+0000 7f138d322800 1 Processor -- start 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.732+0000 7f138d322800 1 -- start start 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f138d322800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f138d322800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b6c00a30 con 0x55c8b6d009e0 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57390/0 (socket says 172.21.15.177:57390) 2024-03-20T13:35:11.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f13890b7640 1 -- 172.21.15.177:0/1421270983 learned_addr learned my addr 172.21.15.177:0/1421270983 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f13890b7640 1 -- 172.21.15.177:0/1421270983 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1380005d20 con 0x55c8b6d009e0 2024-03-20T13:35:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f13890b7640 1 --2- 172.21.15.177:0/1421270983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df0730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f137c001c20 tx=0x7f137c00b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=369c47fac202fadf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f1277606640 1 -- 172.21.15.177:0/1421270983 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c010070 con 0x55c8b6d009e0 2024-03-20T13:35:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.733+0000 7f1277606640 1 -- 172.21.15.177:0/1421270983 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c00b240 con 0x55c8b6d009e0 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f1277606640 1 -- 172.21.15.177:0/1421270983 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c0095d0 con 0x55c8b6d009e0 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 -- 172.21.15.177:0/1421270983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 msgr2=0x55c8b6df0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 --2- 172.21.15.177:0/1421270983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df0730 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f137c001c20 tx=0x7f137c00b850 comp rx=0 tx=0).stop 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 -- 172.21.15.177:0/1421270983 shutdown_connections 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 --2- 172.21.15.177:0/1421270983 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df0730 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 -- 172.21.15.177:0/1421270983 >> 172.21.15.177:0/1421270983 conn(0x55c8b6cfc040 msgr2=0x55c8b6dec050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 -- 172.21.15.177:0/1421270983 shutdown_connections 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.734+0000 7f138d322800 1 -- 172.21.15.177:0/1421270983 wait complete. 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f138d322800 1 Processor -- start 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f138d322800 1 -- start start 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f138d322800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df6d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f138d322800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b6bfc210 con 0x55c8b6d009e0 2024-03-20T13:35:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df6d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57396/0 (socket says 172.21.15.177:57396) 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f13890b7640 1 -- 172.21.15.177:0/1079184969 learned_addr learned my addr 172.21.15.177:0/1079184969 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f13890b7640 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1374001e10 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.735+0000 7f13890b7640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df6d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f137c001080 tx=0x7f137c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.736+0000 7f1275e03640 1 -- 172.21.15.177:0/1079184969 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c01d040 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.736+0000 7f1275e03640 1 -- 172.21.15.177:0/1079184969 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c016640 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.736+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8b6df7240 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.736+0000 7f1275e03640 1 -- 172.21.15.177:0/1079184969 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c016920 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.736+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8b6df76c0 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f1275e03640 1 -- 172.21.15.177:0/1079184969 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f137c016a80 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f1275e03640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f12700367e0 0x7f1270038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f1275e03640 1 -- 172.21.15.177:0/1079184969 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f137c04d560 con 0x55c8b6d009e0 2024-03-20T13:35:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f13888b6640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f12700367e0 0x7f1270038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6d04e70 0x55c8b6dfda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6dfe020 con 0x55c8b6d04e70 2024-03-20T13:35:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f13898b8640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6d04e70 0x55c8b6dfda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f13888b6640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f12700367e0 0x7f1270038ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1380054000 tx=0x7f138004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.737+0000 7f13898b8640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6d04e70 0x55c8b6dfda50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f13898b8640 1 -- 172.21.15.177:0/1079184969 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6d04e70 2024-03-20T13:35:11.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6dfb100 con 0x55c8b6d04e70 2024-03-20T13:35:11.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f13898b8640 1 -- 172.21.15.177:0/1079184969 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6d04e70 2024-03-20T13:35:11.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e00290 0x55c8b6e02680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e02d70 con 0x55c8b6e00290 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f13890b7640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e00290 0x55c8b6e02680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.738+0000 7f13890b7640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e00290 0x55c8b6e02680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.739+0000 7f13890b7640 1 -- 172.21.15.177:0/1079184969 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e00290 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.739+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6dff1e0 con 0x55c8b6d04e70 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.739+0000 7f13898b8640 1 -- 172.21.15.177:0/1079184969 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6d04e70 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.739+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8b6e04190 0x55c8b6e06580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.739+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e06cc0 con 0x55c8b6e04190 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.739+0000 7f13888b6640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8b6e04190 0x55c8b6e06580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.740+0000 7f13888b6640 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8b6e04190 0x55c8b6e06580 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.740+0000 7f13888b6640 1 -- 172.21.15.177:0/1079184969 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e04190 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.740+0000 7f138d322800 1 Processor -- start 2024-03-20T13:35:11.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.740+0000 7f138d322800 1 -- start start 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.740+0000 7f138d322800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 0x55c8b6e15260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.740+0000 7f138d322800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b6b9ec70 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 0x55c8b6e15260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 0x55c8b6e15260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57400/0 (socket says 172.21.15.177:57400) 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f13890b7640 1 -- 172.21.15.177:0/1450947358 learned_addr learned my addr 172.21.15.177:0/1450947358 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f13890b7640 1 -- 172.21.15.177:0/1450947358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b6e157a0 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f13890b7640 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 0x55c8b6e15260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f137c00bda0 tx=0x7f137c046bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f126effd640 1 -- 172.21.15.177:0/1450947358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c0218a0 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f126effd640 1 -- 172.21.15.177:0/1450947358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c04a130 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8b6e16210 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f126effd640 1 -- 172.21.15.177:0/1450947358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c04a3d0 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.741+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8b6e166d0 con 0x55c8b6e14e40 2024-03-20T13:35:11.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.742+0000 7f126effd640 1 -- 172.21.15.177:0/1450947358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f137c045240 con 0x55c8b6e14e40 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.742+0000 7f126effd640 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1260036790 0x7f1260038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.742+0000 7f126effd640 1 -- 172.21.15.177:0/1450947358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f137c035c70 con 0x55c8b6e14e40 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.742+0000 7f13888b6640 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1260036790 0x7f1260038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.742+0000 7f138d322800 1 Processor -- start 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.742+0000 7f138d322800 1 -- start start 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f13888b6640 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1260036790 0x7f1260038c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55c8b6dfb020 tx=0x7f1380005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f138d322800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e224f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f138d322800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b6b745d0 con 0x55c8b6e220f0 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e224f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e224f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57406/0 (socket says 172.21.15.177:57406) 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f13890b7640 1 -- 172.21.15.177:0/850382679 learned_addr learned my addr 172.21.15.177:0/850382679 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f13890b7640 1 -- 172.21.15.177:0/850382679 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b6e22ac0 con 0x55c8b6e220f0 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f13890b7640 1 --2- 172.21.15.177:0/850382679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e224f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f137c03a420 tx=0x7f137c0458c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37bf746315e70a19 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f126cff9640 1 -- 172.21.15.177:0/850382679 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c013770 con 0x55c8b6e220f0 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f126cff9640 1 -- 172.21.15.177:0/850382679 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c053070 con 0x55c8b6e220f0 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.743+0000 7f126cff9640 1 -- 172.21.15.177:0/850382679 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c013b80 con 0x55c8b6e220f0 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- 172.21.15.177:0/850382679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 msgr2=0x55c8b6e224f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 --2- 172.21.15.177:0/850382679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e224f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f137c03a420 tx=0x7f137c0458c0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- 172.21.15.177:0/850382679 shutdown_connections 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 --2- 172.21.15.177:0/850382679 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e224f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- 172.21.15.177:0/850382679 >> 172.21.15.177:0/850382679 conn(0x55c8b6e1e3c0 msgr2=0x55c8b6e1c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- 172.21.15.177:0/850382679 shutdown_connections 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- 172.21.15.177:0/850382679 wait complete. 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 Processor -- start 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- start start 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e29000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f138d322800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b6e29540 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.744+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e29000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f13890b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e29000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57408/0 (socket says 172.21.15.177:57408) 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 learned_addr learned my addr 172.21.15.177:0/3433434002 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b6e166d0 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f13890b7640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e29000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f137c04a7a0 tx=0x7f137c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f125effd640 1 -- 172.21.15.177:0/3433434002 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c04d300 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f125effd640 1 -- 172.21.15.177:0/3433434002 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f137c04d880 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8b6e166d0 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f125effd640 1 -- 172.21.15.177:0/3433434002 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f137c0155c0 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.745+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8b6e29950 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f125effd640 1 -- 172.21.15.177:0/3433434002 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f137c03d000 con 0x55c8b6e220f0 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f125effd640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1254036790 0x7f1254038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f125effd640 1 -- 172.21.15.177:0/3433434002 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f137c041150 con 0x55c8b6e220f0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f13888b6640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1254036790 0x7f1254038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6e34860 0x55c8b6e36d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.746+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e37470 con 0x55c8b6e34860 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f13898b8640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6e34860 0x55c8b6e36d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f13888b6640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1254036790 0x7f1254038c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1380052fd0 tx=0x7f138004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f13898b8640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6e34860 0x55c8b6e36d20 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 20 realm 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e37840 con 0x55c8b6e34860 2024-03-20T13:35:11.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.747+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e38420 con 0x55c8b6e34860 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e38dd0 0x55c8b6e3b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e3b700 con 0x55c8b6e38dd0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f13890b7640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e38dd0 0x55c8b6e3b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f13890b7640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e38dd0 0x55c8b6e3b1c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 20 searching for the correct realm 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8b6e3d6d0 0x55c8b6e3fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.748+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e40260 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.749+0000 7f13888b6640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8b6e3d6d0 0x55c8b6e3fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.749+0000 7f13888b6640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8b6e3d6d0 0x55c8b6e3fb90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.749+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.749+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e40260 con 0x55c8b6e38dd0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.750+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.750+0000 7f13890b7640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f137c06d070 0x7f137c03d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.750+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e40260 con 0x7f137c06d070 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.750+0000 7f13898b8640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f137c06d070 0x7f137c03d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.750+0000 7f13898b8640 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f137c06d070 0x7f137c03d4d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.751+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.751+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.751+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.751+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.751+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.751+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e38dd0 2024-03-20T13:35:11.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.752+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e38dd0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.753+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.754+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.755+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e38dd0 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.756+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x7f137c06d070 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1384031040 con 0x55c8b6e38dd0 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1384031040 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.757+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1384031040 con 0x7f137c06d070 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1384031040 con 0x55c8b6e34860 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f1384031040 con 0x55c8b6e38dd0 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:11.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e380c0 con 0x55c8b6e34860 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.758+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e3c000 con 0x55c8b6e34860 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e3c000 con 0x7f137c06d070 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:11.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 zone default found 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 4 Realm: () 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 zonegroup default 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e3c8d0 con 0x7f137c06d070 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.759+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e3ccb0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e3c8d0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 20 started sync module instance, tier type = 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.760+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e41960 con 0x55c8b6e38dd0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.761+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.761+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94320550220992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e41d10 con 0x55c8b6e38dd0 2024-03-20T13:35:11.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.761+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e42dd0 con 0x55c8b6e34860 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.762+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94320550220992] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.762+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.762+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94320550224608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e431b0 con 0x55c8b6e34860 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.762+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e43c50 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.763+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.763+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94320550229808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e444e0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.763+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e44f70 con 0x55c8b6e38dd0 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.763+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94320550224608] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.764+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.764+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94320550226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e457f0 con 0x55c8b6e38dd0 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.764+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e46160 con 0x55c8b6e34860 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.764+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94320550229808] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.765+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94320550226160] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.765+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.765+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94320550232064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e46160 con 0x55c8b6e34860 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.765+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e46960 con 0x7f137c06d070 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.766+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.766+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94320550241120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e46db0 con 0x7f137c06d070 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.766+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e47880 con 0x7f137c06d070 2024-03-20T13:35:11.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.766+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94320550232064] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.767+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94320550241120] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.767+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.767+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94320550245216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e47840 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.767+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e46930 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94320550245216] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'60 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94320550239424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e48100 con 0x7f137c06d070 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=0 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=1 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=2 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=3 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=4 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=5 2024-03-20T13:35:11.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.768+0000 7f138d322800 20 add_watcher() i=6 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.769+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94320550239424] v30'61 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.769+0000 7f138d322800 20 add_watcher() i=7 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.769+0000 7f138d322800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.769+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e4b480 con 0x55c8b6e34860 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.770+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.770+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94320550260336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e48270 con 0x55c8b6e34860 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94320550260336] v30'74 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f123ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f138d322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f138d322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f138d322800 5 note: GC not initialized 2024-03-20T13:35:11.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f123efe5640 20 reqs_thread_entry: start 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f138d322800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.771+0000 7f138d322800 20 Filter name: none 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.772+0000 7f123cfe1640 20 reqs_thread_entry: start 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.772+0000 7f138d322800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.772+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e7cf60 con 0x55c8b6e34860 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.772+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.772+0000 7f138d322800 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:35:11.787 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.773+0000 7f123ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.773+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94320550260336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e4a360 con 0x55c8b6e34860 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.774+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94320550260336] v30'75 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.774+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94320550220992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e4ae70 con 0x55c8b6e38dd0 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.775+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94320550220992] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.775+0000 7f138d322800 20 remove_watcher() i=0 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.775+0000 7f138d322800 2 removed watcher, disabling cache 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.775+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94320550224608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e414c0 con 0x55c8b6e34860 2024-03-20T13:35:11.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.776+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94320550224608] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.776+0000 7f138d322800 20 remove_watcher() i=1 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.776+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94320550229808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e414c0 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.777+0000 7f13888b6640 1 -- 172.21.15.177:0/3433434002 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94320550229808] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138000a100 con 0x55c8b6e3d6d0 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.777+0000 7f138d322800 20 remove_watcher() i=2 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.777+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94320550226160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e422e0 con 0x55c8b6e38dd0 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.778+0000 7f13890b7640 1 -- 172.21.15.177:0/3433434002 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94320550226160] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f137c028070 con 0x55c8b6e38dd0 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.778+0000 7f138d322800 20 remove_watcher() i=3 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.778+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94320550232064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e422e0 con 0x55c8b6e34860 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.779+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94320550232064] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x55c8b6e34860 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.779+0000 7f138d322800 20 remove_watcher() i=4 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.779+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94320550241120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e422e0 con 0x7f137c06d070 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.780+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94320550241120] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.780+0000 7f138d322800 20 remove_watcher() i=5 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.780+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94320550245216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e46360 con 0x7f137c06d070 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.781+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94320550245216] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.781+0000 7f138d322800 20 remove_watcher() i=6 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.781+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94320550239424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8b6e422e0 con 0x7f137c06d070 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94320550239424] v30'62 uv60 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f138400a4a0 con 0x7f137c06d070 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 20 remove_watcher() i=7 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f137c06d070 msgr2=0x7f137c03d4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f137c06d070 0x7f137c03d4d0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6e34860 msgr2=0x55c8b6e36d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6e34860 0x55c8b6e36d20 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e38dd0 msgr2=0x55c8b6e3b1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e38dd0 0x55c8b6e3b1c0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8b6e3d6d0 msgr2=0x55c8b6e3fb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8b6e3d6d0 0x55c8b6e3fb90 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1254036790 msgr2=0x7f1254038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1254036790 0x7f1254038c50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1380052fd0 tx=0x7f138004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 msgr2=0x55c8b6e29000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e29000 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f137c04a7a0 tx=0x7f137c00ef20 comp rx=0 tx=0).stop 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f13898b8640 1 -- 172.21.15.177:0/3433434002 reap_dead start 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 shutdown_connections 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/3433434002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e220f0 0x55c8b6e29000 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 >> 172.21.15.177:0/3433434002 conn(0x55c8b6e1e3c0 msgr2=0x55c8b6e1ba20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 shutdown_connections 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/3433434002 wait complete. 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1260036790 msgr2=0x7f1260038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1260036790 0x7f1260038c50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x55c8b6dfb020 tx=0x7f1380005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 msgr2=0x55c8b6e15260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 0x55c8b6e15260 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f137c00bda0 tx=0x7f137c046bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 shutdown_connections 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1260036790 0x7f1260038c50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 --2- 172.21.15.177:0/1450947358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6e14e40 0x55c8b6e15260 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 >> 172.21.15.177:0/1450947358 conn(0x55c8b6e08ee0 msgr2=0x55c8b6e092e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 shutdown_connections 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.782+0000 7f138d322800 1 -- 172.21.15.177:0/1450947358 wait complete. 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8b6e04190 msgr2=0x55c8b6e06580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8b6e04190 0x55c8b6e06580 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6d04e70 msgr2=0x55c8b6dfda50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8b6d04e70 0x55c8b6dfda50 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e00290 msgr2=0x55c8b6e02680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8b6e00290 0x55c8b6e02680 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f12700367e0 msgr2=0x7f1270038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f12700367e0 0x7f1270038ca0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1380054000 tx=0x7f138004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 msgr2=0x55c8b6df6d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 --2- 172.21.15.177:0/1079184969 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8b6d009e0 0x55c8b6df6d00 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f137c001080 tx=0x7f137c000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f13898b8640 1 -- 172.21.15.177:0/1079184969 reap_dead start 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 shutdown_connections 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 >> 172.21.15.177:0/1079184969 conn(0x55c8b6cfc040 msgr2=0x55c8b6dea8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 shutdown_connections 2024-03-20T13:35:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.783+0000 7f138d322800 1 -- 172.21.15.177:0/1079184969 wait complete. 2024-03-20T13:35:11.798 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:11.798 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:11.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:11.799 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:11.877 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:11.877 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:11.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e9f28800 1 Processor -- start 2024-03-20T13:35:11.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e9f28800 1 -- start start 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e9f28800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556044fd25f0 0x556044fd49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e9f28800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556044f1ccd0 con 0x556044fd4f20 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e9f28800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x556044ed3500 con 0x556044fd25f0 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e5bcf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556044fd25f0 0x556044fd49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36dd3ce640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x556044fd4f20 0x556044fd7310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36934/0 (socket says 172.21.15.177:36934) 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36dd3ce640 1 -- 172.21.15.177:0/602935355 learned_addr learned my addr 172.21.15.177:0/602935355 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e5bcf640 1 -- 172.21.15.177:0/602935355 >> v1:172.21.15.28:6789/0 conn(0x556044fd4f20 legacy=0x556044fd7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.877+0000 7f36e5bcf640 1 -- 172.21.15.177:0/602935355 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556044fd9a40 con 0x556044fd25f0 2024-03-20T13:35:11.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.879+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/602935355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd49e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36d800a470 tx=0x7f36d801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ef371f385b7211 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e53ce640 1 -- 172.21.15.177:0/602935355 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d8052570 con 0x556044fd25f0 2024-03-20T13:35:11.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e53ce640 1 -- 172.21.15.177:0/602935355 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d80526d0 con 0x556044fd25f0 2024-03-20T13:35:11.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e53ce640 1 -- 172.21.15.177:0/602935355 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d8052990 con 0x556044fd25f0 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 -- 172.21.15.177:0/602935355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 msgr2=0x556044fd49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 --2- 172.21.15.177:0/602935355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd49e0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f36d800a470 tx=0x7f36d801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 -- 172.21.15.177:0/602935355 shutdown_connections 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 --2- 172.21.15.177:0/602935355 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd49e0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 -- 172.21.15.177:0/602935355 >> 172.21.15.177:0/602935355 conn(0x556044fcc040 msgr2=0x556044fce460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 -- 172.21.15.177:0/602935355 shutdown_connections 2024-03-20T13:35:11.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.880+0000 7f36e9f28800 1 -- 172.21.15.177:0/602935355 wait complete. 2024-03-20T13:35:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e9f28800 1 Processor -- start 2024-03-20T13:35:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e9f28800 1 -- start start 2024-03-20T13:35:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e9f28800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e9f28800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556044ed0a30 con 0x556044fd25f0 2024-03-20T13:35:11.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57432/0 (socket says 172.21.15.177:57432) 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.892+0000 7f36e5bcf640 1 -- 172.21.15.177:0/906123029 learned_addr learned my addr 172.21.15.177:0/906123029 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.893+0000 7f36e5bcf640 1 -- 172.21.15.177:0/906123029 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36d8005d20 con 0x556044fd25f0 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.893+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/906123029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd1f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36d8055040 tx=0x7f36d804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faf243610285f095 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.893+0000 7f35d3e07640 1 -- 172.21.15.177:0/906123029 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d800a180 con 0x556044fd25f0 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.893+0000 7f35d3e07640 1 -- 172.21.15.177:0/906123029 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d800a2e0 con 0x556044fd25f0 2024-03-20T13:35:11.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.893+0000 7f35d3e07640 1 -- 172.21.15.177:0/906123029 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d80529b0 con 0x556044fd25f0 2024-03-20T13:35:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- 172.21.15.177:0/906123029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 msgr2=0x556044fd1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 --2- 172.21.15.177:0/906123029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd1f30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f36d8055040 tx=0x7f36d804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- 172.21.15.177:0/906123029 shutdown_connections 2024-03-20T13:35:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 --2- 172.21.15.177:0/906123029 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x556044fd1f30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- 172.21.15.177:0/906123029 >> 172.21.15.177:0/906123029 conn(0x556044fcc040 msgr2=0x5560450bd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- 172.21.15.177:0/906123029 shutdown_connections 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- 172.21.15.177:0/906123029 wait complete. 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 Processor -- start 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- start start 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x5560450cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.894+0000 7f36e9f28800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556044ecc210 con 0x556044fd25f0 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.895+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x5560450cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.895+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x5560450cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57446/0 (socket says 172.21.15.177:57446) 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.895+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3264774544 learned_addr learned my addr 172.21.15.177:0/3264774544 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.895+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556044fd9a40 con 0x556044fd25f0 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.895+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x5560450cb140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f36d8005870 tx=0x7f36d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.896+0000 7f35d2604640 1 -- 172.21.15.177:0/3264774544 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d806a070 con 0x556044fd25f0 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.896+0000 7f35d2604640 1 -- 172.21.15.177:0/3264774544 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d805d550 con 0x556044fd25f0 2024-03-20T13:35:11.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.896+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560450cb680 con 0x556044fd25f0 2024-03-20T13:35:11.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.896+0000 7f35d2604640 1 -- 172.21.15.177:0/3264774544 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d805d7f0 con 0x556044fd25f0 2024-03-20T13:35:11.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.896+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560450cbb60 con 0x556044fd25f0 2024-03-20T13:35:11.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.897+0000 7f35d2604640 1 -- 172.21.15.177:0/3264774544 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f36d805d950 con 0x556044fd25f0 2024-03-20T13:35:11.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.897+0000 7f35d2604640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35cc0367e0 0x7f35cc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.897+0000 7f35d2604640 1 -- 172.21.15.177:0/3264774544 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f36d808dc10 con 0x556044fd25f0 2024-03-20T13:35:11.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.897+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35cc0367e0 0x7f35cc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.897+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556044fd4f20 0x5560450d1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.897+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560450d23c0 con 0x556044fd4f20 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e63d0640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556044fd4f20 0x5560450d1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35cc0367e0 0x7f35cc038ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36d0001d90 tx=0x7f36d00012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e63d0640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556044fd4f20 0x5560450d1df0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e63d0640 1 -- 172.21.15.177:0/3264774544 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556044fd4f20 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560450cf560 con 0x556044fd4f20 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e63d0640 1 -- 172.21.15.177:0/3264774544 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f36e000a4a0 con 0x556044fd4f20 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5560450d4620 0x5560450d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560450d70e0 con 0x5560450d4620 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.898+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5560450d4620 0x5560450d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.899+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5560450d4620 0x5560450d6a10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.899+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3264774544 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f36d8059040 con 0x5560450d4620 2024-03-20T13:35:11.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.899+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560450d35a0 con 0x556044fd4f20 2024-03-20T13:35:11.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.899+0000 7f36e63d0640 1 -- 172.21.15.177:0/3264774544 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f36e000a4a0 con 0x556044fd4f20 2024-03-20T13:35:11.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.899+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5560450d84e0 0x5560450da8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.899+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560450db030 con 0x5560450d84e0 2024-03-20T13:35:11.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.900+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5560450d84e0 0x5560450da8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.900+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5560450d84e0 0x5560450da8d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.900+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3264774544 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f36d0006070 con 0x5560450d84e0 2024-03-20T13:35:11.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e9f28800 1 Processor -- start 2024-03-20T13:35:11.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e9f28800 1 -- start start 2024-03-20T13:35:11.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e9f28800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 0x5560450e9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e9f28800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556044e6ec70 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 0x5560450e9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 0x5560450e9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57454/0 (socket says 172.21.15.177:57454) 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.901+0000 7f36e5bcf640 1 -- 172.21.15.177:0/1984329501 learned_addr learned my addr 172.21.15.177:0/1984329501 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f36e5bcf640 1 -- 172.21.15.177:0/1984329501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560450e9b90 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 0x5560450e9650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f36d808bf90 tx=0x7f36d806e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f35cb7fe640 1 -- 172.21.15.177:0/1984329501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d8065ce0 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f35cb7fe640 1 -- 172.21.15.177:0/1984329501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d807a940 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560450ea600 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f35cb7fe640 1 -- 172.21.15.177:0/1984329501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d8065e40 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.902+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560450ea600 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f35cb7fe640 1 -- 172.21.15.177:0/1984329501 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f36d807ac20 con 0x5560450e9230 2024-03-20T13:35:11.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f35cb7fe640 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35c0036790 0x7f35c0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f35cb7fe640 1 -- 172.21.15.177:0/1984329501 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f36d807f990 con 0x5560450e9230 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35c0036790 0x7f35c0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f36e9f28800 1 Processor -- start 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f36e9f28800 1 -- start start 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35c0036790 0x7f35c0038c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5560450cf460 tx=0x7f36d000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f36e9f28800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450f6560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.903+0000 7f36e9f28800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556044e445d0 con 0x5560450f6140 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450f6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450f6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57458/0 (socket says 172.21.15.177:57458) 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f36e5bcf640 1 -- 172.21.15.177:0/2504369443 learned_addr learned my addr 172.21.15.177:0/2504369443 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f36e5bcf640 1 -- 172.21.15.177:0/2504369443 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560450f6b30 con 0x5560450f6140 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/2504369443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450f6560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36d8090fd0 tx=0x7f36d808a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af3ae2be490fc780 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f35c97fa640 1 -- 172.21.15.177:0/2504369443 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d80a3040 con 0x5560450f6140 2024-03-20T13:35:11.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f35c97fa640 1 -- 172.21.15.177:0/2504369443 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d8089d90 con 0x5560450f6140 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.904+0000 7f35c97fa640 1 -- 172.21.15.177:0/2504369443 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d808f240 con 0x5560450f6140 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- 172.21.15.177:0/2504369443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 msgr2=0x5560450f6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 --2- 172.21.15.177:0/2504369443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450f6560 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f36d8090fd0 tx=0x7f36d808a2d0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- 172.21.15.177:0/2504369443 shutdown_connections 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 --2- 172.21.15.177:0/2504369443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450f6560 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- 172.21.15.177:0/2504369443 >> 172.21.15.177:0/2504369443 conn(0x5560450f24a0 msgr2=0x5560450f0500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- 172.21.15.177:0/2504369443 shutdown_connections 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- 172.21.15.177:0/2504369443 wait complete. 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 Processor -- start 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- start start 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450fcf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e9f28800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560450fd460 con 0x5560450f6140 2024-03-20T13:35:11.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450fcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e5bcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450fcf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57466/0 (socket says 172.21.15.177:57466) 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 learned_addr learned my addr 172.21.15.177:0/3974969934 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.905+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560450e9b90 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.906+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450fcf20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36d80aa040 tx=0x7f36d807f600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.906+0000 7f35b77fe640 1 -- 172.21.15.177:0/3974969934 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d807f2f0 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.906+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5560450e9b90 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.906+0000 7f35b77fe640 1 -- 172.21.15.177:0/3974969934 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36d807f450 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.906+0000 7f35b77fe640 1 -- 172.21.15.177:0/3974969934 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f36d80045d0 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.906+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5560450fd870 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f35b77fe640 1 -- 172.21.15.177:0/3974969934 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f36d80ae050 con 0x5560450f6140 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f35b77fe640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35b0036790 0x7f35b0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f35b77fe640 1 -- 172.21.15.177:0/3974969934 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f36d80bdc40 con 0x5560450f6140 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35b0036790 0x7f35b0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556045108700 0x55604510abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510b310 con 0x556045108700 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36e63d0640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556045108700 0x55604510abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35b0036790 0x7f35b0038c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5560450db3f0 tx=0x7f36d0010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.907+0000 7f36e63d0640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556045108700 0x55604510abc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 realm 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510b6e0 con 0x556045108700 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510bf30 con 0x556045108700 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55604510cfa0 0x55604510f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510f910 con 0x55604510cfa0 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.908+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55604510cfa0 0x55604510f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55604510cfa0 0x55604510f390 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36e9f28800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36e9f28800 20 searching for the correct realm 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5560451118c0 0x556045113d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045114420 con 0x5560451118c0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5560451118c0 0x556045113d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.909+0000 7f36dd3ce640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5560451118c0 0x556045113d50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.910+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.910+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045114420 con 0x55604510cfa0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.910+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.910+0000 7f36e5bcf640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f36d80bc020 0x7f36d80715a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.910+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045114420 con 0x7f36d80bc020 2024-03-20T13:35:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.911+0000 7f36e63d0640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f36d80bc020 0x7f36d80715a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.911+0000 7f36e63d0640 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f36d80bc020 0x7f36d80715a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.911+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.911+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.911+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.911+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x55604510cfa0 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.912+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.913+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x55604510cfa0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.914+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.915+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.916+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.916+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.916+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.916+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x55604510cfa0 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.916+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.917+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.917+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.917+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.918+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.918+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x5560451118c0 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.918+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.918+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x7f36d80bc020 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.919+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.919+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f36e0031040 con 0x55604510cfa0 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.920+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.920+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f36e0031040 con 0x5560451118c0 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.920+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.920+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f36e0031040 con 0x7f36d80bc020 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.921+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.921+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f36e0031040 con 0x556045108700 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f36e0031040 con 0x55604510cfa0 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604510c290 con 0x556045108700 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.922+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560451101e0 con 0x556045108700 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560451101e0 con 0x7f36d80bc020 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 20 zone default found 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 4 Realm: () 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 20 zonegroup default 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.923+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045110ab0 con 0x7f36d80bc020 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.924+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.924+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.924+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.924+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045110ab0 con 0x5560451118c0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.924+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045116240 con 0x5560451118c0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 20 started sync module instance, tier type = 2024-03-20T13:35:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.925+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045115b20 con 0x55604510cfa0 2024-03-20T13:35:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.926+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.926+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93871963985536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045115ed0 con 0x55604510cfa0 2024-03-20T13:35:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.926+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117050 con 0x556045108700 2024-03-20T13:35:11.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.927+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.927+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93871963985536] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.927+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93871963990960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117470 con 0x556045108700 2024-03-20T13:35:11.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.927+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117de0 con 0x5560451118c0 2024-03-20T13:35:11.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.928+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93871963990960] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.928+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.928+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93871963992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5560451173f0 con 0x5560451118c0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.928+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045118c40 con 0x55604510cfa0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.929+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.929+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93871964000160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045119860 con 0x55604510cfa0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.929+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511a210 con 0x556045108700 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.929+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93871963992016] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.930+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.930+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93871963996560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511a5c0 con 0x556045108700 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.930+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511af90 con 0x7f36d80bc020 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.930+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93871964000160] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.931+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.931+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93871964007056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511af50 con 0x7f36d80bc020 2024-03-20T13:35:11.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.931+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511b970 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.932+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93871963996560] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.932+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93871964007056] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.933+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.933+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93871964001216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045119d30 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.933+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511be10 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93871964001216] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'63 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93871964009648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511be10 con 0x7f36d80bc020 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=0 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=1 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=2 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=3 2024-03-20T13:35:11.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=4 2024-03-20T13:35:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=5 2024-03-20T13:35:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.934+0000 7f36e9f28800 20 add_watcher() i=6 2024-03-20T13:35:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.937+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93871964009648] v30'64 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.937+0000 7f36e9f28800 20 add_watcher() i=7 2024-03-20T13:35:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.937+0000 7f36e9f28800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.937+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511f230 con 0x556045108700 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.937+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.937+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93871964011328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511c710 con 0x556045108700 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.938+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93871964011328] v30'76 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.938+0000 7f35977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.938+0000 7f36e9f28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.938+0000 7f36e9f28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.938+0000 7f36e9f28800 5 note: GC not initialized 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f35967fc640 20 reqs_thread_entry: start 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f36e9f28800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f36e9f28800 20 Filter name: none 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f3507fff640 20 reqs_thread_entry: start 2024-03-20T13:35:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f36e9f28800 20 rados->read ofs=0 len=0 2024-03-20T13:35:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045150c10 con 0x556045108700 2024-03-20T13:35:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.939+0000 7f36e9f28800 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:35:11.944 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:11.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.940+0000 7f35977fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.940+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93871964011328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511ea10 con 0x556045108700 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.941+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93871964011328] v30'77 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.941+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93871963985536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511bb10 con 0x55604510cfa0 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.942+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93871963985536] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.942+0000 7f36e9f28800 20 remove_watcher() i=0 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.942+0000 7f36e9f28800 2 removed watcher, disabling cache 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.942+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93871963990960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045115680 con 0x556045108700 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.943+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93871963990960] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.943+0000 7f36e9f28800 20 remove_watcher() i=1 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.943+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93871963992016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045115680 con 0x5560451118c0 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.944+0000 7f36dd3ce640 1 -- 172.21.15.177:0/3974969934 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93871963992016] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d0006070 con 0x5560451118c0 2024-03-20T13:35:11.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.944+0000 7f36e9f28800 20 remove_watcher() i=2 2024-03-20T13:35:11.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.944+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93871964000160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117050 con 0x55604510cfa0 2024-03-20T13:35:11.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.945+0000 7f36e5bcf640 1 -- 172.21.15.177:0/3974969934 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93871964000160] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36d80b9070 con 0x55604510cfa0 2024-03-20T13:35:11.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.945+0000 7f36e9f28800 20 remove_watcher() i=3 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.945+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93871963996560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117050 con 0x556045108700 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.946+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93871963996560] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x556045108700 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.946+0000 7f36e9f28800 20 remove_watcher() i=4 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.946+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93871964007056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117050 con 0x7f36d80bc020 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.947+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93871964007056] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.947+0000 7f36e9f28800 20 remove_watcher() i=5 2024-03-20T13:35:11.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.947+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93871964001216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556045117050 con 0x7f36d80bc020 2024-03-20T13:35:11.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.948+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93871964001216] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.948+0000 7f36e9f28800 20 remove_watcher() i=6 2024-03-20T13:35:11.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.948+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93871964009648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55604511aa90 con 0x7f36d80bc020 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93871964009648] v30'65 uv63 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f36e000a4a0 con 0x7f36d80bc020 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 20 remove_watcher() i=7 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f36d80bc020 msgr2=0x7f36d80715a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f36d80bc020 0x7f36d80715a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556045108700 msgr2=0x55604510abc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556045108700 0x55604510abc0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55604510cfa0 msgr2=0x55604510f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55604510cfa0 0x55604510f390 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5560451118c0 msgr2=0x556045113d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.949+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5560451118c0 0x556045113d50 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35b0036790 msgr2=0x7f35b0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35b0036790 0x7f35b0038c50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x5560450db3f0 tx=0x7f36d0010000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e63d0640 1 -- 172.21.15.177:0/3974969934 reap_dead start 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 msgr2=0x5560450fcf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450fcf20 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f36d80aa040 tx=0x7f36d807f600 comp rx=0 tx=0).stop 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 shutdown_connections 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3974969934 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450f6140 0x5560450fcf20 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 >> 172.21.15.177:0/3974969934 conn(0x5560450f24a0 msgr2=0x5560450efb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 shutdown_connections 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/3974969934 wait complete. 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35c0036790 msgr2=0x7f35c0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35c0036790 0x7f35c0038c50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x5560450cf460 tx=0x7f36d000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 msgr2=0x5560450e9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 0x5560450e9650 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f36d808bf90 tx=0x7f36d806e6e0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 shutdown_connections 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35c0036790 0x7f35c0038c50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 --2- 172.21.15.177:0/1984329501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5560450e9230 0x5560450e9650 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 >> 172.21.15.177:0/1984329501 conn(0x5560450dd2d0 msgr2=0x5560450dd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 shutdown_connections 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.950+0000 7f36e9f28800 1 -- 172.21.15.177:0/1984329501 wait complete. 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5560450d84e0 msgr2=0x5560450da8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5560450d84e0 0x5560450da8d0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556044fd4f20 msgr2=0x5560450d1df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556044fd4f20 0x5560450d1df0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5560450d4620 msgr2=0x5560450d6a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5560450d4620 0x5560450d6a10 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35cc0367e0 msgr2=0x7f35cc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f35cc0367e0 0x7f35cc038ca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f36d0001d90 tx=0x7f36d00012f0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 msgr2=0x5560450cb140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 --2- 172.21.15.177:0/3264774544 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556044fd25f0 0x5560450cb140 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f36d8005870 tx=0x7f36d8002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e63d0640 1 -- 172.21.15.177:0/3264774544 reap_dead start 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 shutdown_connections 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 >> 172.21.15.177:0/3264774544 conn(0x556044fcc040 msgr2=0x556044fd08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 shutdown_connections 2024-03-20T13:35:11.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:11.951+0000 7f36e9f28800 1 -- 172.21.15.177:0/3264774544 wait complete. 2024-03-20T13:35:11.962 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:11.962 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-03-20T13:35:11.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-03-20T13:35:11.963 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-03-20T13:35:12.009 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.009 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.008+0000 7fa96b20f800 1 Processor -- start 2024-03-20T13:35:12.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.008+0000 7fa96b20f800 1 -- start start 2024-03-20T13:35:12.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.008+0000 7fa96b20f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564ef181aa00 0x564ef181ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.008+0000 7fa96b20f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564ef1766d70 con 0x564ef181bc60 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.008+0000 7fa96b20f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x564ef171d500 con 0x564ef181aa00 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.009+0000 7fa966872640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564ef181aa00 0x564ef181ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.009+0000 7fa95e071640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x564ef181bc60 0x564ef181c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36940/0 (socket says 172.21.15.177:36940) 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.009+0000 7fa95e071640 1 -- 172.21.15.177:0/4003059513 learned_addr learned my addr 172.21.15.177:0/4003059513 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.009+0000 7fa966872640 1 -- 172.21.15.177:0/4003059513 >> v1:172.21.15.28:6789/0 conn(0x564ef181bc60 legacy=0x564ef181c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.009+0000 7fa966872640 1 -- 172.21.15.177:0/4003059513 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ef181b4f0 con 0x564ef181aa00 2024-03-20T13:35:12.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa966872640 1 --2- 172.21.15.177:0/4003059513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef181ae20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa95800a470 tx=0x7fa95801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a150a267e46c9b13 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa966071640 1 -- 172.21.15.177:0/4003059513 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa958052570 con 0x564ef181aa00 2024-03-20T13:35:12.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa966071640 1 -- 172.21.15.177:0/4003059513 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9580526d0 con 0x564ef181aa00 2024-03-20T13:35:12.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa966071640 1 -- 172.21.15.177:0/4003059513 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa958052990 con 0x564ef181aa00 2024-03-20T13:35:12.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa96b20f800 1 -- 172.21.15.177:0/4003059513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 msgr2=0x564ef181ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa96b20f800 1 --2- 172.21.15.177:0/4003059513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef181ae20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fa95800a470 tx=0x7fa95801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:12.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa96b20f800 1 -- 172.21.15.177:0/4003059513 shutdown_connections 2024-03-20T13:35:12.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa96b20f800 1 --2- 172.21.15.177:0/4003059513 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef181ae20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.011+0000 7fa96b20f800 1 -- 172.21.15.177:0/4003059513 >> 172.21.15.177:0/4003059513 conn(0x564ef1816060 msgr2=0x564ef1818480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.012+0000 7fa96b20f800 1 -- 172.21.15.177:0/4003059513 shutdown_connections 2024-03-20T13:35:12.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.012+0000 7fa96b20f800 1 -- 172.21.15.177:0/4003059513 wait complete. 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.023+0000 7fa96b20f800 1 Processor -- start 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.023+0000 7fa96b20f800 1 -- start start 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.023+0000 7fa96b20f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef178ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.023+0000 7fa96b20f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ef171aa30 con 0x564ef181aa00 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef178ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef178ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57488/0 (socket says 172.21.15.177:57488) 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa966872640 1 -- 172.21.15.177:0/1090456320 learned_addr learned my addr 172.21.15.177:0/1090456320 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa966872640 1 -- 172.21.15.177:0/1090456320 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa958005d20 con 0x564ef181aa00 2024-03-20T13:35:12.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa966872640 1 --2- 172.21.15.177:0/1090456320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef178ecd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa958055040 tx=0x7fa95804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecb34590a86ed233 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa854e09640 1 -- 172.21.15.177:0/1090456320 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa95800a180 con 0x564ef181aa00 2024-03-20T13:35:12.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa854e09640 1 -- 172.21.15.177:0/1090456320 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa95800a300 con 0x564ef181aa00 2024-03-20T13:35:12.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.024+0000 7fa854e09640 1 -- 172.21.15.177:0/1090456320 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9580529b0 con 0x564ef181aa00 2024-03-20T13:35:12.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 -- 172.21.15.177:0/1090456320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 msgr2=0x564ef178ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1090456320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef178ecd0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fa958055040 tx=0x7fa95804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 -- 172.21.15.177:0/1090456320 shutdown_connections 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1090456320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef178ecd0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 -- 172.21.15.177:0/1090456320 >> 172.21.15.177:0/1090456320 conn(0x564ef1816060 msgr2=0x564ef1906660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 -- 172.21.15.177:0/1090456320 shutdown_connections 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 -- 172.21.15.177:0/1090456320 wait complete. 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 Processor -- start 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.025+0000 7fa96b20f800 1 -- start start 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.026+0000 7fa96b20f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef1915680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.026+0000 7fa96b20f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ef1716210 con 0x564ef181aa00 2024-03-20T13:35:12.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.026+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef1915680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.026+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef1915680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57490/0 (socket says 172.21.15.177:57490) 2024-03-20T13:35:12.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.026+0000 7fa966872640 1 -- 172.21.15.177:0/1597187876 learned_addr learned my addr 172.21.15.177:0/1597187876 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.027+0000 7fa966872640 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95804e070 con 0x564ef181aa00 2024-03-20T13:35:12.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.028+0000 7fa966872640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef1915680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa95805f040 tx=0x7fa958002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.028+0000 7fa853606640 1 -- 172.21.15.177:0/1597187876 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa95806a070 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.028+0000 7fa853606640 1 -- 172.21.15.177:0/1597187876 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958052d10 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.028+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ef1915bc0 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.028+0000 7fa853606640 1 -- 172.21.15.177:0/1597187876 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa95805d420 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.028+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ef19160a0 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa853606640 1 -- 172.21.15.177:0/1597187876 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa95805d580 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa853606640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa84c036790 0x7fa84c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa853606640 1 -- 172.21.15.177:0/1597187876 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa95808d830 con 0x564ef181aa00 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa95e071640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa84c036790 0x7fa84c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef181bc60 0x564ef191c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef191c870 con 0x564ef181bc60 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa967073640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef181bc60 0x564ef191c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa95e071640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa84c036790 0x7fa84c038c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa950000f60 tx=0x7fa9500012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.029+0000 7fa967073640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef181bc60 0x564ef191c330 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa967073640 1 -- 172.21.15.177:0/1597187876 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef181bc60 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef191cc30 con 0x564ef181bc60 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa967073640 1 -- 172.21.15.177:0/1597187876 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef181bc60 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef191e9f0 0x564ef1920de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19214e0 con 0x564ef191e9f0 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa966872640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef191e9f0 0x564ef1920de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.030+0000 7fa966872640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef191e9f0 0x564ef1920de0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.031+0000 7fa966872640 1 -- 172.21.15.177:0/1597187876 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa958059040 con 0x564ef191e9f0 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.031+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef191d970 con 0x564ef181bc60 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.031+0000 7fa967073640 1 -- 172.21.15.177:0/1597187876 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef181bc60 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.031+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564ef1922900 0x564ef1924cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.031+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1925430 con 0x564ef1922900 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.031+0000 7fa95e071640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564ef1922900 0x564ef1924cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.032+0000 7fa95e071640 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564ef1922900 0x564ef1924cf0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.032+0000 7fa95e071640 1 -- 172.21.15.177:0/1597187876 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa950006070 con 0x564ef1922900 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.032+0000 7fa96b20f800 1 Processor -- start 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.032+0000 7fa96b20f800 1 -- start start 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.032+0000 7fa96b20f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 0x564ef19339e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.032+0000 7fa96b20f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ef16b8c70 con 0x564ef19335c0 2024-03-20T13:35:12.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 0x564ef19339e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 0x564ef19339e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57506/0 (socket says 172.21.15.177:57506) 2024-03-20T13:35:12.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa966872640 1 -- 172.21.15.177:0/2351339028 learned_addr learned my addr 172.21.15.177:0/2351339028 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa966872640 1 -- 172.21.15.177:0/2351339028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ef1933f20 con 0x564ef19335c0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa966872640 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 0x564ef19339e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa958065fb0 tx=0x7fa958077b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa850e01640 1 -- 172.21.15.177:0/2351339028 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa95808a350 con 0x564ef19335c0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa850e01640 1 -- 172.21.15.177:0/2351339028 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958087040 con 0x564ef19335c0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.033+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ef1934990 con 0x564ef19335c0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.034+0000 7fa850e01640 1 -- 172.21.15.177:0/2351339028 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa95808a5e0 con 0x564ef19335c0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.034+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ef1934e50 con 0x564ef19335c0 2024-03-20T13:35:12.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.034+0000 7fa850e01640 1 -- 172.21.15.177:0/2351339028 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa95808d170 con 0x564ef19335c0 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.034+0000 7fa850e01640 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa840036790 0x7fa840038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.034+0000 7fa850e01640 1 -- 172.21.15.177:0/2351339028 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa9580831d0 con 0x564ef19335c0 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa95e071640 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa840036790 0x7fa840038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa96b20f800 1 Processor -- start 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa96b20f800 1 -- start start 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa95e071640 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa840036790 0x7fa840038c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa95000bf50 tx=0x7fa95000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa96b20f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1940a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa96b20f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ef168e5d0 con 0x564ef1940670 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1940a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1940a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57522/0 (socket says 172.21.15.177:57522) 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.035+0000 7fa966872640 1 -- 172.21.15.177:0/1186396681 learned_addr learned my addr 172.21.15.177:0/1186396681 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa966872640 1 -- 172.21.15.177:0/1186396681 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ef1941060 con 0x564ef1940670 2024-03-20T13:35:12.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa966872640 1 --2- 172.21.15.177:0/1186396681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1940a90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa95808be70 tx=0x7fa958065b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376f6feb8c7c98bc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa84a7fc640 1 -- 172.21.15.177:0/1186396681 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa958065c80 con 0x564ef1940670 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa84a7fc640 1 -- 172.21.15.177:0/1186396681 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958080040 con 0x564ef1940670 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa84a7fc640 1 -- 172.21.15.177:0/1186396681 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa958055650 con 0x564ef1940670 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 -- 172.21.15.177:0/1186396681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 msgr2=0x564ef1940a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1186396681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1940a90 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa95808be70 tx=0x7fa958065b40 comp rx=0 tx=0).stop 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 -- 172.21.15.177:0/1186396681 shutdown_connections 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1186396681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1940a90 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 -- 172.21.15.177:0/1186396681 >> 172.21.15.177:0/1186396681 conn(0x564ef193c9d0 msgr2=0x564ef193aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 -- 172.21.15.177:0/1186396681 shutdown_connections 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.036+0000 7fa96b20f800 1 -- 172.21.15.177:0/1186396681 wait complete. 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa96b20f800 1 Processor -- start 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa96b20f800 1 -- start start 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa96b20f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1947420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa96b20f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ef1947960 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1947420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa966872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1947420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57538/0 (socket says 172.21.15.177:57538) 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 learned_addr learned my addr 172.21.15.177:0/3907665501 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.037+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95809b070 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.038+0000 7fa966872640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1947420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa958096810 tx=0x7fa958061f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.038+0000 7fa848ff9640 1 -- 172.21.15.177:0/3907665501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa958009d10 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.038+0000 7fa848ff9640 1 -- 172.21.15.177:0/3907665501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa958055650 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.038+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564ef1947b60 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.038+0000 7fa848ff9640 1 -- 172.21.15.177:0/3907665501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa958096bc0 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.038+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ef1947b60 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa848ff9640 1 -- 172.21.15.177:0/3907665501 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa958096d20 con 0x564ef1940670 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa848ff9640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa830036790 0x7fa830038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa848ff9640 1 -- 172.21.15.177:0/3907665501 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fa9580bac50 con 0x564ef1940670 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa95e071640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa830036790 0x7fa830038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef1952dc0 0x564ef1955280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19559d0 con 0x564ef1952dc0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa95e071640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa830036790 0x7fa830038c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa950001b60 tx=0x7fa950010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.039+0000 7fa967073640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef1952dc0 0x564ef1955280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa967073640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef1952dc0 0x564ef1955280 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 realm 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1955da0 con 0x564ef1952dc0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956980 con 0x564ef1952dc0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef1957330 0x564ef1959720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.040+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1959ce0 con 0x564ef1957330 2024-03-20T13:35:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa966872640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef1957330 0x564ef1959720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa966872640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef1957330 0x564ef1959720 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa96b20f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa96b20f800 20 searching for the correct realm 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564ef195bff0 0x564ef195e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195eb80 con 0x564ef195bff0 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.041+0000 7fa95e071640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564ef195bff0 0x564ef195e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.042+0000 7fa95e071640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564ef195bff0 0x564ef195e4b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.042+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.042+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195eb80 con 0x564ef1957330 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.042+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.042+0000 7fa966872640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa958096070 0x7fa958083910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.042+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195eb80 con 0x7fa958096070 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.043+0000 7fa967073640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa958096070 0x7fa958083910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.043+0000 7fa967073640 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa958096070 0x7fa958083910 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.043+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.043+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.044+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1957330 2024-03-20T13:35:12.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.045+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1957330 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.046+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.047+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1957330 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.048+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef195bff0 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x7fa958096070 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.049+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa960031040 con 0x564ef1957330 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.050+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.050+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa960031040 con 0x564ef195bff0 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.050+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.050+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa950045040 con 0x7fa958096070 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.050+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.050+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa950045040 con 0x564ef1952dc0 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa950045040 con 0x564ef1957330 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1956620 con 0x564ef1952dc0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195a3f0 con 0x564ef1952dc0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.051+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195a3f0 con 0x7fa958096070 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 zone default found 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 4 Realm: () 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 zonegroup default 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195acc0 con 0x7fa958096070 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195acc0 con 0x564ef195bff0 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.052+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19609a0 con 0x564ef195bff0 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.053+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.053+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.053+0000 7fa96b20f800 20 started sync module instance, tier type = 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.053+0000 7fa96b20f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.053+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1960280 con 0x564ef1957330 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.054+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.054+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94897060576736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19611a0 con 0x564ef1957330 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.054+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19619a0 con 0x564ef1952dc0 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.055+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94897060576736] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.055+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.055+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94897060582656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1960e10 con 0x564ef1952dc0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.055+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19624e0 con 0x564ef195bff0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.056+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94897060582656] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.056+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.056+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94897060585440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1962890 con 0x564ef195bff0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.056+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1963330 con 0x564ef1957330 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.057+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.057+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94897060591328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1963fa0 con 0x564ef1957330 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.057+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1964990 con 0x564ef1952dc0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.057+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94897060585440] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.058+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.058+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94897060594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1964950 con 0x564ef1952dc0 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.058+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94897060591328] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.058+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19653d0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.059+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.059+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94897060597424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1965390 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.059+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1965e30 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.060+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94897060594800] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.060+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94897060597424] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.061+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.061+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94897060592384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1965920 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.061+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19662d0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94897060592384] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'66 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94897060583712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19662d0 con 0x7fa958096070 2024-03-20T13:35:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=0 2024-03-20T13:35:12.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=1 2024-03-20T13:35:12.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=2 2024-03-20T13:35:12.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=3 2024-03-20T13:35:12.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=4 2024-03-20T13:35:12.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=5 2024-03-20T13:35:12.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=6 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94897060583712] v30'67 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 20 add_watcher() i=7 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.062+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19696f0 con 0x564ef1952dc0 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.063+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.063+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94897060601856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1966bd0 con 0x564ef1952dc0 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.064+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94897060601856] v30'78 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.064+0000 7fa81d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.064+0000 7fa96b20f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.064+0000 7fa96b20f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.064+0000 7fa96b20f800 5 note: GC not initialized 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.064+0000 7fa797fff640 20 reqs_thread_entry: start 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 20 Filter name: none 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa795ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef199b680 con 0x564ef1952dc0 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv7 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-03-20T13:35:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef199c020 con 0x564ef1957330 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.065+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~621 in=621b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19a1a30 con 0x564ef1952dc0 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~621] v30'8 uv8 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa96b20f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa96b20f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa96b20f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94897060844720 in=809b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef199d260 con 0x564ef1952dc0 2024-03-20T13:35:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94897060594800 notify 128849018887 ret 0) v3 ==== 839+0+0 (crc 0 0 0) 0x7fa96003d040 con 0x564ef1952dc0 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa84a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94897060594800 notifier 4379 bl.length()=797 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa84a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa84a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa84a7fc640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa82c003e90 con 0x564ef1952dc0 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(65 notify.4 [notify cookie 94897060844720 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94897060844720 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa960018db0 con 0x564ef1952dc0 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.067+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19a14b0 con 0x564ef1957330 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v30'1 uv1 ondisk = 0) v8 ==== 236+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa96b20f800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa96b20f800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa96b20f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-03-20T13:35:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94897060844720 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef199cdc0 con 0x564ef1957330 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== watch-notify(notify (1) cookie 94897060576736 notify 128849018883 ret 0) v3 ==== 208+0+0 (crc 0 0 0) 0x564ef1941060 con 0x564ef1957330 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa849ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94897060576736 notifier 4379 bl.length()=166 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(68 notify.0 [notify cookie 94897060844720 out=8b] v0'0 uv66 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa849ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa849ffb640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa849ffb640 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fa79c003420 con 0x564ef1957330 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== watch-notify(notify_complete (2) cookie 94897060844720 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564ef1934990 con 0x564ef1957330 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.069+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.082 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.070+0000 7fa81d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.070+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94897060601856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef199d650 con 0x564ef1952dc0 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.071+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94897060601856] v30'79 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.071+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94897060576736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1965fd0 con 0x564ef1957330 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.072+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94897060576736] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.072+0000 7fa96b20f800 20 remove_watcher() i=0 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.072+0000 7fa96b20f800 2 removed watcher, disabling cache 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.072+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94897060582656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195fde0 con 0x564ef1952dc0 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.073+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94897060582656] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.073+0000 7fa96b20f800 20 remove_watcher() i=1 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.073+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94897060585440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195fde0 con 0x564ef195bff0 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.074+0000 7fa95e071640 1 -- 172.21.15.177:0/3907665501 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94897060585440] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa950006070 con 0x564ef195bff0 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.074+0000 7fa96b20f800 20 remove_watcher() i=2 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.074+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94897060591328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1961fe0 con 0x564ef1957330 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.075+0000 7fa966872640 1 -- 172.21.15.177:0/3907665501 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94897060591328] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa9580b6070 con 0x564ef1957330 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.075+0000 7fa96b20f800 20 remove_watcher() i=3 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.075+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94897060594800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195fde0 con 0x564ef1952dc0 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.076+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94897060594800] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x564ef1952dc0 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.076+0000 7fa96b20f800 20 remove_watcher() i=4 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.076+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94897060597424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef19636e0 con 0x7fa958096070 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.077+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94897060597424] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.077+0000 7fa96b20f800 20 remove_watcher() i=5 2024-03-20T13:35:12.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.077+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94897060592384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef1961fe0 con 0x7fa958096070 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.078+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94897060592384] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.078+0000 7fa96b20f800 20 remove_watcher() i=6 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.078+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94897060583712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x564ef195fde0 con 0x7fa958096070 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94897060583712] v30'68 uv66 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa96000a4a0 con 0x7fa958096070 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 20 remove_watcher() i=7 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa958096070 msgr2=0x7fa958083910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa958096070 0x7fa958083910 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef1952dc0 msgr2=0x564ef1955280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef1952dc0 0x564ef1955280 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef1957330 msgr2=0x564ef1959720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef1957330 0x564ef1959720 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564ef195bff0 msgr2=0x564ef195e4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564ef195bff0 0x564ef195e4b0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa830036790 msgr2=0x7fa830038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa830036790 0x7fa830038c50 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa950001b60 tx=0x7fa950010000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 msgr2=0x564ef1947420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 --2- 172.21.15.177:0/3907665501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef1940670 0x564ef1947420 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa958096810 tx=0x7fa958061f40 comp rx=0 tx=0).stop 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa967073640 1 -- 172.21.15.177:0/3907665501 reap_dead start 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 shutdown_connections 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 >> 172.21.15.177:0/3907665501 conn(0x564ef193c9d0 msgr2=0x564ef193a030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 shutdown_connections 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.079+0000 7fa96b20f800 1 -- 172.21.15.177:0/3907665501 wait complete. 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa840036790 msgr2=0x7fa840038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa840036790 0x7fa840038c50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa95000bf50 tx=0x7fa95000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 msgr2=0x564ef19339e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 0x564ef19339e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa958065fb0 tx=0x7fa958077b60 comp rx=0 tx=0).stop 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 shutdown_connections 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa840036790 0x7fa840038c50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/2351339028 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef19335c0 0x564ef19339e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 >> 172.21.15.177:0/2351339028 conn(0x564ef1927660 msgr2=0x564ef1927a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 shutdown_connections 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/2351339028 wait complete. 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564ef1922900 msgr2=0x564ef1924cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564ef1922900 0x564ef1924cf0 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef181bc60 msgr2=0x564ef191c330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564ef181bc60 0x564ef191c330 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef191e9f0 msgr2=0x564ef1920de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564ef191e9f0 0x564ef1920de0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa84c036790 msgr2=0x7fa84c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa84c036790 0x7fa84c038c50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fa950000f60 tx=0x7fa9500012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 msgr2=0x564ef1915680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 --2- 172.21.15.177:0/1597187876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564ef181aa00 0x564ef1915680 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fa95805f040 tx=0x7fa958002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa967073640 1 -- 172.21.15.177:0/1597187876 reap_dead start 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 shutdown_connections 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 >> 172.21.15.177:0/1597187876 conn(0x564ef1816060 msgr2=0x564ef1904ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 shutdown_connections 2024-03-20T13:35:12.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.080+0000 7fa96b20f800 1 -- 172.21.15.177:0/1597187876 wait complete. 2024-03-20T13:35:12.094 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:12.094 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:35:12.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:35:12.094 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:35:12.137 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.137 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.136+0000 7f8127c33800 1 Processor -- start 2024-03-20T13:35:12.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.136+0000 7f8127c33800 1 -- start start 2024-03-20T13:35:12.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.136+0000 7f8127c33800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f3cc564420 0x55f3cc564840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.136+0000 7f8127c33800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f3cc4b0cd0 con 0x55f3cc564d80 2024-03-20T13:35:12.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.136+0000 7f8127c33800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f3cc467500 con 0x55f3cc564420 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f8125732640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f3cc564420 0x55f3cc564840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f811cf31640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55f3cc564d80 0x55f3cc565230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36948/0 (socket says 172.21.15.177:36948) 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f811cf31640 1 -- 172.21.15.177:0/604563271 learned_addr learned my addr 172.21.15.177:0/604563271 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f8124f31640 1 -- 172.21.15.177:0/604563271 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1121861634 0 0) 0x55f3cc4b0cd0 con 0x55f3cc564d80 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f8124f31640 1 -- 172.21.15.177:0/604563271 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8114001e10 con 0x55f3cc564d80 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f8125732640 1 -- 172.21.15.177:0/604563271 >> v1:172.21.15.28:6789/0 conn(0x55f3cc564d80 legacy=0x55f3cc565230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.137+0000 7f8125732640 1 -- 172.21.15.177:0/604563271 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3cc4d9070 con 0x55f3cc564420 2024-03-20T13:35:12.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.139+0000 7f8125732640 1 --2- 172.21.15.177:0/604563271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc564840 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f811800a470 tx=0x7f811801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57607c7ba1d13ac server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.139+0000 7f8124f31640 1 -- 172.21.15.177:0/604563271 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811804ad60 con 0x55f3cc564420 2024-03-20T13:35:12.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.139+0000 7f8124f31640 1 -- 172.21.15.177:0/604563271 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8118052440 con 0x55f3cc564420 2024-03-20T13:35:12.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.139+0000 7f8124f31640 1 -- 172.21.15.177:0/604563271 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81180526e0 con 0x55f3cc564420 2024-03-20T13:35:12.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.139+0000 7f8127c33800 1 -- 172.21.15.177:0/604563271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 msgr2=0x55f3cc564840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.139+0000 7f8127c33800 1 --2- 172.21.15.177:0/604563271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc564840 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f811800a470 tx=0x7f811801cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:12.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.140+0000 7f8127c33800 1 -- 172.21.15.177:0/604563271 shutdown_connections 2024-03-20T13:35:12.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.140+0000 7f8127c33800 1 --2- 172.21.15.177:0/604563271 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc564840 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.140+0000 7f8127c33800 1 -- 172.21.15.177:0/604563271 >> 172.21.15.177:0/604563271 conn(0x55f3cc560040 msgr2=0x55f3cc562460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.140+0000 7f8127c33800 1 -- 172.21.15.177:0/604563271 shutdown_connections 2024-03-20T13:35:12.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.140+0000 7f8127c33800 1 -- 172.21.15.177:0/604563271 wait complete. 2024-03-20T13:35:12.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.151+0000 7f8127c33800 1 Processor -- start 2024-03-20T13:35:12.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.151+0000 7f8127c33800 1 -- start start 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.151+0000 7f8127c33800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc657a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.151+0000 7f8127c33800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3cc464a30 con 0x55f3cc564420 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc657a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc657a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57554/0 (socket says 172.21.15.177:57554) 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8125732640 1 -- 172.21.15.177:0/3468583317 learned_addr learned my addr 172.21.15.177:0/3468583317 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8125732640 1 -- 172.21.15.177:0/3468583317 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8118005d20 con 0x55f3cc564420 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8125732640 1 --2- 172.21.15.177:0/3468583317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc657a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f811801ccc0 tx=0x7f811804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4588d6b61f6e8088 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8013606640 1 -- 172.21.15.177:0/3468583317 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811800a040 con 0x55f3cc564420 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8013606640 1 -- 172.21.15.177:0/3468583317 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811800a1a0 con 0x55f3cc564420 2024-03-20T13:35:12.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.152+0000 7f8013606640 1 -- 172.21.15.177:0/3468583317 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81180525b0 con 0x55f3cc564420 2024-03-20T13:35:12.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 -- 172.21.15.177:0/3468583317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 msgr2=0x55f3cc657a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 --2- 172.21.15.177:0/3468583317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc657a00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f811801ccc0 tx=0x7f811804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 -- 172.21.15.177:0/3468583317 shutdown_connections 2024-03-20T13:35:12.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 --2- 172.21.15.177:0/3468583317 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc657a00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 -- 172.21.15.177:0/3468583317 >> 172.21.15.177:0/3468583317 conn(0x55f3cc560040 msgr2=0x55f3cc653320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 -- 172.21.15.177:0/3468583317 shutdown_connections 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.153+0000 7f8127c33800 1 -- 172.21.15.177:0/3468583317 wait complete. 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8127c33800 1 Processor -- start 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8127c33800 1 -- start start 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8127c33800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc65ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8127c33800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3cc460210 con 0x55f3cc564420 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc65ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc65ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57556/0 (socket says 172.21.15.177:57556) 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8125732640 1 -- 172.21.15.177:0/3677387337 learned_addr learned my addr 172.21.15.177:0/3677387337 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8125732640 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3cc4d9070 con 0x55f3cc564420 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.154+0000 7f8125732640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc65ef80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f811801d3b0 tx=0x7f8118002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.155+0000 7f8011e03640 1 -- 172.21.15.177:0/3677387337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811806b070 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.155+0000 7f8011e03640 1 -- 172.21.15.177:0/3677387337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8118052cb0 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.155+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3cc65f4c0 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.155+0000 7f8011e03640 1 -- 172.21.15.177:0/3677387337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811806f410 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.155+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3cc65fa00 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8011e03640 1 -- 172.21.15.177:0/3677387337 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8118059050 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8011e03640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f800c036790 0x7f800c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8011e03640 1 -- 172.21.15.177:0/3677387337 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f811808d3a0 con 0x55f3cc564420 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f811cf31640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f800c036790 0x7f800c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc564d80 0x55f3cc665d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6662d0 con 0x55f3cc564d80 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8125f33640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc564d80 0x55f3cc665d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f811cf31640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f800c036790 0x7f800c038c50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8110000f60 tx=0x7f81100010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.156+0000 7f8125f33640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc564d80 0x55f3cc665d50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8125f33640 1 -- 172.21.15.177:0/3677387337 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc564d80 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc663310 con 0x55f3cc564d80 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8125f33640 1 -- 172.21.15.177:0/3677387337 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc564d80 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6684e0 0x55f3cc66a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc66afa0 con 0x55f3cc6684e0 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8125732640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6684e0 0x55f3cc66a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.157+0000 7f8125732640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6684e0 0x55f3cc66a8d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f8125732640 1 -- 172.21.15.177:0/3677387337 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f811807f040 con 0x55f3cc6684e0 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc667460 con 0x55f3cc564d80 2024-03-20T13:35:12.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f8125f33640 1 -- 172.21.15.177:0/3677387337 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc564d80 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f3cc66c3a0 0x55f3cc66e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc66eef0 con 0x55f3cc66c3a0 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f811cf31640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f3cc66c3a0 0x55f3cc66e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.158+0000 7f811cf31640 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f3cc66c3a0 0x55f3cc66e790 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.159+0000 7f811cf31640 1 -- 172.21.15.177:0/3677387337 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc66c3a0 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.159+0000 7f8127c33800 1 Processor -- start 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.159+0000 7f8127c33800 1 -- start start 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.159+0000 7f8127c33800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 0x55f3cc67d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.159+0000 7f8127c33800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3cc402c70 con 0x55f3cc67d0f0 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.159+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 0x55f3cc67d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 0x55f3cc67d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57570/0 (socket says 172.21.15.177:57570) 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f8125732640 1 -- 172.21.15.177:0/2787781007 learned_addr learned my addr 172.21.15.177:0/2787781007 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f8125732640 1 -- 172.21.15.177:0/2787781007 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3cc67da50 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f8125732640 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 0x55f3cc67d510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f811805cfd0 tx=0x7f811805b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f800affd640 1 -- 172.21.15.177:0/2787781007 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8118070bf0 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f800affd640 1 -- 172.21.15.177:0/2787781007 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811808b270 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f800affd640 1 -- 172.21.15.177:0/2787781007 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811808b510 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3cc67e4c0 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.160+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3cc67e980 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.161+0000 7f800affd640 1 -- 172.21.15.177:0/2787781007 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f811808b910 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.161+0000 7f800affd640 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ffc036790 0x7f7ffc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.161+0000 7f800affd640 1 -- 172.21.15.177:0/2787781007 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8118097c40 con 0x55f3cc67d0f0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.161+0000 7f811cf31640 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ffc036790 0x7f7ffc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.161+0000 7f8127c33800 1 Processor -- start 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8127c33800 1 -- start start 2024-03-20T13:35:12.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f811cf31640 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ffc036790 0x7f7ffc038c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f811000bf90 tx=0x7f811000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8127c33800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc68a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8127c33800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3cc3d85d0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc68a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc68a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57576/0 (socket says 172.21.15.177:57576) 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8125732640 1 -- 172.21.15.177:0/3681199131 learned_addr learned my addr 172.21.15.177:0/3681199131 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8125732640 1 -- 172.21.15.177:0/3681199131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3cc68ab90 con 0x55f3cc68a1a0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8125732640 1 --2- 172.21.15.177:0/3681199131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc68a5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f811806efb0 tx=0x7f8118078990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a84600a876ad80a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8008ff9640 1 -- 172.21.15.177:0/3681199131 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811806fe00 con 0x55f3cc68a1a0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8008ff9640 1 -- 172.21.15.177:0/3681199131 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8118002d60 con 0x55f3cc68a1a0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.162+0000 7f8008ff9640 1 -- 172.21.15.177:0/3681199131 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8118079c40 con 0x55f3cc68a1a0 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- 172.21.15.177:0/3681199131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 msgr2=0x55f3cc68a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 --2- 172.21.15.177:0/3681199131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc68a5c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f811806efb0 tx=0x7f8118078990 comp rx=0 tx=0).stop 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- 172.21.15.177:0/3681199131 shutdown_connections 2024-03-20T13:35:12.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 --2- 172.21.15.177:0/3681199131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc68a5c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- 172.21.15.177:0/3681199131 >> 172.21.15.177:0/3681199131 conn(0x55f3cc686500 msgr2=0x55f3cc684560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- 172.21.15.177:0/3681199131 shutdown_connections 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- 172.21.15.177:0/3681199131 wait complete. 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 Processor -- start 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- start start 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc691100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.163+0000 7f8127c33800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3cc691640 con 0x55f3cc68a1a0 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc691100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8125732640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc691100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57580/0 (socket says 172.21.15.177:57580) 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 learned_addr learned my addr 172.21.15.177:0/903897440 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3cc67e4c0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8125732640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc691100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f81180a2040 tx=0x7f8118083f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f7ffaffd640 1 -- 172.21.15.177:0/903897440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811806f6a0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f7ffaffd640 1 -- 172.21.15.177:0/903897440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f811808bbc0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f7ffaffd640 1 -- 172.21.15.177:0/903897440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f811808bea0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3cc67e4c0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.164+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3cc67e4c0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.165+0000 7f7ffaffd640 1 -- 172.21.15.177:0/903897440 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f811806f8f0 con 0x55f3cc68a1a0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.165+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f7ffaffd640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ff00366f0 0x7f7ff0038bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f7ffaffd640 1 -- 172.21.15.177:0/903897440 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f81180bec80 con 0x55f3cc68a1a0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f811cf31640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ff00366f0 0x7f7ff0038bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc69c840 0x55f3cc69ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc69f430 con 0x55f3cc69c840 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8125f33640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc69c840 0x55f3cc69ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f811cf31640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ff00366f0 0x7f7ff0038bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f3cc663250 tx=0x7f8110010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8125f33640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc69c840 0x55f3cc69ece0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8127c33800 20 realm 2024-03-20T13:35:12.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.166+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc69f800 con 0x55f3cc69c840 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a03b0 con 0x55f3cc69c840 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6a0d60 0x55f3cc6a3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a3690 con 0x55f3cc6a0d60 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8125732640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6a0d60 0x55f3cc6a3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.167+0000 7f8125732640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6a0d60 0x55f3cc6a3150 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f8127c33800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f8127c33800 20 searching for the correct realm 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f3cc6a5690 0x55f3cc6a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a8220 con 0x55f3cc6a5690 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f811cf31640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f3cc6a5690 0x55f3cc6a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.168+0000 7f811cf31640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f3cc6a5690 0x55f3cc6a7b50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.169+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.169+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a8220 con 0x55f3cc6a0d60 2024-03-20T13:35:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.169+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.169+0000 7f8125732640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f81180bd060 0x7f8118051800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.169+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a8220 con 0x7f81180bd060 2024-03-20T13:35:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.169+0000 7f8125f33640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f81180bd060 0x7f8118051800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.170+0000 7f8125f33640 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f81180bd060 0x7f8118051800 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.170+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.170+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.171+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.171+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.171+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.171+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.171+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.171+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a0d60 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.172+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a0d60 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.173+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.174+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.175+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a0d60 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.176+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.176+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.176+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.176+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.176+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.176+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc6a5690 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.177+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.177+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x7f81180bd060 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.177+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.177+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8120031040 con 0x55f3cc6a0d60 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.177+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.177+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8120031040 con 0x55f3cc6a5690 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.178+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.178+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8120031040 con 0x7f81180bd060 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.178+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.178+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8120031040 con 0x55f3cc69c840 2024-03-20T13:35:12.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.178+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.178+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8120031040 con 0x55f3cc6a0d60 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a0050 con 0x55f3cc69c840 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a3f90 con 0x55f3cc69c840 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.179+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a3f90 con 0x7f81180bd060 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 20 zone default found 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 4 Realm: () 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 20 zonegroup default 2024-03-20T13:35:12.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a4810 con 0x7f81180bd060 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.180+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a4810 con 0x55f3cc6a5690 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aa040 con 0x55f3cc6a5690 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 20 started sync module instance, tier type = 2024-03-20T13:35:12.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.181+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a94d0 con 0x55f3cc6a0d60 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.182+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.182+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94505594951728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a9c50 con 0x55f3cc6a0d60 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.182+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aae50 con 0x55f3cc69c840 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.183+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94505594951728] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.183+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.183+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94505594956208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6ab270 con 0x55f3cc69c840 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.183+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6abbe0 con 0x55f3cc6a5690 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.184+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94505594956208] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.184+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.184+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94505594957264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6ab1f0 con 0x55f3cc6a5690 2024-03-20T13:35:12.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.184+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aca40 con 0x55f3cc6a0d60 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.185+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.185+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94505594965408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6ad660 con 0x55f3cc6a0d60 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.185+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6ae010 con 0x55f3cc69c840 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.185+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94505594957264] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.186+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.186+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94505594961808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6adfd0 con 0x55f3cc69c840 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.186+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aea70 con 0x7f81180bd060 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.186+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94505594965408] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.187+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94505594961808] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.188+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.188+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94505594971536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6adb30 con 0x7f81180bd060 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.188+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6af2c0 con 0x7f81180bd060 2024-03-20T13:35:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.189+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94505594971536] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.189+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.189+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94505594966464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6adb30 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.189+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6af8f0 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.190+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94505594966464] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'69 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94505594973600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6af8f0 con 0x7f81180bd060 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=0 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=1 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=2 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=3 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=4 2024-03-20T13:35:12.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=5 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.191+0000 7f8127c33800 20 add_watcher() i=6 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.192+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94505594973600] v30'70 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.192+0000 7f8127c33800 20 add_watcher() i=7 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.192+0000 7f8127c33800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.192+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6b2d10 con 0x55f3cc69c840 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.192+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.192+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94505594975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6b01f0 con 0x55f3cc69c840 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.194+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94505594975200] v30'80 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.194+0000 7f7fdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.194+0000 7f8127c33800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.194+0000 7f8127c33800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.194+0000 7f8127c33800 5 note: GC not initialized 2024-03-20T13:35:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f7fda7e4640 20 reqs_thread_entry: start 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f8127c33800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f8127c33800 20 Filter name: none 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f7f4bfff640 20 reqs_thread_entry: start 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f8127c33800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6e46e0 con 0x55f3cc69c840 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.195+0000 7f8127c33800 20 rados_obj.operate() r=0 bl.length=621 2024-03-20T13:35:12.204 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.196+0000 7f7fdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.196+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94505594975200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6e3680 con 0x55f3cc69c840 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.197+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94505594975200] v30'81 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.197+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94505594951728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6af3e0 con 0x55f3cc6a0d60 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.198+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94505594951728] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.198+0000 7f8127c33800 20 remove_watcher() i=0 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.198+0000 7f8127c33800 2 removed watcher, disabling cache 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.198+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94505594956208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a9830 con 0x55f3cc69c840 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.199+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94505594956208] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.199+0000 7f8127c33800 20 remove_watcher() i=1 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.199+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94505594957264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6a9830 con 0x55f3cc6a5690 2024-03-20T13:35:12.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.200+0000 7f811cf31640 1 -- 172.21.15.177:0/903897440 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94505594957264] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8110006070 con 0x55f3cc6a5690 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.200+0000 7f8127c33800 20 remove_watcher() i=2 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.200+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94505594965408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aae50 con 0x55f3cc6a0d60 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.201+0000 7f8125732640 1 -- 172.21.15.177:0/903897440 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94505594965408] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f81180a6020 con 0x55f3cc6a0d60 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.201+0000 7f8127c33800 20 remove_watcher() i=3 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.201+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94505594961808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aae50 con 0x55f3cc69c840 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.202+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94505594961808] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x55f3cc69c840 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.202+0000 7f8127c33800 20 remove_watcher() i=4 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.202+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94505594971536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aae50 con 0x7f81180bd060 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.204+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94505594971536] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.204+0000 7f8127c33800 20 remove_watcher() i=5 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.204+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94505594966464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aae50 con 0x7f81180bd060 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.204+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94505594966464] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.204+0000 7f8127c33800 20 remove_watcher() i=6 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.205+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94505594973600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f3cc6aae50 con 0x7f81180bd060 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.205+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94505594973600] v30'71 uv69 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f812000a4a0 con 0x7f81180bd060 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.205+0000 7f8127c33800 20 remove_watcher() i=7 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f81180bd060 msgr2=0x7f8118051800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f81180bd060 0x7f8118051800 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc69c840 msgr2=0x55f3cc69ece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc69c840 0x55f3cc69ece0 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6a0d60 msgr2=0x55f3cc6a3150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6a0d60 0x55f3cc6a3150 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f3cc6a5690 msgr2=0x55f3cc6a7b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f3cc6a5690 0x55f3cc6a7b50 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ff00366f0 msgr2=0x7f7ff0038bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ff00366f0 0x7f7ff0038bb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x55f3cc663250 tx=0x7f8110010000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 msgr2=0x55f3cc691100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8125f33640 1 -- 172.21.15.177:0/903897440 reap_dead start 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc691100 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f81180a2040 tx=0x7f8118083f30 comp rx=0 tx=0).stop 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 shutdown_connections 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/903897440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc68a1a0 0x55f3cc691100 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 >> 172.21.15.177:0/903897440 conn(0x55f3cc686500 msgr2=0x55f3cc683b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 shutdown_connections 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/903897440 wait complete. 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ffc036790 msgr2=0x7f7ffc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ffc036790 0x7f7ffc038c50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f811000bf90 tx=0x7f811000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 msgr2=0x55f3cc67d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 0x55f3cc67d510 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f811805cfd0 tx=0x7f811805b430 comp rx=0 tx=0).stop 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 shutdown_connections 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ffc036790 0x7f7ffc038c50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 --2- 172.21.15.177:0/2787781007 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc67d0f0 0x55f3cc67d510 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 >> 172.21.15.177:0/2787781007 conn(0x55f3cc671190 msgr2=0x55f3cc671590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 shutdown_connections 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.206+0000 7f8127c33800 1 -- 172.21.15.177:0/2787781007 wait complete. 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f3cc66c3a0 msgr2=0x55f3cc66e790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f3cc66c3a0 0x55f3cc66e790 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc564d80 msgr2=0x55f3cc665d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f3cc564d80 0x55f3cc665d50 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6684e0 msgr2=0x55f3cc66a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f3cc6684e0 0x55f3cc66a8d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f800c036790 msgr2=0x7f800c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f800c036790 0x7f800c038c50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8110000f60 tx=0x7f81100010a0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 msgr2=0x55f3cc65ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 --2- 172.21.15.177:0/3677387337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f3cc564420 0x55f3cc65ef80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f811801d3b0 tx=0x7f8118002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8125f33640 1 -- 172.21.15.177:0/3677387337 reap_dead start 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 shutdown_connections 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 >> 172.21.15.177:0/3677387337 conn(0x55f3cc560040 msgr2=0x55f3cc651b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 shutdown_connections 2024-03-20T13:35:12.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.207+0000 7f8127c33800 1 -- 172.21.15.177:0/3677387337 wait complete. 2024-03-20T13:35:12.216 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:12.216 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-03-20T13:35:12.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-03-20T13:35:12.217 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-03-20T13:35:12.300 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.300+0000 7f32a071f800 1 Processor -- start 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.300+0000 7f32a071f800 1 -- start start 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.300+0000 7f32a071f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c4d5e02f40 0x55c4d5e0ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.300+0000 7f32a071f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c4d5d4dcd0 con 0x55c4d5e01400 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.300+0000 7f32a071f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c4d5d04500 con 0x55c4d5e02f40 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.301+0000 7f329bb1a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c4d5e02f40 0x55c4d5e0ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.301+0000 7f329c31b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55c4d5e01400 0x55c4d5e01820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36952/0 (socket says 172.21.15.177:36952) 2024-03-20T13:35:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.301+0000 7f329c31b640 1 -- 172.21.15.177:0/1360270434 learned_addr learned my addr 172.21.15.177:0/1360270434 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.301+0000 7f329bb1a640 1 -- 172.21.15.177:0/1360270434 >> v1:172.21.15.28:6789/0 conn(0x55c4d5e01400 legacy=0x55c4d5e01820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.301+0000 7f329bb1a640 1 -- 172.21.15.177:0/1360270434 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d5d75f00 con 0x55c4d5e02f40 2024-03-20T13:35:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f329bb1a640 1 --2- 172.21.15.177:0/1360270434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e02f40 0x55c4d5e0ba40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f329000a470 tx=0x7f329001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb6522b56c26208 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f329b319640 1 -- 172.21.15.177:0/1360270434 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329004ad40 con 0x55c4d5e02f40 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f329b319640 1 -- 172.21.15.177:0/1360270434 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3290052440 con 0x55c4d5e02f40 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f329b319640 1 -- 172.21.15.177:0/1360270434 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f329004aea0 con 0x55c4d5e02f40 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f32a071f800 1 -- 172.21.15.177:0/1360270434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e02f40 msgr2=0x55c4d5e0ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f32a071f800 1 --2- 172.21.15.177:0/1360270434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e02f40 0x55c4d5e0ba40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f329000a470 tx=0x7f329001cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f32a071f800 1 -- 172.21.15.177:0/1360270434 shutdown_connections 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f32a071f800 1 --2- 172.21.15.177:0/1360270434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e02f40 0x55c4d5e0ba40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.303+0000 7f32a071f800 1 -- 172.21.15.177:0/1360270434 >> 172.21.15.177:0/1360270434 conn(0x55c4d5dfd040 msgr2=0x55c4d5dff460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.304+0000 7f32a071f800 1 -- 172.21.15.177:0/1360270434 shutdown_connections 2024-03-20T13:35:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.304+0000 7f32a071f800 1 -- 172.21.15.177:0/1360270434 wait complete. 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.315+0000 7f32a071f800 1 Processor -- start 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.315+0000 7f32a071f800 1 -- start start 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.315+0000 7f32a071f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5ef4e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.315+0000 7f32a071f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5d01a30 con 0x55c4d5e01400 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5ef4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5ef4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57608/0 (socket says 172.21.15.177:57608) 2024-03-20T13:35:12.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f329c31b640 1 -- 172.21.15.177:0/4244443819 learned_addr learned my addr 172.21.15.177:0/4244443819 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f329c31b640 1 -- 172.21.15.177:0/4244443819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3290005d20 con 0x55c4d5e01400 2024-03-20T13:35:12.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f329c31b640 1 --2- 172.21.15.177:0/4244443819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5ef4e80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f328c001bc0 tx=0x7f328c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aceafda63bbf166 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f318a60c640 1 -- 172.21.15.177:0/4244443819 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c00e470 con 0x55c4d5e01400 2024-03-20T13:35:12.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f318a60c640 1 -- 172.21.15.177:0/4244443819 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c00e5f0 con 0x55c4d5e01400 2024-03-20T13:35:12.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.316+0000 7f318a60c640 1 -- 172.21.15.177:0/4244443819 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c00e950 con 0x55c4d5e01400 2024-03-20T13:35:12.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 -- 172.21.15.177:0/4244443819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 msgr2=0x55c4d5ef4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 --2- 172.21.15.177:0/4244443819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5ef4e80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f328c001bc0 tx=0x7f328c00b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 -- 172.21.15.177:0/4244443819 shutdown_connections 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 --2- 172.21.15.177:0/4244443819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5ef4e80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 -- 172.21.15.177:0/4244443819 >> 172.21.15.177:0/4244443819 conn(0x55c4d5dfd040 msgr2=0x55c4d5ef0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 -- 172.21.15.177:0/4244443819 shutdown_connections 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 -- 172.21.15.177:0/4244443819 wait complete. 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 Processor -- start 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.317+0000 7f32a071f800 1 -- start start 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.318+0000 7f32a071f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5efc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.318+0000 7f32a071f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5cfd210 con 0x55c4d5e01400 2024-03-20T13:35:12.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.319+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5efc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.319+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5efc360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57610/0 (socket says 172.21.15.177:57610) 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.319+0000 7f329c31b640 1 -- 172.21.15.177:0/750265758 learned_addr learned my addr 172.21.15.177:0/750265758 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f329c31b640 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d5d4dcd0 con 0x55c4d5e01400 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f329c31b640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5efc360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b700 tx=0x7f328c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f3188e09640 1 -- 172.21.15.177:0/750265758 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c01f070 con 0x55c4d5e01400 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f3188e09640 1 -- 172.21.15.177:0/750265758 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c0197c0 con 0x55c4d5e01400 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4d5efc8a0 con 0x55c4d5e01400 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f3188e09640 1 -- 172.21.15.177:0/750265758 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c019a60 con 0x55c4d5e01400 2024-03-20T13:35:12.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.320+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4d5efcd80 con 0x55c4d5e01400 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.321+0000 7f3188e09640 1 -- 172.21.15.177:0/750265758 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f328c019bc0 con 0x55c4d5e01400 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.321+0000 7f3188e09640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3184036790 0x7f3184038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.321+0000 7f3188e09640 1 -- 172.21.15.177:0/750265758 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f328c04c740 con 0x55c4d5e01400 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.321+0000 7f329bb1a640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3184036790 0x7f3184038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.321+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5e02f40 0x55c4d5f030e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.321+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f036b0 con 0x55c4d5e02f40 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.322+0000 7f329cb1c640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5e02f40 0x55c4d5f030e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.322+0000 7f329bb1a640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3184036790 0x7f3184038c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3290054000 tx=0x7f329004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.322+0000 7f329cb1c640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5e02f40 0x55c4d5f030e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.322+0000 7f329cb1c640 1 -- 172.21.15.177:0/750265758 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5e02f40 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.322+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f00760 con 0x55c4d5e02f40 2024-03-20T13:35:12.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.322+0000 7f329cb1c640 1 -- 172.21.15.177:0/750265758 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5e02f40 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.323+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f05920 0x55c4d5f07d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.323+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f08400 con 0x55c4d5f05920 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.323+0000 7f329c31b640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f05920 0x55c4d5f07d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.323+0000 7f329c31b640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f05920 0x55c4d5f07d10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.323+0000 7f329c31b640 1 -- 172.21.15.177:0/750265758 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f328c025d30 con 0x55c4d5f05920 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.323+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f048a0 con 0x55c4d5e02f40 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.324+0000 7f329cb1c640 1 -- 172.21.15.177:0/750265758 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5e02f40 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.324+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4d5f09820 0x55c4d5f0bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.324+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f0c350 con 0x55c4d5f09820 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.324+0000 7f329bb1a640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4d5f09820 0x55c4d5f0bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.324+0000 7f329bb1a640 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4d5f09820 0x55c4d5f0bc10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f329bb1a640 1 -- 172.21.15.177:0/750265758 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f09820 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f32a071f800 1 Processor -- start 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f32a071f800 1 -- start start 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f32a071f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 0x55c4d5f1a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f32a071f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5c9fc70 con 0x55c4d5f1a550 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 0x55c4d5f1a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 0x55c4d5f1a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57626/0 (socket says 172.21.15.177:57626) 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.325+0000 7f329c31b640 1 -- 172.21.15.177:0/583812538 learned_addr learned my addr 172.21.15.177:0/583812538 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f329c31b640 1 -- 172.21.15.177:0/583812538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d5f1aeb0 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f329c31b640 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 0x55c4d5f1a970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f328c04abb0 tx=0x7f328c04c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f3181ffb640 1 -- 172.21.15.177:0/583812538 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c049040 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f3181ffb640 1 -- 172.21.15.177:0/583812538 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c016a70 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4d5f1b920 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f3181ffb640 1 -- 172.21.15.177:0/583812538 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c016d50 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.326+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4d5f1bde0 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f3181ffb640 1 -- 172.21.15.177:0/583812538 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f328c00d3d0 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f3181ffb640 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3174036790 0x7f3174038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f3181ffb640 1 -- 172.21.15.177:0/583812538 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f328c033070 con 0x55c4d5f1a550 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f329bb1a640 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3174036790 0x7f3174038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f32a071f800 1 Processor -- start 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f32a071f800 1 -- start start 2024-03-20T13:35:12.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f329bb1a640 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3174036790 0x7f3174038c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55c4d5f00680 tx=0x7f3290005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f32a071f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f27c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.327+0000 7f32a071f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5c755d0 con 0x55c4d5f27820 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f27c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f27c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57630/0 (socket says 172.21.15.177:57630) 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f329c31b640 1 -- 172.21.15.177:0/3409673237 learned_addr learned my addr 172.21.15.177:0/3409673237 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f329c31b640 1 -- 172.21.15.177:0/3409673237 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d5f28210 con 0x55c4d5f27820 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f329c31b640 1 --2- 172.21.15.177:0/3409673237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f27c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f328c016380 tx=0x7f328c023d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f188c7aecfbc0f7a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f317b7fe640 1 -- 172.21.15.177:0/3409673237 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c044550 con 0x55c4d5f27820 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f317b7fe640 1 -- 172.21.15.177:0/3409673237 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c00d680 con 0x55c4d5f27820 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.328+0000 7f317b7fe640 1 -- 172.21.15.177:0/3409673237 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c0235c0 con 0x55c4d5f27820 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- 172.21.15.177:0/3409673237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 msgr2=0x55c4d5f27c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 --2- 172.21.15.177:0/3409673237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f27c40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f328c016380 tx=0x7f328c023d10 comp rx=0 tx=0).stop 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- 172.21.15.177:0/3409673237 shutdown_connections 2024-03-20T13:35:12.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 --2- 172.21.15.177:0/3409673237 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f27c40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- 172.21.15.177:0/3409673237 >> 172.21.15.177:0/3409673237 conn(0x55c4d5f23af0 msgr2=0x55c4d5f21b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- 172.21.15.177:0/3409673237 shutdown_connections 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- 172.21.15.177:0/3409673237 wait complete. 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 Processor -- start 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- start start 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f2e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f32a071f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4d5f2ec30 con 0x55c4d5f27820 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f2e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f329c31b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f2e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57636/0 (socket says 172.21.15.177:57636) 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.329+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 learned_addr learned my addr 172.21.15.177:0/1623289387 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4d5f1bde0 con 0x55c4d5f27820 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f329c31b640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f2e6f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f328c016380 tx=0x7f328c02bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f3179ffb640 1 -- 172.21.15.177:0/1623289387 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c017d20 con 0x55c4d5f27820 2024-03-20T13:35:12.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f3179ffb640 1 -- 172.21.15.177:0/1623289387 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c017e80 con 0x55c4d5f27820 2024-03-20T13:35:12.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4d5f1bde0 con 0x55c4d5f27820 2024-03-20T13:35:12.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f3179ffb640 1 -- 172.21.15.177:0/1623289387 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f328c03a150 con 0x55c4d5f27820 2024-03-20T13:35:12.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.330+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4d5f1bde0 con 0x55c4d5f27820 2024-03-20T13:35:12.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.331+0000 7f3179ffb640 1 -- 172.21.15.177:0/1623289387 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f328c03a2b0 con 0x55c4d5f27820 2024-03-20T13:35:12.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.331+0000 7f3179ffb640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f316c036790 0x7f316c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.331+0000 7f3179ffb640 1 -- 172.21.15.177:0/1623289387 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f328c065070 con 0x55c4d5f27820 2024-03-20T13:35:12.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.331+0000 7f329bb1a640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f316c036790 0x7f316c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5f3a000 0x55c4d5f3c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3cc10 con 0x55c4d5f3a000 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f329bb1a640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f316c036790 0x7f316c038c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f329000a350 tx=0x7f329004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f329cb1c640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5f3a000 0x55c4d5f3c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f329cb1c640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5f3a000 0x55c4d5f3c4c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 20 realm 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3cfe0 con 0x55c4d5f3a000 2024-03-20T13:35:12.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.332+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3dbc0 con 0x55c4d5f3a000 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f3e570 0x55c4d5f40960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f40f20 con 0x55c4d5f3e570 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f329c31b640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f3e570 0x55c4d5f40960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f329c31b640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f3e570 0x55c4d5f40960 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.333+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f32a071f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f32a071f800 20 searching for the correct realm 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4d5f43230 0x55c4d5f456f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f45dc0 con 0x55c4d5f43230 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f329bb1a640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4d5f43230 0x55c4d5f456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f329bb1a640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4d5f43230 0x55c4d5f456f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.334+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f45dc0 con 0x55c4d5f3e570 2024-03-20T13:35:12.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.335+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.335+0000 7f329c31b640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f328c006b00 0x7f328c03c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.335+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f45dc0 con 0x7f328c006b00 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.335+0000 7f329cb1c640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f328c006b00 0x7f328c03c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.335+0000 7f329cb1c640 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f328c006b00 0x7f328c03c120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.336+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3e570 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.337+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3e570 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.338+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.339+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3e570 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.340+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.341+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x7f328c006b00 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3294031040 con 0x55c4d5f3e570 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3294031040 con 0x55c4d5f43230 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3294031040 con 0x7f328c006b00 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.342+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3294031040 con 0x55c4d5f3a000 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3294031040 con 0x55c4d5f3e570 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f41630 con 0x55c4d5f3a000 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.343+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f41630 con 0x7f328c006b00 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 zone default found 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 4 Realm: () 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 zonegroup default 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f41eb0 con 0x7f328c006b00 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f422b0 con 0x55c4d5f43230 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.344+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f47be0 con 0x55c4d5f43230 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.345+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.345+0000 7f32a071f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.345+0000 7f32a071f800 20 started sync module instance, tier type = 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.345+0000 7f32a071f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.345+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f474c0 con 0x55c4d5f3e570 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.346+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.346+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94303891517472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f483e0 con 0x55c4d5f3e570 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.346+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f48be0 con 0x55c4d5f3a000 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.347+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94303891517472] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.347+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.347+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94303891523392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f48050 con 0x55c4d5f3a000 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.347+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f49720 con 0x55c4d5f43230 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.348+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.348+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94303891526176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f49f70 con 0x55c4d5f43230 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.348+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4aa40 con 0x55c4d5f3e570 2024-03-20T13:35:12.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.348+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94303891523392] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.349+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.349+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94303891524448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4b290 con 0x55c4d5f3e570 2024-03-20T13:35:12.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.349+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4bb10 con 0x55c4d5f3a000 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.349+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94303891526176] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.350+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.350+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94303891528400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4b730 con 0x55c4d5f3a000 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.350+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4c580 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.350+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94303891524448] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.351+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.351+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94303891538016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4c540 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.351+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4cf80 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.351+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94303891528400] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.352+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94303891538016] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.352+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.352+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94303891540640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4b290 con 0x7f328c006b00 2024-03-20T13:35:12.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.352+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4d420 con 0x7f328c006b00 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94303891540640] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'72 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94303891533776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4d420 con 0x7f328c006b00 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=0 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=1 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=2 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=3 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=4 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=5 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.353+0000 7f32a071f800 20 add_watcher() i=6 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.354+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94303891533776] v30'73 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.354+0000 7f32a071f800 20 add_watcher() i=7 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.354+0000 7f32a071f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.354+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f508f0 con 0x55c4d5f3a000 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.355+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.355+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94303891542560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4dc80 con 0x55c4d5f3a000 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94303891542560] v30'82 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f31527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 5 note: GC not initialized 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f31517e2640 20 reqs_thread_entry: start 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 20 Filter name: none 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f30c2ffd640 20 reqs_thread_entry: start 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:12.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.356+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f82770 con 0x55c4d5f3a000 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.357+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~621 out=621b,getxattrs out=75b] v0'0 uv8 ondisk = 0) v8 ==== 231+0+744 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.357+0000 7f32a071f800 20 rados_obj.operate() r=0 bl.length=621 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.357+0000 7f32a071f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.357+0000 7f32a071f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.357+0000 7f32a071f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.357+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~539 in=539b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f88c30 con 0x55c4d5f3a000 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~539] v30'9 uv9 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f32a071f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f32a071f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f32a071f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94303891785456 in=727b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f845b0 con 0x55c4d5f3a000 2024-03-20T13:35:12.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94303891528400 notify 128849018888 ret 0) v3 ==== 757+0+0 (crc 0 0 0) 0x7f329403d040 con 0x55c4d5f3a000 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f317b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018888 cookie 94303891528400 notifier 4393 bl.length()=715 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 94303891785456 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f317b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f317b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f317b7fe640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3160003e90 con 0x55c4d5f3a000 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.358+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94303891785456 notify 128849018888 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3294018db0 con 0x55c4d5f3a000 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f32a071f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94303891785456 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f84110 con 0x55c4d5f3e570 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== watch-notify(notify (1) cookie 94303891517472 notify 128849018884 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55c4d5f28210 con 0x55c4d5f3e570 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f317b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94303891517472 notifier 4393 bl.length()=159 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f317b7fe640 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f31600041f0 con 0x55c4d5f3e570 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 notify.0 [notify cookie 94303891785456 out=8b] v0'0 uv72 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== watch-notify(notify_complete (2) cookie 94303891785456 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c4d5f1b920 con 0x55c4d5f3e570 2024-03-20T13:35:12.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.359+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f886f0 con 0x55c4d5f3a000 2024-03-20T13:35:12.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.360+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(68 foo:foo1 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.376 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.361+0000 7f31527e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.361+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94303891542560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f84110 con 0x55c4d5f3a000 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.362+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94303891542560] v30'83 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.362+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94303891517472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4d220 con 0x55c4d5f3e570 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.363+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94303891517472] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.363+0000 7f32a071f800 20 remove_watcher() i=0 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.363+0000 7f32a071f800 2 removed watcher, disabling cache 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.363+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94303891523392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f3a000 2024-03-20T13:35:12.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.364+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94303891523392] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.364+0000 7f32a071f800 20 remove_watcher() i=1 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.364+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94303891526176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f3d860 con 0x55c4d5f43230 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.365+0000 7f329bb1a640 1 -- 172.21.15.177:0/1623289387 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94303891526176] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329000a0c0 con 0x55c4d5f43230 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.365+0000 7f32a071f800 20 remove_watcher() i=2 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.365+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94303891524448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f48740 con 0x55c4d5f3e570 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.366+0000 7f329c31b640 1 -- 172.21.15.177:0/1623289387 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94303891524448] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f328c05d070 con 0x55c4d5f3e570 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.366+0000 7f32a071f800 20 remove_watcher() i=3 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.366+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94303891528400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f49220 con 0x55c4d5f3a000 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.367+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94303891528400] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x55c4d5f3a000 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.367+0000 7f32a071f800 20 remove_watcher() i=4 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.367+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94303891538016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f49220 con 0x7f328c006b00 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.368+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94303891538016] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.368+0000 7f32a071f800 20 remove_watcher() i=5 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.368+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94303891540640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f49220 con 0x7f328c006b00 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.369+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94303891540640] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.369+0000 7f32a071f800 20 remove_watcher() i=6 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.369+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94303891533776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c4d5f4caa0 con 0x7f328c006b00 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94303891533776] v30'74 uv72 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f329400a4a0 con 0x7f328c006b00 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 20 remove_watcher() i=7 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f328c006b00 msgr2=0x7f328c03c120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f328c006b00 0x7f328c03c120 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5f3a000 msgr2=0x55c4d5f3c4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5f3a000 0x55c4d5f3c4c0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f3e570 msgr2=0x55c4d5f40960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f3e570 0x55c4d5f40960 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4d5f43230 msgr2=0x55c4d5f456f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4d5f43230 0x55c4d5f456f0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f316c036790 msgr2=0x7f316c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f316c036790 0x7f316c038c50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f329000a350 tx=0x7f329004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 msgr2=0x55c4d5f2e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f2e6f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f328c016380 tx=0x7f328c02bfb0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f329cb1c640 1 -- 172.21.15.177:0/1623289387 reap_dead start 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 shutdown_connections 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 --2- 172.21.15.177:0/1623289387 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f27820 0x55c4d5f2e6f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 >> 172.21.15.177:0/1623289387 conn(0x55c4d5f23af0 msgr2=0x55c4d5f21150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 shutdown_connections 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.370+0000 7f32a071f800 1 -- 172.21.15.177:0/1623289387 wait complete. 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3174036790 msgr2=0x7f3174038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3174036790 0x7f3174038c50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x55c4d5f00680 tx=0x7f3290005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:12.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 msgr2=0x55c4d5f1a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 0x55c4d5f1a970 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f328c04abb0 tx=0x7f328c04c480 comp rx=0 tx=0).stop 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 shutdown_connections 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3174036790 0x7f3174038c50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/583812538 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5f1a550 0x55c4d5f1a970 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 >> 172.21.15.177:0/583812538 conn(0x55c4d5f0e5f0 msgr2=0x55c4d5f0e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 shutdown_connections 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/583812538 wait complete. 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4d5f09820 msgr2=0x55c4d5f0bc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4d5f09820 0x55c4d5f0bc10 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5e02f40 msgr2=0x55c4d5f030e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4d5e02f40 0x55c4d5f030e0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f05920 msgr2=0x55c4d5f07d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4d5f05920 0x55c4d5f07d10 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3184036790 msgr2=0x7f3184038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3184036790 0x7f3184038c50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3290054000 tx=0x7f329004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 msgr2=0x55c4d5efc360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 --2- 172.21.15.177:0/750265758 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4d5e01400 0x55c4d5efc360 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f328c00b700 tx=0x7f328c000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f329cb1c640 1 -- 172.21.15.177:0/750265758 reap_dead start 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 shutdown_connections 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 >> 172.21.15.177:0/750265758 conn(0x55c4d5dfd040 msgr2=0x55c4d5eeeea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 shutdown_connections 2024-03-20T13:35:12.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.371+0000 7f32a071f800 1 -- 172.21.15.177:0/750265758 wait complete. 2024-03-20T13:35:12.387 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:12.388 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-03-20T13:35:12.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-03-20T13:35:12.388 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-03-20T13:35:12.430 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.430 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3788f2c800 1 Processor -- start 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3788f2c800 1 -- start start 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3788f2c800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561e8b558080 0x561e8b55a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3788f2c800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561e8b49ecd0 con 0x561e8b554570 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3788f2c800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561e8b455500 con 0x561e8b558080 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f37843f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561e8b558080 0x561e8b55a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3784bf7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x561e8b554570 0x561e8b556960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:36958/0 (socket says 172.21.15.177:36958) 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f37843f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561e8b558080 0x561e8b55a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57640/0 (socket says 172.21.15.177:57640) 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f3784bf7640 1 -- 172.21.15.177:0/2385274998 learned_addr learned my addr 172.21.15.177:0/2385274998 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f37843f6640 1 -- 172.21.15.177:0/2385274998 >> v1:172.21.15.28:6789/0 conn(0x561e8b554570 legacy=0x561e8b556960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.430+0000 7f37843f6640 1 -- 172.21.15.177:0/2385274998 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e8b55b9c0 con 0x561e8b558080 2024-03-20T13:35:12.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.432+0000 7f37843f6640 1 --2- 172.21.15.177:0/2385274998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b558080 0x561e8b55a470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f376c00a470 tx=0x7f376c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7219801c0b9342 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.432+0000 7f3783bf5640 1 -- 172.21.15.177:0/2385274998 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f376c052570 con 0x561e8b558080 2024-03-20T13:35:12.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.432+0000 7f3783bf5640 1 -- 172.21.15.177:0/2385274998 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c0526d0 con 0x561e8b558080 2024-03-20T13:35:12.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.432+0000 7f3783bf5640 1 -- 172.21.15.177:0/2385274998 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f376c052990 con 0x561e8b558080 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 -- 172.21.15.177:0/2385274998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b558080 msgr2=0x561e8b55a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 --2- 172.21.15.177:0/2385274998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b558080 0x561e8b55a470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f376c00a470 tx=0x7f376c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 -- 172.21.15.177:0/2385274998 shutdown_connections 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 --2- 172.21.15.177:0/2385274998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b558080 0x561e8b55a470 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 -- 172.21.15.177:0/2385274998 >> 172.21.15.177:0/2385274998 conn(0x561e8b54e040 msgr2=0x561e8b550460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 -- 172.21.15.177:0/2385274998 shutdown_connections 2024-03-20T13:35:12.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.433+0000 7f3788f2c800 1 -- 172.21.15.177:0/2385274998 wait complete. 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.444+0000 7f3788f2c800 1 Processor -- start 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3788f2c800 1 -- start start 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3788f2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b553eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3788f2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b452a30 con 0x561e8b554570 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b553eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b553eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57648/0 (socket says 172.21.15.177:57648) 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3784bf7640 1 -- 172.21.15.177:0/1881918508 learned_addr learned my addr 172.21.15.177:0/1881918508 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3784bf7640 1 -- 172.21.15.177:0/1881918508 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c005d20 con 0x561e8b554570 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.445+0000 7f3784bf7640 1 --2- 172.21.15.177:0/1881918508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b553eb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f377c0014a0 tx=0x7f377c001960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f0333d99a8e4a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3672e0d640 1 -- 172.21.15.177:0/1881918508 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c004520 con 0x561e8b554570 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3672e0d640 1 -- 172.21.15.177:0/1881918508 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c004680 con 0x561e8b554570 2024-03-20T13:35:12.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3672e0d640 1 -- 172.21.15.177:0/1881918508 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c004980 con 0x561e8b554570 2024-03-20T13:35:12.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 -- 172.21.15.177:0/1881918508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 msgr2=0x561e8b553eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1881918508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b553eb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f377c0014a0 tx=0x7f377c001960 comp rx=0 tx=0).stop 2024-03-20T13:35:12.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 -- 172.21.15.177:0/1881918508 shutdown_connections 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1881918508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b553eb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 -- 172.21.15.177:0/1881918508 >> 172.21.15.177:0/1881918508 conn(0x561e8b54e040 msgr2=0x561e8b63f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 -- 172.21.15.177:0/1881918508 shutdown_connections 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.446+0000 7f3788f2c800 1 -- 172.21.15.177:0/1881918508 wait complete. 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3788f2c800 1 Processor -- start 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3788f2c800 1 -- start start 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3788f2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b64d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3788f2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b44e210 con 0x561e8b554570 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b64d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b64d300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57650/0 (socket says 172.21.15.177:57650) 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3784bf7640 1 -- 172.21.15.177:0/628995734 learned_addr learned my addr 172.21.15.177:0/628995734 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3784bf7640 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e8b49ecd0 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.447+0000 7f3784bf7640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b64d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f377c000f80 tx=0x7f377c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.448+0000 7f367160a640 1 -- 172.21.15.177:0/628995734 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c023030 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.448+0000 7f367160a640 1 -- 172.21.15.177:0/628995734 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c013820 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.448+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e8b64d840 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.448+0000 7f367160a640 1 -- 172.21.15.177:0/628995734 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c013ac0 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.448+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e8b64dd20 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.448+0000 7f367160a640 1 -- 172.21.15.177:0/628995734 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f377c026070 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f367160a640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f366c036790 0x7f366c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f367160a640 1 -- 172.21.15.177:0/628995734 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f377c024070 con 0x561e8b554570 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f37843f6640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f366c036790 0x7f366c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b558080 0x561e8b654030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b654600 con 0x561e8b558080 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f37853f8640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b558080 0x561e8b654030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f37843f6640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f366c036790 0x7f366c038c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f376c054000 tx=0x7f376c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f37853f8640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b558080 0x561e8b654030 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f37853f8640 1 -- 172.21.15.177:0/628995734 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b558080 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.449+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6516e0 con 0x561e8b558080 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f37853f8640 1 -- 172.21.15.177:0/628995734 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b558080 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b656840 0x561e8b658c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b659330 con 0x561e8b656840 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f3784bf7640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b656840 0x561e8b658c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f3784bf7640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b656840 0x561e8b658c30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f3784bf7640 1 -- 172.21.15.177:0/628995734 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f377c010360 con 0x561e8b656840 2024-03-20T13:35:12.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.450+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6557c0 con 0x561e8b558080 2024-03-20T13:35:12.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.451+0000 7f37853f8640 1 -- 172.21.15.177:0/628995734 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b558080 2024-03-20T13:35:12.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.451+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e8b65a750 0x561e8b65cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.451+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b65d2b0 con 0x561e8b65a750 2024-03-20T13:35:12.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.451+0000 7f37843f6640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e8b65a750 0x561e8b65cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.451+0000 7f37843f6640 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e8b65a750 0x561e8b65cb40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f37843f6640 1 -- 172.21.15.177:0/628995734 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f376c059040 con 0x561e8b65a750 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3788f2c800 1 Processor -- start 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3788f2c800 1 -- start start 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3788f2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 0x561e8b66b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3788f2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b3f0c70 con 0x561e8b66b440 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 0x561e8b66b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 0x561e8b66b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57666/0 (socket says 172.21.15.177:57666) 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3784bf7640 1 -- 172.21.15.177:0/1534891362 learned_addr learned my addr 172.21.15.177:0/1534891362 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.452+0000 7f3784bf7640 1 -- 172.21.15.177:0/1534891362 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e8b66bda0 con 0x561e8b66b440 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.453+0000 7f3784bf7640 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 0x561e8b66b860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f377c04a510 tx=0x7f377c049210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.453+0000 7f366a7fc640 1 -- 172.21.15.177:0/1534891362 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c010e70 con 0x561e8b66b440 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.453+0000 7f366a7fc640 1 -- 172.21.15.177:0/1534891362 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c0128f0 con 0x561e8b66b440 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.453+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e8b66bda0 con 0x561e8b66b440 2024-03-20T13:35:12.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.453+0000 7f366a7fc640 1 -- 172.21.15.177:0/1534891362 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c044130 con 0x561e8b66b440 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.453+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e8b66bda0 con 0x561e8b66b440 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f366a7fc640 1 -- 172.21.15.177:0/1534891362 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f377c028810 con 0x561e8b66b440 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f366a7fc640 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f365c036790 0x7f365c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f366a7fc640 1 -- 172.21.15.177:0/1534891362 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f377c050c70 con 0x561e8b66b440 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f37843f6640 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f365c036790 0x7f365c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3788f2c800 1 Processor -- start 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3788f2c800 1 -- start start 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f37843f6640 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f365c036790 0x7f365c038c50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x561e8b655200 tx=0x7f376c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3788f2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b678640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3788f2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b3c65d0 con 0x561e8b678220 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b678640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b678640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57674/0 (socket says 172.21.15.177:57674) 2024-03-20T13:35:12.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.454+0000 7f3784bf7640 1 -- 172.21.15.177:0/1732428394 learned_addr learned my addr 172.21.15.177:0/1732428394 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3784bf7640 1 -- 172.21.15.177:0/1732428394 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e8b678c10 con 0x561e8b678220 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3784bf7640 1 --2- 172.21.15.177:0/1732428394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b678640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f377c019eb0 tx=0x7f377c0193d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f73ba2f0fba23c66 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f365bfff640 1 -- 172.21.15.177:0/1732428394 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c057070 con 0x561e8b678220 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f365bfff640 1 -- 172.21.15.177:0/1732428394 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c04aad0 con 0x561e8b678220 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f365bfff640 1 -- 172.21.15.177:0/1732428394 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c028c60 con 0x561e8b678220 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3788f2c800 1 -- 172.21.15.177:0/1732428394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 msgr2=0x561e8b678640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1732428394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b678640 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f377c019eb0 tx=0x7f377c0193d0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3788f2c800 1 -- 172.21.15.177:0/1732428394 shutdown_connections 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1732428394 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b678640 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.455+0000 7f3788f2c800 1 -- 172.21.15.177:0/1732428394 >> 172.21.15.177:0/1732428394 conn(0x561e8b6744f0 msgr2=0x561e8b672550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3788f2c800 1 -- 172.21.15.177:0/1732428394 shutdown_connections 2024-03-20T13:35:12.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3788f2c800 1 -- 172.21.15.177:0/1732428394 wait complete. 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3788f2c800 1 Processor -- start 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3788f2c800 1 -- start start 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3788f2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b67f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3788f2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e8b67f5a0 con 0x561e8b678220 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b67f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3784bf7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b67f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:57688/0 (socket says 172.21.15.177:57688) 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 learned_addr learned my addr 172.21.15.177:0/902472639 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.456+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f377c039030 con 0x561e8b678220 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f3784bf7640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b67f060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f377c019da0 tx=0x7f377c04af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f365a7fc640 1 -- 172.21.15.177:0/902472639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c011910 con 0x561e8b678220 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f365a7fc640 1 -- 172.21.15.177:0/902472639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f377c011a70 con 0x561e8b678220 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561e8b67f7a0 con 0x561e8b678220 2024-03-20T13:35:12.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f365a7fc640 1 -- 172.21.15.177:0/902472639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f377c011d10 con 0x561e8b678220 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561e8b67f7a0 con 0x561e8b678220 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.457+0000 7f365a7fc640 1 -- 172.21.15.177:0/902472639 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f377c071020 con 0x561e8b678220 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f365a7fc640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3650036790 0x7f3650038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f365a7fc640 1 -- 172.21.15.177:0/902472639 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f377c075c60 con 0x561e8b678220 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f37843f6640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3650036790 0x7f3650038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f37843f6640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3650036790 0x7f3650038c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f376c055040 tx=0x7f376c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b68aa70 0x561e8b68cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68d680 con 0x561e8b68aa70 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.458+0000 7f37853f8640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b68aa70 0x561e8b68cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f37853f8640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b68aa70 0x561e8b68cf30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 realm 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68da50 con 0x561e8b68aa70 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e2d0 con 0x561e8b68aa70 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.459+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e630 con 0x561e8b68aa70 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b68efe0 0x561e8b6913d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6919e0 con 0x561e8b68efe0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3784bf7640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b68efe0 0x561e8b6913d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3784bf7640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b68efe0 0x561e8b6913d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 20 searching for the correct realm 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e8b693ce0 0x561e8b6961a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b696870 con 0x561e8b693ce0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.460+0000 7f37843f6640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e8b693ce0 0x561e8b6961a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.461+0000 7f37843f6640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e8b693ce0 0x561e8b6961a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.461+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.461+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b696870 con 0x561e8b68efe0 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.461+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.461+0000 7f3784bf7640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f377c03ec20 0x7f377c056130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.461+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b696870 con 0x7f377c03ec20 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.462+0000 7f37853f8640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f377c03ec20 0x7f377c056130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.462+0000 7f37853f8640 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f377c03ec20 0x7f377c056130 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.462+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.462+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e2d0 con 0x561e8b68aa70 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e2d0 con 0x561e8b68aa70 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e2d0 con 0x7f377c03ec20 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e2d0 con 0x7f377c03ec20 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.463+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b68e2d0 con 0x561e8b68efe0 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68aa70 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x7f377c03ec20 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.464+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68aa70 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.475 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68efe0 2024-03-20T13:35:12.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.465+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x7f377c03ec20 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68aa70 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.466+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68aa70 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x7f377c03ec20 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68efe0 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68aa70 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.467+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x7f377c03ec20 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x7f377c03ec20 2024-03-20T13:35:12.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.468+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68efe0 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.469+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.469+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b693ce0 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.469+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.469+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x7f377c03ec20 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.469+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.469+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68aa70 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f377c082040 con 0x561e8b68efe0 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b692100 con 0x561e8b68aa70 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6924b0 con 0x561e8b68aa70 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.470+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6924b0 con 0x7f377c03ec20 2024-03-20T13:35:12.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 zone default found 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 4 Realm: () 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 zonegroup default 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b692d80 con 0x7f377c03ec20 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b692d80 con 0x561e8b693ce0 2024-03-20T13:35:12.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6987f0 con 0x561e8b693ce0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 started sync module instance, tier type = 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.471+0000 7f3788f2c800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.472+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b697f70 con 0x561e8b68efe0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.472+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.472+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94689187953360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b698320 con 0x561e8b68efe0 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.473+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6996c0 con 0x561e8b68aa70 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.473+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.474+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94689187959328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699b80 con 0x561e8b68aa70 2024-03-20T13:35:12.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.474+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69a630 con 0x561e8b693ce0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.474+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94689187953360] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.475+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.475+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94689187959328] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.475+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94689187963184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69aa10 con 0x561e8b693ce0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.475+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699680 con 0x561e8b68efe0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.476+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94689187963184] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.476+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.476+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94689187957776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69b380 con 0x561e8b68efe0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.476+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69bcf0 con 0x561e8b68aa70 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.477+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.477+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94689187957776] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.477+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94689187967200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69bcf0 con 0x561e8b68aa70 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.477+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69c6d0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.478+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.478+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94689187971568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69c6d0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.478+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69d620 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.478+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94689187967200] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.479+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94689187971568] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.479+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.479+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94689187975488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69c920 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.479+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69dac0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94689187975488] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'75 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94689187969104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69dac0 con 0x7f377c03ec20 2024-03-20T13:35:12.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=0 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=1 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=2 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=3 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=4 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=5 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.480+0000 7f3788f2c800 20 add_watcher() i=6 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.481+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94689187969104] v30'76 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.481+0000 7f3788f2c800 20 add_watcher() i=7 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.481+0000 7f3788f2c800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.481+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6a0eb0 con 0x561e8b68aa70 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.481+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.482+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94689187977200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b69e3c0 con 0x561e8b68aa70 2024-03-20T13:35:12.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.482+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94689187977200] v30'84 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f363afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 5 note: GC not initialized 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3639fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 20 Filter name: none 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f35ab7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.483+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6d2e80 con 0x561e8b68aa70 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.484+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~539 out=539b,getxattrs out=75b] v0'0 uv9 ondisk = 0) v8 ==== 231+0+662 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.484+0000 7f3788f2c800 20 rados_obj.operate() r=0 bl.length=539 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.484+0000 7f3788f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.484+0000 7f3788f2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.484+0000 7f3788f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.484+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~513 in=513b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6d9040 con 0x561e8b68aa70 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~513] v30'10 uv10 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f3788f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f3788f2c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f3788f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94689188219584 in=701b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6d4940 con 0x561e8b68aa70 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94689187967200 notify 128849018889 ret 0) v3 ==== 731+0+0 (crc 0 0 0) 0x7f37740384b0 con 0x561e8b68aa70 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f365bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018889 cookie 94689187967200 notifier 4400 bl.length()=689 2024-03-20T13:35:12.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f365bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f365bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f365bfff640 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3648003e90 con 0x561e8b68aa70 2024-03-20T13:35:12.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 94689188219584 out=8b] v0'0 uv75 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== watch-notify(notify_complete (2) cookie 94689188219584 notify 128849018889 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3774038640 con 0x561e8b68aa70 2024-03-20T13:35:12.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.485+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.499 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.486+0000 7f363afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.486+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94689187977200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6d44a0 con 0x561e8b68aa70 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.487+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94689187977200] v30'85 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.487+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94689187953360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b6d5000 con 0x561e8b68efe0 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.488+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94689187953360] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.488+0000 7f3788f2c800 20 remove_watcher() i=0 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.488+0000 7f3788f2c800 2 removed watcher, disabling cache 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.488+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94689187959328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b697ad0 con 0x561e8b68aa70 2024-03-20T13:35:12.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.489+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94689187959328] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.489+0000 7f3788f2c800 20 remove_watcher() i=1 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.489+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94689187963184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b697ad0 con 0x561e8b693ce0 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.490+0000 7f37843f6640 1 -- 172.21.15.177:0/902472639 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94689187963184] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f376c059040 con 0x561e8b693ce0 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.490+0000 7f3788f2c800 20 remove_watcher() i=2 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.490+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94689187957776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699220 con 0x561e8b68efe0 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.491+0000 7f3784bf7640 1 -- 172.21.15.177:0/902472639 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94689187957776] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f377c010360 con 0x561e8b68efe0 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.491+0000 7f3788f2c800 20 remove_watcher() i=3 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.491+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94689187967200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699220 con 0x561e8b68aa70 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.492+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94689187967200] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x561e8b68aa70 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.492+0000 7f3788f2c800 20 remove_watcher() i=4 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.492+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94689187971568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699220 con 0x7f377c03ec20 2024-03-20T13:35:12.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.494+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94689187971568] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.494+0000 7f3788f2c800 20 remove_watcher() i=5 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.494+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94689187975488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699220 con 0x7f377c03ec20 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.495+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94689187975488] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.495+0000 7f3788f2c800 20 remove_watcher() i=6 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.495+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94689187969104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561e8b699220 con 0x7f377c03ec20 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94689187969104] v30'77 uv75 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f37740083e0 con 0x7f377c03ec20 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 20 remove_watcher() i=7 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f377c03ec20 msgr2=0x7f377c056130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f377c03ec20 0x7f377c056130 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b68aa70 msgr2=0x561e8b68cf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b68aa70 0x561e8b68cf30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b68efe0 msgr2=0x561e8b6913d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b68efe0 0x561e8b6913d0 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e8b693ce0 msgr2=0x561e8b6961a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561e8b693ce0 0x561e8b6961a0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3650036790 msgr2=0x7f3650038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3650036790 0x7f3650038c50 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f376c055040 tx=0x7f376c04f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 msgr2=0x561e8b67f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f37853f8640 1 -- 172.21.15.177:0/902472639 reap_dead start 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b67f060 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f377c019da0 tx=0x7f377c04af30 comp rx=0 tx=0).stop 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 shutdown_connections 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/902472639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b678220 0x561e8b67f060 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 >> 172.21.15.177:0/902472639 conn(0x561e8b6744f0 msgr2=0x561e8b671b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 shutdown_connections 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/902472639 wait complete. 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f365c036790 msgr2=0x7f365c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f365c036790 0x7f365c038c50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x561e8b655200 tx=0x7f376c005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:12.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 msgr2=0x561e8b66b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 0x561e8b66b860 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f377c04a510 tx=0x7f377c049210 comp rx=0 tx=0).stop 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 shutdown_connections 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f365c036790 0x7f365c038c50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 --2- 172.21.15.177:0/1534891362 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b66b440 0x561e8b66b860 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 >> 172.21.15.177:0/1534891362 conn(0x561e8b65f4e0 msgr2=0x561e8b65f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 shutdown_connections 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.496+0000 7f3788f2c800 1 -- 172.21.15.177:0/1534891362 wait complete. 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e8b65a750 msgr2=0x561e8b65cb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561e8b65a750 0x561e8b65cb40 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b558080 msgr2=0x561e8b654030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561e8b558080 0x561e8b654030 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b656840 msgr2=0x561e8b658c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561e8b656840 0x561e8b658c30 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f366c036790 msgr2=0x7f366c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f366c036790 0x7f366c038c50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f376c054000 tx=0x7f376c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 msgr2=0x561e8b64d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 --2- 172.21.15.177:0/628995734 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561e8b554570 0x561e8b64d300 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f377c000f80 tx=0x7f377c001250 comp rx=0 tx=0).stop 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f37853f8640 1 -- 172.21.15.177:0/628995734 reap_dead start 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 shutdown_connections 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 >> 172.21.15.177:0/628995734 conn(0x561e8b54e040 msgr2=0x561e8b552910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 shutdown_connections 2024-03-20T13:35:12.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.497+0000 7f3788f2c800 1 -- 172.21.15.177:0/628995734 wait complete. 2024-03-20T13:35:12.511 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:12.511 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-03-20T13:35:12.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-03-20T13:35:12.511 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-03-20T13:35:12.596 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.597 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.596+0000 7f55aef1f800 1 Processor -- start 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.596+0000 7f55aef1f800 1 -- start start 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.596+0000 7f55aef1f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55bc24e15e90 0x55bc24e18280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.596+0000 7f55aef1f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55bc24d5dd70 con 0x55bc24e11a00 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.596+0000 7f55aef1f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55bc24d14500 con 0x55bc24e15e90 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.597+0000 7f55a23f2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55bc24e15e90 0x55bc24e18280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.597+0000 7f55aabf3640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55bc24e11a00 0x55bc24e11e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50434/0 (socket says 172.21.15.177:50434) 2024-03-20T13:35:12.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.597+0000 7f55aabf3640 1 -- 172.21.15.177:0/1096033708 learned_addr learned my addr 172.21.15.177:0/1096033708 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.597+0000 7f55a23f2640 1 -- 172.21.15.177:0/1096033708 >> v1:172.21.15.28:6789/0 conn(0x55bc24e11a00 legacy=0x55bc24e11e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.597+0000 7f55a23f2640 1 -- 172.21.15.177:0/1096033708 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc24e198b0 con 0x55bc24e15e90 2024-03-20T13:35:12.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.599+0000 7f55a23f2640 1 --2- 172.21.15.177:0/1096033708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e15e90 0x55bc24e18280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f559400a470 tx=0x7f559401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdb15cebb7d4c20d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.599+0000 7f55aa3f2640 1 -- 172.21.15.177:0/1096033708 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5594052570 con 0x55bc24e15e90 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.599+0000 7f55aa3f2640 1 -- 172.21.15.177:0/1096033708 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55940526d0 con 0x55bc24e15e90 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.599+0000 7f55aa3f2640 1 -- 172.21.15.177:0/1096033708 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5594052990 con 0x55bc24e15e90 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 -- 172.21.15.177:0/1096033708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e15e90 msgr2=0x55bc24e18280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 --2- 172.21.15.177:0/1096033708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e15e90 0x55bc24e18280 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f559400a470 tx=0x7f559401cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 -- 172.21.15.177:0/1096033708 shutdown_connections 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 --2- 172.21.15.177:0/1096033708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e15e90 0x55bc24e18280 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 -- 172.21.15.177:0/1096033708 >> 172.21.15.177:0/1096033708 conn(0x55bc24e0d060 msgr2=0x55bc24e0f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 -- 172.21.15.177:0/1096033708 shutdown_connections 2024-03-20T13:35:12.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.600+0000 7f55aef1f800 1 -- 172.21.15.177:0/1096033708 wait complete. 2024-03-20T13:35:12.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.611+0000 7f55aef1f800 1 Processor -- start 2024-03-20T13:35:12.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.611+0000 7f55aef1f800 1 -- start start 2024-03-20T13:35:12.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.611+0000 7f55aef1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f01910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.611+0000 7f55aef1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc24d11a30 con 0x55bc24e11a00 2024-03-20T13:35:12.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.612+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f01910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.612+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f01910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40262/0 (socket says 172.21.15.177:40262) 2024-03-20T13:35:12.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.612+0000 7f55aabf3640 1 -- 172.21.15.177:0/2822548675 learned_addr learned my addr 172.21.15.177:0/2822548675 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.613+0000 7f55aabf3640 1 -- 172.21.15.177:0/2822548675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5594005d20 con 0x55bc24e11a00 2024-03-20T13:35:12.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.613+0000 7f55aabf3640 1 --2- 172.21.15.177:0/2822548675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f01910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f559c001bf0 tx=0x7f559c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bdaa1f0ce36e13 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.613+0000 7f5498e09640 1 -- 172.21.15.177:0/2822548675 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c00e470 con 0x55bc24e11a00 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.613+0000 7f5498e09640 1 -- 172.21.15.177:0/2822548675 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c00e5f0 con 0x55bc24e11a00 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.613+0000 7f5498e09640 1 -- 172.21.15.177:0/2822548675 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c00e910 con 0x55bc24e11a00 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- 172.21.15.177:0/2822548675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 msgr2=0x55bc24f01910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2822548675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f01910 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f559c001bf0 tx=0x7f559c00b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- 172.21.15.177:0/2822548675 shutdown_connections 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2822548675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f01910 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- 172.21.15.177:0/2822548675 >> 172.21.15.177:0/2822548675 conn(0x55bc24e0d060 msgr2=0x55bc24efd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- 172.21.15.177:0/2822548675 shutdown_connections 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- 172.21.15.177:0/2822548675 wait complete. 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 Processor -- start 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- start start 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f09020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aef1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc24d0d210 con 0x55bc24e11a00 2024-03-20T13:35:12.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f09020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f09020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40278/0 (socket says 172.21.15.177:40278) 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.614+0000 7f55aabf3640 1 -- 172.21.15.177:0/3592483706 learned_addr learned my addr 172.21.15.177:0/3592483706 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f55aabf3640 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc24d5dd70 con 0x55bc24e11a00 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f55aabf3640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f09020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f559c004000 tx=0x7f559c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f5497606640 1 -- 172.21.15.177:0/3592483706 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c01f070 con 0x55bc24e11a00 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f5497606640 1 -- 172.21.15.177:0/3592483706 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c0197c0 con 0x55bc24e11a00 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc24f09560 con 0x55bc24e11a00 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f5497606640 1 -- 172.21.15.177:0/3592483706 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c019a80 con 0x55bc24e11a00 2024-03-20T13:35:12.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.615+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc24f099e0 con 0x55bc24e11a00 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f5497606640 1 -- 172.21.15.177:0/3592483706 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f559c019be0 con 0x55bc24e11a00 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f5497606640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5490036790 0x7f5490038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f5497606640 1 -- 172.21.15.177:0/3592483706 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f559c04c6c0 con 0x55bc24e11a00 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f55a23f2640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5490036790 0x7f5490038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24e15e90 0x55bc24f0fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f102c0 con 0x55bc24e15e90 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.616+0000 7f55ab3f4640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24e15e90 0x55bc24f0fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55a23f2640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5490036790 0x7f5490038c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5594054000 tx=0x7f559404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55ab3f4640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24e15e90 0x55bc24f0fca0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55ab3f4640 1 -- 172.21.15.177:0/3592483706 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24e15e90 2024-03-20T13:35:12.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f0d3b0 con 0x55bc24e15e90 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55ab3f4640 1 -- 172.21.15.177:0/3592483706 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24e15e90 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f12500 0x55bc24f148f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f14fc0 con 0x55bc24f12500 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.617+0000 7f55aabf3640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f12500 0x55bc24f148f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55aabf3640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f12500 0x55bc24f148f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55aabf3640 1 -- 172.21.15.177:0/3592483706 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f559c00d590 con 0x55bc24f12500 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f11480 con 0x55bc24e15e90 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55ab3f4640 1 -- 172.21.15.177:0/3592483706 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24e15e90 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55bc24f163c0 0x55bc24f187b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f18f10 con 0x55bc24f163c0 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.618+0000 7f55a23f2640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55bc24f163c0 0x55bc24f187b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.619+0000 7f55a23f2640 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55bc24f163c0 0x55bc24f187b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.619+0000 7f55a23f2640 1 -- 172.21.15.177:0/3592483706 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f163c0 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.619+0000 7f55aef1f800 1 Processor -- start 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.619+0000 7f55aef1f800 1 -- start start 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aef1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 0x55bc24f2b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aef1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc24cafc70 con 0x55bc24f28d60 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 0x55bc24f2b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 0x55bc24f2b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40280/0 (socket says 172.21.15.177:40280) 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aabf3640 1 -- 172.21.15.177:0/3953256437 learned_addr learned my addr 172.21.15.177:0/3953256437 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aabf3640 1 -- 172.21.15.177:0/3953256437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc24d85f90 con 0x55bc24f28d60 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aabf3640 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 0x55bc24f2b150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f559c018fd0 tx=0x7f559c023d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f5494e01640 1 -- 172.21.15.177:0/3953256437 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c033040 con 0x55bc24f28d60 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f5494e01640 1 -- 172.21.15.177:0/3953256437 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c044320 con 0x55bc24f28d60 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc24f2b690 con 0x55bc24f28d60 2024-03-20T13:35:12.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.620+0000 7f5494e01640 1 -- 172.21.15.177:0/3953256437 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c0445e0 con 0x55bc24f28d60 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.621+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc24f2baf0 con 0x55bc24f28d60 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.621+0000 7f5494e01640 1 -- 172.21.15.177:0/3953256437 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f559c043030 con 0x55bc24f28d60 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.621+0000 7f5494e01640 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5484036790 0x7f5484038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.621+0000 7f5494e01640 1 -- 172.21.15.177:0/3953256437 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f559c047050 con 0x55bc24f28d60 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.621+0000 7f55a23f2640 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5484036790 0x7f5484038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aef1f800 1 Processor -- start 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aef1f800 1 -- start start 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aef1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f35710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55a23f2640 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5484036790 0x7f5484038c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55bc24f0d2f0 tx=0x7f5594005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aef1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc24c855d0 con 0x55bc24f35330 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f35710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f35710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40296/0 (socket says 172.21.15.177:40296) 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aabf3640 1 -- 172.21.15.177:0/1619485064 learned_addr learned my addr 172.21.15.177:0/1619485064 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aabf3640 1 -- 172.21.15.177:0/1619485064 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc24f35ce0 con 0x55bc24f35330 2024-03-20T13:35:12.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.622+0000 7f55aabf3640 1 --2- 172.21.15.177:0/1619485064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f35710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f559c022ff0 tx=0x7f559c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ae22cf8026e86e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f548e7fc640 1 -- 172.21.15.177:0/1619485064 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c0495f0 con 0x55bc24f35330 2024-03-20T13:35:12.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f548e7fc640 1 -- 172.21.15.177:0/1619485064 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c044740 con 0x55bc24f35330 2024-03-20T13:35:12.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f548e7fc640 1 -- 172.21.15.177:0/1619485064 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c017a90 con 0x55bc24f35330 2024-03-20T13:35:12.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 -- 172.21.15.177:0/1619485064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 msgr2=0x55bc24f35710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 --2- 172.21.15.177:0/1619485064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f35710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f559c022ff0 tx=0x7f559c021000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 -- 172.21.15.177:0/1619485064 shutdown_connections 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 --2- 172.21.15.177:0/1619485064 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f35710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 -- 172.21.15.177:0/1619485064 >> 172.21.15.177:0/1619485064 conn(0x55bc24f31600 msgr2=0x55bc24f2f660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 -- 172.21.15.177:0/1619485064 shutdown_connections 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 -- 172.21.15.177:0/1619485064 wait complete. 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 Processor -- start 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 -- start start 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.623+0000 7f55aef1f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f3c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aef1f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc24f3c770 con 0x55bc24f35330 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f3c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aabf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f3c230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40306/0 (socket says 172.21.15.177:40306) 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 learned_addr learned my addr 172.21.15.177:0/2233666632 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc24f2b690 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aabf3640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f3c230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f559c04ad70 tx=0x7f559c041ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f548cff9640 1 -- 172.21.15.177:0/2233666632 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c0448b0 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f548cff9640 1 -- 172.21.15.177:0/2233666632 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559c066040 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55bc24f2b690 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f548cff9640 1 -- 172.21.15.177:0/2233666632 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f559c0373f0 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.624+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc24f2b690 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.625+0000 7f548cff9640 1 -- 172.21.15.177:0/2233666632 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f559c017a90 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.625+0000 7f548cff9640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5474036790 0x7f5474038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f548cff9640 1 -- 172.21.15.177:0/2233666632 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f559c0799a0 con 0x55bc24f35330 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55a23f2640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5474036790 0x7f5474038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24f47ac0 0x55bc24f49f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4a6d0 con 0x55bc24f47ac0 2024-03-20T13:35:12.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55ab3f4640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24f47ac0 0x55bc24f49f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55a23f2640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5474036790 0x7f5474038c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f559400a380 tx=0x7f559404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55ab3f4640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24f47ac0 0x55bc24f49f80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.626+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 realm 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4aaa0 con 0x55bc24f47ac0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b680 con 0x55bc24f47ac0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f4c030 0x55bc24f4e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4ea30 con 0x55bc24f4c030 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.627+0000 7f55aabf3640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f4c030 0x55bc24f4e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55aabf3640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f4c030 0x55bc24f4e420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55aef1f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55aef1f800 20 searching for the correct realm 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55bc24f50d10 0x55bc24f531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f53850 con 0x55bc24f50d10 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55a23f2640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55bc24f50d10 0x55bc24f531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.628+0000 7f55a23f2640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55bc24f50d10 0x55bc24f531d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.629+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.629+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f53850 con 0x55bc24f4c030 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.629+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.629+0000 7f55aabf3640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f559c040680 0x7f559c064140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.629+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f53850 con 0x7f559c040680 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.629+0000 7f55ab3f4640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f559c040680 0x7f559c064140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f559c040680 0x7f559c064140 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.630+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f4c030 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.631+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f4c030 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.632+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.633+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.634+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f4c030 2024-03-20T13:35:12.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f50d10 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.635+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x7f559c040680 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f55a4031040 con 0x55bc24f4c030 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f55a4031040 con 0x55bc24f50d10 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f55a4031040 con 0x7f559c040680 2024-03-20T13:35:12.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.636+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f55a4031040 con 0x55bc24f47ac0 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f55a4031040 con 0x55bc24f4c030 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4b320 con 0x55bc24f47ac0 2024-03-20T13:35:12.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4f150 con 0x55bc24f47ac0 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.637+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4f150 con 0x7f559c040680 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 zone default found 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 4 Realm: () 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.653 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 zonegroup default 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4fa60 con 0x7f559c040680 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f4fa60 con 0x55bc24f50d10 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.638+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f55670 con 0x55bc24f50d10 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.639+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.654 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.639+0000 7f55aef1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.639+0000 7f55aef1f800 20 started sync module instance, tier type = 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.639+0000 7f55aef1f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.639+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f54f50 con 0x55bc24f4c030 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.640+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.640+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94266562267824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f55300 con 0x55bc24f4c030 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.640+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f56370 con 0x55bc24f47ac0 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.641+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94266562267824] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.641+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.641+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94266562271696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f56720 con 0x55bc24f47ac0 2024-03-20T13:35:12.655 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.641+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f57110 con 0x55bc24f50d10 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.642+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94266562271696] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.642+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.642+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94266562276336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f574c0 con 0x55bc24f50d10 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.642+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f57f10 con 0x55bc24f4c030 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.643+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94266562276336] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.643+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.643+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94266562272752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f58760 con 0x55bc24f4c030 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.643+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f590d0 con 0x55bc24f47ac0 2024-03-20T13:35:12.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.644+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.644+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94266562285072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f59850 con 0x55bc24f47ac0 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.644+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5a320 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.644+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94266562272752] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.645+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.645+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94266562285072] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.645+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94266562289152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5a2e0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.645+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5ab70 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.646+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94266562289152] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.646+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.646+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94266562282176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5a2e0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.646+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5b1a0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94266562282176] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'78 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94266562292960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5b1a0 con 0x7f559c040680 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=0 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=1 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=2 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=3 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=4 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=5 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.647+0000 7f55aef1f800 20 add_watcher() i=6 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.648+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94266562292960] v30'79 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.648+0000 7f55aef1f800 20 add_watcher() i=7 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.648+0000 7f55aef1f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.648+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5e680 con 0x55bc24f47ac0 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.649+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.649+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94266562290944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5ba30 con 0x55bc24f47ac0 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94266562290944] v30'86 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f54617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 5 note: GC not initialized 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f53dbfff640 20 reqs_thread_entry: start 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 20 Filter name: none 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f53d9ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.650+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f90500 con 0x55bc24f47ac0 2024-03-20T13:35:12.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.651+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~513 out=513b,getxattrs out=75b] v0'0 uv10 ondisk = 0) v8 ==== 231+0+636 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.651+0000 7f55aef1f800 20 rados_obj.operate() r=0 bl.length=513 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.651+0000 7f55aef1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.651+0000 7f55aef1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.651+0000 7f55aef1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.651+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f965d0 con 0x55bc24f47ac0 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v30'11 uv11 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55aef1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55aef1f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55aef1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94266562535568 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f91ee0 con 0x55bc24f47ac0 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94266562285072 notify 128849018890 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f55a403d040 con 0x55bc24f47ac0 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f548e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 94266562285072 notifier 4407 bl.length()=533 2024-03-20T13:35:12.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f548e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f548e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 94266562535568 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.652+0000 7f548e7fc640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5470003e90 con 0x55bc24f47ac0 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94266562535568 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f55a4018db0 con 0x55bc24f47ac0 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55aef1f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94266562535568 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f951a0 con 0x55bc24f4c030 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== watch-notify(notify (1) cookie 94266562267824 notify 128849018885 ret 0) v3 ==== 201+0+0 (crc 0 0 0) 0x55bc24f35ce0 con 0x55bc24f4c030 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f548e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94266562267824 notifier 4407 bl.length()=159 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 notify.0 [notify cookie 94266562535568 out=8b] v0'0 uv78 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f559c070020 con 0x55bc24f4c030 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f548e7fc640 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5470003e90 con 0x55bc24f4c030 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.653+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== watch-notify(notify_complete (2) cookie 94266562535568 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f559c08b020 con 0x55bc24f4c030 2024-03-20T13:35:12.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.654+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(67 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c08d040 con 0x55bc24f4c030 2024-03-20T13:35:12.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.654+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f96090 con 0x55bc24f4c030 2024-03-20T13:35:12.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.654+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(68 foo:foo2 [delete] v30'2 uv2 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c08d040 con 0x55bc24f4c030 2024-03-20T13:35:12.668 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:12.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.655+0000 7f54617e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.655+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94266562290944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5d760 con 0x55bc24f47ac0 2024-03-20T13:35:12.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.656+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94266562290944] v30'87 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.656+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94266562267824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f5a4c0 con 0x55bc24f4c030 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.657+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94266562267824] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c08d040 con 0x55bc24f4c030 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.657+0000 7f55aef1f800 20 remove_watcher() i=0 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.657+0000 7f55aef1f800 2 removed watcher, disabling cache 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.657+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94266562271696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f54ab0 con 0x55bc24f47ac0 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.658+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94266562271696] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.658+0000 7f55aef1f800 20 remove_watcher() i=1 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.658+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94266562276336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f54ab0 con 0x55bc24f50d10 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.659+0000 7f55a23f2640 1 -- 172.21.15.177:0/2233666632 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94266562276336] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5594059040 con 0x55bc24f50d10 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.659+0000 7f55aef1f800 20 remove_watcher() i=2 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.659+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94266562272752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f56bf0 con 0x55bc24f4c030 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.660+0000 7f55aabf3640 1 -- 172.21.15.177:0/2233666632 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94266562272752] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f559c08d040 con 0x55bc24f4c030 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.660+0000 7f55aef1f800 20 remove_watcher() i=3 2024-03-20T13:35:12.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.660+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94266562285072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f56bf0 con 0x55bc24f47ac0 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.661+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94266562285072] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x55bc24f47ac0 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.661+0000 7f55aef1f800 20 remove_watcher() i=4 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.661+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94266562289152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f56bf0 con 0x7f559c040680 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.662+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94266562289152] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.662+0000 7f55aef1f800 20 remove_watcher() i=5 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.662+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94266562282176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f59e00 con 0x7f559c040680 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.663+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94266562282176] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.663+0000 7f55aef1f800 20 remove_watcher() i=6 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.663+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94266562292960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55bc24f582c0 con 0x7f559c040680 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.664+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94266562292960] v30'80 uv78 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f55a400a4a0 con 0x7f559c040680 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.664+0000 7f55aef1f800 20 remove_watcher() i=7 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f559c040680 msgr2=0x7f559c064140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f559c040680 0x7f559c064140 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24f47ac0 msgr2=0x55bc24f49f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24f47ac0 0x55bc24f49f80 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f4c030 msgr2=0x55bc24f4e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f4c030 0x55bc24f4e420 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55bc24f50d10 msgr2=0x55bc24f531d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55bc24f50d10 0x55bc24f531d0 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5474036790 msgr2=0x7f5474038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5474036790 0x7f5474038c50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f559400a380 tx=0x7f559404f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 msgr2=0x55bc24f3c230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55ab3f4640 1 -- 172.21.15.177:0/2233666632 reap_dead start 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f3c230 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f559c04ad70 tx=0x7f559c041ef0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 shutdown_connections 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/2233666632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f35330 0x55bc24f3c230 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 >> 172.21.15.177:0/2233666632 conn(0x55bc24f31600 msgr2=0x55bc24f2ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 shutdown_connections 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/2233666632 wait complete. 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5484036790 msgr2=0x7f5484038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5484036790 0x7f5484038c50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x55bc24f0d2f0 tx=0x7f5594005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 msgr2=0x55bc24f2b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 0x55bc24f2b150 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f559c018fd0 tx=0x7f559c023d00 comp rx=0 tx=0).stop 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 shutdown_connections 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5484036790 0x7f5484038c50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3953256437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24f28d60 0x55bc24f2b150 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 >> 172.21.15.177:0/3953256437 conn(0x55bc24f1b160 msgr2=0x55bc24f1b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 shutdown_connections 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3953256437 wait complete. 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.665+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55bc24f163c0 msgr2=0x55bc24f187b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55bc24f163c0 0x55bc24f187b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24e15e90 msgr2=0x55bc24f0fca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55bc24e15e90 0x55bc24f0fca0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f12500 msgr2=0x55bc24f148f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55bc24f12500 0x55bc24f148f0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5490036790 msgr2=0x7f5490038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5490036790 0x7f5490038c50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5594054000 tx=0x7f559404e000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 msgr2=0x55bc24f09020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 --2- 172.21.15.177:0/3592483706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55bc24e11a00 0x55bc24f09020 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f559c004000 tx=0x7f559c000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55ab3f4640 1 -- 172.21.15.177:0/3592483706 reap_dead start 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 shutdown_connections 2024-03-20T13:35:12.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 >> 172.21.15.177:0/3592483706 conn(0x55bc24e0d060 msgr2=0x55bc24efba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 shutdown_connections 2024-03-20T13:35:12.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.666+0000 7f55aef1f800 1 -- 172.21.15.177:0/3592483706 wait complete. 2024-03-20T13:35:12.679 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:12.680 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:35:12.680 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:35:12.680 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-03-20T13:35:12.722 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.722 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb5129800 1 Processor -- start 2024-03-20T13:35:12.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb5129800 1 -- start start 2024-03-20T13:35:12.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb5129800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5638395bedf0 0x5638395c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb5129800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563839505cd0 con 0x56383952de80 2024-03-20T13:35:12.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb5129800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5638394bc500 con 0x5638395bedf0 2024-03-20T13:35:12.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeabfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5638395bedf0 0x5638395c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb0dac640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56383952de80 0x5638395bd6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50444/0 (socket says 172.21.15.177:50444) 2024-03-20T13:35:12.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeb0dac640 1 -- 172.21.15.177:0/519205530 learned_addr learned my addr 172.21.15.177:0/519205530 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeabfff640 1 -- 172.21.15.177:0/519205530 >> v1:172.21.15.28:6789/0 conn(0x56383952de80 legacy=0x5638395bd6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.722+0000 7efeabfff640 1 -- 172.21.15.177:0/519205530 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638395c29c0 con 0x5638395bedf0 2024-03-20T13:35:12.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.724+0000 7efeabfff640 1 --2- 172.21.15.177:0/519205530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638395bedf0 0x5638395c12b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00a470 tx=0x7efe9c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8985a976265cb6b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.724+0000 7efeab7fe640 1 -- 172.21.15.177:0/519205530 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe9c052570 con 0x5638395bedf0 2024-03-20T13:35:12.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeab7fe640 1 -- 172.21.15.177:0/519205530 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe9c0526d0 con 0x5638395bedf0 2024-03-20T13:35:12.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeab7fe640 1 -- 172.21.15.177:0/519205530 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe9c052990 con 0x5638395bedf0 2024-03-20T13:35:12.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 -- 172.21.15.177:0/519205530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638395bedf0 msgr2=0x5638395c12b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 --2- 172.21.15.177:0/519205530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638395bedf0 0x5638395c12b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00a470 tx=0x7efe9c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 -- 172.21.15.177:0/519205530 shutdown_connections 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 --2- 172.21.15.177:0/519205530 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638395bedf0 0x5638395c12b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 -- 172.21.15.177:0/519205530 >> 172.21.15.177:0/519205530 conn(0x5638395b5040 msgr2=0x5638395b7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 -- 172.21.15.177:0/519205530 shutdown_connections 2024-03-20T13:35:12.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.725+0000 7efeb5129800 1 -- 172.21.15.177:0/519205530 wait complete. 2024-03-20T13:35:12.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.737+0000 7efeb5129800 1 Processor -- start 2024-03-20T13:35:12.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.737+0000 7efeb5129800 1 -- start start 2024-03-20T13:35:12.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.737+0000 7efeb5129800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638395bafd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.737+0000 7efeb5129800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638394b9a30 con 0x56383952de80 2024-03-20T13:35:12.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.738+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638395bafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.738+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638395bafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40324/0 (socket says 172.21.15.177:40324) 2024-03-20T13:35:12.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.738+0000 7efeb0dac640 1 -- 172.21.15.177:0/3024687405 learned_addr learned my addr 172.21.15.177:0/3024687405 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.740+0000 7efeb0dac640 1 -- 172.21.15.177:0/3024687405 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe9c005d20 con 0x56383952de80 2024-03-20T13:35:12.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.740+0000 7efeb0dac640 1 --2- 172.21.15.177:0/3024687405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638395bafd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efea4001c50 tx=0x7efea400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67ff11ab15c74f59 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.740+0000 7efd9ee05640 1 -- 172.21.15.177:0/3024687405 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea400e470 con 0x56383952de80 2024-03-20T13:35:12.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.740+0000 7efd9ee05640 1 -- 172.21.15.177:0/3024687405 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea400e5d0 con 0x56383952de80 2024-03-20T13:35:12.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.740+0000 7efd9ee05640 1 -- 172.21.15.177:0/3024687405 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea400e8d0 con 0x56383952de80 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 -- 172.21.15.177:0/3024687405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 msgr2=0x5638395bafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 --2- 172.21.15.177:0/3024687405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638395bafd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efea4001c50 tx=0x7efea400b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 -- 172.21.15.177:0/3024687405 shutdown_connections 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 --2- 172.21.15.177:0/3024687405 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638395bafd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 -- 172.21.15.177:0/3024687405 >> 172.21.15.177:0/3024687405 conn(0x5638395b5040 msgr2=0x5638396a6350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 -- 172.21.15.177:0/3024687405 shutdown_connections 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.741+0000 7efeb5129800 1 -- 172.21.15.177:0/3024687405 wait complete. 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb5129800 1 Processor -- start 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb5129800 1 -- start start 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb5129800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638396b4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb5129800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638394b5210 con 0x56383952de80 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638396b4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638396b4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40326/0 (socket says 172.21.15.177:40326) 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb0dac640 1 -- 172.21.15.177:0/1322440715 learned_addr learned my addr 172.21.15.177:0/1322440715 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb0dac640 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563839505cd0 con 0x56383952de80 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638396b4300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efea4001c50 tx=0x7efea4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.742+0000 7efd9d602640 1 -- 172.21.15.177:0/1322440715 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea401f070 con 0x56383952de80 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.743+0000 7efd9d602640 1 -- 172.21.15.177:0/1322440715 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea4018850 con 0x56383952de80 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.743+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638396b4840 con 0x56383952de80 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.743+0000 7efd9d602640 1 -- 172.21.15.177:0/1322440715 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea4018b30 con 0x56383952de80 2024-03-20T13:35:12.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.743+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638396b4d20 con 0x56383952de80 2024-03-20T13:35:12.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.743+0000 7efd9d602640 1 -- 172.21.15.177:0/1322440715 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efea4018d20 con 0x56383952de80 2024-03-20T13:35:12.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.743+0000 7efd9d602640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd98036790 0x7efd98038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efd9d602640 1 -- 172.21.15.177:0/1322440715 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7efea404c480 con 0x56383952de80 2024-03-20T13:35:12.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeabfff640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd98036790 0x7efd98038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638395bedf0 0x5638396baff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396bb5c0 con 0x5638395bedf0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeb15ad640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638395bedf0 0x5638396baff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeabfff640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd98036790 0x7efd98038c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe9c054000 tx=0x7efe9c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeb15ad640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638395bedf0 0x5638396baff0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeb15ad640 1 -- 172.21.15.177:0/1322440715 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638395bedf0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.744+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396b8700 con 0x5638395bedf0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb15ad640 1 -- 172.21.15.177:0/1322440715 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638395bedf0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396bd830 0x5638396bfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396c0310 con 0x5638396bd830 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396bd830 0x5638396bfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396bd830 0x5638396bfc20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb0dac640 1 -- 172.21.15.177:0/1322440715 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7efea4014070 con 0x5638396bd830 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.745+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396bc7b0 con 0x5638395bedf0 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.746+0000 7efeb15ad640 1 -- 172.21.15.177:0/1322440715 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638395bedf0 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.746+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5638396c1730 0x5638396c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.746+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396c4220 con 0x5638396c1730 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.746+0000 7efeabfff640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5638396c1730 0x5638396c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.746+0000 7efeabfff640 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5638396c1730 0x5638396c3b20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.746+0000 7efeabfff640 1 -- 172.21.15.177:0/1322440715 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7efe9c059040 con 0x5638396c1730 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb5129800 1 Processor -- start 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb5129800 1 -- start start 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb5129800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 0x5638396d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb5129800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563839457c70 con 0x5638396d2370 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 0x5638396d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 0x5638396d2790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40332/0 (socket says 172.21.15.177:40332) 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb0dac640 1 -- 172.21.15.177:0/2212325775 learned_addr learned my addr 172.21.15.177:0/2212325775 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.747+0000 7efeb0dac640 1 -- 172.21.15.177:0/2212325775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638396d2cd0 con 0x5638396d2370 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efeb0dac640 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 0x5638396d2790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efea404a8d0 tx=0x7efea4023870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efd967fc640 1 -- 172.21.15.177:0/2212325775 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea404abe0 con 0x5638396d2370 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efd967fc640 1 -- 172.21.15.177:0/2212325775 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea404ad40 con 0x5638396d2370 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638396d3740 con 0x5638396d2370 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efd967fc640 1 -- 172.21.15.177:0/2212325775 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea402d440 con 0x5638396d2370 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638396d3c00 con 0x5638396d2370 2024-03-20T13:35:12.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.748+0000 7efd967fc640 1 -- 172.21.15.177:0/2212325775 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efea402d5a0 con 0x5638396d2370 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efd967fc640 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd88036790 0x7efd88038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efd967fc640 1 -- 172.21.15.177:0/2212325775 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7efea4037c80 con 0x5638396d2370 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeabfff640 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd88036790 0x7efd88038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb5129800 1 Processor -- start 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb5129800 1 -- start start 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeabfff640 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd88036790 0x7efd88038c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5638396b8620 tx=0x7efe9c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb5129800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396df910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb5129800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56383942d5d0 con 0x5638396df4f0 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396df910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396df910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40348/0 (socket says 172.21.15.177:40348) 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.749+0000 7efeb0dac640 1 -- 172.21.15.177:0/3190343925 learned_addr learned my addr 172.21.15.177:0/3190343925 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb0dac640 1 -- 172.21.15.177:0/3190343925 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638396dfee0 con 0x5638396df4f0 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb0dac640 1 --2- 172.21.15.177:0/3190343925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396df910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efea4038000 tx=0x7efea4009790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50e3fdd48ccc767f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efd87fff640 1 -- 172.21.15.177:0/3190343925 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea402e5a0 con 0x5638396df4f0 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efd87fff640 1 -- 172.21.15.177:0/3190343925 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea402d850 con 0x5638396df4f0 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efd87fff640 1 -- 172.21.15.177:0/3190343925 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea403ebf0 con 0x5638396df4f0 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 -- 172.21.15.177:0/3190343925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 msgr2=0x5638396df910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 --2- 172.21.15.177:0/3190343925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396df910 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7efea4038000 tx=0x7efea4009790 comp rx=0 tx=0).stop 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 -- 172.21.15.177:0/3190343925 shutdown_connections 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 --2- 172.21.15.177:0/3190343925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396df910 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 -- 172.21.15.177:0/3190343925 >> 172.21.15.177:0/3190343925 conn(0x5638396db7c0 msgr2=0x5638396d9820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 -- 172.21.15.177:0/3190343925 shutdown_connections 2024-03-20T13:35:12.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.750+0000 7efeb5129800 1 -- 172.21.15.177:0/3190343925 wait complete. 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb5129800 1 Processor -- start 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb5129800 1 -- start start 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb5129800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396e6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb5129800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638396e6950 con 0x5638396df4f0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396e6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb0dac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396e6410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40356/0 (socket says 172.21.15.177:40356) 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 learned_addr learned my addr 172.21.15.177:0/1702248001 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.751+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5638396d3740 con 0x5638396df4f0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396e6410 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efea402e450 tx=0x7efea402e480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efd867fc640 1 -- 172.21.15.177:0/1702248001 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea4009350 con 0x5638396df4f0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efd867fc640 1 -- 172.21.15.177:0/1702248001 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efea40094b0 con 0x5638396df4f0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5638396d3740 con 0x5638396df4f0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efd867fc640 1 -- 172.21.15.177:0/1702248001 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efea400dd40 con 0x5638396df4f0 2024-03-20T13:35:12.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5638396d3740 con 0x5638396df4f0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.752+0000 7efd867fc640 1 -- 172.21.15.177:0/1702248001 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7efea4055070 con 0x5638396df4f0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efd867fc640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd7c036790 0x7efd7c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efd867fc640 1 -- 172.21.15.177:0/1702248001 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7efea4052040 con 0x5638396df4f0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeabfff640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd7c036790 0x7efd7c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638396f1cd0 0x5638396f4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f48c0 con 0x5638396f1cd0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeb15ad640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638396f1cd0 0x5638396f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeabfff640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd7c036790 0x7efd7c038c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe9c000c00 tx=0x7efe9c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.753+0000 7efeb15ad640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638396f1cd0 0x5638396f4170 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 realm 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f4c90 con 0x5638396f1cd0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f5840 con 0x5638396f1cd0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396f61f0 0x5638396f85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f8b60 con 0x5638396f61f0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.754+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396f61f0 0x5638396f85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396f61f0 0x5638396f85e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeb5129800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeb5129800 20 searching for the correct realm 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5638396fab00 0x5638396fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396fd690 con 0x5638396fab00 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeabfff640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5638396fab00 0x5638396fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.755+0000 7efeabfff640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5638396fab00 0x5638396fcfc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.756+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.756+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396fd690 con 0x5638396f61f0 2024-03-20T13:35:12.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.756+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.756+0000 7efeb0dac640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7efea406c070 0x7efea4012990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.756+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396fd690 con 0x7efea406c070 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.756+0000 7efeb15ad640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7efea406c070 0x7efea4012990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7efea406c070 0x7efea4012990 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.757+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f61f0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.758+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f61f0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.759+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.760+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.761+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f61f0 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396fab00 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.762+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x7efea406c070 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7efeac031040 con 0x5638396f61f0 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7efeac031040 con 0x5638396fab00 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.763+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7efeac031040 con 0x7efea406c070 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7efeac031040 con 0x5638396f1cd0 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7efeac031040 con 0x5638396f61f0 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f54e0 con 0x5638396f1cd0 2024-03-20T13:35:12.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.764+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f9430 con 0x5638396f1cd0 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f9430 con 0x7efea406c070 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 zone default found 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 4 Realm: () 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 zonegroup default 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f9d00 con 0x7efea406c070 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396fa0e0 con 0x5638396fab00 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.765+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396f9d00 con 0x5638396fab00 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 20 started sync module instance, tier type = 2024-03-20T13:35:12.783 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.766+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396fed90 con 0x5638396f61f0 2024-03-20T13:35:12.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.767+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.767+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94799481792752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396ff140 con 0x5638396f61f0 2024-03-20T13:35:12.784 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.767+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839700180 con 0x5638396f1cd0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.768+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94799481792752] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.768+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.768+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94799481796240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839700560 con 0x5638396f1cd0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.768+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839700f60 con 0x5638396fab00 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.769+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.769+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94799481801312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638397017e0 con 0x5638396fab00 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.769+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638397022b0 con 0x5638396f61f0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.769+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94799481796240] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.770+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.770+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94799481801312] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.770+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94799481797792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839702b00 con 0x5638396f61f0 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.770+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839701340 con 0x5638396f1cd0 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.771+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.771+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94799481797792] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.771+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94799481808480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839703470 con 0x5638396f1cd0 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.771+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839703cb0 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.772+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94799481808480] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.772+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.772+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94799481810896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839703890 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.772+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839704670 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.773+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.773+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94799481815504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839704ad0 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.773+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839705550 con 0x7efea406c070 2024-03-20T13:35:12.795 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.773+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94799481810896] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94799481815504] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'81 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94799481819216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839705510 con 0x7efea406c070 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=0 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=1 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=2 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=3 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=4 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=5 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.774+0000 7efeb5129800 20 add_watcher() i=6 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.775+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94799481819216] v30'82 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.775+0000 7efeb5129800 20 add_watcher() i=7 2024-03-20T13:35:12.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.775+0000 7efeb5129800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.775+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638397045f0 con 0x5638396f1cd0 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.775+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.775+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94799481811952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638397045f0 con 0x5638396f1cd0 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94799481811952] v30'88 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efd66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb5129800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb5129800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb5129800 5 note: GC not initialized 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efd65fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb5129800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb5129800 20 Filter name: none 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efcd77fe640 20 reqs_thread_entry: start 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.776+0000 7efeb5129800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.777+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839739f00 con 0x5638396f1cd0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.778+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.778+0000 7efeb5129800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.778+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56383973b410 con 0x5638396f61f0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.779+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.779+0000 7efd66fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.779+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94799481811952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839739ec0 con 0x5638396f1cd0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.780+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94799481811952] v30'89 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.780+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94799481792752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839739ec0 con 0x5638396f61f0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.781+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94799481792752] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.781+0000 7efeb5129800 20 remove_watcher() i=0 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.781+0000 7efeb5129800 2 removed watcher, disabling cache 2024-03-20T13:35:12.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.781+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94799481796240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839739ec0 con 0x5638396f1cd0 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.782+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94799481796240] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.782+0000 7efeb5129800 20 remove_watcher() i=1 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.782+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94799481801312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x563839739ec0 con 0x5638396fab00 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.783+0000 7efeabfff640 1 -- 172.21.15.177:0/1702248001 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94799481801312] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efe9c059040 con 0x5638396fab00 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.783+0000 7efeb5129800 20 remove_watcher() i=2 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.783+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94799481797792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396ff690 con 0x5638396f61f0 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.784+0000 7efeb0dac640 1 -- 172.21.15.177:0/1702248001 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94799481797792] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efea4014070 con 0x5638396f61f0 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.784+0000 7efeb5129800 20 remove_watcher() i=3 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.784+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94799481808480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396ffca0 con 0x5638396f1cd0 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.785+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94799481808480] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x5638396f1cd0 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.785+0000 7efeb5129800 20 remove_watcher() i=4 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.785+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94799481810896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396ff690 con 0x7efea406c070 2024-03-20T13:35:12.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.786+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94799481810896] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.786+0000 7efeb5129800 20 remove_watcher() i=5 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.786+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94799481815504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638396ff690 con 0x7efea406c070 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.787+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94799481815504] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.787+0000 7efeb5129800 20 remove_watcher() i=6 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.787+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94799481819216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5638397041d0 con 0x7efea406c070 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94799481819216] v30'83 uv81 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7efeac00a4a0 con 0x7efea406c070 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 20 remove_watcher() i=7 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7efea406c070 msgr2=0x7efea4012990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7efea406c070 0x7efea4012990 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638396f1cd0 msgr2=0x5638396f4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638396f1cd0 0x5638396f4170 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396f61f0 msgr2=0x5638396f85e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396f61f0 0x5638396f85e0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5638396fab00 msgr2=0x5638396fcfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5638396fab00 0x5638396fcfc0 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd7c036790 msgr2=0x7efd7c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd7c036790 0x7efd7c038c50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7efe9c000c00 tx=0x7efe9c04f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 msgr2=0x5638396e6410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/1702248001 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396df4f0 0x5638396e6410 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7efea402e450 tx=0x7efea402e480 comp rx=0 tx=0).stop 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 reap_dead start 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb15ad640 1 -- 172.21.15.177:0/1702248001 reap_dead start 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 shutdown_connections 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 >> 172.21.15.177:0/1702248001 conn(0x5638396db7c0 msgr2=0x5638396d8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 shutdown_connections 2024-03-20T13:35:12.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/1702248001 wait complete. 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd88036790 msgr2=0x7efd88038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd88036790 0x7efd88038c50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x5638396b8620 tx=0x7efe9c005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.789+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 msgr2=0x5638396d2790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 0x5638396d2790 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7efea404a8d0 tx=0x7efea4023870 comp rx=0 tx=0).stop 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 shutdown_connections 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd88036790 0x7efd88038c50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/2212325775 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5638396d2370 0x5638396d2790 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 >> 172.21.15.177:0/2212325775 conn(0x5638396c6410 msgr2=0x5638396c6810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 shutdown_connections 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/2212325775 wait complete. 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5638396c1730 msgr2=0x5638396c3b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5638396c1730 0x5638396c3b20 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638395bedf0 msgr2=0x5638396baff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5638395bedf0 0x5638396baff0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396bd830 msgr2=0x5638396bfc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5638396bd830 0x5638396bfc20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd98036790 msgr2=0x7efd98038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efd98036790 0x7efd98038c50 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7efe9c054000 tx=0x7efe9c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 msgr2=0x5638396b4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 --2- 172.21.15.177:0/1322440715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56383952de80 0x5638396b4300 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7efea4001c50 tx=0x7efea4000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb15ad640 1 -- 172.21.15.177:0/1322440715 reap_dead start 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 shutdown_connections 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 >> 172.21.15.177:0/1322440715 conn(0x5638395b5040 msgr2=0x5638395b9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 shutdown_connections 2024-03-20T13:35:12.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.790+0000 7efeb5129800 1 -- 172.21.15.177:0/1322440715 wait complete. 2024-03-20T13:35:12.804 INFO:teuthology.orchestra.run.smithi177.stdout:[] 2024-03-20T13:35:12.805 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:35:12.805 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-03-20T13:35:12.805 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-03-20T13:35:12.805 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-03-20T13:35:12.889 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:12.889 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:12.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.888+0000 7f9d14e10800 1 Processor -- start 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.888+0000 7f9d14e10800 1 -- start start 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d14e10800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56055de1ee70 0x56055de21260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d14e10800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56055dd66cd0 con 0x56055de1a9e0 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d14e10800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56055dd1d500 con 0x56055de1ee70 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d104c2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56055de1a9e0 0x56055de1ae00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50450/0 (socket says 172.21.15.177:50450) 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d104c2640 1 -- 172.21.15.177:0/4100098837 learned_addr learned my addr 172.21.15.177:0/4100098837 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/4100098837 >> v2:172.21.15.28:3300/0 conn(0x56055de1ee70 0x56055de21260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d0f4c0640 1 -- 172.21.15.177:0/4100098837 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1104524483 0 0) 0x56055dd66cd0 con 0x56055de1a9e0 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d0f4c0640 1 -- 172.21.15.177:0/4100098837 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9cfc001e10 con 0x56055de1a9e0 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/4100098837 >> v1:172.21.15.28:6789/0 conn(0x56055de1a9e0 legacy=0x56055de1ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.889+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/4100098837 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56055de22890 con 0x56055de1ee70 2024-03-20T13:35:12.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.892+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/4100098837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1ee70 0x56055de21260 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800a470 tx=0x7f9cf801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93a6a9ed77240a26 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d0f4c0640 1 -- 172.21.15.177:0/4100098837 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf804ad60 con 0x56055de1ee70 2024-03-20T13:35:12.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d0f4c0640 1 -- 172.21.15.177:0/4100098837 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf8052440 con 0x56055de1ee70 2024-03-20T13:35:12.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d0f4c0640 1 -- 172.21.15.177:0/4100098837 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf80526e0 con 0x56055de1ee70 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 -- 172.21.15.177:0/4100098837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1ee70 msgr2=0x56055de21260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 --2- 172.21.15.177:0/4100098837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1ee70 0x56055de21260 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800a470 tx=0x7f9cf801cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 -- 172.21.15.177:0/4100098837 shutdown_connections 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 --2- 172.21.15.177:0/4100098837 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1ee70 0x56055de21260 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 -- 172.21.15.177:0/4100098837 >> 172.21.15.177:0/4100098837 conn(0x56055de16040 msgr2=0x56055de18460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 -- 172.21.15.177:0/4100098837 shutdown_connections 2024-03-20T13:35:12.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.893+0000 7f9d14e10800 1 -- 172.21.15.177:0/4100098837 wait complete. 2024-03-20T13:35:12.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.905+0000 7f9d14e10800 1 Processor -- start 2024-03-20T13:35:12.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.905+0000 7f9d14e10800 1 -- start start 2024-03-20T13:35:12.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.905+0000 7f9d14e10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055de26640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.905+0000 7f9d14e10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055dd1aa30 con 0x56055de1a9e0 2024-03-20T13:35:12.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.906+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055de26640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.906+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055de26640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40366/0 (socket says 172.21.15.177:40366) 2024-03-20T13:35:12.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.906+0000 7f9d104c2640 1 -- 172.21.15.177:0/1065259392 learned_addr learned my addr 172.21.15.177:0/1065259392 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.907+0000 7f9d104c2640 1 -- 172.21.15.177:0/1065259392 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8005d20 con 0x56055de1a9e0 2024-03-20T13:35:12.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.907+0000 7f9d104c2640 1 --2- 172.21.15.177:0/1065259392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055de26640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9d08006e20 tx=0x7f9d08001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2566496c272426e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9bfe60c640 1 -- 172.21.15.177:0/1065259392 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08004520 con 0x56055de1a9e0 2024-03-20T13:35:12.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9bfe60c640 1 -- 172.21.15.177:0/1065259392 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08004680 con 0x56055de1a9e0 2024-03-20T13:35:12.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9bfe60c640 1 -- 172.21.15.177:0/1065259392 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d080049e0 con 0x56055de1a9e0 2024-03-20T13:35:12.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 -- 172.21.15.177:0/1065259392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 msgr2=0x56055de26640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 --2- 172.21.15.177:0/1065259392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055de26640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f9d08006e20 tx=0x7f9d08001a20 comp rx=0 tx=0).stop 2024-03-20T13:35:12.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 -- 172.21.15.177:0/1065259392 shutdown_connections 2024-03-20T13:35:12.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 --2- 172.21.15.177:0/1065259392 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055de26640 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 -- 172.21.15.177:0/1065259392 >> 172.21.15.177:0/1065259392 conn(0x56055de16040 msgr2=0x56055df07150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 -- 172.21.15.177:0/1065259392 shutdown_connections 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.908+0000 7f9d14e10800 1 -- 172.21.15.177:0/1065259392 wait complete. 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d14e10800 1 Processor -- start 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d14e10800 1 -- start start 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d14e10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055df15150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d14e10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055dd16210 con 0x56055de1a9e0 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055df15150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055df15150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40380/0 (socket says 172.21.15.177:40380) 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.909+0000 7f9d104c2640 1 -- 172.21.15.177:0/134354739 learned_addr learned my addr 172.21.15.177:0/134354739 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9d104c2640 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cfc001e10 con 0x56055de1a9e0 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9d104c2640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055df15150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d08002250 tx=0x7f9d08000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9bfce09640 1 -- 172.21.15.177:0/134354739 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08023070 con 0x56055de1a9e0 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9bfce09640 1 -- 172.21.15.177:0/134354739 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d08013820 con 0x56055de1a9e0 2024-03-20T13:35:12.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56055df15690 con 0x56055de1a9e0 2024-03-20T13:35:12.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9bfce09640 1 -- 172.21.15.177:0/134354739 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08013ac0 con 0x56055de1a9e0 2024-03-20T13:35:12.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.910+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56055df15b70 con 0x56055de1a9e0 2024-03-20T13:35:12.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9bfce09640 1 -- 172.21.15.177:0/134354739 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9d08013d30 con 0x56055de1a9e0 2024-03-20T13:35:12.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9bfce09640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9bf8036790 0x7f9bf8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9bfce09640 1 -- 172.21.15.177:0/134354739 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9d0804bff0 con 0x56055de1a9e0 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9bf8036790 0x7f9bf8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055de1ee70 0x56055df1bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df1c4a0 con 0x56055de1ee70 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.911+0000 7f9d10cc3640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055de1ee70 0x56055df1bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9bf8036790 0x7f9bf8038c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8054000 tx=0x7f9cf804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d10cc3640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055de1ee70 0x56055df1bed0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d10cc3640 1 -- 172.21.15.177:0/134354739 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055de1ee70 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df19510 con 0x56055de1ee70 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d10cc3640 1 -- 172.21.15.177:0/134354739 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d000083e0 con 0x56055de1ee70 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df1e6e0 0x56055df20ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df211c0 con 0x56055df1e6e0 2024-03-20T13:35:12.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.912+0000 7f9d104c2640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df1e6e0 0x56055df20ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d104c2640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df1e6e0 0x56055df20ad0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d104c2640 1 -- 172.21.15.177:0/134354739 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9d08025070 con 0x56055df1e6e0 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df1d660 con 0x56055de1ee70 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d10cc3640 1 -- 172.21.15.177:0/134354739 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9d000083e0 con 0x56055de1ee70 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56055df225e0 0x56055df249d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df25110 con 0x56055df225e0 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.913+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56055df225e0 0x56055df249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.914+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56055df225e0 0x56055df249d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.914+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/134354739 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df225e0 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d14e10800 1 Processor -- start 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d14e10800 1 -- start start 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d14e10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 0x56055df33640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d14e10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055dcb8c70 con 0x56055df33220 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 0x56055df33640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 0x56055df33640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40396/0 (socket says 172.21.15.177:40396) 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d104c2640 1 -- 172.21.15.177:0/1283112448 learned_addr learned my addr 172.21.15.177:0/1283112448 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d104c2640 1 -- 172.21.15.177:0/1283112448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56055df33b80 con 0x56055df33220 2024-03-20T13:35:12.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.915+0000 7f9d104c2640 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 0x56055df33640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9d08027920 tx=0x7f9d0803edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9bf5ffb640 1 -- 172.21.15.177:0/1283112448 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d0801de40 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9bf5ffb640 1 -- 172.21.15.177:0/1283112448 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0801ee60 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56055df345f0 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9bf5ffb640 1 -- 172.21.15.177:0/1283112448 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08043d00 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56055df345f0 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9bf5ffb640 1 -- 172.21.15.177:0/1283112448 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9d08043e60 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.916+0000 7f9bf5ffb640 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be80367e0 0x7f9be8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9bf5ffb640 1 -- 172.21.15.177:0/1283112448 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9d08050c70 con 0x56055df33220 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be80367e0 0x7f9be8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d14e10800 1 Processor -- start 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d14e10800 1 -- start start 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be80367e0 0x7f9be8038ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56055df19890 tx=0x7f9cf8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d14e10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df405b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d14e10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055dc8e5d0 con 0x56055df40190 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40400/0 (socket says 172.21.15.177:40400) 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d104c2640 1 -- 172.21.15.177:0/310507164 learned_addr learned my addr 172.21.15.177:0/310507164 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.917+0000 7f9d104c2640 1 -- 172.21.15.177:0/310507164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56055df40b80 con 0x56055df40190 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d104c2640 1 --2- 172.21.15.177:0/310507164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df405b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d0801da60 tx=0x7f9d08033a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e264f7be1bf99148 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9bef7fe640 1 -- 172.21.15.177:0/310507164 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d080433e0 con 0x56055df40190 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9bef7fe640 1 -- 172.21.15.177:0/310507164 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0801e420 con 0x56055df40190 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9bef7fe640 1 -- 172.21.15.177:0/310507164 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08011af0 con 0x56055df40190 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 -- 172.21.15.177:0/310507164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 msgr2=0x56055df405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 --2- 172.21.15.177:0/310507164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df405b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9d0801da60 tx=0x7f9d08033a10 comp rx=0 tx=0).stop 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 -- 172.21.15.177:0/310507164 shutdown_connections 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 --2- 172.21.15.177:0/310507164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df405b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 -- 172.21.15.177:0/310507164 >> 172.21.15.177:0/310507164 conn(0x56055df3c4b0 msgr2=0x56055df3a510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 -- 172.21.15.177:0/310507164 shutdown_connections 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.918+0000 7f9d14e10800 1 -- 172.21.15.177:0/310507164 wait complete. 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.919+0000 7f9d14e10800 1 Processor -- start 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.919+0000 7f9d14e10800 1 -- start start 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.919+0000 7f9d14e10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df47150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.919+0000 7f9d14e10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56055df47690 con 0x56055df40190 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.919+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df47150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9d104c2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df47150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40414/0 (socket says 172.21.15.177:40414) 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 learned_addr learned my addr 172.21.15.177:0/781697344 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56055df33b80 con 0x56055df40190 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9d104c2640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df47150 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d08033a50 tx=0x7f9d08046ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9bedffb640 1 -- 172.21.15.177:0/781697344 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d0801e590 con 0x56055df40190 2024-03-20T13:35:12.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9bedffb640 1 -- 172.21.15.177:0/781697344 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d080128c0 con 0x56055df40190 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56055df33b80 con 0x56055df40190 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9bedffb640 1 -- 172.21.15.177:0/781697344 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9d08012b60 con 0x56055df40190 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.920+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56055df47aa0 con 0x56055df40190 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9bedffb640 1 -- 172.21.15.177:0/781697344 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9d0800bac0 con 0x56055df40190 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9bedffb640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be0036790 0x7f9be0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9bedffb640 1 -- 172.21.15.177:0/781697344 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9d08071c40 con 0x56055df40190 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be0036790 0x7f9be0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055df529a0 0x56055df54e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df555b0 con 0x56055df529a0 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.921+0000 7f9d10cc3640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055df529a0 0x56055df54e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be0036790 0x7f9be0038c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56055df254b0 tx=0x7f9cf804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d10cc3640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055df529a0 0x56055df54e60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 realm 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df55980 con 0x56055df529a0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df561d0 con 0x56055df529a0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.922+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df56530 con 0x56055df529a0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df56ee0 0x56055df592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df59850 con 0x56055df56ee0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d104c2640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df56ee0 0x56055df592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d104c2640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df56ee0 0x56055df592d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 20 searching for the correct realm 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56055df5b870 0x56055df5dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5e400 con 0x56055df5b870 2024-03-20T13:35:12.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.923+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56055df5b870 0x56055df5dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.924+0000 7f9d0fcc1640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56055df5b870 0x56055df5dd30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.924+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.924+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5e400 con 0x56055df56ee0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.924+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.924+0000 7f9d104c2640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9d08070020 0x7f9d0806e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.924+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5e400 con 0x7f9d08070020 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.925+0000 7f9d10cc3640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9d08070020 0x7f9d0806e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.925+0000 7f9d10cc3640 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9d08070020 0x7f9d0806e310 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.925+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.925+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df561d0 con 0x56055df529a0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.926+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.926+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df561d0 con 0x56055df529a0 2024-03-20T13:35:12.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.926+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.926+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df561d0 con 0x7f9d08070020 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.926+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.926+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df56ee0 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df529a0 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.927+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df529a0 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df56ee0 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.928+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.929+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df529a0 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df529a0 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.930+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df56ee0 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df529a0 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.931+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.932+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.932+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df56ee0 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.932+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.932+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df5b870 2024-03-20T13:35:12.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.932+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.932+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x7f9d08070020 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df529a0 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9d00027040 con 0x56055df56ee0 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:12.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df561d0 con 0x56055df529a0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.933+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5a150 con 0x56055df529a0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5a150 con 0x7f9d08070020 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 20 zone default found 2024-03-20T13:35:12.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 4 Realm: () 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 20 zonegroup default 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.934+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5a9d0 con 0x7f9d08070020 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5a9d0 con 0x56055df5b870 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df60220 con 0x56055df5b870 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 started sync module instance, tier type = 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.935+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5f6b0 con 0x56055df56ee0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.936+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.937+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94581051226640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5fe30 con 0x56055df56ee0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.937+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df60ec0 con 0x56055df529a0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.938+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94581051226640] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.938+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.938+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94581051230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df61270 con 0x56055df529a0 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.938+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df61c80 con 0x56055df5b870 2024-03-20T13:35:12.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.939+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.939+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94581051234160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df62510 con 0x56055df5b870 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.939+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df62fc0 con 0x56055df56ee0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.939+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94581051230048] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.940+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94581051234160] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.940+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.940+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94581051239104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df63370 con 0x56055df56ee0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.940+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df63b70 con 0x56055df529a0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.941+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94581051239104] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.941+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.941+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94581051241328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df63f20 con 0x56055df529a0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.941+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df64720 con 0x7f9d08070020 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.942+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94581051241328] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.943+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.943+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94581051244240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df64790 con 0x7f9d08070020 2024-03-20T13:35:12.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.943+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df64fd0 con 0x7f9d08070020 2024-03-20T13:35:12.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.944+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.944+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94581051244240] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.944+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94581051246480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df65650 con 0x7f9d08070020 2024-03-20T13:35:12.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.944+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df642f0 con 0x7f9d08070020 2024-03-20T13:35:12.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94581051246480] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'84 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94581051249072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df655d0 con 0x7f9d08070020 2024-03-20T13:35:12.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=0 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=1 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=2 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=3 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=4 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=5 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.945+0000 7f9d14e10800 20 add_watcher() i=6 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.946+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94581051249072] v30'85 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.946+0000 7f9d14e10800 20 add_watcher() i=7 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.946+0000 7f9d14e10800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.946+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df68ff0 con 0x56055df529a0 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.947+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.947+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94581051251488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df664b0 con 0x56055df529a0 2024-03-20T13:35:12.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94581051251488] v30'90 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9bc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 5 note: GC not initialized 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9bc57e2640 20 reqs_thread_entry: start 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 20 Filter name: none 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9b36ffd640 20 reqs_thread_entry: start 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.948+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df9a8e0 con 0x56055df529a0 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.949+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.949+0000 7f9d14e10800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:12.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.949+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df9a8e0 con 0x56055df56ee0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.949+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.950+0000 7f9bc67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.950+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94581051251488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df9a8a0 con 0x56055df529a0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.950+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94581051251488] v30'91 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.951+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94581051226640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df9a8a0 con 0x56055df56ee0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.951+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94581051226640] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.951+0000 7f9d14e10800 20 remove_watcher() i=0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.951+0000 7f9d14e10800 2 removed watcher, disabling cache 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.952+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94581051230048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df9a8a0 con 0x56055df529a0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.953+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94581051230048] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.953+0000 7f9d14e10800 20 remove_watcher() i=1 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.953+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94581051234160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df9a8a0 con 0x56055df5b870 2024-03-20T13:35:12.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.954+0000 7f9d0fcc1640 1 -- 172.21.15.177:0/781697344 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94581051234160] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9cf80525b0 con 0x56055df5b870 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.954+0000 7f9d14e10800 20 remove_watcher() i=2 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.954+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94581051239104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5fa10 con 0x56055df56ee0 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.955+0000 7f9d104c2640 1 -- 172.21.15.177:0/781697344 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94581051239104] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d0806d070 con 0x56055df56ee0 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.955+0000 7f9d14e10800 20 remove_watcher() i=3 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.955+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94581051241328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df60760 con 0x56055df529a0 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.956+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94581051241328] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x56055df529a0 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.956+0000 7f9d14e10800 20 remove_watcher() i=4 2024-03-20T13:35:12.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.956+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94581051244240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df61770 con 0x7f9d08070020 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.958+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94581051244240] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.958+0000 7f9d14e10800 20 remove_watcher() i=5 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.958+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94581051246480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df5fa10 con 0x7f9d08070020 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.959+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94581051246480] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.959+0000 7f9d14e10800 20 remove_watcher() i=6 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.959+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94581051249072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56055df60760 con 0x7f9d08070020 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94581051249072] v30'86 uv84 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9d000083e0 con 0x7f9d08070020 2024-03-20T13:35:12.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 20 remove_watcher() i=7 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9d08070020 msgr2=0x7f9d0806e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9d08070020 0x7f9d0806e310 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055df529a0 msgr2=0x56055df54e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055df529a0 0x56055df54e60 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df56ee0 msgr2=0x56055df592d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df56ee0 0x56055df592d0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56055df5b870 msgr2=0x56055df5dd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.961+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56055df5b870 0x56055df5dd30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be0036790 msgr2=0x7f9be0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be0036790 0x7f9be0038c50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x56055df254b0 tx=0x7f9cf804f000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 msgr2=0x56055df47150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d10cc3640 1 -- 172.21.15.177:0/781697344 reap_dead start 2024-03-20T13:35:12.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df47150 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9d08033a50 tx=0x7f9d08046ee0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 shutdown_connections 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/781697344 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df40190 0x56055df47150 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 >> 172.21.15.177:0/781697344 conn(0x56055df3c4b0 msgr2=0x56055df39b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 shutdown_connections 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/781697344 wait complete. 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be80367e0 msgr2=0x7f9be8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be80367e0 0x7f9be8038ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56055df19890 tx=0x7f9cf8005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 msgr2=0x56055df33640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 0x56055df33640 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9d08027920 tx=0x7f9d0803edd0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 shutdown_connections 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9be80367e0 0x7f9be8038ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/1283112448 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055df33220 0x56055df33640 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 >> 172.21.15.177:0/1283112448 conn(0x56055df272c0 msgr2=0x56055df276c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 shutdown_connections 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/1283112448 wait complete. 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56055df225e0 msgr2=0x56055df249d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56055df225e0 0x56055df249d0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055de1ee70 msgr2=0x56055df1bed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56055de1ee70 0x56055df1bed0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df1e6e0 msgr2=0x56055df20ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56055df1e6e0 0x56055df20ad0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9bf8036790 msgr2=0x7f9bf8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9bf8036790 0x7f9bf8038c50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8054000 tx=0x7f9cf804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 msgr2=0x56055df15150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.962+0000 7f9d14e10800 1 --2- 172.21.15.177:0/134354739 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56055de1a9e0 0x56055df15150 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f9d08002250 tx=0x7f9d08000f40 comp rx=0 tx=0).stop 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.963+0000 7f9d10cc3640 1 -- 172.21.15.177:0/134354739 reap_dead start 2024-03-20T13:35:12.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.963+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 shutdown_connections 2024-03-20T13:35:12.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.963+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 >> 172.21.15.177:0/134354739 conn(0x56055de16040 msgr2=0x56055de250a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:12.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.963+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 shutdown_connections 2024-03-20T13:35:12.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:12.963+0000 7f9d14e10800 1 -- 172.21.15.177:0/134354739 wait complete. 2024-03-20T13:35:12.972 INFO:teuthology.orchestra.run.smithi177.stdout:[] 2024-03-20T13:35:12.972 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:35:12.990 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:12.990 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-03-20T13:35:12.990 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-03-20T13:35:12.991 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-03-20T13:35:13.056 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:13.056 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f5103bad800 1 Processor -- start 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f5103bad800 1 -- start start 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f5103bad800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561ea1fb8420 0x561ea1fb8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f5103bad800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561ea1f04cd0 con 0x561ea1fb8d80 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f5103bad800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561ea1ebb500 con 0x561ea1fb8420 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f51016ac640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561ea1fb8420 0x561ea1fb8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f51016ac640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561ea1fb8420 0x561ea1fb8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40422/0 (socket says 172.21.15.177:40422) 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.056+0000 7f51016ac640 1 -- 172.21.15.177:0/1763419727 learned_addr learned my addr 172.21.15.177:0/1763419727 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.057+0000 7f51016ac640 1 -- 172.21.15.177:0/1763419727 >> v1:172.21.15.28:6789/0 conn(0x561ea1fb8d80 legacy=0x561ea1fb9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:13.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.057+0000 7f51016ac640 1 -- 172.21.15.177:0/1763419727 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea1f2d070 con 0x561ea1fb8420 2024-03-20T13:35:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.058+0000 7f51016ac640 1 --2- 172.21.15.177:0/1763419727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea1fb8840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50f400a520 tx=0x7f50f401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fde8ee89978f9e2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f50f3fff640 1 -- 172.21.15.177:0/1763419727 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4052570 con 0x561ea1fb8420 2024-03-20T13:35:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f50f3fff640 1 -- 172.21.15.177:0/1763419727 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f40526d0 con 0x561ea1fb8420 2024-03-20T13:35:13.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f50f3fff640 1 -- 172.21.15.177:0/1763419727 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4052990 con 0x561ea1fb8420 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 -- 172.21.15.177:0/1763419727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 msgr2=0x561ea1fb8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 --2- 172.21.15.177:0/1763419727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea1fb8840 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50f400a520 tx=0x7f50f401cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 -- 172.21.15.177:0/1763419727 shutdown_connections 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 --2- 172.21.15.177:0/1763419727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea1fb8840 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 -- 172.21.15.177:0/1763419727 >> 172.21.15.177:0/1763419727 conn(0x561ea1fb4040 msgr2=0x561ea1fb6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 -- 172.21.15.177:0/1763419727 shutdown_connections 2024-03-20T13:35:13.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.059+0000 7f5103bad800 1 -- 172.21.15.177:0/1763419727 wait complete. 2024-03-20T13:35:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f5103bad800 1 Processor -- start 2024-03-20T13:35:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f5103bad800 1 -- start start 2024-03-20T13:35:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f5103bad800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20abbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f5103bad800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1eb8a30 con 0x561ea1fb8420 2024-03-20T13:35:13.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20abbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20abbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40434/0 (socket says 172.21.15.177:40434) 2024-03-20T13:35:13.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f51016ac640 1 -- 172.21.15.177:0/2762473918 learned_addr learned my addr 172.21.15.177:0/2762473918 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:13.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.071+0000 7f51016ac640 1 -- 172.21.15.177:0/2762473918 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4005de0 con 0x561ea1fb8420 2024-03-20T13:35:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.072+0000 7f51016ac640 1 --2- 172.21.15.177:0/2762473918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20abbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f50f401cf20 tx=0x7f50f404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6214cb74fe219d6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.072+0000 7f4fef606640 1 -- 172.21.15.177:0/2762473918 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4052840 con 0x561ea1fb8420 2024-03-20T13:35:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.072+0000 7f4fef606640 1 -- 172.21.15.177:0/2762473918 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f40529a0 con 0x561ea1fb8420 2024-03-20T13:35:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.072+0000 7f4fef606640 1 -- 172.21.15.177:0/2762473918 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4052c80 con 0x561ea1fb8420 2024-03-20T13:35:13.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- 172.21.15.177:0/2762473918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 msgr2=0x561ea20abbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 --2- 172.21.15.177:0/2762473918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20abbd0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f50f401cf20 tx=0x7f50f404c000 comp rx=0 tx=0).stop 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- 172.21.15.177:0/2762473918 shutdown_connections 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 --2- 172.21.15.177:0/2762473918 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20abbd0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- 172.21.15.177:0/2762473918 >> 172.21.15.177:0/2762473918 conn(0x561ea1fb4040 msgr2=0x561ea20a74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- 172.21.15.177:0/2762473918 shutdown_connections 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- 172.21.15.177:0/2762473918 wait complete. 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 Processor -- start 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- start start 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.073+0000 7f5103bad800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1eb4210 con 0x561ea1fb8420 2024-03-20T13:35:13.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.075+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.075+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20b3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40446/0 (socket says 172.21.15.177:40446) 2024-03-20T13:35:13.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.075+0000 7f51016ac640 1 -- 172.21.15.177:0/1115462844 learned_addr learned my addr 172.21.15.177:0/1115462844 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:13.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.076+0000 7f51016ac640 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea1f2d070 con 0x561ea1fb8420 2024-03-20T13:35:13.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.077+0000 7f51016ac640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20b3180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f50f401ceb0 tx=0x7f50f4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.077+0000 7f4fede03640 1 -- 172.21.15.177:0/1115462844 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f406c070 con 0x561ea1fb8420 2024-03-20T13:35:13.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.077+0000 7f4fede03640 1 -- 172.21.15.177:0/1115462844 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f405d7c0 con 0x561ea1fb8420 2024-03-20T13:35:13.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.077+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561ea20b36c0 con 0x561ea1fb8420 2024-03-20T13:35:13.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.077+0000 7f4fede03640 1 -- 172.21.15.177:0/1115462844 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f405da60 con 0x561ea1fb8420 2024-03-20T13:35:13.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.077+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea20b3c00 con 0x561ea1fb8420 2024-03-20T13:35:13.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f4fede03640 1 -- 172.21.15.177:0/1115462844 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f50f4059040 con 0x561ea1fb8420 2024-03-20T13:35:13.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f4fede03640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fe80367e0 0x7f4fe8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f4fede03640 1 -- 172.21.15.177:0/1115462844 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f50f408d8c0 con 0x561ea1fb8420 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f5100eab640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fe80367e0 0x7f4fe8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea1fb8d80 0x561ea20b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ba490 con 0x561ea1fb8d80 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.078+0000 7f5101ead640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea1fb8d80 0x561ea20b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5100eab640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fe80367e0 0x7f4fe8038ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50f8001e10 tx=0x7f50f8001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5101ead640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea1fb8d80 0x561ea20b9f50 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5101ead640 1 -- 172.21.15.177:0/1115462844 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea1fb8d80 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ba870 con 0x561ea1fb8d80 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5101ead640 1 -- 172.21.15.177:0/1115462844 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea1fb8d80 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20bc630 0x561ea20bea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20bf0c0 con 0x561ea20bc630 2024-03-20T13:35:13.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.079+0000 7f51016ac640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20bc630 0x561ea20bea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f51016ac640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20bc630 0x561ea20bea20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f51016ac640 1 -- 172.21.15.177:0/1115462844 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f50f40673f0 con 0x561ea20bc630 2024-03-20T13:35:13.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20bb5b0 con 0x561ea1fb8d80 2024-03-20T13:35:13.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f5101ead640 1 -- 172.21.15.177:0/1115462844 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea1fb8d80 2024-03-20T13:35:13.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561ea20c04e0 0x561ea20c28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20c3030 con 0x561ea20c04e0 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.080+0000 7f5100eab640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561ea20c04e0 0x561ea20c28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.081+0000 7f5100eab640 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561ea20c04e0 0x561ea20c28d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.081+0000 7f5100eab640 1 -- 172.21.15.177:0/1115462844 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f50f80106a0 con 0x561ea20c04e0 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.081+0000 7f5103bad800 1 Processor -- start 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.081+0000 7f5103bad800 1 -- start start 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.082+0000 7f5103bad800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 0x561ea20d1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.082+0000 7f5103bad800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1e56c70 con 0x561ea20d1230 2024-03-20T13:35:13.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.083+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 0x561ea20d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.083+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 0x561ea20d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40456/0 (socket says 172.21.15.177:40456) 2024-03-20T13:35:13.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.083+0000 7f51016ac640 1 -- 172.21.15.177:0/2418061103 learned_addr learned my addr 172.21.15.177:0/2418061103 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:13.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.085+0000 7f51016ac640 1 -- 172.21.15.177:0/2418061103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea20d1b90 con 0x561ea20d1230 2024-03-20T13:35:13.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.086+0000 7f51016ac640 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 0x561ea20d1650 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f50f4078ad0 tx=0x7f50f406fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.087+0000 7f4fe6ffd640 1 -- 172.21.15.177:0/2418061103 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f408dc90 con 0x561ea20d1230 2024-03-20T13:35:13.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.087+0000 7f4fe6ffd640 1 -- 172.21.15.177:0/2418061103 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f408ddf0 con 0x561ea20d1230 2024-03-20T13:35:13.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.087+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561ea20d2600 con 0x561ea20d1230 2024-03-20T13:35:13.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.087+0000 7f4fe6ffd640 1 -- 172.21.15.177:0/2418061103 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4054c20 con 0x561ea20d1230 2024-03-20T13:35:13.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.087+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea20d2600 con 0x561ea20d1230 2024-03-20T13:35:13.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f4fe6ffd640 1 -- 172.21.15.177:0/2418061103 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f50f4054d80 con 0x561ea20d1230 2024-03-20T13:35:13.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f4fe6ffd640 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fd80367e0 0x7f4fd8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f4fe6ffd640 1 -- 172.21.15.177:0/2418061103 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f50f408be40 con 0x561ea20d1230 2024-03-20T13:35:13.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f5100eab640 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fd80367e0 0x7f4fd8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:13.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f5103bad800 1 Processor -- start 2024-03-20T13:35:13.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f5103bad800 1 -- start start 2024-03-20T13:35:13.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f5100eab640 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fd80367e0 0x7f4fd8038ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x561ea20babf0 tx=0x7f50f8006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:13.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f5103bad800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20de5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:13.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:13.089+0000 7f5103bad800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea1e2c5d0 con 0x561ea20de1f0 2024-03-20T13:35:14.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.141+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.141+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20de5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40464/0 (socket says 172.21.15.177:40464) 2024-03-20T13:35:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.141+0000 7f51016ac640 1 -- 172.21.15.177:0/565946137 learned_addr learned my addr 172.21.15.177:0/565946137 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.141+0000 7f51016ac640 1 -- 172.21.15.177:0/565946137 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea20deba0 con 0x561ea20de1f0 2024-03-20T13:35:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.141+0000 7f51016ac640 1 --2- 172.21.15.177:0/565946137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20de5d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f50f4067f70 tx=0x7f50f40547e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921a999d584e6170 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.142+0000 7f4fe4ff9640 1 -- 172.21.15.177:0/565946137 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4079a50 con 0x561ea20de1f0 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.142+0000 7f4fe4ff9640 1 -- 172.21.15.177:0/565946137 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f4079bb0 con 0x561ea20de1f0 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.142+0000 7f4fe4ff9640 1 -- 172.21.15.177:0/565946137 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f40754e0 con 0x561ea20de1f0 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- 172.21.15.177:0/565946137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 msgr2=0x561ea20de5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 --2- 172.21.15.177:0/565946137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20de5d0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f50f4067f70 tx=0x7f50f40547e0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- 172.21.15.177:0/565946137 shutdown_connections 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 --2- 172.21.15.177:0/565946137 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20de5d0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- 172.21.15.177:0/565946137 >> 172.21.15.177:0/565946137 conn(0x561ea20da4c0 msgr2=0x561ea20d8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- 172.21.15.177:0/565946137 shutdown_connections 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- 172.21.15.177:0/565946137 wait complete. 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 Processor -- start 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- start start 2024-03-20T13:35:14.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20e4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.143+0000 7f5103bad800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ea20e54f0 con 0x561ea20de1f0 2024-03-20T13:35:14.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.144+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20e4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.144+0000 7f51016ac640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20e4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40470/0 (socket says 172.21.15.177:40470) 2024-03-20T13:35:14.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.144+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 learned_addr learned my addr 172.21.15.177:0/890975515 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.144+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ea20d1b90 con 0x561ea20de1f0 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.145+0000 7f51016ac640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20e4fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50f407c390 tx=0x7f50f4074e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.145+0000 7f4fd6ffd640 1 -- 172.21.15.177:0/890975515 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4079a50 con 0x561ea20de1f0 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.145+0000 7f4fd6ffd640 1 -- 172.21.15.177:0/890975515 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f4004f40 con 0x561ea20de1f0 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.145+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561ea20d1b90 con 0x561ea20de1f0 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.145+0000 7f4fd6ffd640 1 -- 172.21.15.177:0/890975515 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50f4054080 con 0x561ea20de1f0 2024-03-20T13:35:14.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.145+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561ea20d1b90 con 0x561ea20de1f0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.146+0000 7f4fd6ffd640 1 -- 172.21.15.177:0/890975515 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f50f40541e0 con 0x561ea20de1f0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.146+0000 7f4fd6ffd640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fcc036790 0x7f4fcc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.146+0000 7f4fd6ffd640 1 -- 172.21.15.177:0/890975515 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f50f40c1c80 con 0x561ea20de1f0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.146+0000 7f5100eab640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fcc036790 0x7f4fcc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.146+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.147+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea20f06d0 0x561ea20f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.147+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f32e0 con 0x561ea20f06d0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.147+0000 7f5101ead640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea20f06d0 0x561ea20f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.147+0000 7f5100eab640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fcc036790 0x7f4fcc038c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x561ea20c33f0 tx=0x7f50f8011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.147+0000 7f5101ead640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea20f06d0 0x561ea20f2b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 realm 2024-03-20T13:35:14.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f36b0 con 0x561ea20f06d0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.148+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f4290 con 0x561ea20f06d0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20f49e0 0x561ea20f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f7540 con 0x561ea20f49e0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f51016ac640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20f49e0 0x561ea20f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f51016ac640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20f49e0 0x561ea20f6dd0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 20 searching for the correct realm 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561ea20f94d0 0x561ea20fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.149+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fc060 con 0x561ea20f94d0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.150+0000 7f5100eab640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561ea20f94d0 0x561ea20fb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.150+0000 7f5100eab640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561ea20f94d0 0x561ea20fb990 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.150+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.150+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fc060 con 0x561ea20f49e0 2024-03-20T13:35:14.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.151+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.151+0000 7f51016ac640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f50f40c0060 0x7f50f40c1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.151+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fc060 con 0x7f50f40c0060 2024-03-20T13:35:14.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.151+0000 7f5101ead640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f50f40c0060 0x7f50f40c1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.152+0000 7f5101ead640 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f50f40c0060 0x7f50f40c1450 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.152+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.152+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.152+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.152+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.153+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.153+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.153+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.153+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.153+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.153+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f49e0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.154+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.154+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.154+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.154+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.154+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.154+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.155+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.155+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.155+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.155+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f49e0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.155+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.155+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.156+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.156+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.156+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.156+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.156+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.156+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.157+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.158+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.158+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.158+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.158+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f49e0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.158+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.158+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.159+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.159+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.159+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.159+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f94d0 2024-03-20T13:35:14.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.160+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.160+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x7f50f40c0060 2024-03-20T13:35:14.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.160+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.160+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f50fc031040 con 0x561ea20f49e0 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.160+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.160+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f50fc031040 con 0x561ea20f94d0 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.161+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.161+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f50fc031040 con 0x7f50f40c0060 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.161+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.161+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f50fc031040 con 0x561ea20f06d0 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.161+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.161+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f50fc031040 con 0x561ea20f49e0 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f3f30 con 0x561ea20f06d0 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f7e40 con 0x561ea20f06d0 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.162+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f7e40 con 0x7f50f40c0060 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 20 zone default found 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 4 Realm: () 2024-03-20T13:35:14.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 20 zonegroup default 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f8710 con 0x7f50f40c0060 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.163+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f8af0 con 0x561ea20f94d0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20f8710 con 0x561ea20f94d0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 20 started sync module instance, tier type = 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.164+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fd760 con 0x561ea20f49e0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.165+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.165+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94689567953600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fdb10 con 0x561ea20f49e0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.165+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fec50 con 0x561ea20f06d0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.167+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94689567953600] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.167+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.167+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94689567958832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ff000 con 0x561ea20f06d0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.167+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ffa50 con 0x561ea20f94d0 2024-03-20T13:35:14.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.168+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.168+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94689567958832] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.168+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94689567957200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ffe00 con 0x561ea20f94d0 2024-03-20T13:35:14.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.168+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea21008a0 con 0x561ea20f49e0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.169+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94689567957200] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.169+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.169+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94689567962416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea21010f0 con 0x561ea20f49e0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.170+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2101a60 con 0x561ea20f06d0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.172+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.172+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94689567971232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea21021c0 con 0x561ea20f06d0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.172+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2102c90 con 0x7f50f40c0060 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.172+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94689567962416] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.173+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94689567971232] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.173+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.173+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94689567975280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2102c50 con 0x7f50f40c0060 2024-03-20T13:35:14.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.173+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2101d90 con 0x7f50f40c0060 2024-03-20T13:35:14.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.175+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.175+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94689567977536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2103900 con 0x7f50f40c0060 2024-03-20T13:35:14.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.175+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea21043d0 con 0x7f50f40c0060 2024-03-20T13:35:14.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.175+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94689567975280] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.176+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94689567977536] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'87 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94689567981232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2103460 con 0x7f50f40c0060 2024-03-20T13:35:14.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=0 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=1 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=2 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=3 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=4 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=5 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.177+0000 7f5103bad800 20 add_watcher() i=6 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.178+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94689567981232] v30'88 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.178+0000 7f5103bad800 20 add_watcher() i=7 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.178+0000 7f5103bad800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.178+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea21074d0 con 0x561ea20f06d0 2024-03-20T13:35:14.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.178+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.178+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94689567968336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2104940 con 0x561ea20f06d0 2024-03-20T13:35:14.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94689567968336] v30'92 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f4fb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 5 note: GC not initialized 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f4fb67e4640 20 reqs_thread_entry: start 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 20 Filter name: none 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f4f27fff640 20 reqs_thread_entry: start 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.180+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2138cf0 con 0x561ea20f06d0 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.181+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.181+0000 7f5103bad800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.181+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2138cf0 con 0x561ea20f49e0 2024-03-20T13:35:14.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.181+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.182+0000 7f4fb77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.182+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94689567968336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2139690 con 0x561ea20f06d0 2024-03-20T13:35:14.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.183+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94689567968336] v30'93 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.183+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94689567953600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea2100c00 con 0x561ea20f49e0 2024-03-20T13:35:14.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.185+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94689567953600] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.185+0000 7f5103bad800 20 remove_watcher() i=0 2024-03-20T13:35:14.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.185+0000 7f5103bad800 2 removed watcher, disabling cache 2024-03-20T13:35:14.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.185+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94689567958832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fd2c0 con 0x561ea20f06d0 2024-03-20T13:35:14.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.186+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94689567958832] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.186+0000 7f5103bad800 20 remove_watcher() i=1 2024-03-20T13:35:14.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.186+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94689567957200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fd2c0 con 0x561ea20f94d0 2024-03-20T13:35:14.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.187+0000 7f5100eab640 1 -- 172.21.15.177:0/890975515 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94689567957200] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f8032040 con 0x561ea20f94d0 2024-03-20T13:35:14.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.187+0000 7f5103bad800 20 remove_watcher() i=2 2024-03-20T13:35:14.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.187+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94689567962416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fe0d0 con 0x561ea20f49e0 2024-03-20T13:35:14.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.188+0000 7f51016ac640 1 -- 172.21.15.177:0/890975515 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94689567962416] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50f4085070 con 0x561ea20f49e0 2024-03-20T13:35:14.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.189+0000 7f5103bad800 20 remove_watcher() i=3 2024-03-20T13:35:14.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.189+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94689567971232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ff530 con 0x561ea20f06d0 2024-03-20T13:35:14.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.190+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94689567971232] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x561ea20f06d0 2024-03-20T13:35:14.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.190+0000 7f5103bad800 20 remove_watcher() i=4 2024-03-20T13:35:14.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.190+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94689567975280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20fe0d0 con 0x7f50f40c0060 2024-03-20T13:35:14.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.191+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94689567975280] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.191+0000 7f5103bad800 20 remove_watcher() i=5 2024-03-20T13:35:14.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.191+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94689567977536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea21017a0 con 0x7f50f40c0060 2024-03-20T13:35:14.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.192+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94689567977536] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.192+0000 7f5103bad800 20 remove_watcher() i=6 2024-03-20T13:35:14.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.192+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94689567981232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x561ea20ff530 con 0x7f50f40c0060 2024-03-20T13:35:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.193+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94689567981232] v30'89 uv87 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50fc00a4a0 con 0x7f50f40c0060 2024-03-20T13:35:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.193+0000 7f5103bad800 20 remove_watcher() i=7 2024-03-20T13:35:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.193+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f50f40c0060 msgr2=0x7f50f40c1450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.193+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f50f40c0060 0x7f50f40c1450 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.193+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea20f06d0 msgr2=0x561ea20f2b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.193+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea20f06d0 0x561ea20f2b90 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20f49e0 msgr2=0x561ea20f6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20f49e0 0x561ea20f6dd0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561ea20f94d0 msgr2=0x561ea20fb990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561ea20f94d0 0x561ea20fb990 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fcc036790 msgr2=0x7f4fcc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fcc036790 0x7f4fcc038c50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x561ea20c33f0 tx=0x7f50f8011000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 msgr2=0x561ea20e4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20e4fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f50f407c390 tx=0x7f50f4074e70 comp rx=0 tx=0).stop 2024-03-20T13:35:14.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5101ead640 1 -- 172.21.15.177:0/890975515 reap_dead start 2024-03-20T13:35:14.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 shutdown_connections 2024-03-20T13:35:14.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/890975515 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20de1f0 0x561ea20e4fb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 >> 172.21.15.177:0/890975515 conn(0x561ea20da4c0 msgr2=0x561ea20d7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 shutdown_connections 2024-03-20T13:35:14.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/890975515 wait complete. 2024-03-20T13:35:14.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fd80367e0 msgr2=0x7f4fd8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fd80367e0 0x7f4fd8038ca0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x561ea20babf0 tx=0x7f50f8006000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 msgr2=0x561ea20d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 0x561ea20d1650 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f50f4078ad0 tx=0x7f50f406fe80 comp rx=0 tx=0).stop 2024-03-20T13:35:14.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 shutdown_connections 2024-03-20T13:35:14.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fd80367e0 0x7f4fd8038ca0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 --2- 172.21.15.177:0/2418061103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea20d1230 0x561ea20d1650 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 >> 172.21.15.177:0/2418061103 conn(0x561ea20c52d0 msgr2=0x561ea20c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 shutdown_connections 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.194+0000 7f5103bad800 1 -- 172.21.15.177:0/2418061103 wait complete. 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561ea20c04e0 msgr2=0x561ea20c28d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561ea20c04e0 0x561ea20c28d0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea1fb8d80 msgr2=0x561ea20b9f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561ea1fb8d80 0x561ea20b9f50 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20bc630 msgr2=0x561ea20bea20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561ea20bc630 0x561ea20bea20 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fe80367e0 msgr2=0x7f4fe8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4fe80367e0 0x7f4fe8038ca0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f50f8001e10 tx=0x7f50f8001390 comp rx=0 tx=0).stop 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 msgr2=0x561ea20b3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 --2- 172.21.15.177:0/1115462844 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561ea1fb8420 0x561ea20b3180 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f50f401ceb0 tx=0x7f50f4002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5101ead640 1 -- 172.21.15.177:0/1115462844 reap_dead start 2024-03-20T13:35:14.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 shutdown_connections 2024-03-20T13:35:14.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 >> 172.21.15.177:0/1115462844 conn(0x561ea1fb4040 msgr2=0x561ea20a5d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 shutdown_connections 2024-03-20T13:35:14.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.195+0000 7f5103bad800 1 -- 172.21.15.177:0/1115462844 wait complete. 2024-03-20T13:35:14.206 INFO:teuthology.orchestra.run.smithi177.stdout:["myfoo"] 2024-03-20T13:35:14.206 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-03-20T13:35:14.214 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-03-20T13:35:14.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-03-20T13:35:14.215 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-03-20T13:35:14.290 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:14.291 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.290+0000 7f7f4d824800 1 Processor -- start 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.290+0000 7f7f4d824800 1 -- start start 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.290+0000 7f7f4d824800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x562750db3070 0x562750db5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.290+0000 7f7f4d824800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x562750cf9cc0 con 0x562750daf560 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.290+0000 7f7f4d824800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x562750cb0500 con 0x562750db3070 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f4b323640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x562750daf560 0x562750db1950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50482/0 (socket says 172.21.15.177:50482) 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f4b323640 1 -- 172.21.15.177:0/3559503301 learned_addr learned my addr 172.21.15.177:0/3559503301 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:14.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f42b22640 1 --2- 172.21.15.177:0/3559503301 >> v2:172.21.15.28:3300/0 conn(0x562750db3070 0x562750db5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f4ab22640 1 -- 172.21.15.177:0/3559503301 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1370387225 0 0) 0x562750cf9cc0 con 0x562750daf560 2024-03-20T13:35:14.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f4ab22640 1 -- 172.21.15.177:0/3559503301 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7f38001e10 con 0x562750daf560 2024-03-20T13:35:14.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f42b22640 1 -- 172.21.15.177:0/3559503301 >> v1:172.21.15.28:6789/0 conn(0x562750daf560 legacy=0x562750db1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.291+0000 7f7f42b22640 1 -- 172.21.15.177:0/3559503301 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562750db69b0 con 0x562750db3070 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.293+0000 7f7f42b22640 1 --2- 172.21.15.177:0/3559503301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750db3070 0x562750db5460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400a470 tx=0x7f7f3401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde86d7e553b38a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.293+0000 7f7f4ab22640 1 -- 172.21.15.177:0/3559503301 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3404ad60 con 0x562750db3070 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.293+0000 7f7f4ab22640 1 -- 172.21.15.177:0/3559503301 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f34052440 con 0x562750db3070 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.293+0000 7f7f4ab22640 1 -- 172.21.15.177:0/3559503301 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f34052700 con 0x562750db3070 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 -- 172.21.15.177:0/3559503301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750db3070 msgr2=0x562750db5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 --2- 172.21.15.177:0/3559503301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750db3070 0x562750db5460 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7f3400a470 tx=0x7f7f3401cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 -- 172.21.15.177:0/3559503301 shutdown_connections 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 --2- 172.21.15.177:0/3559503301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750db3070 0x562750db5460 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 -- 172.21.15.177:0/3559503301 >> 172.21.15.177:0/3559503301 conn(0x562750da9030 msgr2=0x562750dab450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 -- 172.21.15.177:0/3559503301 shutdown_connections 2024-03-20T13:35:14.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.294+0000 7f7f4d824800 1 -- 172.21.15.177:0/3559503301 wait complete. 2024-03-20T13:35:14.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4d824800 1 Processor -- start 2024-03-20T13:35:14.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4d824800 1 -- start start 2024-03-20T13:35:14.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4d824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750daeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4d824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750cada30 con 0x562750daf560 2024-03-20T13:35:14.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750daeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750daeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40490/0 (socket says 172.21.15.177:40490) 2024-03-20T13:35:14.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4b323640 1 -- 172.21.15.177:0/2226218160 learned_addr learned my addr 172.21.15.177:0/2226218160 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.307+0000 7f7f4b323640 1 -- 172.21.15.177:0/2226218160 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f34005d20 con 0x562750daf560 2024-03-20T13:35:14.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.308+0000 7f7f4b323640 1 --2- 172.21.15.177:0/2226218160 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750daeea0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c001c50 tx=0x7f7f3c00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95f61fdd4b75f3e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.308+0000 7f7e3960a640 1 -- 172.21.15.177:0/2226218160 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c00e470 con 0x562750daf560 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.308+0000 7f7e3960a640 1 -- 172.21.15.177:0/2226218160 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00e5d0 con 0x562750daf560 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.308+0000 7f7e3960a640 1 -- 172.21.15.177:0/2226218160 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c00e8b0 con 0x562750daf560 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- 172.21.15.177:0/2226218160 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 msgr2=0x562750daeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 --2- 172.21.15.177:0/2226218160 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750daeea0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c001c50 tx=0x7f7f3c00b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- 172.21.15.177:0/2226218160 shutdown_connections 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 --2- 172.21.15.177:0/2226218160 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750daeea0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- 172.21.15.177:0/2226218160 >> 172.21.15.177:0/2226218160 conn(0x562750da9030 msgr2=0x562750e9a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- 172.21.15.177:0/2226218160 shutdown_connections 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- 172.21.15.177:0/2226218160 wait complete. 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 Processor -- start 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- start start 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750ea8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4d824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750ca9210 con 0x562750daf560 2024-03-20T13:35:14.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750ea8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750ea8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40494/0 (socket says 172.21.15.177:40494) 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.309+0000 7f7f4b323640 1 -- 172.21.15.177:0/4111288843 learned_addr learned my addr 172.21.15.177:0/4111288843 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7f4b323640 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f38001e10 con 0x562750daf560 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7f4b323640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750ea8190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000c00 tx=0x7f7f3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7e37e07640 1 -- 172.21.15.177:0/4111288843 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c01f070 con 0x562750daf560 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7e37e07640 1 -- 172.21.15.177:0/4111288843 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c018830 con 0x562750daf560 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7e37e07640 1 -- 172.21.15.177:0/4111288843 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c018ad0 con 0x562750daf560 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562750ea86d0 con 0x562750daf560 2024-03-20T13:35:14.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.310+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562750ea8bb0 con 0x562750daf560 2024-03-20T13:35:14.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.311+0000 7f7e37e07640 1 -- 172.21.15.177:0/4111288843 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7f3c018d40 con 0x562750daf560 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.311+0000 7f7e37e07640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e30036790 0x7f7e30038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.311+0000 7f7e37e07640 1 -- 172.21.15.177:0/4111288843 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7f3c04c390 con 0x562750daf560 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.311+0000 7f7f42b22640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e30036790 0x7f7e30038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.311+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750db3070 0x562750eaee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.311+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eaf430 con 0x562750db3070 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.312+0000 7f7f4bb24640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750db3070 0x562750eaee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.312+0000 7f7f42b22640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e30036790 0x7f7e30038c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f34054000 tx=0x7f7f3404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.312+0000 7f7f4bb24640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750db3070 0x562750eaee60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.312+0000 7f7f4bb24640 1 -- 172.21.15.177:0/4111288843 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750db3070 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.312+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eac590 con 0x562750db3070 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4bb24640 1 -- 172.21.15.177:0/4111288843 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750db3070 2024-03-20T13:35:14.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750eb16a0 0x562750eb3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eb4180 con 0x562750eb16a0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4b323640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750eb16a0 0x562750eb3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4b323640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750eb16a0 0x562750eb3a90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4b323640 1 -- 172.21.15.177:0/4111288843 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7f3c014070 con 0x562750eb16a0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.313+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eb0620 con 0x562750db3070 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.314+0000 7f7f4bb24640 1 -- 172.21.15.177:0/4111288843 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750db3070 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.314+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562750eb55a0 0x562750eb7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.314+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eb80d0 con 0x562750eb55a0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.314+0000 7f7f42b22640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562750eb55a0 0x562750eb7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.314+0000 7f7f42b22640 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562750eb55a0 0x562750eb7990 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f42b22640 1 -- 172.21.15.177:0/4111288843 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7f34065040 con 0x562750eb55a0 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4d824800 1 Processor -- start 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4d824800 1 -- start start 2024-03-20T13:35:14.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4d824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 0x562750ec6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4d824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750c4bc70 con 0x562750ec6260 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 0x562750ec6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 0x562750ec6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40510/0 (socket says 172.21.15.177:40510) 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.315+0000 7f7f4b323640 1 -- 172.21.15.177:0/1111925252 learned_addr learned my addr 172.21.15.177:0/1111925252 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7f4b323640 1 -- 172.21.15.177:0/1111925252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562750ec6bc0 con 0x562750ec6260 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7f4b323640 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 0x562750ec6680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c016520 tx=0x7f7f3c023e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7e35602640 1 -- 172.21.15.177:0/1111925252 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c0229b0 con 0x562750ec6260 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7e35602640 1 -- 172.21.15.177:0/1111925252 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c022b30 con 0x562750ec6260 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562750ec7630 con 0x562750ec6260 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7e35602640 1 -- 172.21.15.177:0/1111925252 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c022e10 con 0x562750ec6260 2024-03-20T13:35:14.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.316+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562750ec7af0 con 0x562750ec6260 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7e35602640 1 -- 172.21.15.177:0/1111925252 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7f3c02d440 con 0x562750ec6260 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7e35602640 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e240367e0 0x7f7e24038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7e35602640 1 -- 172.21.15.177:0/1111925252 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7f3c040e40 con 0x562750ec6260 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7f42b22640 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e240367e0 0x7f7e24038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7f4d824800 1 Processor -- start 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7f4d824800 1 -- start start 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.317+0000 7f7f42b22640 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e240367e0 0x7f7e24038ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x562750eac4b0 tx=0x7f7f34005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4d824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750ed3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4d824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750c215d0 con 0x562750ed33f0 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750ed3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750ed3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40514/0 (socket says 172.21.15.177:40514) 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4b323640 1 -- 172.21.15.177:0/3304221834 learned_addr learned my addr 172.21.15.177:0/3304221834 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4b323640 1 -- 172.21.15.177:0/3304221834 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562750ed3de0 con 0x562750ed33f0 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.318+0000 7f7f4b323640 1 --2- 172.21.15.177:0/3304221834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750ed3810 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c01afd0 tx=0x7f7f3c03eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1613c7ba00ec4210 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7e2effd640 1 -- 172.21.15.177:0/3304221834 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c043fb0 con 0x562750ed33f0 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7e2effd640 1 -- 172.21.15.177:0/3304221834 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c044110 con 0x562750ed33f0 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7e2effd640 1 -- 172.21.15.177:0/3304221834 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c02d820 con 0x562750ed33f0 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 -- 172.21.15.177:0/3304221834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 msgr2=0x562750ed3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 --2- 172.21.15.177:0/3304221834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750ed3810 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c01afd0 tx=0x7f7f3c03eaa0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 -- 172.21.15.177:0/3304221834 shutdown_connections 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 --2- 172.21.15.177:0/3304221834 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750ed3810 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 -- 172.21.15.177:0/3304221834 >> 172.21.15.177:0/3304221834 conn(0x562750ecf670 msgr2=0x562750ecd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 -- 172.21.15.177:0/3304221834 shutdown_connections 2024-03-20T13:35:14.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 -- 172.21.15.177:0/3304221834 wait complete. 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 Processor -- start 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.319+0000 7f7f4d824800 1 -- start start 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4d824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750eda110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4d824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x562750eda650 con 0x562750ed33f0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750eda110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4b323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750eda110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40530/0 (socket says 172.21.15.177:40530) 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 learned_addr learned my addr 172.21.15.177:0/465182822 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562750ec7630 con 0x562750ed33f0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4b323640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750eda110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c02dad0 tx=0x7f7f3c045e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7e2d7fa640 1 -- 172.21.15.177:0/465182822 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c00d570 con 0x562750ed33f0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7e2d7fa640 1 -- 172.21.15.177:0/465182822 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f3c00de00 con 0x562750ed33f0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7e2d7fa640 1 -- 172.21.15.177:0/465182822 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7f3c04c9b0 con 0x562750ed33f0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.320+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x562750ec7630 con 0x562750ed33f0 2024-03-20T13:35:14.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.321+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562750ec7630 con 0x562750ed33f0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.321+0000 7f7e2d7fa640 1 -- 172.21.15.177:0/465182822 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7f3c05d070 con 0x562750ed33f0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7e2d7fa640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e14036790 0x7f7e14038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7e2d7fa640 1 -- 172.21.15.177:0/465182822 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7f3c06ac40 con 0x562750ed33f0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f42b22640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e14036790 0x7f7e14038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750ee59d0 0x562750ee7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee85c0 con 0x562750ee59d0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f4bb24640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750ee59d0 0x562750ee7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f42b22640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e14036790 0x7f7e14038c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x562750eb8490 tx=0x7f7f3405e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.322+0000 7f7f4bb24640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750ee59d0 0x562750ee7e70 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 realm 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee8990 con 0x562750ee59d0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee9540 con 0x562750ee59d0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750ee9ef0 0x562750eec2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eec860 con 0x562750ee9ef0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.323+0000 7f7f4b323640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750ee9ef0 0x562750eec2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f4b323640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750ee9ef0 0x562750eec2e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7f3c014070 con 0x562750ee9ef0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f4d824800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f4d824800 20 searching for the correct realm 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562750eee800 0x562750ef0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef1390 con 0x562750eee800 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f42b22640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562750eee800 0x562750ef0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.324+0000 7f7f42b22640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562750eee800 0x562750ef0cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.325+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.325+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef1390 con 0x562750ee9ef0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.325+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c014070 con 0x562750ee9ef0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.325+0000 7f7f4b323640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7f3c036020 0x7f7f3c024880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.325+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef1390 con 0x7f7f3c036020 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.325+0000 7f7f4bb24640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7f3c036020 0x7f7f3c024880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7f3c036020 0x7f7f3c024880 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.326+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.327+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.327+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.327+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.327+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.327+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c014070 con 0x562750ee9ef0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.327+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.328+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7f3c014070 con 0x562750ee9ef0 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.329+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.330+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.331+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.332+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.332+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.332+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.332+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.332+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.332+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7f44031040 con 0x562750ee9ef0 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.333+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.333+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7f44031040 con 0x562750eee800 2024-03-20T13:35:14.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.333+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.333+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7f44031040 con 0x7f7f3c036020 2024-03-20T13:35:14.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.333+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.333+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7f44031040 con 0x562750ee59d0 2024-03-20T13:35:14.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7f44031040 con 0x562750ee9ef0 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eed130 con 0x562750ee59d0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.334+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eed130 con 0x7f7f3c036020 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 20 zone default found 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 4 Realm: () 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 20 zonegroup default 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.335+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eeda00 con 0x7f7f3c036020 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eedde0 con 0x562750eee800 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750eeda00 con 0x562750eee800 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 started sync module instance, tier type = 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.336+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef2a90 con 0x562750ee9ef0 2024-03-20T13:35:14.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.337+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.337+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94726861563376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef2e40 con 0x562750ee9ef0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.337+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef3ea0 con 0x562750ee59d0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.338+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94726861563376] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.338+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.339+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94726861568416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef4280 con 0x562750ee59d0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.339+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef4c70 con 0x562750eee800 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.340+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94726861568416] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.340+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.340+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94726861571920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef5020 con 0x562750eee800 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.340+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef5a90 con 0x562750ee9ef0 2024-03-20T13:35:14.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.341+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.341+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94726861577792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef6700 con 0x562750ee9ef0 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.342+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef70f0 con 0x562750ee59d0 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.342+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94726861571920] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.343+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.343+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94726861581264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef74a0 con 0x562750ee59d0 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.343+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94726861577792] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.343+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef6260 con 0x7f7f3c036020 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.344+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.344+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94726861584752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef6260 con 0x7f7f3c036020 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.344+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef8840 con 0x7f7f3c036020 2024-03-20T13:35:14.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.344+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94726861581264] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.345+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94726861584752] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.345+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.345+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94726861585808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef83a0 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.345+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef8d10 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'90 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94726861585808] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94726861588592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef9130 con 0x7f7f3c036020 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=0 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=1 2024-03-20T13:35:14.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=2 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=3 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=4 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=5 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.346+0000 7f7f4d824800 20 add_watcher() i=6 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.347+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94726861588592] v30'91 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.347+0000 7f7f4d824800 20 add_watcher() i=7 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.347+0000 7f7f4d824800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.347+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef9130 con 0x562750ee59d0 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.347+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.347+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94726861589648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef90b0 con 0x562750ee59d0 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.348+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94726861589648] v30'94 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.348+0000 7f7e01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.348+0000 7f7f4d824800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.348+0000 7f7f4d824800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7f4d824800 5 note: GC not initialized 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7e00fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7f4d824800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7f4d824800 20 Filter name: none 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7d7a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750f2d7f0 con 0x562750eee800 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(62 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.349+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750f2d7f0 con 0x562750eee800 2024-03-20T13:35:14.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(63 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750f2d7f0 con 0x562750ee59d0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(64 [pgnls start_epoch 30 out=127b] v30'3 uv3 ondisk = 1) v8 ==== 144+0+127 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 [pgnls start_epoch 30 out=49b] v30'11 uv11 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.350+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(67 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(69 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.351+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.352+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(71 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.352+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.352+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(72 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.352+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.353+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.353+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.353+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.353+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.353+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(75 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.353+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.354+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(76 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.354+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.354+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.354+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.354+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(78 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.354+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(79 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(80 [pgnls start_epoch 30 out=70b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+70 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(81 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(82 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.355+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.356+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(83 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.356+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.356+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(84 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.356+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.357+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(85 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.357+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.357+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(86 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.357+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.358+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(87 [pgnls start_epoch 30 out=49b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.358+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.359+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(88 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.359+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.359+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(89 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.359+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x7f7f3c036020 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.360+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(90 [pgnls start_epoch 30 out=49b] v30'1 uv1 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.360+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee59d0 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.360+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(91 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.360+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750eee800 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.360+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(92 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.360+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ee91e0 con 0x562750ee9ef0 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.361+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(93 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.361+0000 7f7f4d824800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.361+0000 7f7f4d824800 20 RGWRados::pool_iterate: got myfoo 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.361+0000 7f7e01fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.361+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94726861589648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef9540 con 0x562750ee59d0 2024-03-20T13:35:14.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.362+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94726861589648] v30'95 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.362+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94726861563376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef8c90 con 0x562750ee9ef0 2024-03-20T13:35:14.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.363+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94726861563376] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.363+0000 7f7f4d824800 20 remove_watcher() i=0 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.363+0000 7f7f4d824800 2 removed watcher, disabling cache 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.363+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94726861568416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef8c90 con 0x562750ee59d0 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.365+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94726861568416] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.365+0000 7f7f4d824800 20 remove_watcher() i=1 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.365+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94726861571920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef8c90 con 0x562750eee800 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.367+0000 7f7f42b22640 1 -- 172.21.15.177:0/465182822 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94726861571920] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f34065040 con 0x562750eee800 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.367+0000 7f7f4d824800 20 remove_watcher() i=2 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.367+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94726861577792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef4750 con 0x562750ee9ef0 2024-03-20T13:35:14.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.368+0000 7f7f4b323640 1 -- 172.21.15.177:0/465182822 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94726861577792] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f3c081080 con 0x562750ee9ef0 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.368+0000 7f7f4d824800 20 remove_watcher() i=3 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.368+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94726861581264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef5e40 con 0x562750ee59d0 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.369+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94726861581264] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x562750ee59d0 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.369+0000 7f7f4d824800 20 remove_watcher() i=4 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.369+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94726861584752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef4750 con 0x7f7f3c036020 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.370+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94726861584752] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.370+0000 7f7f4d824800 20 remove_watcher() i=5 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.370+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94726861585808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef5e40 con 0x7f7f3c036020 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.371+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94726861585808] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.371+0000 7f7f4d824800 20 remove_watcher() i=6 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.371+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94726861588592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x562750ef4750 con 0x7f7f3c036020 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94726861588592] v30'92 uv90 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7f4400a4a0 con 0x7f7f3c036020 2024-03-20T13:35:14.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 20 remove_watcher() i=7 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7f3c036020 msgr2=0x7f7f3c024880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7f3c036020 0x7f7f3c024880 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750ee59d0 msgr2=0x562750ee7e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750ee59d0 0x562750ee7e70 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750ee9ef0 msgr2=0x562750eec2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750ee9ef0 0x562750eec2e0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562750eee800 msgr2=0x562750ef0cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x562750eee800 0x562750ef0cc0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e14036790 msgr2=0x7f7e14038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e14036790 0x7f7e14038c50 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x562750eb8490 tx=0x7f7f3405e040 comp rx=0 tx=0).stop 2024-03-20T13:35:14.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 msgr2=0x562750eda110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4bb24640 1 -- 172.21.15.177:0/465182822 reap_dead start 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750eda110 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c02dad0 tx=0x7f7f3c045e70 comp rx=0 tx=0).stop 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 shutdown_connections 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/465182822 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ed33f0 0x562750eda110 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 >> 172.21.15.177:0/465182822 conn(0x562750ecf670 msgr2=0x562750ecccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 shutdown_connections 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/465182822 wait complete. 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e240367e0 msgr2=0x7f7e24038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e240367e0 0x7f7e24038ca0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x562750eac4b0 tx=0x7f7f34005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 msgr2=0x562750ec6680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 0x562750ec6680 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c016520 tx=0x7f7f3c023e70 comp rx=0 tx=0).stop 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 shutdown_connections 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e240367e0 0x7f7e24038ca0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 --2- 172.21.15.177:0/1111925252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750ec6260 0x562750ec6680 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 >> 172.21.15.177:0/1111925252 conn(0x562750eba300 msgr2=0x562750eba700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 shutdown_connections 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.372+0000 7f7f4d824800 1 -- 172.21.15.177:0/1111925252 wait complete. 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562750eb55a0 msgr2=0x562750eb7990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x562750eb55a0 0x562750eb7990 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750db3070 msgr2=0x562750eaee60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x562750db3070 0x562750eaee60 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750eb16a0 msgr2=0x562750eb3a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x562750eb16a0 0x562750eb3a90 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e30036790 msgr2=0x7f7e30038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e30036790 0x7f7e30038c50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7f34054000 tx=0x7f7f3404e000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 msgr2=0x562750ea8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 --2- 172.21.15.177:0/4111288843 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x562750daf560 0x562750ea8190 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7f3c000c00 tx=0x7f7f3c000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4bb24640 1 -- 172.21.15.177:0/4111288843 reap_dead start 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 shutdown_connections 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 >> 172.21.15.177:0/4111288843 conn(0x562750da9030 msgr2=0x562750dad900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 shutdown_connections 2024-03-20T13:35:14.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.373+0000 7f7f4d824800 1 -- 172.21.15.177:0/4111288843 wait complete. 2024-03-20T13:35:14.392 INFO:teuthology.orchestra.run.smithi177.stdout:["myfoo"] 2024-03-20T13:35:14.393 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-03-20T13:35:14.403 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.416 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.426 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.476 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-03-20T13:35:14.503 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.533 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.563 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:14.563 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:35:14.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:35:14.564 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-03-20T13:35:14.607 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:14.607 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fc2b2f800 1 Processor -- start 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fc2b2f800 1 -- start start 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fc2b2f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x559050d139e0 0x559050d13e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fc2b2f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559050c5fcd0 con 0x559050d14c40 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fc2b2f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x559050c16500 con 0x559050d139e0 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fbe7b3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x559050d139e0 0x559050d13e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fb5fb2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x559050d14c40 0x559050d150c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50490/0 (socket says 172.21.15.177:50490) 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.607+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/3962801642 learned_addr learned my addr 172.21.15.177:0/3962801642 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.608+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/3962801642 >> v1:172.21.15.28:6789/0 conn(0x559050d14c40 legacy=0x559050d150c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.608+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/3962801642 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559050d144d0 con 0x559050d139e0 2024-03-20T13:35:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.609+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/3962801642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050d13e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000a470 tx=0x7f7fb001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26102fef496c2ff server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.609+0000 7f7fbdfb2640 1 -- 172.21.15.177:0/3962801642 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0052570 con 0x559050d139e0 2024-03-20T13:35:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.609+0000 7f7fbdfb2640 1 -- 172.21.15.177:0/3962801642 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb00526d0 con 0x559050d139e0 2024-03-20T13:35:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.609+0000 7f7fbdfb2640 1 -- 172.21.15.177:0/3962801642 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0052990 con 0x559050d139e0 2024-03-20T13:35:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3962801642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 msgr2=0x559050d13e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/3962801642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050d13e00 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000a470 tx=0x7f7fb001cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:14.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3962801642 shutdown_connections 2024-03-20T13:35:14.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/3962801642 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050d13e00 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3962801642 >> 172.21.15.177:0/3962801642 conn(0x559050d0f040 msgr2=0x559050d11460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3962801642 shutdown_connections 2024-03-20T13:35:14.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.610+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3962801642 wait complete. 2024-03-20T13:35:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.621+0000 7f7fc2b2f800 1 Processor -- start 2024-03-20T13:35:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fc2b2f800 1 -- start start 2024-03-20T13:35:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fc2b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e03ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fc2b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559050c13a30 con 0x559050d139e0 2024-03-20T13:35:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e03ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e03ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40536/0 (socket says 172.21.15.177:40536) 2024-03-20T13:35:14.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/3073377353 learned_addr learned my addr 172.21.15.177:0/3073377353 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/3073377353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb0005d20 con 0x559050d139e0 2024-03-20T13:35:14.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.622+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/3073377353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e03ea0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0055040 tx=0x7f7fb004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28843fe9e2efe480 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7eac608640 1 -- 172.21.15.177:0/3073377353 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb000a180 con 0x559050d139e0 2024-03-20T13:35:14.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7eac608640 1 -- 172.21.15.177:0/3073377353 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000a2e0 con 0x559050d139e0 2024-03-20T13:35:14.630 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7eac608640 1 -- 172.21.15.177:0/3073377353 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb00529b0 con 0x559050d139e0 2024-03-20T13:35:14.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3073377353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 msgr2=0x559050e03ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/3073377353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e03ea0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f7fb0055040 tx=0x7f7fb004c000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3073377353 shutdown_connections 2024-03-20T13:35:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/3073377353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e03ea0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3073377353 >> 172.21.15.177:0/3073377353 conn(0x559050d0f040 msgr2=0x559050dff640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3073377353 shutdown_connections 2024-03-20T13:35:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.623+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3073377353 wait complete. 2024-03-20T13:35:14.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fc2b2f800 1 Processor -- start 2024-03-20T13:35:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fc2b2f800 1 -- start start 2024-03-20T13:35:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fc2b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e0b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fc2b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559050c0f210 con 0x559050d139e0 2024-03-20T13:35:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e0b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e0b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40552/0 (socket says 172.21.15.177:40552) 2024-03-20T13:35:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1192417861 learned_addr learned my addr 172.21.15.177:0/1192417861 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.624+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb004e070 con 0x559050d139e0 2024-03-20T13:35:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.625+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e0b2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000a470 tx=0x7f7fb0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.625+0000 7f7eaae05640 1 -- 172.21.15.177:0/1192417861 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb006c070 con 0x559050d139e0 2024-03-20T13:35:14.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.625+0000 7f7eaae05640 1 -- 172.21.15.177:0/1192417861 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0052cc0 con 0x559050d139e0 2024-03-20T13:35:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.625+0000 7f7eaae05640 1 -- 172.21.15.177:0/1192417861 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0067600 con 0x559050d139e0 2024-03-20T13:35:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.625+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559050e0b830 con 0x559050d139e0 2024-03-20T13:35:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.625+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559050e0bd10 con 0x559050d139e0 2024-03-20T13:35:14.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7eaae05640 1 -- 172.21.15.177:0/1192417861 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7fb0067760 con 0x559050d139e0 2024-03-20T13:35:14.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7eaae05640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ea4036790 0x7f7ea4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7eaae05640 1 -- 172.21.15.177:0/1192417861 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7fb008f960 con 0x559050d139e0 2024-03-20T13:35:14.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ea4036790 0x7f7ea4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050d14c40 0x559050e110e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e11620 con 0x559050d14c40 2024-03-20T13:35:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7fbefb4640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050d14c40 0x559050e110e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ea4036790 0x7f7ea4038c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001d90 tx=0x7f7fa80012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.626+0000 7f7fbefb4640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050d14c40 0x559050e110e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1192417861 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050d14c40 2024-03-20T13:35:14.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e11980 con 0x559050d14c40 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1192417861 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050d14c40 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e13400 0x559050e158a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e16030 con 0x559050e13400 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e13400 0x559050e158a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.627+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e13400 0x559050e158a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.628+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1192417861 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7fb0080040 con 0x559050e13400 2024-03-20T13:35:14.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.628+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e12180 con 0x559050d14c40 2024-03-20T13:35:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.628+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1192417861 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050d14c40 2024-03-20T13:35:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.628+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559050e17450 0x559050e198a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.628+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e1a030 con 0x559050e17450 2024-03-20T13:35:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.629+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559050e17450 0x559050e198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.630+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559050e17450 0x559050e198a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.656 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.630+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1192417861 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e17450 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fc2b2f800 1 Processor -- start 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fc2b2f800 1 -- start start 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fc2b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 0x559050e28650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fc2b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559050bb1c70 con 0x559050e28230 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 0x559050e28650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 0x559050e28650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40560/0 (socket says 172.21.15.177:40560) 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/102212257 learned_addr learned my addr 172.21.15.177:0/102212257 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.631+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/102212257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559050e28b90 con 0x559050e28230 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 0x559050e28650 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7fb008dd50 tx=0x7f7fb0079d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7ea3fff640 1 -- 172.21.15.177:0/102212257 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb008c6e0 con 0x559050e28230 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7ea3fff640 1 -- 172.21.15.177:0/102212257 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb008c860 con 0x559050e28230 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559050e29600 con 0x559050e28230 2024-03-20T13:35:14.657 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7ea3fff640 1 -- 172.21.15.177:0/102212257 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb008f130 con 0x559050e28230 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559050e29ac0 con 0x559050e28230 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.632+0000 7f7ea3fff640 1 -- 172.21.15.177:0/102212257 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7fb008f2b0 con 0x559050e28230 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7ea3fff640 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e980367e0 0x7f7e98038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7ea3fff640 1 -- 172.21.15.177:0/102212257 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7fb009acc0 con 0x559050e28230 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e980367e0 0x7f7e98038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fc2b2f800 1 Processor -- start 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fc2b2f800 1 -- start start 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e980367e0 0x7f7e98038ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559050e0eaa0 tx=0x7f7fa800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fc2b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e39c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fc2b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559050b875d0 con 0x559050e39820 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e39c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e39c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40576/0 (socket says 172.21.15.177:40576) 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.633+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/3349854065 learned_addr learned my addr 172.21.15.177:0/3349854065 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/3349854065 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559050e3a230 con 0x559050e39820 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/3349854065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e39c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7fb008f6d0 tx=0x7f7fb0067410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bf90da067f96d04 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7ea1ffb640 1 -- 172.21.15.177:0/3349854065 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb00988e0 con 0x559050e39820 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7ea1ffb640 1 -- 172.21.15.177:0/3349854065 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0098a40 con 0x559050e39820 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7ea1ffb640 1 -- 172.21.15.177:0/3349854065 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb0009dc0 con 0x559050e39820 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3349854065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 msgr2=0x559050e39c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/3349854065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e39c40 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7fb008f6d0 tx=0x7f7fb0067410 comp rx=0 tx=0).stop 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3349854065 shutdown_connections 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/3349854065 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e39c40 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3349854065 >> 172.21.15.177:0/3349854065 conn(0x559050e31750 msgr2=0x559050e2f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3349854065 shutdown_connections 2024-03-20T13:35:14.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.634+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/3349854065 wait complete. 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fc2b2f800 1 Processor -- start 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fc2b2f800 1 -- start start 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fc2b2f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e408a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fc2b2f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559050e40de0 con 0x559050e39820 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e408a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fbe7b3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e408a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40588/0 (socket says 172.21.15.177:40588) 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 learned_addr learned my addr 172.21.15.177:0/1672907456 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559050e29ac0 con 0x559050e39820 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.635+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e408a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7fb006f880 tx=0x7f7fb006a120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.636+0000 7f7e8ffff640 1 -- 172.21.15.177:0/1672907456 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb00988e0 con 0x559050e39820 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.636+0000 7f7e8ffff640 1 -- 172.21.15.177:0/1672907456 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb0070e50 con 0x559050e39820 2024-03-20T13:35:14.660 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.636+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559050e29ac0 con 0x559050e39820 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.636+0000 7f7e8ffff640 1 -- 172.21.15.177:0/1672907456 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7fb005c5b0 con 0x559050e39820 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.636+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559050e29ac0 con 0x559050e39820 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.636+0000 7f7e8ffff640 1 -- 172.21.15.177:0/1672907456 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7fb00ac040 con 0x559050e39820 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7e8ffff640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e88036740 0x7f7e88038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7e8ffff640 1 -- 172.21.15.177:0/1672907456 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7fb00bbc40 con 0x559050e39820 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e88036740 0x7f7e88038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050e4c010 0x559050e4e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4ec20 con 0x559050e4c010 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fbefb4640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050e4c010 0x559050e4e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fbefb4640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050e4c010 0x559050e4e4d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e88036740 0x7f7e88038c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559050e1a3f0 tx=0x7f7fa8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 20 realm 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.637+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4eff0 con 0x559050e4c010 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4fba0 con 0x559050e4c010 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e50550 0x559050e52940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e52ec0 con 0x559050e50550 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e50550 0x559050e52940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.638+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e50550 0x559050e52940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fc2b2f800 20 searching for the correct realm 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559050e54e60 0x559050e57320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e579f0 con 0x559050e54e60 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559050e54e60 0x559050e57320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.639+0000 7f7fb5fb2640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559050e54e60 0x559050e57320 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.640+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.640+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e579f0 con 0x559050e50550 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.640+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.640+0000 7f7fbe7b3640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7fb00ba020 0x7f7fb00b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.640+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e579f0 con 0x7f7fb00ba020 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.641+0000 7f7fbefb4640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7fb00ba020 0x7f7fb00b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.643+0000 7f7fbefb4640 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7fb00ba020 0x7f7fb00b4170 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.643+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.643+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.644+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e50550 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.645+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e50550 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.646+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.647+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e50550 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.648+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.649+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.649+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e54e60 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.649+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.649+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x7f7fb00ba020 2024-03-20T13:35:14.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.649+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.649+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7fb8031040 con 0x559050e50550 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.650+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.650+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7fb8031040 con 0x559050e54e60 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.650+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.650+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7fb8031040 con 0x7f7fb00ba020 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7fb8031040 con 0x559050e4c010 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7fb8031040 con 0x559050e50550 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e4f840 con 0x559050e4c010 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.651+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e53790 con 0x559050e4c010 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e53790 con 0x7f7fb00ba020 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 20 zone default found 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 4 Realm: () 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:14.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 20 zonegroup default 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.652+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e54060 con 0x7f7fb00ba020 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e54440 con 0x559050e54e60 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.653+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e54060 con 0x559050e54e60 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.654+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.654+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.654+0000 7f7fc2b2f800 20 started sync module instance, tier type = 2024-03-20T13:35:14.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.654+0000 7f7fc2b2f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:14.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.654+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e590f0 con 0x559050e50550 2024-03-20T13:35:14.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.655+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.655+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94078320872528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e594a0 con 0x559050e50550 2024-03-20T13:35:14.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.655+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5a5d0 con 0x559050e4c010 2024-03-20T13:35:14.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.656+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94078320872528] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.656+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.656+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94078320877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5a9b0 con 0x559050e4c010 2024-03-20T13:35:14.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.656+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5b450 con 0x559050e54e60 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.657+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94078320877808] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.657+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.657+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94078320881456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5b800 con 0x559050e54e60 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.657+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5c230 con 0x559050e50550 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.658+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94078320881456] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.658+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.658+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94078320876208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5ca80 con 0x559050e50550 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.658+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5d3f0 con 0x559050e4c010 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.659+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94078320876208] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.659+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.659+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94078320889680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5d810 con 0x559050e4c010 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.660+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5e180 con 0x7f7fb00ba020 2024-03-20T13:35:14.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.660+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94078320889680] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.662+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.662+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94078320891216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5e180 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.662+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5eaf0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.663+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94078320891216] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.663+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.663+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94078320893152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5eaf0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.663+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5f4b0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94078320893152] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'93 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94078320896080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5f4b0 con 0x7f7fb00ba020 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=0 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=1 2024-03-20T13:35:14.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=2 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=3 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=4 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=5 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.664+0000 7f7fc2b2f800 20 add_watcher() i=6 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.666+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94078320896080] v30'94 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.666+0000 7f7fc2b2f800 20 add_watcher() i=7 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.666+0000 7f7fc2b2f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.666+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e628d0 con 0x559050e4c010 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.666+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.666+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94078320898528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e5fdb0 con 0x559050e4c010 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94078320898528] v30'96 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7fc2b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7fc2b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7fc2b2f800 5 note: GC not initialized 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7def7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7fc2b2f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.667+0000 7f7fc2b2f800 20 Filter name: none 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7ded7fa640 20 reqs_thread_entry: start 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e94730 con 0x559050e50550 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.668+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e951c0 con 0x559050e4c010 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(63 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e95200 con 0x559050e50550 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e96660 con 0x559050e4c010 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 4.c 4:308e6e23:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e96040 con 0x559050e4c010 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 4.1f 4:fad6e193:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e9b070 con 0x559050e54e60 2024-03-20T13:35:14.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 4.3e 4:7ce6a172:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e9d970 con 0x559050e50550 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 4.17 4:e9d229c3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050ea0210 con 0x7f7fb00ba020 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 4.21 4:87353121:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050ea2af0 con 0x7f7fb00ba020 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 4.1b 4:db926116:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050ea55a0 con 0x559050e50550 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050ea7f50 con 0x559050e50550 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 4.3b 4:ddf15168:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050eaadc0 con 0x559050e54e60 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 4.1a 4:59833ee6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050eadbb0 con 0x559050e50550 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 4.33 4:cc074805:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050eb0980 con 0x7f7fb00ba020 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.669+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 4.20 4:0726f43c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050eb37a0 con 0x559050e4c010 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(75 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(71 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(72 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(73 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(74 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fc2b2f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e0a0517e:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050eadbb0 con 0x559050e54e60 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.670+0000 7f7fc2b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.671+0000 7f7e74fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.671+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94078320898528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x559050e4c010 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.672+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94078320898528] v30'97 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.672+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94078320872528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x559050e50550 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.673+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94078320872528] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.673+0000 7f7fc2b2f800 20 remove_watcher() i=0 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.673+0000 7f7fc2b2f800 2 removed watcher, disabling cache 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.673+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94078320877808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x559050e4c010 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.674+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94078320877808] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.674+0000 7f7fc2b2f800 20 remove_watcher() i=1 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.674+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94078320881456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x559050e54e60 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.675+0000 7f7fb5fb2640 1 -- 172.21.15.177:0/1672907456 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94078320881456] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fa8006070 con 0x559050e54e60 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.675+0000 7f7fc2b2f800 20 remove_watcher() i=2 2024-03-20T13:35:14.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.675+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94078320876208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x559050e50550 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.676+0000 7f7fbe7b3640 1 -- 172.21.15.177:0/1672907456 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94078320876208] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb00b7070 con 0x559050e50550 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.676+0000 7f7fc2b2f800 20 remove_watcher() i=3 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.676+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94078320889680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x559050e4c010 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.677+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94078320889680] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x559050e4c010 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.677+0000 7f7fc2b2f800 20 remove_watcher() i=4 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.677+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94078320891216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x7f7fb00ba020 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.680+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94078320891216] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.680+0000 7f7fc2b2f800 20 remove_watcher() i=5 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.680+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94078320893152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x7f7fb00ba020 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.683+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94078320893152] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.683+0000 7f7fc2b2f800 20 remove_watcher() i=6 2024-03-20T13:35:14.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.683+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94078320896080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x559050e7e4e0 con 0x7f7fb00ba020 2024-03-20T13:35:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94078320896080] v30'95 uv93 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7fb800a4a0 con 0x7f7fb00ba020 2024-03-20T13:35:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 20 remove_watcher() i=7 2024-03-20T13:35:14.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7fb00ba020 msgr2=0x7f7fb00b4170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7fb00ba020 0x7f7fb00b4170 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050e4c010 msgr2=0x559050e4e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050e4c010 0x559050e4e4d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e50550 msgr2=0x559050e52940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e50550 0x559050e52940 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559050e54e60 msgr2=0x559050e57320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559050e54e60 0x559050e57320 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e88036740 msgr2=0x7f7e88038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e88036740 0x7f7e88038c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x559050e1a3f0 tx=0x7f7fa8010000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 msgr2=0x559050e408a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1672907456 reap_dead start 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e408a0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7fb006f880 tx=0x7f7fb006a120 comp rx=0 tx=0).stop 2024-03-20T13:35:14.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 shutdown_connections 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1672907456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e39820 0x559050e408a0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 >> 172.21.15.177:0/1672907456 conn(0x559050e31750 msgr2=0x559050e2edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 shutdown_connections 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.685+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1672907456 wait complete. 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e980367e0 msgr2=0x7f7e98038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e980367e0 0x7f7e98038ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x559050e0eaa0 tx=0x7f7fa800f000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 msgr2=0x559050e28650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 0x559050e28650 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7fb008dd50 tx=0x7f7fb0079d40 comp rx=0 tx=0).stop 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 shutdown_connections 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7e980367e0 0x7f7e98038ca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/102212257 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050e28230 0x559050e28650 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 >> 172.21.15.177:0/102212257 conn(0x559050e1c2d0 msgr2=0x559050e1c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 shutdown_connections 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/102212257 wait complete. 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559050e17450 msgr2=0x559050e198a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559050e17450 0x559050e198a0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050d14c40 msgr2=0x559050e110e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559050d14c40 0x559050e110e0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e13400 msgr2=0x559050e158a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559050e13400 0x559050e158a0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ea4036790 msgr2=0x7f7ea4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ea4036790 0x7f7ea4038c50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7fa8001d90 tx=0x7f7fa80012f0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 msgr2=0x559050e0b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 --2- 172.21.15.177:0/1192417861 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559050d139e0 0x559050e0b2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000a470 tx=0x7f7fb0002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fbefb4640 1 -- 172.21.15.177:0/1192417861 reap_dead start 2024-03-20T13:35:14.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 shutdown_connections 2024-03-20T13:35:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 >> 172.21.15.177:0/1192417861 conn(0x559050d0f040 msgr2=0x559050dfdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 shutdown_connections 2024-03-20T13:35:14.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.686+0000 7f7fc2b2f800 1 -- 172.21.15.177:0/1192417861 wait complete. 2024-03-20T13:35:14.703 INFO:teuthology.orchestra.run.smithi177.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7b38e3a9-8d74-4698-af71-c25b0690d394","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","marker":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:35:12.981337Z","creation_time":"2024-03-20T13:35:12.979038Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-03-20T13:35:14.704 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7b38e3a9-8d74-4698-af71-c25b0690d394', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'marker': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:35:12.981337Z', 'creation_time': '2024-03-20T13:35:12.979038Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-03-20T13:35:14.704 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:35:14.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-03-20T13:35:14.704 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-03-20T13:35:14.788 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:14.788 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:14.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.787+0000 7f9c3dfaf800 1 Processor -- start 2024-03-20T13:35:14.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.787+0000 7f9c3dfaf800 1 -- start start 2024-03-20T13:35:14.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.787+0000 7f9c3dfaf800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5607aec43e80 0x5607aecd36a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.787+0000 7f9c3dfaf800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5607aec1bcd0 con 0x5607aecd3c10 2024-03-20T13:35:14.789 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.787+0000 7f9c3dfaf800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5607aebd2500 con 0x5607aec43e80 2024-03-20T13:35:14.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.788+0000 7f9c3b2ad640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5607aecd3c10 0x5607aecd60d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50506/0 (socket says 172.21.15.177:50506) 2024-03-20T13:35:14.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.788+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/2316159879 learned_addr learned my addr 172.21.15.177:0/2316159879 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:14.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.788+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2316159879 >> v2:172.21.15.28:3300/0 conn(0x5607aec43e80 0x5607aecd36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.789+0000 7f9c3baae640 1 -- 172.21.15.177:0/2316159879 >> v1:172.21.15.28:6789/0 conn(0x5607aecd3c10 legacy=0x5607aecd60d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.790 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.789+0000 7f9c3baae640 1 -- 172.21.15.177:0/2316159879 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607aecd89c0 con 0x5607aec43e80 2024-03-20T13:35:14.792 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.791+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2316159879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aecd36a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a470 tx=0x7f9c2c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d81b281cdd63dd8b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.792+0000 7f9c3aaac640 1 -- 172.21.15.177:0/2316159879 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c052570 con 0x5607aec43e80 2024-03-20T13:35:14.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.792+0000 7f9c3aaac640 1 -- 172.21.15.177:0/2316159879 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0526d0 con 0x5607aec43e80 2024-03-20T13:35:14.793 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.792+0000 7f9c3aaac640 1 -- 172.21.15.177:0/2316159879 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c052990 con 0x5607aec43e80 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.792+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2316159879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 msgr2=0x5607aecd36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.792+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2316159879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aecd36a0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a470 tx=0x7f9c2c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.793+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2316159879 shutdown_connections 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.793+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2316159879 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aecd36a0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.793+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2316159879 >> 172.21.15.177:0/2316159879 conn(0x5607aeccb040 msgr2=0x5607aeccd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.793+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2316159879 shutdown_connections 2024-03-20T13:35:14.794 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.793+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2316159879 wait complete. 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.804+0000 7f9c3dfaf800 1 Processor -- start 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.804+0000 7f9c3dfaf800 1 -- start start 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.804+0000 7f9c3dfaf800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.804+0000 7f9c3dfaf800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607aebcfa30 con 0x5607aec43e80 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40610/0 (socket says 172.21.15.177:40610) 2024-03-20T13:35:14.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9c3baae640 1 -- 172.21.15.177:0/725348936 learned_addr learned my addr 172.21.15.177:0/725348936 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9c3baae640 1 -- 172.21.15.177:0/725348936 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c005d20 con 0x5607aec43e80 2024-03-20T13:35:14.807 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9c3baae640 1 --2- 172.21.15.177:0/725348936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc0a90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c055040 tx=0x7f9c2c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d81d1fad5fb79a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9b29e0b640 1 -- 172.21.15.177:0/725348936 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c00a180 con 0x5607aec43e80 2024-03-20T13:35:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9b29e0b640 1 -- 172.21.15.177:0/725348936 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c00a2e0 con 0x5607aec43e80 2024-03-20T13:35:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.805+0000 7f9b29e0b640 1 -- 172.21.15.177:0/725348936 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c0529b0 con 0x5607aec43e80 2024-03-20T13:35:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/725348936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 msgr2=0x5607aedc0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/725348936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc0a90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c055040 tx=0x7f9c2c04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/725348936 shutdown_connections 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/725348936 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc0a90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/725348936 >> 172.21.15.177:0/725348936 conn(0x5607aeccb040 msgr2=0x5607aedbc3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/725348936 shutdown_connections 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.806+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/725348936 wait complete. 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3dfaf800 1 Processor -- start 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3dfaf800 1 -- start start 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3dfaf800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3dfaf800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607aebcb210 con 0x5607aec43e80 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40612/0 (socket says 172.21.15.177:40612) 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3baae640 1 -- 172.21.15.177:0/2102158639 learned_addr learned my addr 172.21.15.177:0/2102158639 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3baae640 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607aecd89c0 con 0x5607aec43e80 2024-03-20T13:35:14.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.807+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc80e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a470 tx=0x7f9c2c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.808+0000 7f9b23fff640 1 -- 172.21.15.177:0/2102158639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c06a070 con 0x5607aec43e80 2024-03-20T13:35:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.808+0000 7f9b23fff640 1 -- 172.21.15.177:0/2102158639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c05d420 con 0x5607aec43e80 2024-03-20T13:35:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.808+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5607aedc8620 con 0x5607aec43e80 2024-03-20T13:35:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.808+0000 7f9b23fff640 1 -- 172.21.15.177:0/2102158639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c05d5d0 con 0x5607aec43e80 2024-03-20T13:35:14.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.808+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607aedc8b00 con 0x5607aec43e80 2024-03-20T13:35:14.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.808+0000 7f9b23fff640 1 -- 172.21.15.177:0/2102158639 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c2c05d730 con 0x5607aec43e80 2024-03-20T13:35:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9b23fff640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b24036790 0x7f9b24038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9b23fff640 1 -- 172.21.15.177:0/2102158639 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9c2c08db20 con 0x5607aec43e80 2024-03-20T13:35:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b24036790 0x7f9b24038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aecd3c10 0x5607aedcee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aedcf400 con 0x5607aecd3c10 2024-03-20T13:35:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9c3c2af640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aecd3c10 0x5607aedcee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b24036790 0x7f9b24038c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000f60 tx=0x7f9c300012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.809+0000 7f9c3c2af640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aecd3c10 0x5607aedcee30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3c2af640 1 -- 172.21.15.177:0/2102158639 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aecd3c10 2024-03-20T13:35:14.823 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aedcc4e0 con 0x5607aecd3c10 2024-03-20T13:35:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3c2af640 1 -- 172.21.15.177:0/2102158639 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aecd3c10 2024-03-20T13:35:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aedd1670 0x5607aedd3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aedd4150 con 0x5607aedd1670 2024-03-20T13:35:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aedd1670 0x5607aedd3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.810+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aedd1670 0x5607aedd3a60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3baae640 1 -- 172.21.15.177:0/2102158639 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9c2c07e040 con 0x5607aedd1670 2024-03-20T13:35:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aedd05f0 con 0x5607aecd3c10 2024-03-20T13:35:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3c2af640 1 -- 172.21.15.177:0/2102158639 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aecd3c10 2024-03-20T13:35:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5607aedd5570 0x5607aedd7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aedd80c0 con 0x5607aedd5570 2024-03-20T13:35:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5607aedd5570 0x5607aedd7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.811+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5607aedd5570 0x5607aedd7960 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/2102158639 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9c30006070 con 0x5607aedd5570 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3dfaf800 1 Processor -- start 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3dfaf800 1 -- start start 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3dfaf800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 0x5607aede6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3dfaf800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607aeb6dc70 con 0x5607aede6250 2024-03-20T13:35:14.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 0x5607aede6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 0x5607aede6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40622/0 (socket says 172.21.15.177:40622) 2024-03-20T13:35:14.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.812+0000 7f9c3baae640 1 -- 172.21.15.177:0/2990559347 learned_addr learned my addr 172.21.15.177:0/2990559347 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9c3baae640 1 -- 172.21.15.177:0/2990559347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607aede6bb0 con 0x5607aede6250 2024-03-20T13:35:14.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 0x5607aede6670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c08bf10 tx=0x7f9c2c079e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.827 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9b217fa640 1 -- 172.21.15.177:0/2990559347 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c077e50 con 0x5607aede6250 2024-03-20T13:35:14.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9b217fa640 1 -- 172.21.15.177:0/2990559347 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0773b0 con 0x5607aede6250 2024-03-20T13:35:14.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9b217fa640 1 -- 172.21.15.177:0/2990559347 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c077650 con 0x5607aede6250 2024-03-20T13:35:14.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5607aede7620 con 0x5607aede6250 2024-03-20T13:35:14.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.813+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607aede7ae0 con 0x5607aede6250 2024-03-20T13:35:14.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9b217fa640 1 -- 172.21.15.177:0/2990559347 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c2c08d290 con 0x5607aede6250 2024-03-20T13:35:14.828 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9b217fa640 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b140367e0 0x7f9b14038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9b217fa640 1 -- 172.21.15.177:0/2990559347 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9c2c08de40 con 0x5607aede6250 2024-03-20T13:35:14.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b140367e0 0x7f9b14038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9c3dfaf800 1 Processor -- start 2024-03-20T13:35:14.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9c3dfaf800 1 -- start start 2024-03-20T13:35:14.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.814+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b140367e0 0x7f9b14038ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000bf50 tx=0x7f9c3000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3dfaf800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aecd10a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3dfaf800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607aeb435d0 con 0x5607aecd0c80 2024-03-20T13:35:14.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aecd10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aecd10a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40628/0 (socket says 172.21.15.177:40628) 2024-03-20T13:35:14.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3baae640 1 -- 172.21.15.177:0/2349465132 learned_addr learned my addr 172.21.15.177:0/2349465132 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3baae640 1 -- 172.21.15.177:0/2349465132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607aeccf480 con 0x5607aecd0c80 2024-03-20T13:35:14.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9c3baae640 1 --2- 172.21.15.177:0/2349465132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aecd10a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c086f90 tx=0x7f9c2c084b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac5cf779658ce37 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9b1affd640 1 -- 172.21.15.177:0/2349465132 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c0777b0 con 0x5607aecd0c80 2024-03-20T13:35:14.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9b1affd640 1 -- 172.21.15.177:0/2349465132 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c084410 con 0x5607aecd0c80 2024-03-20T13:35:14.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.815+0000 7f9b1affd640 1 -- 172.21.15.177:0/2349465132 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c04ccc0 con 0x5607aecd0c80 2024-03-20T13:35:14.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2349465132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 msgr2=0x5607aecd10a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2349465132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aecd10a0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c086f90 tx=0x7f9c2c084b60 comp rx=0 tx=0).stop 2024-03-20T13:35:14.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2349465132 shutdown_connections 2024-03-20T13:35:14.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2349465132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aecd10a0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2349465132 >> 172.21.15.177:0/2349465132 conn(0x5607aedef640 msgr2=0x5607aeded6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2349465132 shutdown_connections 2024-03-20T13:35:14.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2349465132 wait complete. 2024-03-20T13:35:14.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 Processor -- start 2024-03-20T13:35:14.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- start start 2024-03-20T13:35:14.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aedfc3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3dfaf800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607aedfc920 con 0x5607aecd0c80 2024-03-20T13:35:14.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aedfc3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3baae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aedfc3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40638/0 (socket says 172.21.15.177:40638) 2024-03-20T13:35:14.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.816+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 learned_addr learned my addr 172.21.15.177:0/1110730816 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607aede7620 con 0x5607aecd0c80 2024-03-20T13:35:14.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9c3baae640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aedfc3e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c06e5b0 tx=0x7f9c2c08ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9b197fa640 1 -- 172.21.15.177:0/1110730816 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c06e850 con 0x5607aecd0c80 2024-03-20T13:35:14.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9b197fa640 1 -- 172.21.15.177:0/1110730816 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c0b2070 con 0x5607aecd0c80 2024-03-20T13:35:14.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5607aede7620 con 0x5607aecd0c80 2024-03-20T13:35:14.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9b197fa640 1 -- 172.21.15.177:0/1110730816 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c2c06eb80 con 0x5607aecd0c80 2024-03-20T13:35:14.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.817+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5607aede7620 con 0x5607aecd0c80 2024-03-20T13:35:14.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9b197fa640 1 -- 172.21.15.177:0/1110730816 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c2c0b4030 con 0x5607aecd0c80 2024-03-20T13:35:14.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9b197fa640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b04036790 0x7f9b04038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9b197fa640 1 -- 172.21.15.177:0/1110730816 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9c2c0b8c70 con 0x5607aecd0c80 2024-03-20T13:35:14.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b04036790 0x7f9b04038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aee07ba0 0x5607aee0a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0a7b0 con 0x5607aee07ba0 2024-03-20T13:35:14.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.818+0000 7f9c3c2af640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aee07ba0 0x5607aee0a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3c2af640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aee07ba0 0x5607aee0a060 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b04036790 0x7f9b04038c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9c30001b60 tx=0x7f9c30010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 realm 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0ab80 con 0x5607aee07ba0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:14.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.819+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b730 con 0x5607aee07ba0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aee0c0e0 0x5607aee0e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0ea50 con 0x5607aee0c0e0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3baae640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aee0c0e0 0x5607aee0e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3baae640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aee0c0e0 0x5607aee0e4d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 20 searching for the correct realm 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5607aee109f0 0x5607aee12eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee13580 con 0x5607aee109f0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.820+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5607aee109f0 0x5607aee12eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.821+0000 7f9c3b2ad640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5607aee109f0 0x5607aee12eb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.821+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.821+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee13580 con 0x5607aee0c0e0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.821+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.821+0000 7f9c3baae640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9c2c0ae040 0x7f9c2c0ae880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.821+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee13580 con 0x7f9c2c0ae040 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.823+0000 7f9c3c2af640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9c2c0ae040 0x7f9c2c0ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.824+0000 7f9c3c2af640 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9c2c0ae040 0x7f9c2c0ae880 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.825+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.825+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.825+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.825+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.825+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.825+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee0c0e0 2024-03-20T13:35:14.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.826+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee0c0e0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.827+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.828+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.829+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee0c0e0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.830+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee109f0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.831+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.831+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.831+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.831+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9c34031040 con 0x5607aee0c0e0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.831+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.831+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9c34031040 con 0x5607aee109f0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9c34031040 con 0x7f9c2c0ae040 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9c34031040 con 0x5607aee07ba0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9c34031040 con 0x5607aee0c0e0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3dfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3dfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3dfaf800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:14.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3dfaf800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3dfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.832+0000 7f9c3dfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0b3d0 con 0x5607aee07ba0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0f320 con 0x5607aee07ba0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.833+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0f320 con 0x7f9c2c0ae040 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 20 zone default found 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 4 Realm: () 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 20 zonegroup default 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.834+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0fba0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee0fba0 con 0x5607aee109f0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.835+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.836+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee153a0 con 0x5607aee109f0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.836+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.836+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.836+0000 7f9c3dfaf800 20 started sync module instance, tier type = 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.836+0000 7f9c3dfaf800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.836+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee14830 con 0x5607aee0c0e0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.837+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.837+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94590998760416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee15000 con 0x5607aee0c0e0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.837+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee161b0 con 0x5607aee07ba0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.838+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94590998760416] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.863 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.838+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.838+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94590998764816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee165d0 con 0x5607aee07ba0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.838+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee16f40 con 0x5607aee109f0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.839+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94590998764816] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.839+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.839+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94590998765872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee16550 con 0x5607aee109f0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.839+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee17d50 con 0x5607aee0c0e0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.840+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.840+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94590998773936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee18970 con 0x5607aee0c0e0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.840+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee192e0 con 0x5607aee07ba0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.840+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94590998765872] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.841+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94590998773936] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.841+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.841+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94590998777408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee18970 con 0x5607aee07ba0 2024-03-20T13:35:14.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.841+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee19b30 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.842+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94590998777408] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.844+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.844+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94590998774992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee19a50 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.844+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee1a250 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.846+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94590998774992] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.847+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.847+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94590998779792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee1a110 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.847+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee1abe0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'96 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94590998779792] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94590998780848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee1aba0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=0 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=1 2024-03-20T13:35:14.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=2 2024-03-20T13:35:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=3 2024-03-20T13:35:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=4 2024-03-20T13:35:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=5 2024-03-20T13:35:14.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.849+0000 7f9c3dfaf800 20 add_watcher() i=6 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.851+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94590998780848] v30'97 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.851+0000 7f9c3dfaf800 20 add_watcher() i=7 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.851+0000 7f9c3dfaf800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.851+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee1dff0 con 0x5607aee07ba0 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.851+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.851+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94590998783680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee1b500 con 0x5607aee07ba0 2024-03-20T13:35:14.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.852+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94590998783680] v30'98 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9af1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 5 note: GC not initialized 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9af0fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 20 Filter name: none 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9a6a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee4faf0 con 0x5607aee07ba0 2024-03-20T13:35:14.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.853+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee51000 con 0x5607aee0c0e0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee4e850 con 0x5607aee0c0e0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.854+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee4ee70 con 0x5607aee07ba0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:14.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 4.c 4:308e6e23:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee50660 con 0x5607aee07ba0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 4.1f 4:fad6e193:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee555f0 con 0x5607aee109f0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 4.3e 4:7ce6a172:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee57e90 con 0x5607aee0c0e0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 4.17 4:e9d229c3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee5a780 con 0x7f9c2c0ae040 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 4.21 4:87353121:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee5d110 con 0x7f9c2c0ae040 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 4.1b 4:db926116:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee5fc70 con 0x5607aee0c0e0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee62130 con 0x5607aee0c0e0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 4.3b 4:ddf15168:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee649d0 con 0x5607aee109f0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 4.1a 4:59833ee6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee67410 con 0x5607aee0c0e0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(73 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(71 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(68 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 4.33 4:cc074805:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee501c0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(72 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 4.20 4:0726f43c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee644c0 con 0x5607aee07ba0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.855+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(74 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.856+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.856+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.856+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.857+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(75 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.857+0000 7f9c3dfaf800 20 rados->read ofs=0 len=0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.857+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e0a0517e:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee67410 con 0x5607aee109f0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.857+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.857+0000 7f9c3dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:14.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.858+0000 7f9af1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.858+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94590998783680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x5607aee07ba0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.858+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94590998783680] v30'99 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.859+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94590998760416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x5607aee0c0e0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.859+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94590998760416] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.859+0000 7f9c3dfaf800 20 remove_watcher() i=0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.859+0000 7f9c3dfaf800 2 removed watcher, disabling cache 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.859+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94590998764816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x5607aee07ba0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.860+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94590998764816] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.860+0000 7f9c3dfaf800 20 remove_watcher() i=1 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.860+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94590998765872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x5607aee109f0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.862+0000 7f9c3b2ad640 1 -- 172.21.15.177:0/1110730816 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94590998765872] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c30006070 con 0x5607aee109f0 2024-03-20T13:35:14.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.862+0000 7f9c3dfaf800 20 remove_watcher() i=2 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.862+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94590998773936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x5607aee0c0e0 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.863+0000 7f9c3baae640 1 -- 172.21.15.177:0/1110730816 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94590998773936] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c2c089070 con 0x5607aee0c0e0 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.863+0000 7f9c3dfaf800 20 remove_watcher() i=3 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.863+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94590998777408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x5607aee07ba0 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.864+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94590998777408] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x5607aee07ba0 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.864+0000 7f9c3dfaf800 20 remove_watcher() i=4 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.864+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94590998774992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x7f9c2c0ae040 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.867+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94590998774992] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.867+0000 7f9c3dfaf800 20 remove_watcher() i=5 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.867+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94590998779792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x7f9c2c0ae040 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.870+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94590998779792] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.870+0000 7f9c3dfaf800 20 remove_watcher() i=6 2024-03-20T13:35:14.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.870+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94590998780848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5607aee39c80 con 0x7f9c2c0ae040 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.872+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94590998780848] v30'98 uv96 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9c3400a4a0 con 0x7f9c2c0ae040 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.872+0000 7f9c3dfaf800 20 remove_watcher() i=7 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9c2c0ae040 msgr2=0x7f9c2c0ae880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9c2c0ae040 0x7f9c2c0ae880 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aee07ba0 msgr2=0x5607aee0a060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aee07ba0 0x5607aee0a060 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aee0c0e0 msgr2=0x5607aee0e4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aee0c0e0 0x5607aee0e4d0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5607aee109f0 msgr2=0x5607aee12eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5607aee109f0 0x5607aee12eb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b04036790 msgr2=0x7f9b04038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b04036790 0x7f9b04038c50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9c30001b60 tx=0x7f9c30010000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 msgr2=0x5607aedfc3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/1110730816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aecd0c80 0x5607aedfc3e0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c06e5b0 tx=0x7f9c2c08ff10 comp rx=0 tx=0).stop 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 reap_dead start 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3c2af640 1 -- 172.21.15.177:0/1110730816 reap_dead start 2024-03-20T13:35:14.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 shutdown_connections 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 >> 172.21.15.177:0/1110730816 conn(0x5607aedef640 msgr2=0x5607aedecca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 shutdown_connections 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/1110730816 wait complete. 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b140367e0 msgr2=0x7f9b14038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b140367e0 0x7f9b14038ca0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9c3000bf50 tx=0x7f9c3000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 msgr2=0x5607aede6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 0x5607aede6670 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c08bf10 tx=0x7f9c2c079e30 comp rx=0 tx=0).stop 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 shutdown_connections 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b140367e0 0x7f9b14038ca0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2990559347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aede6250 0x5607aede6670 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 >> 172.21.15.177:0/2990559347 conn(0x5607aedda2f0 msgr2=0x5607aedda6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 shutdown_connections 2024-03-20T13:35:14.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.873+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2990559347 wait complete. 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5607aedd5570 msgr2=0x5607aedd7960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5607aedd5570 0x5607aedd7960 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aecd3c10 msgr2=0x5607aedcee30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5607aecd3c10 0x5607aedcee30 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aedd1670 msgr2=0x5607aedd3a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5607aedd1670 0x5607aedd3a60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b24036790 msgr2=0x7f9b24038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b24036790 0x7f9b24038c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f9c30000f60 tx=0x7f9c300012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 msgr2=0x5607aedc80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 --2- 172.21.15.177:0/2102158639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5607aec43e80 0x5607aedc80e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00a470 tx=0x7f9c2c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3c2af640 1 -- 172.21.15.177:0/2102158639 reap_dead start 2024-03-20T13:35:14.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 shutdown_connections 2024-03-20T13:35:14.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 >> 172.21.15.177:0/2102158639 conn(0x5607aeccb040 msgr2=0x5607aedbac50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 shutdown_connections 2024-03-20T13:35:14.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.874+0000 7f9c3dfaf800 1 -- 172.21.15.177:0/2102158639 wait complete. 2024-03-20T13:35:14.888 INFO:teuthology.orchestra.run.smithi177.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7b38e3a9-8d74-4698-af71-c25b0690d394","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","marker":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:35:12.981337Z","creation_time":"2024-03-20T13:35:12.979038Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]}] 2024-03-20T13:35:14.888 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7b38e3a9-8d74-4698-af71-c25b0690d394', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'marker': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:35:12.981337Z', 'creation_time': '2024-03-20T13:35:12.979038Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []}] 2024-03-20T13:35:14.894 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:35:14.894 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:35:14.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:35:14.895 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-03-20T13:35:14.971 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:14.971 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef3624800 1 Processor -- start 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef3624800 1 -- start start 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef3624800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5624f21fff40 0x5624f2208a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef3624800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5624f214acd0 con 0x5624f21fe400 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef3624800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5624f2101500 con 0x5624f21fff40 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef0922640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5624f21fff40 0x5624f2208a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef1123640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5624f21fe400 0x5624f21fe820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50510/0 (socket says 172.21.15.177:50510) 2024-03-20T13:35:14.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef1123640 1 -- 172.21.15.177:0/883085815 learned_addr learned my addr 172.21.15.177:0/883085815 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:14.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef0922640 1 -- 172.21.15.177:0/883085815 >> v1:172.21.15.28:6789/0 conn(0x5624f21fe400 legacy=0x5624f21fe820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.971+0000 7f6ef0922640 1 -- 172.21.15.177:0/883085815 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624f2172f00 con 0x5624f21fff40 2024-03-20T13:35:14.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.973+0000 7f6ef0922640 1 --2- 172.21.15.177:0/883085815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fff40 0x5624f2208a40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800a470 tx=0x7f6ee801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f389086184f0c78 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.973+0000 7f6ee3fff640 1 -- 172.21.15.177:0/883085815 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee804ad40 con 0x5624f21fff40 2024-03-20T13:35:14.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.973+0000 7f6ee3fff640 1 -- 172.21.15.177:0/883085815 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee8052440 con 0x5624f21fff40 2024-03-20T13:35:14.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.973+0000 7f6ee3fff640 1 -- 172.21.15.177:0/883085815 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee804aea0 con 0x5624f21fff40 2024-03-20T13:35:14.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 -- 172.21.15.177:0/883085815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fff40 msgr2=0x5624f2208a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 --2- 172.21.15.177:0/883085815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fff40 0x5624f2208a40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800a470 tx=0x7f6ee801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:14.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 -- 172.21.15.177:0/883085815 shutdown_connections 2024-03-20T13:35:14.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 --2- 172.21.15.177:0/883085815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fff40 0x5624f2208a40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 -- 172.21.15.177:0/883085815 >> 172.21.15.177:0/883085815 conn(0x5624f21fa040 msgr2=0x5624f21fc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 -- 172.21.15.177:0/883085815 shutdown_connections 2024-03-20T13:35:14.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.974+0000 7f6ef3624800 1 -- 172.21.15.177:0/883085815 wait complete. 2024-03-20T13:35:14.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.985+0000 7f6ef3624800 1 Processor -- start 2024-03-20T13:35:14.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef3624800 1 -- start start 2024-03-20T13:35:14.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef3624800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef3624800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624f20fea30 con 0x5624f21fe400 2024-03-20T13:35:14.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40662/0 (socket says 172.21.15.177:40662) 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef1123640 1 -- 172.21.15.177:0/505317019 learned_addr learned my addr 172.21.15.177:0/505317019 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.986+0000 7f6ef1123640 1 -- 172.21.15.177:0/505317019 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee8005d20 con 0x5624f21fe400 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.987+0000 7f6ef1123640 1 --2- 172.21.15.177:0/505317019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f1ee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4001c50 tx=0x7f6ee400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d8fbce879520c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.987+0000 7f6ddf606640 1 -- 172.21.15.177:0/505317019 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee400e470 con 0x5624f21fe400 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.987+0000 7f6ddf606640 1 -- 172.21.15.177:0/505317019 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee400e5d0 con 0x5624f21fe400 2024-03-20T13:35:14.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.987+0000 7f6ddf606640 1 -- 172.21.15.177:0/505317019 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee400e8d0 con 0x5624f21fe400 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.987+0000 7f6ef3624800 1 -- 172.21.15.177:0/505317019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 msgr2=0x5624f22f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.987+0000 7f6ef3624800 1 --2- 172.21.15.177:0/505317019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f1ee0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4001c50 tx=0x7f6ee400b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 -- 172.21.15.177:0/505317019 shutdown_connections 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 --2- 172.21.15.177:0/505317019 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f1ee0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 -- 172.21.15.177:0/505317019 >> 172.21.15.177:0/505317019 conn(0x5624f21fa040 msgr2=0x5624f22ed680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 -- 172.21.15.177:0/505317019 shutdown_connections 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 -- 172.21.15.177:0/505317019 wait complete. 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 Processor -- start 2024-03-20T13:35:14.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 -- start start 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef3624800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624f20fa210 con 0x5624f21fe400 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40666/0 (socket says 172.21.15.177:40666) 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.988+0000 7f6ef1123640 1 -- 172.21.15.177:0/2569514459 learned_addr learned my addr 172.21.15.177:0/2569514459 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ef1123640 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624f214acd0 con 0x5624f21fe400 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ef1123640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f9410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000c00 tx=0x7f6ee4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ddde03640 1 -- 172.21.15.177:0/2569514459 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee401f070 con 0x5624f21fe400 2024-03-20T13:35:14.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ddde03640 1 -- 172.21.15.177:0/2569514459 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4018770 con 0x5624f21fe400 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624f22f9950 con 0x5624f21fe400 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ddde03640 1 -- 172.21.15.177:0/2569514459 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4018a30 con 0x5624f21fe400 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.989+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624f22f9e30 con 0x5624f21fe400 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ddde03640 1 -- 172.21.15.177:0/2569514459 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6ee4018c20 con 0x5624f21fe400 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ddde03640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dd8036790 0x7f6dd8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ddde03640 1 -- 172.21.15.177:0/2569514459 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6ee404c2e0 con 0x5624f21fe400 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ef0922640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dd8036790 0x7f6dd8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f21fff40 0x5624f2300090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2300660 con 0x5624f21fff40 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.990+0000 7f6ef1924640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f21fff40 0x5624f2300090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef0922640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dd8036790 0x7f6dd8038c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8054000 tx=0x7f6ee804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef1924640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f21fff40 0x5624f2300090 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef1924640 1 -- 172.21.15.177:0/2569514459 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f21fff40 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f22fd7c0 con 0x5624f21fff40 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef1924640 1 -- 172.21.15.177:0/2569514459 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f21fff40 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f23028d0 0x5624f2304cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2305390 con 0x5624f23028d0 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.991+0000 7f6ef1123640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f23028d0 0x5624f2304cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.992+0000 7f6ef1123640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f23028d0 0x5624f2304cc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.992+0000 7f6ef1123640 1 -- 172.21.15.177:0/2569514459 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f6ee4014070 con 0x5624f23028d0 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.992+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2301850 con 0x5624f21fff40 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.992+0000 7f6ef1924640 1 -- 172.21.15.177:0/2569514459 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f21fff40 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.992+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5624f23067b0 0x5624f2308ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:14.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.992+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2309300 con 0x5624f23067b0 2024-03-20T13:35:15.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.993+0000 7f6ef0922640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5624f23067b0 0x5624f2308ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.994+0000 7f6ef0922640 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5624f23067b0 0x5624f2308ba0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.995+0000 7f6ef0922640 1 -- 172.21.15.177:0/2569514459 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f23067b0 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.995+0000 7f6ef3624800 1 Processor -- start 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.995+0000 7f6ef3624800 1 -- start start 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.995+0000 7f6ef3624800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 0x5624f2317920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.995+0000 7f6ef3624800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624f209cc70 con 0x5624f2317500 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 0x5624f2317920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 0x5624f2317920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40668/0 (socket says 172.21.15.177:40668) 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef1123640 1 -- 172.21.15.177:0/2360121018 learned_addr learned my addr 172.21.15.177:0/2360121018 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef1123640 1 -- 172.21.15.177:0/2360121018 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624f2317e60 con 0x5624f2317500 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef1123640 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 0x5624f2317920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ee404a730 tx=0x7f6ee402c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6dd6ffd640 1 -- 172.21.15.177:0/2360121018 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee40229b0 con 0x5624f2317500 2024-03-20T13:35:15.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6dd6ffd640 1 -- 172.21.15.177:0/2360121018 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4033070 con 0x5624f2317500 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6dd6ffd640 1 -- 172.21.15.177:0/2360121018 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4022c40 con 0x5624f2317500 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624f23188d0 con 0x5624f2317500 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.996+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624f2318d90 con 0x5624f2317500 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.997+0000 7f6dd6ffd640 1 -- 172.21.15.177:0/2360121018 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6ee402d440 con 0x5624f2317500 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.997+0000 7f6dd6ffd640 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dc8036790 0x7f6dc8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.997+0000 7f6dd6ffd640 1 -- 172.21.15.177:0/2360121018 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6ee404de40 con 0x5624f2317500 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.997+0000 7f6ef0922640 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dc8036790 0x7f6dc8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef3624800 1 Processor -- start 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef3624800 1 -- start start 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef0922640 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dc8036790 0x7f6dc8038c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5624f22fd710 tx=0x7f6ee8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef3624800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f23249d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef3624800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624f20725d0 con 0x5624f23245d0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f23249d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f23249d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40678/0 (socket says 172.21.15.177:40678) 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef1123640 1 -- 172.21.15.177:0/290929622 learned_addr learned my addr 172.21.15.177:0/290929622 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef1123640 1 -- 172.21.15.177:0/290929622 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624f2324fa0 con 0x5624f23245d0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.998+0000 7f6ef1123640 1 --2- 172.21.15.177:0/290929622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f23249d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4018bf0 tx=0x7f6ee4043b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=627f3ed015ee4567 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6dd4ff9640 1 -- 172.21.15.177:0/290929622 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4043cd0 con 0x5624f23245d0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6dd4ff9640 1 -- 172.21.15.177:0/290929622 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee4022da0 con 0x5624f23245d0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6dd4ff9640 1 -- 172.21.15.177:0/290929622 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4010e90 con 0x5624f23245d0 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 -- 172.21.15.177:0/290929622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 msgr2=0x5624f23249d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 --2- 172.21.15.177:0/290929622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f23249d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4018bf0 tx=0x7f6ee4043b90 comp rx=0 tx=0).stop 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 -- 172.21.15.177:0/290929622 shutdown_connections 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 --2- 172.21.15.177:0/290929622 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f23249d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 -- 172.21.15.177:0/290929622 >> 172.21.15.177:0/290929622 conn(0x5624f23208a0 msgr2=0x5624f231e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 -- 172.21.15.177:0/290929622 shutdown_connections 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 -- 172.21.15.177:0/290929622 wait complete. 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 Processor -- start 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:14.999+0000 7f6ef3624800 1 -- start start 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef3624800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f232b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef3624800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624f232ba70 con 0x5624f23245d0 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f232b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef1123640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f232b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40688/0 (socket says 172.21.15.177:40688) 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 learned_addr learned my addr 172.21.15.177:0/501989972 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624f23188d0 con 0x5624f23245d0 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef1123640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f232b530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6ee404e000 tx=0x7f6ee4008ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6dc6ffd640 1 -- 172.21.15.177:0/501989972 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee4043cd0 con 0x5624f23245d0 2024-03-20T13:35:15.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6dc6ffd640 1 -- 172.21.15.177:0/501989972 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ee400dbd0 con 0x5624f23245d0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624f23188d0 con 0x5624f23245d0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6dc6ffd640 1 -- 172.21.15.177:0/501989972 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6ee400d570 con 0x5624f23245d0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.000+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624f23188d0 con 0x5624f23245d0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.001+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6dc6ffd640 1 -- 172.21.15.177:0/501989972 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6ee4059070 con 0x5624f23245d0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6dc6ffd640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dbc036790 0x7f6dbc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6dc6ffd640 1 -- 172.21.15.177:0/501989972 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f6ee4056040 con 0x5624f23245d0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6ef0922640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dbc036790 0x7f6dbc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f2336d20 0x5624f23391c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2339910 con 0x5624f2336d20 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6ef1924640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f2336d20 0x5624f23391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6ef0922640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dbc036790 0x7f6dbc038c50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5624f23096c0 tx=0x7f6ee805e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.002+0000 7f6ef1924640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f2336d20 0x5624f23391c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 realm 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2339ce0 con 0x5624f2336d20 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a890 con 0x5624f2336d20 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f233b240 0x5624f233d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233db70 con 0x5624f233b240 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.003+0000 7f6ef1123640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f233b240 0x5624f233d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef1123640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f233b240 0x5624f233d630 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f6ee4062040 con 0x5624f233b240 2024-03-20T13:35:15.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef3624800 20 searching for the correct realm 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5624f233fb70 0x5624f2342030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2342700 con 0x5624f233fb70 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef0922640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5624f233fb70 0x5624f2342030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.004+0000 7f6ef0922640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5624f233fb70 0x5624f2342030 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.005+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.005+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2342700 con 0x5624f233b240 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.005+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee4062040 con 0x5624f233b240 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.005+0000 7f6ef1123640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f6ee406f070 0x7f6ee403b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.005+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2342700 con 0x7f6ee406f070 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.007+0000 7f6ef1924640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f6ee406f070 0x7f6ee403b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.010+0000 7f6ef1924640 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f6ee406f070 0x7f6ee403b890 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.011+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.011+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.012+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.012+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.012+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.012+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.013+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.013+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.014+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.014+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233b240 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.015+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee4062040 con 0x5624f233b240 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.015+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.015+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.015+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.015+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.015+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.016+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.016+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.016+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.016+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233b240 2024-03-20T13:35:15.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.017+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f6ee4062040 con 0x5624f233b240 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.017+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.017+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.017+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.017+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.017+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.018+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233b240 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.019+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.020+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.020+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.020+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.020+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f233fb70 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.021+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.021+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x7f6ee406f070 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.021+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.021+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6eec031040 con 0x5624f233b240 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.021+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.021+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6eec031040 con 0x5624f233fb70 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.022+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.022+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6eec031040 con 0x7f6ee406f070 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.022+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.022+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6eec031040 con 0x5624f2336d20 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.022+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.022+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f6eec031040 con 0x5624f233b240 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:15.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233a530 con 0x5624f2336d20 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233e470 con 0x5624f2336d20 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233e470 con 0x7f6ee406f070 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 zone default found 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 4 Realm: () 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 zonegroup default 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.023+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233ecf0 con 0x7f6ee406f070 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f233ecf0 con 0x5624f233fb70 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2344520 con 0x5624f233fb70 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 started sync module instance, tier type = 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:15.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.024+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23439b0 con 0x5624f233b240 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.026+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.026+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94716682321168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2344130 con 0x5624f233b240 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.026+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23451c0 con 0x5624f2336d20 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.026+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94716682321168] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.027+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.027+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94716682324576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2345570 con 0x5624f2336d20 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.027+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2345f90 con 0x5624f233fb70 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.028+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94716682324576] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.028+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.028+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94716682328688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2346340 con 0x5624f233fb70 2024-03-20T13:35:15.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.028+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2346d90 con 0x5624f233b240 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.029+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.029+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94716682334528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2347a00 con 0x5624f233b240 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.030+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23483f0 con 0x5624f2336d20 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.030+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94716682328688] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.030+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94716682334528] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.031+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.031+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94716682335584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2344f00 con 0x5624f2336d20 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.031+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2348c80 con 0x7f6ee406f070 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.032+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.032+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94716682335584] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.032+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94716682340176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2348b70 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.032+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2349640 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.033+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94716682340176] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.033+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.033+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94716682338000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2349640 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.033+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2349ff0 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.034+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94716682338000] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'99 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94716682342816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2349fb0 con 0x7f6ee406f070 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=0 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=1 2024-03-20T13:35:15.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=2 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=3 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=4 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=5 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.035+0000 7f6ef3624800 20 add_watcher() i=6 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.036+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94716682342816] v30'100 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.036+0000 7f6ef3624800 20 add_watcher() i=7 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.036+0000 7f6ef3624800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.036+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f234d4e0 con 0x5624f2336d20 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.037+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.037+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94716682345696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f234a920 con 0x5624f2336d20 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94716682345696] v30'100 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6da77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:15.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 5 note: GC not initialized 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6da67e4640 20 reqs_thread_entry: start 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 20 Filter name: none 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6d17fff640 20 reqs_thread_entry: start 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.038+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237f330 con 0x5624f233b240 2024-03-20T13:35:15.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237f9f0 con 0x5624f2336d20 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(63 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237e910 con 0x5624f233b240 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.039+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2380eb0 con 0x5624f2336d20 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 4.c 4:308e6e23:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23808d0 con 0x5624f2336d20 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 4.1f 4:fad6e193:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2385980 con 0x5624f233fb70 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 4.3e 4:7ce6a172:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23881e0 con 0x5624f233b240 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 4.17 4:e9d229c3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f238ab80 con 0x7f6ee406f070 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 4.21 4:87353121:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f238d490 con 0x7f6ee406f070 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 4.1b 4:db926116:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f238fd40 con 0x5624f233b240 2024-03-20T13:35:15.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2392850 con 0x5624f233b240 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 4.3b 4:ddf15168:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23956c0 con 0x5624f233fb70 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 4.1a 4:59833ee6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23984b0 con 0x5624f233b240 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 4.33 4:cc074805:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f239aed0 con 0x7f6ee406f070 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 4.20 4:0726f43c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f239d980 con 0x5624f2336d20 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(71 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(70 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(75 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(73 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(69 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(72 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.040+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.041+0000 7f6ef3624800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.041+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e0a0517e:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f2380320 con 0x5624f233fb70 2024-03-20T13:35:15.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.041+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.041+0000 7f6ef3624800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.041+0000 7f6da77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.041+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94716682345696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23690a0 con 0x5624f2336d20 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.042+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94716682345696] v30'101 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.042+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94716682321168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23690a0 con 0x5624f233b240 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.043+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94716682321168] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.043+0000 7f6ef3624800 20 remove_watcher() i=0 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.043+0000 7f6ef3624800 2 removed watcher, disabling cache 2024-03-20T13:35:15.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.043+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94716682324576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23690a0 con 0x5624f2336d20 2024-03-20T13:35:15.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.044+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94716682324576] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.044+0000 7f6ef3624800 20 remove_watcher() i=1 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.044+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94716682328688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23690a0 con 0x5624f233fb70 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.046+0000 7f6ef0922640 1 -- 172.21.15.177:0/501989972 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94716682328688] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee80651d0 con 0x5624f233fb70 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.046+0000 7f6ef3624800 20 remove_watcher() i=2 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.046+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94716682334528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f23690a0 con 0x5624f233b240 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.047+0000 7f6ef1123640 1 -- 172.21.15.177:0/501989972 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94716682334528] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6ee4085080 con 0x5624f233b240 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.047+0000 7f6ef3624800 20 remove_watcher() i=3 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.047+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94716682335584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237f3b0 con 0x5624f2336d20 2024-03-20T13:35:15.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.048+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94716682335584] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x5624f2336d20 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.048+0000 7f6ef3624800 20 remove_watcher() i=4 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.048+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94716682340176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237f3b0 con 0x7f6ee406f070 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.049+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94716682340176] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.049+0000 7f6ef3624800 20 remove_watcher() i=5 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.049+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94716682338000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237f3b0 con 0x7f6ee406f070 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.051+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94716682338000] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.051+0000 7f6ef3624800 20 remove_watcher() i=6 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.051+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94716682342816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5624f237f3b0 con 0x7f6ee406f070 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94716682342816] v30'101 uv99 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6eec00a4a0 con 0x7f6ee406f070 2024-03-20T13:35:15.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 20 remove_watcher() i=7 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f6ee406f070 msgr2=0x7f6ee403b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f6ee406f070 0x7f6ee403b890 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f2336d20 msgr2=0x5624f23391c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f2336d20 0x5624f23391c0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f233b240 msgr2=0x5624f233d630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f233b240 0x5624f233d630 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5624f233fb70 msgr2=0x5624f2342030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5624f233fb70 0x5624f2342030 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dbc036790 msgr2=0x7f6dbc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dbc036790 0x7f6dbc038c50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x5624f23096c0 tx=0x7f6ee805e040 comp rx=0 tx=0).stop 2024-03-20T13:35:15.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 msgr2=0x5624f232b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef1924640 1 -- 172.21.15.177:0/501989972 reap_dead start 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f232b530 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f6ee404e000 tx=0x7f6ee4008ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 shutdown_connections 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/501989972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f23245d0 0x5624f232b530 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 >> 172.21.15.177:0/501989972 conn(0x5624f23208a0 msgr2=0x5624f231df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 shutdown_connections 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/501989972 wait complete. 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dc8036790 msgr2=0x7f6dc8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dc8036790 0x7f6dc8038c50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5624f22fd710 tx=0x7f6ee8005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 msgr2=0x5624f2317920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 0x5624f2317920 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6ee404a730 tx=0x7f6ee402c4e0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 shutdown_connections 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dc8036790 0x7f6dc8038c50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2360121018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f2317500 0x5624f2317920 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.052+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 >> 172.21.15.177:0/2360121018 conn(0x5624f230b5a0 msgr2=0x5624f230b9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 shutdown_connections 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2360121018 wait complete. 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5624f23067b0 msgr2=0x5624f2308ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5624f23067b0 0x5624f2308ba0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f21fff40 msgr2=0x5624f2300090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5624f21fff40 0x5624f2300090 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f23028d0 msgr2=0x5624f2304cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5624f23028d0 0x5624f2304cc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dd8036790 msgr2=0x7f6dd8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6dd8036790 0x7f6dd8038c50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ee8054000 tx=0x7f6ee804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 msgr2=0x5624f22f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 --2- 172.21.15.177:0/2569514459 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5624f21fe400 0x5624f22f9410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4000c00 tx=0x7f6ee4000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef1924640 1 -- 172.21.15.177:0/2569514459 reap_dead start 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 shutdown_connections 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 >> 172.21.15.177:0/2569514459 conn(0x5624f21fa040 msgr2=0x5624f22ebf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 shutdown_connections 2024-03-20T13:35:15.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.053+0000 7f6ef3624800 1 -- 172.21.15.177:0/2569514459 wait complete. 2024-03-20T13:35:15.066 INFO:teuthology.orchestra.run.smithi177.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7b38e3a9-8d74-4698-af71-c25b0690d394","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","marker":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:35:12.981337Z","creation_time":"2024-03-20T13:35:12.979038Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-03-20T13:35:15.066 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7b38e3a9-8d74-4698-af71-c25b0690d394', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'marker': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:35:12.981337Z', 'creation_time': '2024-03-20T13:35:12.979038Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-03-20T13:35:15.067 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-03-20T13:35:15.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-03-20T13:35:15.067 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-03-20T13:35:15.152 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:15.152 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.151+0000 7f882cd0d800 1 Processor -- start 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882cd0d800 1 -- start start 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882cd0d800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d644a73420 0x55d644a73840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882cd0d800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d6449bfcd0 con 0x55d644a73d80 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882cd0d800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d644976500 con 0x55d644a73420 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882a80c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d644a73420 0x55d644a73840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882a00b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55d644a73d80 0x55d644a74230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50524/0 (socket says 172.21.15.177:50524) 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882a80c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d644a73420 0x55d644a73840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40698/0 (socket says 172.21.15.177:40698) 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882a00b640 1 -- 172.21.15.177:0/2361309508 learned_addr learned my addr 172.21.15.177:0/2361309508 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:15.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882a80c640 1 -- 172.21.15.177:0/2361309508 >> v1:172.21.15.28:6789/0 conn(0x55d644a73d80 legacy=0x55d644a74230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.152+0000 7f882a80c640 1 -- 172.21.15.177:0/2361309508 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6449e8070 con 0x55d644a73420 2024-03-20T13:35:15.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.154+0000 7f882a80c640 1 --2- 172.21.15.177:0/2361309508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644a73840 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f882000a470 tx=0x7f882001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930c9ab2f4d0b31f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.154+0000 7f882980a640 1 -- 172.21.15.177:0/2361309508 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8820052570 con 0x55d644a73420 2024-03-20T13:35:15.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882980a640 1 -- 172.21.15.177:0/2361309508 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88200526d0 con 0x55d644a73420 2024-03-20T13:35:15.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882980a640 1 -- 172.21.15.177:0/2361309508 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8820052990 con 0x55d644a73420 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 -- 172.21.15.177:0/2361309508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 msgr2=0x55d644a73840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 --2- 172.21.15.177:0/2361309508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644a73840 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f882000a470 tx=0x7f882001cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 -- 172.21.15.177:0/2361309508 shutdown_connections 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 --2- 172.21.15.177:0/2361309508 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644a73840 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 -- 172.21.15.177:0/2361309508 >> 172.21.15.177:0/2361309508 conn(0x55d644a6f040 msgr2=0x55d644a71460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 -- 172.21.15.177:0/2361309508 shutdown_connections 2024-03-20T13:35:15.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.155+0000 7f882cd0d800 1 -- 172.21.15.177:0/2361309508 wait complete. 2024-03-20T13:35:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882cd0d800 1 Processor -- start 2024-03-20T13:35:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882cd0d800 1 -- start start 2024-03-20T13:35:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882cd0d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b66bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882cd0d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644973a30 con 0x55d644a73420 2024-03-20T13:35:15.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b66bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b66bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40712/0 (socket says 172.21.15.177:40712) 2024-03-20T13:35:15.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882a80c640 1 -- 172.21.15.177:0/559324050 learned_addr learned my addr 172.21.15.177:0/559324050 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.167+0000 7f882a80c640 1 -- 172.21.15.177:0/559324050 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8820005d20 con 0x55d644a73420 2024-03-20T13:35:15.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.168+0000 7f882a80c640 1 --2- 172.21.15.177:0/559324050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b66bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8820055040 tx=0x7f882004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5411e957f796d845 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.171 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.168+0000 7f8718e09640 1 -- 172.21.15.177:0/559324050 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f882000a180 con 0x55d644a73420 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.168+0000 7f8718e09640 1 -- 172.21.15.177:0/559324050 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882000a300 con 0x55d644a73420 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.168+0000 7f8718e09640 1 -- 172.21.15.177:0/559324050 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88200529b0 con 0x55d644a73420 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- 172.21.15.177:0/559324050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 msgr2=0x55d644b66bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 --2- 172.21.15.177:0/559324050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b66bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f8820055040 tx=0x7f882004c000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- 172.21.15.177:0/559324050 shutdown_connections 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 --2- 172.21.15.177:0/559324050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b66bd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- 172.21.15.177:0/559324050 >> 172.21.15.177:0/559324050 conn(0x55d644a6f040 msgr2=0x55d644b624f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- 172.21.15.177:0/559324050 shutdown_connections 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- 172.21.15.177:0/559324050 wait complete. 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 Processor -- start 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- start start 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b6e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.172 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882cd0d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d64496f210 con 0x55d644a73420 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b6e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b6e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40724/0 (socket says 172.21.15.177:40724) 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.169+0000 7f882a80c640 1 -- 172.21.15.177:0/549918075 learned_addr learned my addr 172.21.15.177:0/549918075 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f882a80c640 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6449e8070 con 0x55d644a73420 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f882a80c640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b6e220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f882005f040 tx=0x7f8820002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f8717606640 1 -- 172.21.15.177:0/549918075 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f882006a070 con 0x55d644a73420 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f8717606640 1 -- 172.21.15.177:0/549918075 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882005d420 con 0x55d644a73420 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d644b6e760 con 0x55d644a73420 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f8717606640 1 -- 172.21.15.177:0/549918075 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f882005d6c0 con 0x55d644a73420 2024-03-20T13:35:15.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.170+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d644b6ec40 con 0x55d644a73420 2024-03-20T13:35:15.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f8717606640 1 -- 172.21.15.177:0/549918075 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f882005d820 con 0x55d644a73420 2024-03-20T13:35:15.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f8717606640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8710036790 0x7f8710038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f8717606640 1 -- 172.21.15.177:0/549918075 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f882008dbb0 con 0x55d644a73420 2024-03-20T13:35:15.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f882a00b640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8710036790 0x7f8710038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644a73d80 0x55d644b74ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644b754c0 con 0x55d644a73d80 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.171+0000 7f882b00d640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644a73d80 0x55d644b74ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882a00b640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8710036790 0x7f8710038c50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f881c000f60 tx=0x7f881c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882b00d640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644a73d80 0x55d644b74ef0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882b00d640 1 -- 172.21.15.177:0/549918075 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644a73d80 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644b72620 con 0x55d644a73d80 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882b00d640 1 -- 172.21.15.177:0/549918075 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644a73d80 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644b77730 0x55d644b79b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644b7a210 con 0x55d644b77730 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.172+0000 7f882a80c640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644b77730 0x55d644b79b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882a80c640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644b77730 0x55d644b79b20 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882a80c640 1 -- 172.21.15.177:0/549918075 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f8820059040 con 0x55d644b77730 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644b766b0 con 0x55d644a73d80 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882b00d640 1 -- 172.21.15.177:0/549918075 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644a73d80 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d644b7b630 0x55d644b7da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644b7e160 con 0x55d644b7b630 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.173+0000 7f882a00b640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d644b7b630 0x55d644b7da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.174+0000 7f882a00b640 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d644b7b630 0x55d644b7da20 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.174+0000 7f882a00b640 1 -- 172.21.15.177:0/549918075 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f881c006070 con 0x55d644b7b630 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.174+0000 7f882cd0d800 1 Processor -- start 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882cd0d800 1 -- start start 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882cd0d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 0x55d644b8c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882cd0d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644911c70 con 0x55d644b8c2f0 2024-03-20T13:35:15.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 0x55d644b8c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 0x55d644b8c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40740/0 (socket says 172.21.15.177:40740) 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882a80c640 1 -- 172.21.15.177:0/3570777700 learned_addr learned my addr 172.21.15.177:0/3570777700 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882a80c640 1 -- 172.21.15.177:0/3570777700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d644b8cc50 con 0x55d644b8c2f0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.175+0000 7f882a80c640 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 0x55d644b8c710 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f882008bf70 tx=0x7f8820077b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.176+0000 7f8714e01640 1 -- 172.21.15.177:0/3570777700 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8820077920 con 0x55d644b8c2f0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.176+0000 7f8714e01640 1 -- 172.21.15.177:0/3570777700 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882008a040 con 0x55d644b8c2f0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.176+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d644b8d6c0 con 0x55d644b8c2f0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.176+0000 7f8714e01640 1 -- 172.21.15.177:0/3570777700 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f882006dac0 con 0x55d644b8c2f0 2024-03-20T13:35:15.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.176+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d644b8db80 con 0x55d644b8c2f0 2024-03-20T13:35:15.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.176+0000 7f8714e01640 1 -- 172.21.15.177:0/3570777700 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f882006dc20 con 0x55d644b8c2f0 2024-03-20T13:35:15.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f8714e01640 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8704036790 0x7f8704038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.193 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f8714e01640 1 -- 172.21.15.177:0/3570777700 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f8820097ca0 con 0x55d644b8c2f0 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882a00b640 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8704036790 0x7f8704038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882cd0d800 1 Processor -- start 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882cd0d800 1 -- start start 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882a00b640 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8704036790 0x7f8704038c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f881c00bf50 tx=0x7f881c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882cd0d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644b997c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882cd0d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6448e75d0 con 0x55d644b993a0 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644b997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644b997c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40756/0 (socket says 172.21.15.177:40756) 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882a80c640 1 -- 172.21.15.177:0/2541935937 learned_addr learned my addr 172.21.15.177:0/2541935937 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.177+0000 7f882a80c640 1 -- 172.21.15.177:0/2541935937 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d644b99d90 con 0x55d644b993a0 2024-03-20T13:35:15.194 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882a80c640 1 --2- 172.21.15.177:0/2541935937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644b997c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f882007cfd0 tx=0x7f88200096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ae06f51bdfc7ec server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f870e7fc640 1 -- 172.21.15.177:0/2541935937 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f882005f790 con 0x55d644b993a0 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f870e7fc640 1 -- 172.21.15.177:0/2541935937 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882005f8f0 con 0x55d644b993a0 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f870e7fc640 1 -- 172.21.15.177:0/2541935937 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f88200659a0 con 0x55d644b993a0 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 -- 172.21.15.177:0/2541935937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 msgr2=0x55d644b997c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 --2- 172.21.15.177:0/2541935937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644b997c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f882007cfd0 tx=0x7f88200096a0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 -- 172.21.15.177:0/2541935937 shutdown_connections 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 --2- 172.21.15.177:0/2541935937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644b997c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 -- 172.21.15.177:0/2541935937 >> 172.21.15.177:0/2541935937 conn(0x55d644b95700 msgr2=0x55d644b93760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 -- 172.21.15.177:0/2541935937 shutdown_connections 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.178+0000 7f882cd0d800 1 -- 172.21.15.177:0/2541935937 wait complete. 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882cd0d800 1 Processor -- start 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882cd0d800 1 -- start start 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882cd0d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644ba0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882cd0d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d644ba06d0 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644ba0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882a80c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644ba0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40768/0 (socket says 172.21.15.177:40768) 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 learned_addr learned my addr 172.21.15.177:0/734308100 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.179+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d644b8d6c0 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.180+0000 7f882a80c640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644ba0190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f88200099f0 tx=0x7f8820097f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.180+0000 7f870cff9640 1 -- 172.21.15.177:0/734308100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8820087e80 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.180+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d644b8d6c0 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.180+0000 7f870cff9640 1 -- 172.21.15.177:0/734308100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88200b8070 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.180+0000 7f870cff9640 1 -- 172.21.15.177:0/734308100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f882008a2e0 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.180+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d644ba0ae0 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f870cff9640 1 -- 172.21.15.177:0/734308100 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f88200ba030 con 0x55d644b993a0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f870cff9640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86f4036790 0x7f86f4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f870cff9640 1 -- 172.21.15.177:0/734308100 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f88200c5950 con 0x55d644b993a0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f882a00b640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86f4036790 0x7f86f4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644bab910 0x55d644baddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bae520 con 0x55d644bab910 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.181+0000 7f882b00d640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644bab910 0x55d644baddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882a00b640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86f4036790 0x7f86f4038c50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f881c001b60 tx=0x7f881c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882b00d640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644bab910 0x55d644baddd0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 realm 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bae8f0 con 0x55d644bab910 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.182+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf4a0 con 0x55d644bab910 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644bafe50 0x55d644bb2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb27c0 con 0x55d644bafe50 2024-03-20T13:35:15.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882a80c640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644bafe50 0x55d644bb2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882a80c640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644bafe50 0x55d644bb2240 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 20 searching for the correct realm 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d644bb47a0 0x55d644bb6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb7330 con 0x55d644bb47a0 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.183+0000 7f882a00b640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d644bb47a0 0x55d644bb6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.184+0000 7f882a00b640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d644bb47a0 0x55d644bb6c60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.184+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.184+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb7330 con 0x55d644bafe50 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.184+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.184+0000 7f882a80c640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f88200b4040 0x7f88200ad1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.184+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb7330 con 0x7f88200b4040 2024-03-20T13:35:15.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.185+0000 7f882b00d640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f88200b4040 0x7f88200ad1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.185+0000 7f882b00d640 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f88200b4040 0x7f88200ad1c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.185+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.185+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.186+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bafe50 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.187+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.187+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.187+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.187+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.187+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.187+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bafe50 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.188+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.189+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bafe50 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.190+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.191+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.191+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.191+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.191+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bb47a0 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.191+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.191+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x7f88200b4040 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.192+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.192+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8824031040 con 0x55d644bafe50 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.192+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.192+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8824031040 con 0x55d644bb47a0 2024-03-20T13:35:15.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.192+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.192+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8824031040 con 0x7f88200b4040 2024-03-20T13:35:15.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8824031040 con 0x55d644bab910 2024-03-20T13:35:15.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f8824031040 con 0x55d644bafe50 2024-03-20T13:35:15.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882cd0d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882cd0d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882cd0d800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882cd0d800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882cd0d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.193+0000 7f882cd0d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644baf140 con 0x55d644bab910 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb3090 con 0x55d644bab910 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.194+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb3090 con 0x7f88200b4040 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 20 zone default found 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 4 Realm: () 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 20 zonegroup default 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb3960 con 0x7f88200b4040 2024-03-20T13:35:15.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb3d60 con 0x55d644bb47a0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.195+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb9150 con 0x55d644bb47a0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 20 started sync module instance, tier type = 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.196+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb85e0 con 0x55d644bafe50 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.197+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.197+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94378764503488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb8250 con 0x55d644bafe50 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.197+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bb9f60 con 0x55d644bab910 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.198+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94378764503488] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.198+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.198+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94378764507840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bba380 con 0x55d644bab910 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.198+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbacf0 con 0x55d644bb47a0 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.199+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94378764507840] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.200+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.200+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94378764508896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bba300 con 0x55d644bb47a0 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.200+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbbb50 con 0x55d644bafe50 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.201+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.201+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94378764517040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbc770 con 0x55d644bafe50 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.201+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbd140 con 0x55d644bab910 2024-03-20T13:35:15.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.202+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94378764508896] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.202+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94378764517040] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.202+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.202+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94378764520512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbc2d0 con 0x55d644bab910 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.202+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbd990 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.203+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94378764520512] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.204+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.204+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94378764513440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbc2d0 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.204+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbdfe0 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.206+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.206+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94378764524256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbe440 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.206+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94378764513440] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.206+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbd3f0 con 0x7f88200b4040 2024-03-20T13:35:15.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'102 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94378764524256] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94378764528112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbe440 con 0x7f88200b4040 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=0 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=1 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=2 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=3 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=4 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=5 2024-03-20T13:35:15.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.208+0000 7f882cd0d800 20 add_watcher() i=6 2024-03-20T13:35:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.210+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94378764528112] v30'103 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.210+0000 7f882cd0d800 20 add_watcher() i=7 2024-03-20T13:35:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.210+0000 7f882cd0d800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.210+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bc1f00 con 0x55d644bab910 2024-03-20T13:35:15.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.211+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.211+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94378764525936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbf410 con 0x55d644bab910 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94378764525936] v30'102 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f86e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 5 note: GC not initialized 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f865bfff640 20 reqs_thread_entry: start 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 20 Filter name: none 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f8659ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.212+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf3790 con 0x55d644bab910 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf4ca0 con 0x55d644bafe50 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf2af0 con 0x55d644bab910 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.213+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 4.c 4:308e6e23:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf63e0 con 0x55d644bab910 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 4.1f 4:fad6e193:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf9000 con 0x55d644bb47a0 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 4.3e 4:7ce6a172:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bfbc80 con 0x55d644bafe50 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:68 4.17 4:e9d229c3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bfe590 con 0x7f88200b4040 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 4.21 4:87353121:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644c01150 con 0x7f88200b4040 2024-03-20T13:35:15.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 4.1b 4:db926116:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644c039b0 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644c05ef0 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:72 4.3b 4:ddf15168:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644c083f0 con 0x55d644bb47a0 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 4.1a 4:59833ee6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bfb810 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 4.33 4:cc074805:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644c083f0 con 0x7f88200b4040 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5 [call out=124b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 4.20 4:0726f43c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf4620 con 0x55d644bab910 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(71 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(72 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(73 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.214+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(75 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.215+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.215+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(68 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.215+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(74 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.215+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf24f0 con 0x55d644bafe50 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.216+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(76 foo.buckets [call] v30'15 uv15 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.216+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf4180 con 0x55d644bafe50 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.217+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(77 foo.buckets [call] v30'16 uv16 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.217+0000 7f882cd0d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.217+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf4180 con 0x55d644bab910 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.218+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(78 foo [stat out=16b,read 0~357 out=357b] v0'0 uv11 ondisk = 0) v8 ==== 189+0+373 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.218+0000 7f882cd0d800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.218+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bf4180 con 0x55d644bafe50 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.218+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) v8 ==== 155+0+58 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.219+0000 7f86e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.219+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94378764525936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x55d644bab910 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.220+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94378764525936] v30'103 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.220+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94378764503488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x55d644bafe50 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.221+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94378764503488] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.221+0000 7f882cd0d800 20 remove_watcher() i=0 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.221+0000 7f882cd0d800 2 removed watcher, disabling cache 2024-03-20T13:35:15.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.221+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94378764507840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x55d644bab910 2024-03-20T13:35:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.222+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94378764507840] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.222+0000 7f882cd0d800 20 remove_watcher() i=1 2024-03-20T13:35:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.222+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94378764508896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x55d644bb47a0 2024-03-20T13:35:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.223+0000 7f882a00b640 1 -- 172.21.15.177:0/734308100 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94378764508896] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f881c006070 con 0x55d644bb47a0 2024-03-20T13:35:15.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.223+0000 7f882cd0d800 20 remove_watcher() i=2 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.223+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94378764517040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x55d644bafe50 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.224+0000 7f882a80c640 1 -- 172.21.15.177:0/734308100 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94378764517040] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8820059040 con 0x55d644bafe50 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.224+0000 7f882cd0d800 20 remove_watcher() i=3 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.224+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94378764520512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x55d644bab910 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.225+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94378764520512] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x55d644bab910 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.225+0000 7f882cd0d800 20 remove_watcher() i=4 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.225+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94378764513440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbcc40 con 0x7f88200b4040 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.227+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94378764513440] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.227+0000 7f882cd0d800 20 remove_watcher() i=5 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.227+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94378764524256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bdd8d0 con 0x7f88200b4040 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.229+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94378764524256] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.229+0000 7f882cd0d800 20 remove_watcher() i=6 2024-03-20T13:35:15.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.229+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94378764528112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d644bbb0a0 con 0x7f88200b4040 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.230+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94378764528112] v30'104 uv102 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f882400a4a0 con 0x7f88200b4040 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 20 remove_watcher() i=7 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f88200b4040 msgr2=0x7f88200ad1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f88200b4040 0x7f88200ad1c0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644bab910 msgr2=0x55d644baddd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644bab910 0x55d644baddd0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644bafe50 msgr2=0x55d644bb2240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644bafe50 0x55d644bb2240 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d644bb47a0 msgr2=0x55d644bb6c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d644bb47a0 0x55d644bb6c60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86f4036790 msgr2=0x7f86f4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f86f4036790 0x7f86f4038c50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f881c001b60 tx=0x7f881c010000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 msgr2=0x55d644ba0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/734308100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b993a0 0x55d644ba0190 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f88200099f0 tx=0x7f8820097f40 comp rx=0 tx=0).stop 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 reap_dead start 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882b00d640 1 -- 172.21.15.177:0/734308100 reap_dead start 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 shutdown_connections 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 >> 172.21.15.177:0/734308100 conn(0x55d644b95700 msgr2=0x55d644b92d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 shutdown_connections 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/734308100 wait complete. 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8704036790 msgr2=0x7f8704038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8704036790 0x7f8704038c50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f881c00bf50 tx=0x7f881c00f000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 msgr2=0x55d644b8c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 0x55d644b8c710 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f882008bf70 tx=0x7f8820077b00 comp rx=0 tx=0).stop 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 shutdown_connections 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8704036790 0x7f8704038c50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 --2- 172.21.15.177:0/3570777700 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644b8c2f0 0x55d644b8c710 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 >> 172.21.15.177:0/3570777700 conn(0x55d644b80390 msgr2=0x55d644b80790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 shutdown_connections 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.231+0000 7f882cd0d800 1 -- 172.21.15.177:0/3570777700 wait complete. 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d644b7b630 msgr2=0x55d644b7da20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d644b7b630 0x55d644b7da20 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644a73d80 msgr2=0x55d644b74ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d644a73d80 0x55d644b74ef0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644b77730 msgr2=0x55d644b79b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d644b77730 0x55d644b79b20 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8710036790 msgr2=0x7f8710038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8710036790 0x7f8710038c50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f881c000f60 tx=0x7f881c0012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 msgr2=0x55d644b6e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 --2- 172.21.15.177:0/549918075 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d644a73420 0x55d644b6e220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f882005f040 tx=0x7f8820002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882b00d640 1 -- 172.21.15.177:0/549918075 reap_dead start 2024-03-20T13:35:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 shutdown_connections 2024-03-20T13:35:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 >> 172.21.15.177:0/549918075 conn(0x55d644a6f040 msgr2=0x55d644b60d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 shutdown_connections 2024-03-20T13:35:15.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.232+0000 7f882cd0d800 1 -- 172.21.15.177:0/549918075 wait complete. 2024-03-20T13:35:15.241 INFO:teuthology.orchestra.run.smithi177.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-03-20T13:35:15.217474Z","last_stats_update":"2024-03-20T13:35:15.215928Z"} 2024-03-20T13:35:15.241 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-03-20T13:35:15.217474Z', 'last_stats_update': '2024-03-20T13:35:15.215928Z'} 2024-03-20T13:35:15.247 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:15.247 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-03-20T13:35:15.248 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-03-20T13:35:15.248 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-03-20T13:35:15.328 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:15.328 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:15.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2be32d800 1 Processor -- start 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2be32d800 1 -- start start 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2be32d800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556dedc8ce00 0x556dedc8f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2be32d800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556dedbd3cd0 con 0x556dedbfbea0 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2be32d800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x556dedb8a500 con 0x556dedc8ce00 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2b9783640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556dedc8ce00 0x556dedc8f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2b9783640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556dedc8ce00 0x556dedc8f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40780/0 (socket says 172.21.15.177:40780) 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2b9783640 1 -- 172.21.15.177:0/3942246023 learned_addr learned my addr 172.21.15.177:0/3942246023 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.327+0000 7fc2b9f84640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x556dedbfbea0 0x556dedc8b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50526/0 (socket says 172.21.15.177:50526) 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.328+0000 7fc2b9783640 1 -- 172.21.15.177:0/3942246023 >> v1:172.21.15.28:6789/0 conn(0x556dedbfbea0 legacy=0x556dedc8b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.328+0000 7fc2b9783640 1 -- 172.21.15.177:0/3942246023 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dedc90980 con 0x556dedc8ce00 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.329+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3942246023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedc8ce00 0x556dedc8f2a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000a520 tx=0x7fc2b001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d78153397902d53 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2b8f82640 1 -- 172.21.15.177:0/3942246023 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0052570 con 0x556dedc8ce00 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2b8f82640 1 -- 172.21.15.177:0/3942246023 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b00526d0 con 0x556dedc8ce00 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2b8f82640 1 -- 172.21.15.177:0/3942246023 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2b0052990 con 0x556dedc8ce00 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 -- 172.21.15.177:0/3942246023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedc8ce00 msgr2=0x556dedc8f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3942246023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedc8ce00 0x556dedc8f2a0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc2b000a520 tx=0x7fc2b001cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 -- 172.21.15.177:0/3942246023 shutdown_connections 2024-03-20T13:35:15.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3942246023 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedc8ce00 0x556dedc8f2a0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 -- 172.21.15.177:0/3942246023 >> 172.21.15.177:0/3942246023 conn(0x556dedc83040 msgr2=0x556dedc85460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 -- 172.21.15.177:0/3942246023 shutdown_connections 2024-03-20T13:35:15.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.330+0000 7fc2be32d800 1 -- 172.21.15.177:0/3942246023 wait complete. 2024-03-20T13:35:15.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2be32d800 1 Processor -- start 2024-03-20T13:35:15.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2be32d800 1 -- start start 2024-03-20T13:35:15.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2be32d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedc88fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2be32d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dedb87a30 con 0x556dedbfbea0 2024-03-20T13:35:15.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedc88fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedc88fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40790/0 (socket says 172.21.15.177:40790) 2024-03-20T13:35:15.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2b9f84640 1 -- 172.21.15.177:0/2174072311 learned_addr learned my addr 172.21.15.177:0/2174072311 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.342+0000 7fc2b9f84640 1 -- 172.21.15.177:0/2174072311 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b0005de0 con 0x556dedbfbea0 2024-03-20T13:35:15.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.343+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/2174072311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedc88fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac001c80 tx=0x7fc2ac00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f038fe5f1aa7ed01 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.343+0000 7fc1a7e07640 1 -- 172.21.15.177:0/2174072311 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac014070 con 0x556dedbfbea0 2024-03-20T13:35:15.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.343+0000 7fc1a7e07640 1 -- 172.21.15.177:0/2174072311 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac00f450 con 0x556dedbfbea0 2024-03-20T13:35:15.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.343+0000 7fc1a7e07640 1 -- 172.21.15.177:0/2174072311 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac00f790 con 0x556dedbfbea0 2024-03-20T13:35:15.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- 172.21.15.177:0/2174072311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 msgr2=0x556dedc88fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 --2- 172.21.15.177:0/2174072311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedc88fb0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac001c80 tx=0x7fc2ac00b600 comp rx=0 tx=0).stop 2024-03-20T13:35:15.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- 172.21.15.177:0/2174072311 shutdown_connections 2024-03-20T13:35:15.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 --2- 172.21.15.177:0/2174072311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedc88fb0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- 172.21.15.177:0/2174072311 >> 172.21.15.177:0/2174072311 conn(0x556dedc83040 msgr2=0x556dedd74320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- 172.21.15.177:0/2174072311 shutdown_connections 2024-03-20T13:35:15.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- 172.21.15.177:0/2174072311 wait complete. 2024-03-20T13:35:15.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 Processor -- start 2024-03-20T13:35:15.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- start start 2024-03-20T13:35:15.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedd822c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2be32d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dedb83210 con 0x556dedbfbea0 2024-03-20T13:35:15.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedd822c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedd822c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40796/0 (socket says 172.21.15.177:40796) 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.344+0000 7fc2b9f84640 1 -- 172.21.15.177:0/1635608413 learned_addr learned my addr 172.21.15.177:0/1635608413 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc2b9f84640 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dedbd3cd0 con 0x556dedbfbea0 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedd822c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac004000 tx=0x7fc2ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc1a6604640 1 -- 172.21.15.177:0/1635608413 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac014050 con 0x556dedbfbea0 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc1a6604640 1 -- 172.21.15.177:0/1635608413 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac01b850 con 0x556dedbfbea0 2024-03-20T13:35:15.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556dedd82800 con 0x556dedbfbea0 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc1a6604640 1 -- 172.21.15.177:0/1635608413 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac01bb10 con 0x556dedbfbea0 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.345+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dedd82ce0 con 0x556dedbfbea0 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.346+0000 7fc1a6604640 1 -- 172.21.15.177:0/1635608413 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc2ac022020 con 0x556dedbfbea0 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.346+0000 7fc1a6604640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1a0036790 0x7fc1a0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.346+0000 7fc1a6604640 1 -- 172.21.15.177:0/1635608413 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc2ac008030 con 0x556dedbfbea0 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.346+0000 7fc2b9783640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1a0036790 0x7fc1a0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.346+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556dedc8ce00 0x556dedd89010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.346+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dedd895e0 con 0x556dedc8ce00 2024-03-20T13:35:15.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2ba785640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556dedc8ce00 0x556dedd89010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2b9783640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1a0036790 0x7fc1a0038c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0054000 tx=0x7fc2b004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2ba785640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556dedc8ce00 0x556dedd89010 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2ba785640 1 -- 172.21.15.177:0/1635608413 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556dedc8ce00 2024-03-20T13:35:15.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dedd866c0 con 0x556dedc8ce00 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2ba785640 1 -- 172.21.15.177:0/1635608413 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556dedc8ce00 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556dedd8b850 0x556dedd8dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dedd8e330 con 0x556dedd8b850 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.347+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556dedd8b850 0x556dedd8dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.348+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556dedd8b850 0x556dedd8dc40 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.348+0000 7fc2b9f84640 1 -- 172.21.15.177:0/1635608413 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc2ac016070 con 0x556dedd8b850 2024-03-20T13:35:15.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.348+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dedd8a7d0 con 0x556dedc8ce00 2024-03-20T13:35:15.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.348+0000 7fc2ba785640 1 -- 172.21.15.177:0/1635608413 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556dedc8ce00 2024-03-20T13:35:15.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.348+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556dedd8f750 0x556dedd91b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.348+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dedd92280 con 0x556dedd8f750 2024-03-20T13:35:15.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.350+0000 7fc2b9783640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556dedd8f750 0x556dedd91b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.355+0000 7fc2b9783640 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556dedd8f750 0x556dedd91b40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.356+0000 7fc2b9783640 1 -- 172.21.15.177:0/1635608413 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556dedd8f750 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.357+0000 7fc2be32d800 1 Processor -- start 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.357+0000 7fc2be32d800 1 -- start start 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.357+0000 7fc2be32d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 0x556dedda0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.357+0000 7fc2be32d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dedb25c70 con 0x556dedda0430 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.359+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 0x556dedda0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.359+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 0x556dedda0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40802/0 (socket says 172.21.15.177:40802) 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.359+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3388972785 learned_addr learned my addr 172.21.15.177:0/3388972785 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.361+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3388972785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dedda0d90 con 0x556dedda0430 2024-03-20T13:35:15.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.363+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 0x556dedda0850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac001520 tx=0x7fc2ac018ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.364+0000 7fc19f7fe640 1 -- 172.21.15.177:0/3388972785 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac043f50 con 0x556dedda0430 2024-03-20T13:35:15.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.364+0000 7fc19f7fe640 1 -- 172.21.15.177:0/3388972785 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac0440b0 con 0x556dedda0430 2024-03-20T13:35:15.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.364+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556dedda1800 con 0x556dedda0430 2024-03-20T13:35:15.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.364+0000 7fc19f7fe640 1 -- 172.21.15.177:0/3388972785 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac02d6b0 con 0x556dedda0430 2024-03-20T13:35:15.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.364+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dedda1cc0 con 0x556dedda0430 2024-03-20T13:35:15.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc19f7fe640 1 -- 172.21.15.177:0/3388972785 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc2ac03e250 con 0x556dedda0430 2024-03-20T13:35:15.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc19f7fe640 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1940367e0 0x7fc194038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc19f7fe640 1 -- 172.21.15.177:0/3388972785 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc2ac039c80 con 0x556dedda0430 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1940367e0 0x7fc194038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc2be32d800 1 Processor -- start 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc2be32d800 1 -- start start 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1940367e0 0x7fc194038ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556dedd865e0 tx=0x7fc2b0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc2be32d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.367+0000 7fc2be32d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dedafb5d0 con 0x556deddad680 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.368+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.368+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddada80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40814/0 (socket says 172.21.15.177:40814) 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.368+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3979948845 learned_addr learned my addr 172.21.15.177:0/3979948845 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.368+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3979948845 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556deddae050 con 0x556deddad680 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.369+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/3979948845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddada80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac01bd50 tx=0x7fc2ac04a900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0090f46c5ad9d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.369+0000 7fc19d7fa640 1 -- 172.21.15.177:0/3979948845 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac02f480 con 0x556deddad680 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.369+0000 7fc19d7fa640 1 -- 172.21.15.177:0/3979948845 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac02f5e0 con 0x556deddad680 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.369+0000 7fc19d7fa640 1 -- 172.21.15.177:0/3979948845 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac04adc0 con 0x556deddad680 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 -- 172.21.15.177:0/3979948845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 msgr2=0x556deddada80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3979948845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddada80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac01bd50 tx=0x7fc2ac04a900 comp rx=0 tx=0).stop 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 -- 172.21.15.177:0/3979948845 shutdown_connections 2024-03-20T13:35:15.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3979948845 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddada80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 -- 172.21.15.177:0/3979948845 >> 172.21.15.177:0/3979948845 conn(0x556dedda9950 msgr2=0x556dedda79b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 -- 172.21.15.177:0/3979948845 shutdown_connections 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 -- 172.21.15.177:0/3979948845 wait complete. 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 Processor -- start 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.370+0000 7fc2be32d800 1 -- start start 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.371+0000 7fc2be32d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddb4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.371+0000 7fc2be32d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556deddb4a80 con 0x556deddad680 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.371+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddb4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.371+0000 7fc2b9f84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddb4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40818/0 (socket says 172.21.15.177:40818) 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.371+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 learned_addr learned my addr 172.21.15.177:0/3940127224 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.372+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dedda1cc0 con 0x556deddad680 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.372+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddb4540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac02f790 tx=0x7fc2ac024d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.373+0000 7fc18b7fe640 1 -- 172.21.15.177:0/3940127224 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac04b870 con 0x556deddad680 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.373+0000 7fc18b7fe640 1 -- 172.21.15.177:0/3940127224 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2ac03e500 con 0x556deddad680 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.373+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556dedda1cc0 con 0x556deddad680 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.373+0000 7fc18b7fe640 1 -- 172.21.15.177:0/3940127224 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2ac03e7a0 con 0x556deddad680 2024-03-20T13:35:15.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.373+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dedda1cc0 con 0x556deddad680 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc18b7fe640 1 -- 172.21.15.177:0/3940127224 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc2ac02f7e0 con 0x556deddad680 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc18b7fe640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc184036790 0x7fc184038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc18b7fe640 1 -- 172.21.15.177:0/3940127224 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc2ac06ac50 con 0x556deddad680 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc184036790 0x7fc184038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556deddbfd20 0x556deddc21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc2930 con 0x556deddbfd20 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc2ba785640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556deddbfd20 0x556deddc21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.374+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc184036790 0x7fc184038c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0055040 tx=0x7fc2b004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2ba785640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556deddbfd20 0x556deddc21e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 realm 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc2d00 con 0x556deddbfd20 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc38e0 con 0x556deddbfd20 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.375+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556deddc4290 0x556deddc6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc6c40 con 0x556deddc4290 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556deddc4290 0x556deddc6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556deddc4290 0x556deddc6680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2be32d800 20 searching for the correct realm 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556deddc8f50 0x556deddcb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddcbae0 con 0x556deddc8f50 2024-03-20T13:35:15.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.376+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556deddc8f50 0x556deddcb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.377+0000 7fc2b9783640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556deddc8f50 0x556deddcb410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.377+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.377+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddcbae0 con 0x556deddc4290 2024-03-20T13:35:15.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.377+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.377+0000 7fc2b9f84640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc2ac077040 0x7fc2ac01f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.377+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddcbae0 con 0x7fc2ac077040 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.378+0000 7fc2ba785640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc2ac077040 0x7fc2ac01f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.379+0000 7fc2ba785640 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc2ac077040 0x7fc2ac01f8e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.380+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.380+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.381+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.381+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.381+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.381+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.381+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.381+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.382+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.382+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc4290 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.382+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.382+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.382+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.383+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.383+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.383+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.383+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.383+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc4290 2024-03-20T13:35:15.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.384+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.385+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.385+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.385+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.385+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.385+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.385+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.386+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.386+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.386+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.386+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.386+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.386+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.387+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.387+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc4290 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.387+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.387+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.387+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.387+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.388+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.388+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddc8f50 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.388+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.388+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x7fc2ac077040 2024-03-20T13:35:15.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.388+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.388+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc2b4031040 con 0x556deddc4290 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.389+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.389+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc2b4031040 con 0x556deddc8f50 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.389+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.389+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc2b4031040 con 0x7fc2ac077040 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc2b4031040 con 0x556deddbfd20 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc2b4031040 con 0x556deddc4290 2024-03-20T13:35:15.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.390+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc3580 con 0x556deddbfd20 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc7350 con 0x556deddbfd20 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.391+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc7350 con 0x7fc2ac077040 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 20 zone default found 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 4 Realm: () 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:15.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 20 zonegroup default 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.392+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc7c20 con 0x7fc2ac077040 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.393+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.393+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.393+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.393+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddc7c20 con 0x556deddc8f50 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddcd900 con 0x556deddc8f50 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 20 started sync module instance, tier type = 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.394+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddccd90 con 0x556deddc4290 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.395+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.395+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93930630467824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddcd510 con 0x556deddc4290 2024-03-20T13:35:15.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.395+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddce710 con 0x556deddbfd20 2024-03-20T13:35:15.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.396+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93930630467824] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.396+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.396+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93930630472304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddceb30 con 0x556deddbfd20 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.396+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddcf4a0 con 0x556deddc8f50 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.398+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93930630472304] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.398+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.398+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93930630473360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddceab0 con 0x556deddc8f50 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.398+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd0300 con 0x556deddc4290 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.399+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.399+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93930630479936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd0aa0 con 0x556deddc4290 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.399+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd1550 con 0x556deddbfd20 2024-03-20T13:35:15.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.400+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93930630473360] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.400+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93930630479936] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.400+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.400+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93930630484048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd1510 con 0x556deddbfd20 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.400+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd0670 con 0x7fc2ac077040 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.401+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93930630484048] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.402+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.402+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93930630477904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd1e20 con 0x7fc2ac077040 2024-03-20T13:35:15.406 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.402+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd2790 con 0x7fc2ac077040 2024-03-20T13:35:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.404+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93930630477904] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.404+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.404+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93930630486240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd2790 con 0x7fc2ac077040 2024-03-20T13:35:15.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.404+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd3120 con 0x7fc2ac077040 2024-03-20T13:35:15.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'105 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93930630486240] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93930630491232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd3120 con 0x7fc2ac077040 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=0 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=1 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=2 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=3 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=4 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=5 2024-03-20T13:35:15.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.407+0000 7fc2be32d800 20 add_watcher() i=6 2024-03-20T13:35:15.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.410+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93930630491232] v30'106 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.411+0000 7fc2be32d800 20 add_watcher() i=7 2024-03-20T13:35:15.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.411+0000 7fc2be32d800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:15.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.411+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd6620 con 0x556deddbfd20 2024-03-20T13:35:15.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.411+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.411+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93930630488816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd3b00 con 0x556deddbfd20 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93930630488816] v30'104 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc16b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc2be32d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc2be32d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc2be32d800 5 note: GC not initialized 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc16a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc2be32d800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:15.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.412+0000 7fc2be32d800 20 Filter name: none 2024-03-20T13:35:15.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc0dbfff640 20 reqs_thread_entry: start 2024-03-20T13:35:15.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:15.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede084f0 con 0x556deddbfd20 2024-03-20T13:35:15.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:15.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:15.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:15.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:15.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:15.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede0a050 con 0x556deddc4290 2024-03-20T13:35:15.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:15.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:15.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:15.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:15.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.413+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede0b800 con 0x556deddbfd20 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:15.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.414+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede0ecf0 con 0x556deddc4290 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 foo.buckets [call] v30'17 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede0dce0 con 0x556deddc4290 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:15.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.416+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede127f0 con 0x556deddc4290 2024-03-20T13:35:15.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.428+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'18 uv18 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.428+0000 7fc2be32d800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:35:15.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.428+0000 7fc2be32d800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:15.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.428+0000 7fc2be32d800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:15.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.428+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93930630734272 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556dede0fa90 con 0x7fc2ac077040 2024-03-20T13:35:15.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== watch-notify(notify (1) cookie 93930630486240 notify 128849018890 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7fc2b403d040 con 0x7fc2ac077040 2024-03-20T13:35:15.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc19d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018890 cookie 93930630486240 notifier 4470 bl.length()=338 2024-03-20T13:35:15.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(68 notify.6 [notify cookie 93930630734272 out=8b] v0'0 uv105 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc19d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:35:15.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc19d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:15.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc19d7fa640 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc17c003e90 con 0x7fc2ac077040 2024-03-20T13:35:15.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.429+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.430+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== watch-notify(notify_complete (2) cookie 93930630734272 notify 128849018890 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc2b4005040 con 0x7fc2ac077040 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.430+0000 7fc16b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.431+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93930630488816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddbd3b0 con 0x556deddbfd20 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.431+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93930630488816] v30'105 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.432+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93930630467824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd22f0 con 0x556deddc4290 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.432+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93930630467824] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.432+0000 7fc2be32d800 20 remove_watcher() i=0 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.432+0000 7fc2be32d800 2 removed watcher, disabling cache 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.432+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93930630472304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd22f0 con 0x556deddbfd20 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.434+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93930630472304] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.434+0000 7fc2be32d800 20 remove_watcher() i=1 2024-03-20T13:35:15.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.434+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93930630473360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddce270 con 0x556deddc8f50 2024-03-20T13:35:15.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.436+0000 7fc2b9783640 1 -- 172.21.15.177:0/3940127224 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93930630473360] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b0052ba0 con 0x556deddc8f50 2024-03-20T13:35:15.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.436+0000 7fc2be32d800 20 remove_watcher() i=2 2024-03-20T13:35:15.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.436+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93930630479936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd22f0 con 0x556deddc4290 2024-03-20T13:35:15.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.436+0000 7fc2b9f84640 1 -- 172.21.15.177:0/3940127224 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93930630479936] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2ac016070 con 0x556deddc4290 2024-03-20T13:35:15.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.436+0000 7fc2be32d800 20 remove_watcher() i=3 2024-03-20T13:35:15.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.436+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93930630484048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd0040 con 0x556deddbfd20 2024-03-20T13:35:15.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.438+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93930630484048] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x556deddbfd20 2024-03-20T13:35:15.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.438+0000 7fc2be32d800 20 remove_watcher() i=4 2024-03-20T13:35:15.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.438+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93930630477904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd22f0 con 0x7fc2ac077040 2024-03-20T13:35:15.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.439+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93930630477904] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.439+0000 7fc2be32d800 20 remove_watcher() i=5 2024-03-20T13:35:15.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.439+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93930630486240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd0040 con 0x7fc2ac077040 2024-03-20T13:35:15.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.441+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93930630486240] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.441+0000 7fc2be32d800 20 remove_watcher() i=6 2024-03-20T13:35:15.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.441+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93930630491232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556deddd22f0 con 0x7fc2ac077040 2024-03-20T13:35:15.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.443+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93930630491232] v30'107 uv105 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc2b400a4a0 con 0x7fc2ac077040 2024-03-20T13:35:15.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.443+0000 7fc2be32d800 20 remove_watcher() i=7 2024-03-20T13:35:15.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc2ac077040 msgr2=0x7fc2ac01f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc2ac077040 0x7fc2ac01f8e0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556deddbfd20 msgr2=0x556deddc21e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556deddbfd20 0x556deddc21e0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556deddc4290 msgr2=0x556deddc6680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556deddc4290 0x556deddc6680 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556deddc8f50 msgr2=0x556deddcb410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556deddc8f50 0x556deddcb410 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc184036790 msgr2=0x7fc184038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc184036790 0x7fc184038c50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0055040 tx=0x7fc2b004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 msgr2=0x556deddb4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2ba785640 1 -- 172.21.15.177:0/3940127224 reap_dead start 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddb4540 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac02f790 tx=0x7fc2ac024d70 comp rx=0 tx=0).stop 2024-03-20T13:35:15.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 shutdown_connections 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3940127224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556deddad680 0x556deddb4540 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 >> 172.21.15.177:0/3940127224 conn(0x556dedda9950 msgr2=0x556dedda6fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 shutdown_connections 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3940127224 wait complete. 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1940367e0 msgr2=0x7fc194038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1940367e0 0x7fc194038ca0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x556dedd865e0 tx=0x7fc2b0005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 msgr2=0x556dedda0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 0x556dedda0850 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac001520 tx=0x7fc2ac018ae0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 shutdown_connections 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1940367e0 0x7fc194038ca0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 --2- 172.21.15.177:0/3388972785 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedda0430 0x556dedda0850 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 >> 172.21.15.177:0/3388972785 conn(0x556dedd944d0 msgr2=0x556dedd948d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 shutdown_connections 2024-03-20T13:35:15.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.444+0000 7fc2be32d800 1 -- 172.21.15.177:0/3388972785 wait complete. 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556dedd8f750 msgr2=0x556dedd91b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556dedd8f750 0x556dedd91b40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556dedc8ce00 msgr2=0x556dedd89010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556dedc8ce00 0x556dedd89010 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556dedd8b850 msgr2=0x556dedd8dc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556dedd8b850 0x556dedd8dc40 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1a0036790 msgr2=0x7fc1a0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc1a0036790 0x7fc1a0038c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0054000 tx=0x7fc2b004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 msgr2=0x556dedd822c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 --2- 172.21.15.177:0/1635608413 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556dedbfbea0 0x556dedd822c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc2ac004000 tx=0x7fc2ac000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2ba785640 1 -- 172.21.15.177:0/1635608413 reap_dead start 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 shutdown_connections 2024-03-20T13:35:15.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 >> 172.21.15.177:0/1635608413 conn(0x556dedc83040 msgr2=0x556dedc87a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 shutdown_connections 2024-03-20T13:35:15.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.445+0000 7fc2be32d800 1 -- 172.21.15.177:0/1635608413 wait complete. 2024-03-20T13:35:15.454 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:35:15.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:35:15.455 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-03-20T13:35:15.505 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:15.506 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:15.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.505+0000 7f5b28ec0800 1 Processor -- start 2024-03-20T13:35:15.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.505+0000 7f5b28ec0800 1 -- start start 2024-03-20T13:35:15.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.505+0000 7f5b28ec0800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5613d236a0b0 0x5613d236c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.505+0000 7f5b28ec0800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5613d22b0d00 con 0x5613d23665a0 2024-03-20T13:35:15.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.505+0000 7f5b28ec0800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5613d2267500 con 0x5613d236a0b0 2024-03-20T13:35:15.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.506+0000 7f5b261c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5613d236a0b0 0x5613d236c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.506+0000 7f5b269c6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5613d23665a0 0x5613d2368990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50540/0 (socket says 172.21.15.177:50540) 2024-03-20T13:35:15.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.506+0000 7f5b269c6640 1 -- 172.21.15.177:0/3145179722 learned_addr learned my addr 172.21.15.177:0/3145179722 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:15.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.506+0000 7f5b261c5640 1 -- 172.21.15.177:0/3145179722 >> v1:172.21.15.28:6789/0 conn(0x5613d23665a0 legacy=0x5613d2368990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.506+0000 7f5b261c5640 1 -- 172.21.15.177:0/3145179722 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d236d9f0 con 0x5613d236a0b0 2024-03-20T13:35:15.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.508+0000 7f5b261c5640 1 --2- 172.21.15.177:0/3145179722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d236a0b0 0x5613d236c4a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00a470 tx=0x7f5b1c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af13c7a2bae29d3f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.508+0000 7f5b259c4640 1 -- 172.21.15.177:0/3145179722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b1c052570 con 0x5613d236a0b0 2024-03-20T13:35:15.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.508+0000 7f5b259c4640 1 -- 172.21.15.177:0/3145179722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1c0526d0 con 0x5613d236a0b0 2024-03-20T13:35:15.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.508+0000 7f5b259c4640 1 -- 172.21.15.177:0/3145179722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b1c052990 con 0x5613d236a0b0 2024-03-20T13:35:15.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 -- 172.21.15.177:0/3145179722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d236a0b0 msgr2=0x5613d236c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/3145179722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d236a0b0 0x5613d236c4a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00a470 tx=0x7f5b1c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:15.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 -- 172.21.15.177:0/3145179722 shutdown_connections 2024-03-20T13:35:15.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/3145179722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d236a0b0 0x5613d236c4a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 -- 172.21.15.177:0/3145179722 >> 172.21.15.177:0/3145179722 conn(0x5613d2360070 msgr2=0x5613d2362490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 -- 172.21.15.177:0/3145179722 shutdown_connections 2024-03-20T13:35:15.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.509+0000 7f5b28ec0800 1 -- 172.21.15.177:0/3145179722 wait complete. 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.520+0000 7f5b28ec0800 1 Processor -- start 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.520+0000 7f5b28ec0800 1 -- start start 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.520+0000 7f5b28ec0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d2455b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.520+0000 7f5b28ec0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d2264a30 con 0x5613d23665a0 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d2455b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d2455b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40840/0 (socket says 172.21.15.177:40840) 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5b269c6640 1 -- 172.21.15.177:0/243545876 learned_addr learned my addr 172.21.15.177:0/243545876 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.522 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5b269c6640 1 -- 172.21.15.177:0/243545876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c005d20 con 0x5613d23665a0 2024-03-20T13:35:15.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5b269c6640 1 --2- 172.21.15.177:0/243545876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d2455b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5b18001c50 tx=0x7f5b1800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6618d7da39a4a3fc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5a14e09640 1 -- 172.21.15.177:0/243545876 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b1800e470 con 0x5613d23665a0 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5a14e09640 1 -- 172.21.15.177:0/243545876 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1800e5d0 con 0x5613d23665a0 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.521+0000 7f5a14e09640 1 -- 172.21.15.177:0/243545876 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b1800e8d0 con 0x5613d23665a0 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 -- 172.21.15.177:0/243545876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 msgr2=0x5613d2455b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/243545876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d2455b60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f5b18001c50 tx=0x7f5b1800b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 -- 172.21.15.177:0/243545876 shutdown_connections 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/243545876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d2455b60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 -- 172.21.15.177:0/243545876 >> 172.21.15.177:0/243545876 conn(0x5613d2360070 msgr2=0x5613d2451480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 -- 172.21.15.177:0/243545876 shutdown_connections 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.522+0000 7f5b28ec0800 1 -- 172.21.15.177:0/243545876 wait complete. 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b28ec0800 1 Processor -- start 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b28ec0800 1 -- start start 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b28ec0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d245d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b28ec0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d2260210 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d245d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d245d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40854/0 (socket says 172.21.15.177:40854) 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b269c6640 1 -- 172.21.15.177:0/2751747799 learned_addr learned my addr 172.21.15.177:0/2751747799 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.523+0000 7f5b269c6640 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d22b0d00 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.524+0000 7f5b269c6640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d245d210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b18001c50 tx=0x7f5b18000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.524+0000 7f5a13606640 1 -- 172.21.15.177:0/2751747799 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b1801f070 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.524+0000 7f5a13606640 1 -- 172.21.15.177:0/2751747799 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18018850 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.524+0000 7f5a13606640 1 -- 172.21.15.177:0/2751747799 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b18018b30 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.524+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613d245d750 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.524+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613d245dc30 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5a13606640 1 -- 172.21.15.177:0/2751747799 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5b18018c90 con 0x5613d23665a0 2024-03-20T13:35:15.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5a13606640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a0c0367e0 0x7f5a0c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5a13606640 1 -- 172.21.15.177:0/2751747799 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5b1804c370 con 0x5613d23665a0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5b261c5640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a0c0367e0 0x7f5a0c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d236a0b0 0x5613d2463eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d2464480 con 0x5613d236a0b0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5b271c7640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d236a0b0 0x5613d2463eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5b261c5640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a0c0367e0 0x7f5a0c038ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c054000 tx=0x7f5b1c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.525+0000 7f5b271c7640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d236a0b0 0x5613d2463eb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b271c7640 1 -- 172.21.15.177:0/2751747799 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d236a0b0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24615c0 con 0x5613d236a0b0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b271c7640 1 -- 172.21.15.177:0/2751747799 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d236a0b0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d24666f0 0x5613d2468ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24691d0 con 0x5613d24666f0 2024-03-20T13:35:15.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b269c6640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d24666f0 0x5613d2468ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.526+0000 7f5b269c6640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d24666f0 0x5613d2468ae0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.527+0000 7f5b269c6640 1 -- 172.21.15.177:0/2751747799 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5b18014070 con 0x5613d24666f0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.527+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d2465670 con 0x5613d236a0b0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.527+0000 7f5b271c7640 1 -- 172.21.15.177:0/2751747799 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d236a0b0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.527+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5613d246a5f0 0x5613d246c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.527+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d246d120 con 0x5613d246a5f0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.528+0000 7f5b261c5640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5613d246a5f0 0x5613d246c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.528+0000 7f5b261c5640 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5613d246a5f0 0x5613d246c9e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.528+0000 7f5b261c5640 1 -- 172.21.15.177:0/2751747799 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d246a5f0 2024-03-20T13:35:15.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b28ec0800 1 Processor -- start 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b28ec0800 1 -- start start 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b28ec0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 0x5613d247b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b28ec0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d2202c70 con 0x5613d247b2b0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 0x5613d247b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 0x5613d247b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40864/0 (socket says 172.21.15.177:40864) 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b269c6640 1 -- 172.21.15.177:0/4286490245 learned_addr learned my addr 172.21.15.177:0/4286490245 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.529+0000 7f5b269c6640 1 -- 172.21.15.177:0/4286490245 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d247bc10 con 0x5613d247b2b0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5b269c6640 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 0x5613d247b6d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b1804c2e0 tx=0x7f5b180166c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5a10e01640 1 -- 172.21.15.177:0/4286490245 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b180236b0 con 0x5613d247b2b0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5a10e01640 1 -- 172.21.15.177:0/4286490245 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18023810 con 0x5613d247b2b0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5a10e01640 1 -- 172.21.15.177:0/4286490245 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b180229b0 con 0x5613d247b2b0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613d247c680 con 0x5613d247b2b0 2024-03-20T13:35:15.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613d247c680 con 0x5613d247b2b0 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.530+0000 7f5a10e01640 1 -- 172.21.15.177:0/4286490245 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5b18022d20 con 0x5613d247b2b0 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5a10e01640 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a00036790 0x7f5a00038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5a10e01640 1 -- 172.21.15.177:0/4286490245 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5b1804de10 con 0x5613d247b2b0 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b261c5640 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a00036790 0x7f5a00038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b28ec0800 1 Processor -- start 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b28ec0800 1 -- start start 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b261c5640 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a00036790 0x7f5a00038c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5613d24614e0 tx=0x7f5b1c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b28ec0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d2488670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b28ec0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d21d85d0 con 0x5613d2488250 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d2488670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d2488670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40872/0 (socket says 172.21.15.177:40872) 2024-03-20T13:35:15.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.531+0000 7f5b269c6640 1 -- 172.21.15.177:0/842406200 learned_addr learned my addr 172.21.15.177:0/842406200 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b269c6640 1 -- 172.21.15.177:0/842406200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d2488c40 con 0x5613d2488250 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b269c6640 1 --2- 172.21.15.177:0/842406200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d2488670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5b1804c010 tx=0x7f5b18010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a925cd3bbcf58064 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5a0a7fc640 1 -- 172.21.15.177:0/842406200 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b18055070 con 0x5613d2488250 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5a0a7fc640 1 -- 172.21.15.177:0/842406200 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18044310 con 0x5613d2488250 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5a0a7fc640 1 -- 172.21.15.177:0/842406200 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b1802d440 con 0x5613d2488250 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b28ec0800 1 -- 172.21.15.177:0/842406200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 msgr2=0x5613d2488670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/842406200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d2488670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5b1804c010 tx=0x7f5b18010e10 comp rx=0 tx=0).stop 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b28ec0800 1 -- 172.21.15.177:0/842406200 shutdown_connections 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/842406200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d2488670 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.532+0000 7f5b28ec0800 1 -- 172.21.15.177:0/842406200 >> 172.21.15.177:0/842406200 conn(0x5613d2484520 msgr2=0x5613d2482580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b28ec0800 1 -- 172.21.15.177:0/842406200 shutdown_connections 2024-03-20T13:35:15.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b28ec0800 1 -- 172.21.15.177:0/842406200 wait complete. 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b28ec0800 1 Processor -- start 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b28ec0800 1 -- start start 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b28ec0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d248f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b28ec0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d248f750 con 0x5613d2488250 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d248f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b269c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d248f210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40876/0 (socket says 172.21.15.177:40876) 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.533+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 learned_addr learned my addr 172.21.15.177:0/1270492334 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1803a030 con 0x5613d2488250 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5b269c6640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d248f210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5b1804c010 tx=0x7f5b18031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5a08ff9640 1 -- 172.21.15.177:0/1270492334 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b18044480 con 0x5613d2488250 2024-03-20T13:35:15.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5a08ff9640 1 -- 172.21.15.177:0/1270492334 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b18035c10 con 0x5613d2488250 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5a08ff9640 1 -- 172.21.15.177:0/1270492334 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5b18024630 con 0x5613d2488250 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613d248f950 con 0x5613d2488250 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.534+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613d248f950 con 0x5613d2488250 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.535+0000 7f5a08ff9640 1 -- 172.21.15.177:0/1270492334 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5b18024850 con 0x5613d2488250 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.535+0000 7f5a08ff9640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f59f0036740 0x7f59f0038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.535+0000 7f5a08ff9640 1 -- 172.21.15.177:0/1270492334 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5b18066c40 con 0x5613d2488250 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.535+0000 7f5b261c5640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f59f0036740 0x7f59f0038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d249ac20 0x5613d249d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249d830 con 0x5613d249ac20 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b261c5640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f59f0036740 0x7f59f0038c00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c055040 tx=0x7f5b1c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b271c7640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d249ac20 0x5613d249d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b271c7640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d249ac20 0x5613d249d0e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 20 realm 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249dc00 con 0x5613d249ac20 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.536+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e7e0 con 0x5613d249ac20 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d249f190 0x5613d24a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a1b40 con 0x5613d249f190 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b269c6640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d249f190 0x5613d24a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b269c6640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d249f190 0x5613d24a1580 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.537+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b28ec0800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b28ec0800 20 searching for the correct realm 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5613d24a3e50 0x5613d24a6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a69e0 con 0x5613d24a3e50 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b261c5640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5613d24a3e50 0x5613d24a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b261c5640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5613d24a3e50 0x5613d24a6310 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.538+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a69e0 con 0x5613d249f190 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.539+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.539+0000 7f5b269c6640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5b18036030 0x7f5b18060a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.539+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a69e0 con 0x7f5b18036030 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.539+0000 7f5b271c7640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5b18036030 0x7f5b18060a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.540+0000 7f5b271c7640 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5b18036030 0x7f5b18060a70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.540+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.540+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.540+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.540+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249f190 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.541+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.542+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249f190 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.543+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.544+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249f190 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.545+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d24a3e50 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x7f5b18036030 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.546+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5b20031040 con 0x5613d249f190 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5b20031040 con 0x5613d24a3e50 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5b20031040 con 0x7f5b18036030 2024-03-20T13:35:15.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5b20031040 con 0x5613d249ac20 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.547+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5b20031040 con 0x5613d249f190 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d249e480 con 0x5613d249ac20 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a2250 con 0x5613d249ac20 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.548+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a2250 con 0x7f5b18036030 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:15.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 20 zone default found 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 4 Realm: () 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 20 zonegroup default 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.549+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a2b20 con 0x7f5b18036030 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a2f00 con 0x5613d24a3e50 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.550+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a2b20 con 0x5613d24a3e50 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.551+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.551+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.551+0000 7f5b28ec0800 20 started sync module instance, tier type = 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.551+0000 7f5b28ec0800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.551+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a80e0 con 0x5613d249f190 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.552+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.552+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94643132464192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a8490 con 0x5613d249f190 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.552+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a9490 con 0x5613d249ac20 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.553+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94643132464192] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.553+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.553+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94643132467616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a9870 con 0x5613d249ac20 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.553+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24aa290 con 0x5613d24a3e50 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.554+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.554+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94643132472688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24aaae0 con 0x5613d24a3e50 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.554+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24ab570 con 0x5613d249f190 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.554+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94643132467616] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.555+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.555+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94643132469168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24abdf0 con 0x5613d249f190 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.555+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24ac760 con 0x5613d249ac20 2024-03-20T13:35:15.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.555+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94643132472688] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.556+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94643132469168] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.557+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.557+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94643132474944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24ac760 con 0x5613d249ac20 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.557+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24acff0 con 0x7f5b18036030 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.558+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.558+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94643132483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24acf60 con 0x7f5b18036030 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.558+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24adf80 con 0x7f5b18036030 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.558+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94643132474944] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.559+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94643132483936] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.559+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.559+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94643132488288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24adf40 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.559+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24ad4c0 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94643132488288] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'108 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94643132482240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24ad4c0 con 0x7f5b18036030 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=0 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=1 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=2 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=3 2024-03-20T13:35:15.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=4 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=5 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.560+0000 7f5b28ec0800 20 add_watcher() i=6 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.561+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94643132482240] v30'109 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.561+0000 7f5b28ec0800 20 add_watcher() i=7 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.561+0000 7f5b28ec0800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.561+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24b1800 con 0x5613d249ac20 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.562+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.562+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94643132490544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24aecb0 con 0x5613d249ac20 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94643132490544] v30'106 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f59dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:15.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 5 note: GC not initialized 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5957fff640 20 reqs_thread_entry: start 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 20 Filter name: none 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5955ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.563+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24e3800 con 0x7f5b18036030 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:15.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24e1eb0 con 0x7f5b18036030 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.564+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24e2290 con 0x7f5b18036030 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v30'1 uv1 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b28ec0800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b28ec0800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:15.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b28ec0800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94643132707424 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24e6d60 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== watch-notify(notify (1) cookie 94643132483936 notify 128849018891 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f5b2003d040 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5a0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94643132483936 notifier 4477 bl.length()=522 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(65 notify.5 [notify cookie 94643132707424 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5a0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5a0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.566+0000 7f5a0a7fc640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f59ec003e90 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.567+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== watch-notify(notify_complete (2) cookie 94643132707424 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5b200050f0 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.567+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.567+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24e3260 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v30'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b28ec0800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:35:15.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b28ec0800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b28ec0800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94643132707424 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24e6d10 con 0x5613d24a3e50 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== watch-notify(notify (1) cookie 94643132472688 notify 128849018882 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x5613d236d9f0 con 0x5613d24a3e50 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5a0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018882 cookie 94643132472688 notifier 4477 bl.length()=177 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5a0a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5a0a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(68 notify.2 [notify cookie 94643132707424 out=8b] v0'0 uv108 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5a0a7fc640 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f59ec003e90 con 0x5613d24a3e50 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== watch-notify(notify_complete (2) cookie 94643132707424 notify 128849018882 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5b1c04e070 con 0x5613d24a3e50 2024-03-20T13:35:15.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.569+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.591 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:15.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.570+0000 7f59dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.570+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94643132490544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24b12e0 con 0x5613d249ac20 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.571+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94643132490544] v30'107 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.571+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94643132464192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24ae2e0 con 0x5613d249f190 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.572+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94643132464192] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.572+0000 7f5b28ec0800 20 remove_watcher() i=0 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.572+0000 7f5b28ec0800 2 removed watcher, disabling cache 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.572+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94643132467616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a7c40 con 0x5613d249ac20 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.573+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94643132467616] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.573+0000 7f5b28ec0800 20 remove_watcher() i=1 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.573+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94643132472688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a7c40 con 0x5613d24a3e50 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.575+0000 7f5b261c5640 1 -- 172.21.15.177:0/1270492334 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94643132472688] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b1c059040 con 0x5613d24a3e50 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.575+0000 7f5b28ec0800 20 remove_watcher() i=2 2024-03-20T13:35:15.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.575+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94643132469168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a9d70 con 0x5613d249f190 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.576+0000 7f5b269c6640 1 -- 172.21.15.177:0/1270492334 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94643132469168] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b18014070 con 0x5613d249f190 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.576+0000 7f5b28ec0800 20 remove_watcher() i=3 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.576+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94643132474944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a7c40 con 0x5613d249ac20 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.577+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94643132474944] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x5613d249ac20 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.577+0000 7f5b28ec0800 20 remove_watcher() i=4 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.577+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94643132483936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a9d70 con 0x7f5b18036030 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.578+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94643132483936] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.578+0000 7f5b28ec0800 20 remove_watcher() i=5 2024-03-20T13:35:15.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.578+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94643132488288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24aa640 con 0x7f5b18036030 2024-03-20T13:35:15.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.579+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94643132488288] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.579+0000 7f5b28ec0800 20 remove_watcher() i=6 2024-03-20T13:35:15.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.579+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94643132482240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5613d24a7c40 con 0x7f5b18036030 2024-03-20T13:35:15.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94643132482240] v30'110 uv108 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5b2000a4a0 con 0x7f5b18036030 2024-03-20T13:35:15.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 20 remove_watcher() i=7 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5b18036030 msgr2=0x7f5b18060a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5b18036030 0x7f5b18060a70 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d249ac20 msgr2=0x5613d249d0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d249ac20 0x5613d249d0e0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d249f190 msgr2=0x5613d24a1580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d249f190 0x5613d24a1580 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5613d24a3e50 msgr2=0x5613d24a6310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5613d24a3e50 0x5613d24a6310 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f59f0036740 msgr2=0x7f59f0038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f59f0036740 0x7f59f0038c00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c055040 tx=0x7f5b1c04f000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 msgr2=0x5613d248f210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b271c7640 1 -- 172.21.15.177:0/1270492334 reap_dead start 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.580+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d248f210 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f5b1804c010 tx=0x7f5b18031ef0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 shutdown_connections 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/1270492334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d2488250 0x5613d248f210 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 >> 172.21.15.177:0/1270492334 conn(0x5613d2484520 msgr2=0x5613d2481b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 shutdown_connections 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/1270492334 wait complete. 2024-03-20T13:35:15.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a00036790 msgr2=0x7f5a00038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a00036790 0x7f5a00038c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x5613d24614e0 tx=0x7f5b1c005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 msgr2=0x5613d247b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 0x5613d247b6d0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b1804c2e0 tx=0x7f5b180166c0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 shutdown_connections 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a00036790 0x7f5a00038c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/4286490245 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d247b2b0 0x5613d247b6d0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 >> 172.21.15.177:0/4286490245 conn(0x5613d246f350 msgr2=0x5613d246f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 shutdown_connections 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/4286490245 wait complete. 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5613d246a5f0 msgr2=0x5613d246c9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5613d246a5f0 0x5613d246c9e0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d236a0b0 msgr2=0x5613d2463eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5613d236a0b0 0x5613d2463eb0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d24666f0 msgr2=0x5613d2468ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5613d24666f0 0x5613d2468ae0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a0c0367e0 msgr2=0x7f5a0c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5a0c0367e0 0x7f5a0c038ca0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c054000 tx=0x7f5b1c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 msgr2=0x5613d245d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 --2- 172.21.15.177:0/2751747799 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5613d23665a0 0x5613d245d210 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b18001c50 tx=0x7f5b18000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b271c7640 1 -- 172.21.15.177:0/2751747799 reap_dead start 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 shutdown_connections 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 >> 172.21.15.177:0/2751747799 conn(0x5613d2360070 msgr2=0x5613d244fce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 shutdown_connections 2024-03-20T13:35:15.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.581+0000 7f5b28ec0800 1 -- 172.21.15.177:0/2751747799 wait complete. 2024-03-20T13:35:15.604 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:15.609 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:35:15.615 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:15.615 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-03-20T13:35:15.615 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-03-20T13:35:15.615 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-03-20T13:35:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:15.657 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:15.658 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.656+0000 7f66b7410800 1 Processor -- start 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.656+0000 7f66b7410800 1 -- start start 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b7410800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55929eb129e0 0x55929eb12e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b7410800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55929ea5ecd0 con 0x55929eb13c40 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b7410800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55929ea15500 con 0x55929eb129e0 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b2ac2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55929eb129e0 0x55929eb12e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b2ac2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55929eb129e0 0x55929eb12e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40892/0 (socket says 172.21.15.177:40892) 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2496070483 learned_addr learned my addr 172.21.15.177:0/2496070483 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66abfff640 1 --1- 172.21.15.177:0/2496070483 >> v1:172.21.15.28:6789/0 conn(0x55929eb13c40 0x55929eb140c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50542/0 (socket says 172.21.15.177:50542) 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2496070483 >> v1:172.21.15.28:6789/0 conn(0x55929eb13c40 legacy=0x55929eb140c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.659 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.657+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2496070483 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55929eb134d0 con 0x55929eb129e0 2024-03-20T13:35:15.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.660+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/2496070483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929eb12e00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f66a400a520 tx=0x7f66a401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411408340ffe4462 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b22c1640 1 -- 172.21.15.177:0/2496070483 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a4052570 con 0x55929eb129e0 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b22c1640 1 -- 172.21.15.177:0/2496070483 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40526d0 con 0x55929eb129e0 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b22c1640 1 -- 172.21.15.177:0/2496070483 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a4052990 con 0x55929eb129e0 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b7410800 1 -- 172.21.15.177:0/2496070483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 msgr2=0x55929eb12e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b7410800 1 --2- 172.21.15.177:0/2496070483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929eb12e00 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f66a400a520 tx=0x7f66a401cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b7410800 1 -- 172.21.15.177:0/2496070483 shutdown_connections 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b7410800 1 --2- 172.21.15.177:0/2496070483 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929eb12e00 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.661+0000 7f66b7410800 1 -- 172.21.15.177:0/2496070483 >> 172.21.15.177:0/2496070483 conn(0x55929eb0e040 msgr2=0x55929eb10460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.662+0000 7f66b7410800 1 -- 172.21.15.177:0/2496070483 shutdown_connections 2024-03-20T13:35:15.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.662+0000 7f66b7410800 1 -- 172.21.15.177:0/2496070483 wait complete. 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.673+0000 7f66b7410800 1 Processor -- start 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.673+0000 7f66b7410800 1 -- start start 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.673+0000 7f66b7410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec02ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.673+0000 7f66b7410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ea12a30 con 0x55929eb129e0 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec02ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec02ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40906/0 (socket says 172.21.15.177:40906) 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f66b2ac2640 1 -- 172.21.15.177:0/562450116 learned_addr learned my addr 172.21.15.177:0/562450116 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f66b2ac2640 1 -- 172.21.15.177:0/562450116 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4005de0 con 0x55929eb129e0 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/562450116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec02ed0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f66a4055040 tx=0x7f66a404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce284421b2843a23 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f65a0e09640 1 -- 172.21.15.177:0/562450116 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a4052840 con 0x55929eb129e0 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f65a0e09640 1 -- 172.21.15.177:0/562450116 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40529c0 con 0x55929eb129e0 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.674+0000 7f65a0e09640 1 -- 172.21.15.177:0/562450116 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a4052ca0 con 0x55929eb129e0 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 -- 172.21.15.177:0/562450116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 msgr2=0x55929ec02ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 --2- 172.21.15.177:0/562450116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec02ed0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f66a4055040 tx=0x7f66a404c000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 -- 172.21.15.177:0/562450116 shutdown_connections 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 --2- 172.21.15.177:0/562450116 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec02ed0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 -- 172.21.15.177:0/562450116 >> 172.21.15.177:0/562450116 conn(0x55929eb0e040 msgr2=0x55929ebfe670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 -- 172.21.15.177:0/562450116 shutdown_connections 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 -- 172.21.15.177:0/562450116 wait complete. 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 Processor -- start 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.675+0000 7f66b7410800 1 -- start start 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.676+0000 7f66b7410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec01280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.678 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.676+0000 7f66b7410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ea0e210 con 0x55929eb129e0 2024-03-20T13:35:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.677+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec01280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.677+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec01280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40916/0 (socket says 172.21.15.177:40916) 2024-03-20T13:35:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.677+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2831169242 learned_addr learned my addr 172.21.15.177:0/2831169242 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.678+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a404e070 con 0x55929eb129e0 2024-03-20T13:35:15.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.679+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec01280 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f66a4005870 tx=0x7f66a4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.680+0000 7f659f606640 1 -- 172.21.15.177:0/2831169242 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a406c070 con 0x55929eb129e0 2024-03-20T13:35:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.680+0000 7f659f606640 1 -- 172.21.15.177:0/2831169242 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a405d5b0 con 0x55929eb129e0 2024-03-20T13:35:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.680+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55929ebff970 con 0x55929eb129e0 2024-03-20T13:35:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.680+0000 7f659f606640 1 -- 172.21.15.177:0/2831169242 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a405d850 con 0x55929eb129e0 2024-03-20T13:35:15.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.680+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55929ebffeb0 con 0x55929eb129e0 2024-03-20T13:35:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f659f606640 1 -- 172.21.15.177:0/2831169242 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f66a4059040 con 0x55929eb129e0 2024-03-20T13:35:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f659f606640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65980367e0 0x7f6598038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f659f606640 1 -- 172.21.15.177:0/2831169242 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f66a408d480 con 0x55929eb129e0 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f66abfff640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65980367e0 0x7f6598038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929eb13c40 0x55929ec146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec00590 con 0x55929eb13c40 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f66b32c3640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929eb13c40 0x55929ec146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.681+0000 7f66abfff640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65980367e0 0x7f6598038ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f669c000f60 tx=0x7f669c001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b32c3640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929eb13c40 0x55929ec146d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b32c3640 1 -- 172.21.15.177:0/2831169242 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929eb13c40 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec14c10 con 0x55929eb13c40 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b32c3640 1 -- 172.21.15.177:0/2831169242 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929eb13c40 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec16980 0x55929ec18d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec19410 con 0x55929ec16980 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.682+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec16980 0x55929ec18d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec16980 0x55929ec18d70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2831169242 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec16980 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec15900 con 0x55929eb13c40 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66b32c3640 1 -- 172.21.15.177:0/2831169242 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929eb13c40 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55929ec1a810 0x55929ec1cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec1d360 con 0x55929ec1a810 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.683+0000 7f66abfff640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55929ec1a810 0x55929ec1cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.684+0000 7f66abfff640 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55929ec1a810 0x55929ec1cc00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.684+0000 7f66abfff640 1 -- 172.21.15.177:0/2831169242 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f669c00f690 con 0x55929ec1a810 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.684+0000 7f66b7410800 1 Processor -- start 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b7410800 1 -- start start 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b7410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 0x55929ec2b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b7410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929e9b0c70 con 0x55929ec2b560 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 0x55929ec2b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 0x55929ec2b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40932/0 (socket says 172.21.15.177:40932) 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b2ac2640 1 -- 172.21.15.177:0/1672604908 learned_addr learned my addr 172.21.15.177:0/1672604908 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b2ac2640 1 -- 172.21.15.177:0/1672604908 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55929ec2bec0 con 0x55929ec2b560 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.685+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 0x55929ec2b980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f66a408b950 tx=0x7f66a4001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.686+0000 7f659ce01640 1 -- 172.21.15.177:0/1672604908 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a408b470 con 0x55929ec2b560 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.686+0000 7f659ce01640 1 -- 172.21.15.177:0/1672604908 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a40823b0 con 0x55929ec2b560 2024-03-20T13:35:15.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.686+0000 7f659ce01640 1 -- 172.21.15.177:0/1672604908 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a408b760 con 0x55929ec2b560 2024-03-20T13:35:15.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.686+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55929ec2c930 con 0x55929ec2b560 2024-03-20T13:35:15.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.686+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55929ec2cdf0 con 0x55929ec2b560 2024-03-20T13:35:15.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.686+0000 7f659ce01640 1 -- 172.21.15.177:0/1672604908 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f66a408d720 con 0x55929ec2b560 2024-03-20T13:35:15.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f659ce01640 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f658c036790 0x7f658c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f659ce01640 1 -- 172.21.15.177:0/1672604908 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f66a4085750 con 0x55929ec2b560 2024-03-20T13:35:15.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66abfff640 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f658c036790 0x7f658c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b7410800 1 Processor -- start 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b7410800 1 -- start start 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66abfff640 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f658c036790 0x7f658c038c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55929eb13610 tx=0x7f669c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b7410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec38a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b7410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929e9865d0 con 0x55929ec38660 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec38a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec38a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40948/0 (socket says 172.21.15.177:40948) 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.687+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2464276030 learned_addr learned my addr 172.21.15.177:0/2464276030 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.688+0000 7f66b2ac2640 1 -- 172.21.15.177:0/2464276030 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55929ec39050 con 0x55929ec38660 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.688+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/2464276030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec38a80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66a4077790 tx=0x7f66a4077540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e12821769ed6adb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.688+0000 7f65967fc640 1 -- 172.21.15.177:0/2464276030 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a405c980 con 0x55929ec38660 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.688+0000 7f65967fc640 1 -- 172.21.15.177:0/2464276030 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a405cae0 con 0x55929ec38660 2024-03-20T13:35:15.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.688+0000 7f65967fc640 1 -- 172.21.15.177:0/2464276030 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a4085210 con 0x55929ec38660 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- 172.21.15.177:0/2464276030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 msgr2=0x55929ec38a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 --2- 172.21.15.177:0/2464276030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec38a80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f66a4077790 tx=0x7f66a4077540 comp rx=0 tx=0).stop 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- 172.21.15.177:0/2464276030 shutdown_connections 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 --2- 172.21.15.177:0/2464276030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec38a80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- 172.21.15.177:0/2464276030 >> 172.21.15.177:0/2464276030 conn(0x55929ec34970 msgr2=0x55929ec329d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- 172.21.15.177:0/2464276030 shutdown_connections 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- 172.21.15.177:0/2464276030 wait complete. 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 Processor -- start 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- start start 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec3f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.689+0000 7f66b7410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55929ec3f9c0 con 0x55929ec38660 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.690+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec3f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.690+0000 7f66b2ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec3f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40958/0 (socket says 172.21.15.177:40958) 2024-03-20T13:35:15.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.690+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 learned_addr learned my addr 172.21.15.177:0/101302939 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.692+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55929ec2c930 con 0x55929ec38660 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.693+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec3f480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66a4089fd0 tx=0x7f66a4085420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.694+0000 7f6594ff9640 1 -- 172.21.15.177:0/101302939 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a4077c30 con 0x55929ec38660 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.694+0000 7f6594ff9640 1 -- 172.21.15.177:0/101302939 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a4077d90 con 0x55929ec38660 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.694+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55929ec2c930 con 0x55929ec38660 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.694+0000 7f6594ff9640 1 -- 172.21.15.177:0/101302939 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66a408db50 con 0x55929ec38660 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.694+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55929ec2c930 con 0x55929ec38660 2024-03-20T13:35:15.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.695+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.696+0000 7f6594ff9640 1 -- 172.21.15.177:0/101302939 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f66a408dcb0 con 0x55929ec38660 2024-03-20T13:35:15.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f6594ff9640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f657c0367e0 0x7f657c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f6594ff9640 1 -- 172.21.15.177:0/101302939 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f66a40c1c80 con 0x55929ec38660 2024-03-20T13:35:15.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66abfff640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f657c0367e0 0x7f657c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929ec4abc0 0x55929ec4d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4d7d0 con 0x55929ec4abc0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b32c3640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929ec4abc0 0x55929ec4d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66abfff640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f657c0367e0 0x7f657c038ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55929ec1d720 tx=0x7f669c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b32c3640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929ec4abc0 0x55929ec4d080 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b7410800 20 realm 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.697+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4dba0 con 0x55929ec4abc0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e750 con 0x55929ec4abc0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec4f100 0x55929ec514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec51a30 con 0x55929ec4f100 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec4f100 0x55929ec514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.698+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec4f100 0x55929ec514f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66b7410800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66b7410800 20 searching for the correct realm 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55929ec53a30 0x55929ec55ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec565c0 con 0x55929ec53a30 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66abfff640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55929ec53a30 0x55929ec55ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.699+0000 7f66abfff640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55929ec53a30 0x55929ec55ef0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.700+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.700+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec565c0 con 0x55929ec4f100 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.700+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.700+0000 7f66b2ac2640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f66a40c0060 0x7f66a40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.700+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec565c0 con 0x7f66a40c0060 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.701+0000 7f66b32c3640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f66a40c0060 0x7f66a40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.702+0000 7f66b32c3640 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f66a40c0060 0x7f66a40a5150 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.702+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.702+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.703+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.703+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.703+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.703+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.704+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.704+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4f100 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.705+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.706+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.706+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.706+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.706+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4f100 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.707+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.707+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.707+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.707+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.707+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.707+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.708+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.708+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.709+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.711+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.711+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.711+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.711+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4f100 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.711+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.711+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.712+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.712+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.713+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.713+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec53a30 2024-03-20T13:35:15.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.713+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.713+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x7f66a40c0060 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.714+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.714+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f66ac031040 con 0x55929ec4f100 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.714+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.714+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f66ac031040 con 0x55929ec53a30 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.714+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.714+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f66ac031040 con 0x7f66a40c0060 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f66ac031040 con 0x55929ec4abc0 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f66ac031040 con 0x55929ec4f100 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:15.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec4e3f0 con 0x55929ec4abc0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.715+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec52330 con 0x55929ec4abc0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec52330 con 0x7f66a40c0060 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:15.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 20 zone default found 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 4 Realm: () 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 20 zonegroup default 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.716+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec52bb0 con 0x7f66a40c0060 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec52bb0 con 0x55929ec53a30 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec583e0 con 0x55929ec53a30 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 started sync module instance, tier type = 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.717+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec57870 con 0x55929ec4f100 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.718+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.718+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94088217328592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec57ff0 con 0x55929ec4f100 2024-03-20T13:35:15.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.718+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec591f0 con 0x55929ec4abc0 2024-03-20T13:35:15.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.719+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94088217328592] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.720+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.720+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94088217333072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec59610 con 0x55929ec4abc0 2024-03-20T13:35:15.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.720+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec59f80 con 0x55929ec53a30 2024-03-20T13:35:15.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.721+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94088217333072] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.722+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.722+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94088217334128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec59590 con 0x55929ec53a30 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.722+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5ad90 con 0x55929ec4f100 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.723+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.723+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94088217342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5ba00 con 0x55929ec4f100 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.723+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5c3d0 con 0x55929ec4abc0 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.723+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94088217334128] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.724+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.724+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94088217345744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5c7b0 con 0x55929ec4abc0 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.724+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94088217342272] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.724+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5b580 con 0x7f66a40c0060 2024-03-20T13:35:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.725+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94088217345744] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.725+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.725+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94088217343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5cc80 con 0x7f66a40c0060 2024-03-20T13:35:15.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.725+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5d650 con 0x7f66a40c0060 2024-03-20T13:35:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.726+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.726+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94088217343360] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.726+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94088217350480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5d610 con 0x7f66a40c0060 2024-03-20T13:35:15.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.726+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5a2e0 con 0x7f66a40c0060 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94088217350480] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'111 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94088217352752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5a2e0 con 0x7f66a40c0060 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=0 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=1 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=2 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=3 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=4 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=5 2024-03-20T13:35:15.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.727+0000 7f66b7410800 20 add_watcher() i=6 2024-03-20T13:35:15.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.728+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94088217352752] v30'112 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.728+0000 7f66b7410800 20 add_watcher() i=7 2024-03-20T13:35:15.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.728+0000 7f66b7410800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:15.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.728+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec61590 con 0x55929ec4abc0 2024-03-20T13:35:15.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.729+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.729+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94088217354432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5e9f0 con 0x55929ec4abc0 2024-03-20T13:35:15.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94088217354432] v30'108 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f65697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:15.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:15.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 5 note: GC not initialized 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f64e3fff640 20 reqs_thread_entry: start 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 20 Filter name: none 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f64e1ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.730+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec92d50 con 0x55929ec4f100 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.731+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) v8 ==== 275+0+304 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.731+0000 7f66b7410800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:15.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.732+0000 7f65697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.732+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94088217354432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec608f0 con 0x55929ec4abc0 2024-03-20T13:35:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.733+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94088217354432] v30'109 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.733+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94088217328592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5e0c0 con 0x55929ec4f100 2024-03-20T13:35:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.734+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94088217328592] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.734+0000 7f66b7410800 20 remove_watcher() i=0 2024-03-20T13:35:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.734+0000 7f66b7410800 2 removed watcher, disabling cache 2024-03-20T13:35:15.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.734+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94088217333072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec57bd0 con 0x55929ec4abc0 2024-03-20T13:35:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.735+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94088217333072] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.735+0000 7f66b7410800 20 remove_watcher() i=1 2024-03-20T13:35:15.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.735+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94088217334128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec57bd0 con 0x55929ec53a30 2024-03-20T13:35:15.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.736+0000 7f66abfff640 1 -- 172.21.15.177:0/101302939 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94088217334128] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f669c033040 con 0x55929ec53a30 2024-03-20T13:35:15.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.736+0000 7f66b7410800 20 remove_watcher() i=2 2024-03-20T13:35:15.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.736+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94088217342272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5e0c0 con 0x55929ec4f100 2024-03-20T13:35:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.737+0000 7f66b2ac2640 1 -- 172.21.15.177:0/101302939 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94088217342272] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66a405da50 con 0x55929ec4f100 2024-03-20T13:35:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.737+0000 7f66b7410800 20 remove_watcher() i=3 2024-03-20T13:35:15.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.737+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94088217345744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5b140 con 0x55929ec4abc0 2024-03-20T13:35:15.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.738+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94088217345744] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x55929ec4abc0 2024-03-20T13:35:15.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.738+0000 7f66b7410800 20 remove_watcher() i=4 2024-03-20T13:35:15.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.738+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94088217343360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5b140 con 0x7f66a40c0060 2024-03-20T13:35:15.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.740+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94088217343360] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.740+0000 7f66b7410800 20 remove_watcher() i=5 2024-03-20T13:35:15.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.740+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94088217350480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5b580 con 0x7f66a40c0060 2024-03-20T13:35:15.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.742+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94088217350480] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.742+0000 7f66b7410800 20 remove_watcher() i=6 2024-03-20T13:35:15.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.742+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94088217352752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55929ec5d150 con 0x7f66a40c0060 2024-03-20T13:35:15.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94088217352752] v30'113 uv111 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f66ac00a4a0 con 0x7f66a40c0060 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 20 remove_watcher() i=7 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f66a40c0060 msgr2=0x7f66a40a5150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f66a40c0060 0x7f66a40a5150 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929ec4abc0 msgr2=0x55929ec4d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929ec4abc0 0x55929ec4d080 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec4f100 msgr2=0x55929ec514f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec4f100 0x55929ec514f0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55929ec53a30 msgr2=0x55929ec55ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55929ec53a30 0x55929ec55ef0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f657c0367e0 msgr2=0x7f657c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f657c0367e0 0x7f657c038ca0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x55929ec1d720 tx=0x7f669c010000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 msgr2=0x55929ec3f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b32c3640 1 -- 172.21.15.177:0/101302939 reap_dead start 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec3f480 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f66a4089fd0 tx=0x7f66a4085420 comp rx=0 tx=0).stop 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 shutdown_connections 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 --2- 172.21.15.177:0/101302939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec38660 0x55929ec3f480 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 >> 172.21.15.177:0/101302939 conn(0x55929ec34970 msgr2=0x55929ec329a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 shutdown_connections 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.744+0000 7f66b7410800 1 -- 172.21.15.177:0/101302939 wait complete. 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f658c036790 msgr2=0x7f658c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f658c036790 0x7f658c038c50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x55929eb13610 tx=0x7f669c00f000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 msgr2=0x55929ec2b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 0x55929ec2b980 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f66a408b950 tx=0x7f66a4001c60 comp rx=0 tx=0).stop 2024-03-20T13:35:15.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 shutdown_connections 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f658c036790 0x7f658c038c50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/1672604908 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929ec2b560 0x55929ec2b980 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 >> 172.21.15.177:0/1672604908 conn(0x55929ec1f600 msgr2=0x55929ec1fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 shutdown_connections 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/1672604908 wait complete. 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55929ec1a810 msgr2=0x55929ec1cc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55929ec1a810 0x55929ec1cc00 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929eb13c40 msgr2=0x55929ec146d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55929eb13c40 0x55929ec146d0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec16980 msgr2=0x55929ec18d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55929ec16980 0x55929ec18d70 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65980367e0 msgr2=0x7f6598038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65980367e0 0x7f6598038ca0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f669c000f60 tx=0x7f669c001370 comp rx=0 tx=0).stop 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 msgr2=0x55929ec01280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 --2- 172.21.15.177:0/2831169242 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55929eb129e0 0x55929ec01280 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f66a4005870 tx=0x7f66a4002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b32c3640 1 -- 172.21.15.177:0/2831169242 reap_dead start 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 shutdown_connections 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 >> 172.21.15.177:0/2831169242 conn(0x55929eb0e040 msgr2=0x55929ec01940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 shutdown_connections 2024-03-20T13:35:15.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.745+0000 7f66b7410800 1 -- 172.21.15.177:0/2831169242 wait complete. 2024-03-20T13:35:15.754 INFO:teuthology.orchestra.run.smithi177.stdout:{"key":"bucket:myfoo","ver":{"tag":"_Xatigv7A9fkR3JXj-jUWFYK","ver":2},"mtime":"2024-03-20T13:35:15.417283Z","data":{"bucket":{"name":"myfoo","marker":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","bucket_id":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-03-20T13:35:12.979038Z","linked":false,"has_bucket_info":false}} 2024-03-20T13:35:15.755 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_Xatigv7A9fkR3JXj-jUWFYK', 'ver': 2}, 'mtime': '2024-03-20T13:35:15.417283Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'bucket_id': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-03-20T13:35:12.979038Z', 'linked': False, 'has_bucket_info': False}} 2024-03-20T13:35:15.755 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1'] 2024-03-20T13:35:15.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1'] 2024-03-20T13:35:15.755 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:15.843 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:15.843 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:15.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.842+0000 7ff591922800 1 Processor -- start 2024-03-20T13:35:15.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.842+0000 7ff591922800 1 -- start start 2024-03-20T13:35:15.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff591922800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x557a9ac11120 0x557a9ac13510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff591922800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x557a9ab57d70 con 0x557a9ac0d610 2024-03-20T13:35:15.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff591922800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x557a9ab0e500 con 0x557a9ac11120 2024-03-20T13:35:15.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff58d6b7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x557a9ac0d610 0x557a9ac0fa00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50546/0 (socket says 172.21.15.177:50546) 2024-03-20T13:35:15.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1542781337 learned_addr learned my addr 172.21.15.177:0/1542781337 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:15.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 966456557 0 0) 0x557a9ab57d70 con 0x557a9ac0d610 2024-03-20T13:35:15.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff578001e10 con 0x557a9ac0d610 2024-03-20T13:35:15.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 75084549 0 0) 0x7ff578001e10 con 0x557a9ac0d610 2024-03-20T13:35:15.846 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 >> v2:172.21.15.28:3300/0 conn(0x557a9ac11120 msgr2=0x557a9ac13510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 --2- 172.21.15.177:0/1542781337 >> v2:172.21.15.28:3300/0 conn(0x557a9ac11120 0x557a9ac13510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9ac14a60 con 0x557a9ac0d610 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7ff5800015a0 con 0x557a9ac0d610 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 >> v1:172.21.15.28:6789/0 conn(0x557a9ac0d610 legacy=0x557a9ac0fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 --2- 172.21.15.177:0/1542781337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff578002260 0x7ff578002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.843+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9ab0e500 con 0x7ff578002260 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.844+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1542781337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff578002260 0x7ff578002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.844+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1542781337 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578001e10 con 0x7ff578002260 2024-03-20T13:35:15.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.846+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1542781337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff578002260 0x7ff578002660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x557a9ab7fc30 tx=0x7ff58001d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d788b28344ad82 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.847+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58004ba40 con 0x7ff578002260 2024-03-20T13:35:15.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.847+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58004bba0 con 0x7ff578002260 2024-03-20T13:35:15.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.847+0000 7ff57ffff640 1 -- 172.21.15.177:0/1542781337 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58004be80 con 0x7ff578002260 2024-03-20T13:35:15.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 -- 172.21.15.177:0/1542781337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff578002260 msgr2=0x7ff578002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 --2- 172.21.15.177:0/1542781337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff578002260 0x7ff578002660 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x557a9ab7fc30 tx=0x7ff58001d6b0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 -- 172.21.15.177:0/1542781337 shutdown_connections 2024-03-20T13:35:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 --2- 172.21.15.177:0/1542781337 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff578002260 0x7ff578002660 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 --2- 172.21.15.177:0/1542781337 >> v2:172.21.15.28:3300/0 conn(0x557a9ac11120 0x557a9ac13510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 -- 172.21.15.177:0/1542781337 >> 172.21.15.177:0/1542781337 conn(0x557a9ac07060 msgr2=0x557a9ac09480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 -- 172.21.15.177:0/1542781337 shutdown_connections 2024-03-20T13:35:15.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.848+0000 7ff591922800 1 -- 172.21.15.177:0/1542781337 wait complete. 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.859+0000 7ff591922800 1 Processor -- start 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff591922800 1 -- start start 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff591922800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 0x557a9acfc650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff591922800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9ab0ba30 con 0x557a9ac0d610 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 0x557a9acfc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 0x557a9acfc650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40990/0 (socket says 172.21.15.177:40990) 2024-03-20T13:35:15.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1951441148 learned_addr learned my addr 172.21.15.177:0/1951441148 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.860+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1951441148 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9acfcc20 con 0x557a9ac0d610 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.861+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1951441148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 0x557a9acfc650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff58001dde0 tx=0x7ff58004d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bddbfd82f45420ce server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.861+0000 7ff47b606640 1 -- 172.21.15.177:0/1951441148 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58004ba40 con 0x557a9ac0d610 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.861+0000 7ff47b606640 1 -- 172.21.15.177:0/1951441148 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580001430 con 0x557a9ac0d610 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.861+0000 7ff47b606640 1 -- 172.21.15.177:0/1951441148 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58005f480 con 0x557a9ac0d610 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.861+0000 7ff591922800 1 -- 172.21.15.177:0/1951441148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 msgr2=0x557a9acfc650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.861+0000 7ff591922800 1 --2- 172.21.15.177:0/1951441148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 0x557a9acfc650 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff58001dde0 tx=0x7ff58004d000 comp rx=0 tx=0).stop 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 -- 172.21.15.177:0/1951441148 shutdown_connections 2024-03-20T13:35:15.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 --2- 172.21.15.177:0/1951441148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d610 0x557a9acfc650 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 -- 172.21.15.177:0/1951441148 >> 172.21.15.177:0/1951441148 conn(0x557a9ac07060 msgr2=0x557a9acf7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 -- 172.21.15.177:0/1951441148 shutdown_connections 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 -- 172.21.15.177:0/1951441148 wait complete. 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 Processor -- start 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 -- start start 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac11120 0x557a9ad04000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff591922800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9ab07210 con 0x557a9ac11120 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac11120 0x557a9ad04000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac11120 0x557a9ad04000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40994/0 (socket says 172.21.15.177:40994) 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.862+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1767663158 learned_addr learned my addr 172.21.15.177:0/1767663158 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff578001e10 con 0x557a9ac11120 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac11120 0x557a9ad04000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff580001ed0 tx=0x7ff5780040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff479e03640 1 -- 172.21.15.177:0/1767663158 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58004b910 con 0x557a9ac11120 2024-03-20T13:35:15.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff479e03640 1 -- 172.21.15.177:0/1767663158 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58006f070 con 0x557a9ac11120 2024-03-20T13:35:15.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a9ad04540 con 0x557a9ac11120 2024-03-20T13:35:15.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff479e03640 1 -- 172.21.15.177:0/1767663158 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58005fb80 con 0x557a9ac11120 2024-03-20T13:35:15.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.863+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a9ad04a80 con 0x557a9ac11120 2024-03-20T13:35:15.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff479e03640 1 -- 172.21.15.177:0/1767663158 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff58006b420 con 0x557a9ac11120 2024-03-20T13:35:15.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff479e03640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff474036790 0x7ff474038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff479e03640 1 -- 172.21.15.177:0/1767663158 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff58008eb90 con 0x557a9ac11120 2024-03-20T13:35:15.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff474036790 0x7ff474038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7ff578002260 0x557a9ad0ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad0b360 con 0x7ff578002260 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.864+0000 7ff58deb8640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7ff578002260 0x557a9ad0ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff474036790 0x7ff474038c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff584008530 tx=0x7ff584005600 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff58deb8640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7ff578002260 0x557a9ad0ae20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff58deb8640 1 -- 172.21.15.177:0/1767663158 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff578002260 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad0b730 con 0x7ff578002260 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff58deb8640 1 -- 172.21.15.177:0/1767663158 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff578002260 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad0d4f0 0x557a9ad0f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad0ff80 con 0x557a9ad0d4f0 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.865+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad0d4f0 0x557a9ad0f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.866+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad0d4f0 0x557a9ad0f8e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.866+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1767663158 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff580065020 con 0x557a9ad0d4f0 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.866+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad0c470 con 0x7ff578002260 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.866+0000 7ff58deb8640 1 -- 172.21.15.177:0/1767663158 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff578002260 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.866+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557a9ad113a0 0x557a9ad13790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.866+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad13ef0 con 0x557a9ad113a0 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.867+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557a9ad113a0 0x557a9ad13790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.869+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557a9ad113a0 0x557a9ad13790 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.870+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1767663158 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad113a0 2024-03-20T13:35:15.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.870+0000 7ff591922800 1 Processor -- start 2024-03-20T13:35:15.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.871+0000 7ff591922800 1 -- start start 2024-03-20T13:35:15.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.871+0000 7ff591922800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 0x557a9ac0b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.871+0000 7ff591922800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9aaa9c70 con 0x557a9ac0d1b0 2024-03-20T13:35:15.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.873+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 0x557a9ac0b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.873+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 0x557a9ac0b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40996/0 (socket says 172.21.15.177:40996) 2024-03-20T13:35:15.875 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.873+0000 7ff58d6b7640 1 -- 172.21.15.177:0/3508043682 learned_addr learned my addr 172.21.15.177:0/3508043682 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.875+0000 7ff58d6b7640 1 -- 172.21.15.177:0/3508043682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9ac0bb60 con 0x557a9ac0d1b0 2024-03-20T13:35:15.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.877+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 0x557a9ac0b620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff58008cf50 tx=0x7ff58005fe70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.878+0000 7ff472ffd640 1 -- 172.21.15.177:0/3508043682 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5800843b0 con 0x557a9ac0d1b0 2024-03-20T13:35:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.878+0000 7ff472ffd640 1 -- 172.21.15.177:0/3508043682 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff58008a040 con 0x557a9ac0d1b0 2024-03-20T13:35:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.878+0000 7ff472ffd640 1 -- 172.21.15.177:0/3508043682 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff58008e860 con 0x557a9ac0d1b0 2024-03-20T13:35:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.878+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a9ac0bdb0 con 0x557a9ac0d1b0 2024-03-20T13:35:15.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.878+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a9ac0c270 con 0x557a9ac0d1b0 2024-03-20T13:35:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff472ffd640 1 -- 172.21.15.177:0/3508043682 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff5800673b0 con 0x557a9ac0d1b0 2024-03-20T13:35:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff472ffd640 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff4640367e0 0x7ff464038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff472ffd640 1 -- 172.21.15.177:0/3508043682 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff580098c90 con 0x557a9ac0d1b0 2024-03-20T13:35:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff4640367e0 0x7ff464038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff591922800 1 Processor -- start 2024-03-20T13:35:15.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff591922800 1 -- start start 2024-03-20T13:35:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff4640367e0 0x7ff464038ca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x557a9ad0bab0 tx=0x7ff58400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff591922800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.881+0000 7ff591922800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9aa7f5d0 con 0x557a9ad313b0 2024-03-20T13:35:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.883+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.883+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad317d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:40998/0 (socket says 172.21.15.177:40998) 2024-03-20T13:35:15.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.883+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1121363412 learned_addr learned my addr 172.21.15.177:0/1121363412 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.884+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1121363412 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9ad31da0 con 0x557a9ad313b0 2024-03-20T13:35:15.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.885+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1121363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad317d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff58006b7f0 tx=0x7ff58006ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59ca5d68828712a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.886+0000 7ff470ff9640 1 -- 172.21.15.177:0/1121363412 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580069a00 con 0x557a9ad313b0 2024-03-20T13:35:15.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.886+0000 7ff470ff9640 1 -- 172.21.15.177:0/1121363412 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580069b60 con 0x557a9ad313b0 2024-03-20T13:35:15.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.886+0000 7ff470ff9640 1 -- 172.21.15.177:0/1121363412 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580069e20 con 0x557a9ad313b0 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- 172.21.15.177:0/1121363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 msgr2=0x557a9ad317d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 --2- 172.21.15.177:0/1121363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad317d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7ff58006b7f0 tx=0x7ff58006ad60 comp rx=0 tx=0).stop 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- 172.21.15.177:0/1121363412 shutdown_connections 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 --2- 172.21.15.177:0/1121363412 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad317d0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- 172.21.15.177:0/1121363412 >> 172.21.15.177:0/1121363412 conn(0x557a9ad2d710 msgr2=0x557a9ad2b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- 172.21.15.177:0/1121363412 shutdown_connections 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- 172.21.15.177:0/1121363412 wait complete. 2024-03-20T13:35:15.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 Processor -- start 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- start start 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff591922800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a9ad38900 con 0x557a9ad313b0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff58d6b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad383c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41002/0 (socket says 172.21.15.177:41002) 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.887+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 learned_addr learned my addr 172.21.15.177:0/1526369425 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a9ac0bdb0 con 0x557a9ad313b0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad383c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff580056860 tx=0x7ff58008ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff462ffd640 1 -- 172.21.15.177:0/1526369425 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff5800b2070 con 0x557a9ad313b0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff462ffd640 1 -- 172.21.15.177:0/1526369425 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff580056930 con 0x557a9ad313b0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557a9ac0bdb0 con 0x557a9ad313b0 2024-03-20T13:35:15.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff462ffd640 1 -- 172.21.15.177:0/1526369425 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff580069a00 con 0x557a9ad313b0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.888+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a9ac0bdb0 con 0x557a9ad313b0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.889+0000 7ff462ffd640 1 -- 172.21.15.177:0/1526369425 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff5800b6070 con 0x557a9ad313b0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.889+0000 7ff462ffd640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff458036830 0x7ff458038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.889+0000 7ff462ffd640 1 -- 172.21.15.177:0/1526369425 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff5800b9c60 con 0x557a9ad313b0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff458036830 0x7ff458038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557a9ad43b20 0x557a9ad45fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad46730 con 0x557a9ad43b20 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff58deb8640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557a9ad43b20 0x557a9ad45fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff458036830 0x7ff458038cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff584014fd0 tx=0x7ff584002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff58deb8640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557a9ad43b20 0x557a9ad45fe0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 20 realm 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.890+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad46b00 con 0x557a9ad43b20 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad476e0 con 0x557a9ad43b20 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad48090 0x557a9ad4a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4aa90 con 0x557a9ad48090 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad48090 0x557a9ad4a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.891+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad48090 0x557a9ad4a480 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff580065020 con 0x557a9ad48090 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff591922800 20 searching for the correct realm 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557a9ad4cd40 0x557a9ad4f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4f880 con 0x557a9ad4cd40 2024-03-20T13:35:15.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557a9ad4cd40 0x557a9ad4f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff58ceb6640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557a9ad4cd40 0x557a9ad4f200 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.892+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.893+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4f880 con 0x557a9ad48090 2024-03-20T13:35:15.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.893+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.893+0000 7ff58d6b7640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff5800c2060 0x7ff580097830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:15.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.893+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4f880 con 0x7ff5800c2060 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.894+0000 7ff58deb8640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff5800c2060 0x7ff580097830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.896+0000 7ff58deb8640 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff5800c2060 0x7ff580097830 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.897+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.897+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.897+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.897+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.897+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.897+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.898+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.898+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.898+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.898+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad48090 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.898+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.898+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.899+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.899+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.899+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.899+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.899+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.899+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad48090 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.900+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.901+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.901+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.902+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.903+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.903+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.903+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.903+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad48090 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.903+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.903+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.904+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.904+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.904+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.904+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad4cd40 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.905+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.905+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x7ff5800c2060 2024-03-20T13:35:15.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.906+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.906+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff588031040 con 0x557a9ad48090 2024-03-20T13:35:15.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.906+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.906+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff588031040 con 0x557a9ad4cd40 2024-03-20T13:35:15.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.906+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.906+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff588031040 con 0x7ff5800c2060 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff588031040 con 0x557a9ad43b20 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff588031040 con 0x557a9ad48090 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:15.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.908+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad47380 con 0x557a9ad43b20 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4b180 con 0x557a9ad43b20 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.909+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4b180 con 0x7ff5800c2060 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 20 zone default found 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 4 Realm: () 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:15.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:15.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:15.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 20 zonegroup default 2024-03-20T13:35:15.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.910+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4bf40 con 0x7ff5800c2060 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.911+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.911+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.911+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.911+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad4bf40 con 0x557a9ad4cd40 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad516a0 con 0x557a9ad4cd40 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:15.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 20 started sync module instance, tier type = 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.912+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad50b30 con 0x557a9ad48090 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.913+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.913+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93985072025360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad507a0 con 0x557a9ad48090 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.913+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad523c0 con 0x557a9ad43b20 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.914+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93985072025360] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.914+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.914+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93985072028160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad52770 con 0x557a9ad43b20 2024-03-20T13:35:15.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.914+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad531c0 con 0x557a9ad4cd40 2024-03-20T13:35:15.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.915+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93985072028160] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.916+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.916+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93985072032928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad53570 con 0x557a9ad4cd40 2024-03-20T13:35:15.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.916+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad54010 con 0x557a9ad48090 2024-03-20T13:35:15.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.917+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.917+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93985072036592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad54860 con 0x557a9ad48090 2024-03-20T13:35:15.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.917+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad55310 con 0x557a9ad43b20 2024-03-20T13:35:15.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.917+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93985072032928] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:15.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.918+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93985072036592] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.918+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.918+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93985072041488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad543c0 con 0x557a9ad43b20 2024-03-20T13:35:15.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.918+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad55b60 con 0x7ff5800c2060 2024-03-20T13:35:15.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.919+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93985072041488] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.919+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.919+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93985072029216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad543c0 con 0x7ff5800c2060 2024-03-20T13:35:15.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.919+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad561d0 con 0x7ff5800c2060 2024-03-20T13:35:15.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.921+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93985072029216] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.921+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.921+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93985072045232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad56190 con 0x7ff5800c2060 2024-03-20T13:35:15.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.921+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad56b90 con 0x7ff5800c2060 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93985072045232] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'114 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93985072047760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad56b50 con 0x7ff5800c2060 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=0 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=1 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=2 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=3 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=4 2024-03-20T13:35:15.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=5 2024-03-20T13:35:15.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.922+0000 7ff591922800 20 add_watcher() i=6 2024-03-20T13:35:15.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.924+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93985072047760] v30'115 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.924+0000 7ff591922800 20 add_watcher() i=7 2024-03-20T13:35:15.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.924+0000 7ff591922800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:15.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.924+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad59fd0 con 0x557a9ad43b20 2024-03-20T13:35:15.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.925+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.926 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.925+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93985072043424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad57480 con 0x557a9ad43b20 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93985072043424] v30'110 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff4437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 5 note: GC not initialized 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff4427e4640 20 reqs_thread_entry: start 2024-03-20T13:35:15.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:15.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 20 Filter name: none 2024-03-20T13:35:15.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff3b3fff640 20 reqs_thread_entry: start 2024-03-20T13:35:15.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:15.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.926+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad8bf10 con 0x7ff5800c2060 2024-03-20T13:35:15.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:15.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:35:15.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:35:15.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:15.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:15.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.927+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad8da70 con 0x557a9ad48090 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 20 rados->read ofs=0 len=0 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad8f210 con 0x557a9ad43b20 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(64 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:15.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:15.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:15.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:15.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-03-20T13:35:15.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.928+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad93510 con 0x557a9ad48090 2024-03-20T13:35:15.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.930+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 foo.buckets [call] v30'19 uv17 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.930+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad99330 con 0x557a9ad43b20 2024-03-20T13:35:15.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(66 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'4 uv4 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:15.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff591922800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:15.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff591922800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff591922800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff591922800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 93985072281280 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad93900 con 0x557a9ad48090 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== watch-notify(notify (1) cookie 93985072036592 notify 128849018893 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x557a9ad31da0 con 0x557a9ad48090 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff470ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 93985072036592 notifier 4490 bl.length()=725 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff470ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff470ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff470ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff470ff9640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff450003e90 con 0x557a9ad48090 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.931+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(67 notify.3 [notify cookie 93985072281280 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== watch-notify(notify_complete (2) cookie 93985072281280 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x557a9ac0bb60 con 0x557a9ad48090 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff591922800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_sources= new_sources= 2024-03-20T13:35:15.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff591922800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential sources added=[] removed=[] 2024-03-20T13:35:15.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff591922800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_dests= new_dests= 2024-03-20T13:35:15.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff591922800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential dests added=[] removed=[] 2024-03-20T13:35:15.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:15.932+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad8f6a0 con 0x7ff5800c2060 2024-03-20T13:35:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.139+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 fud.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:16.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.139+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad8f6a0 con 0x557a9ad48090 2024-03-20T13:35:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'20 uv20 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff591922800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:35:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff591922800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff591922800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:16.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93985072281248 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad98090 con 0x7ff5800c2060 2024-03-20T13:35:16.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== watch-notify(notify (1) cookie 93985072045232 notify 128849018892 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7ff58803d040 con 0x7ff5800c2060 2024-03-20T13:35:16.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff463fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 93985072045232 notifier 4490 bl.length()=314 2024-03-20T13:35:16.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(71 notify.6 [notify cookie 93985072281248 out=8b] v0'0 uv114 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff463fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff463fff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.141+0000 7ff463fff640 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff3c00033f0 con 0x7ff5800c2060 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.142+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== watch-notify(notify_complete (2) cookie 93985072281248 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff588018de0 con 0x7ff5800c2060 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.142+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.143+0000 7ff4437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.143+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93985072043424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad8f6a0 con 0x557a9ad43b20 2024-03-20T13:35:16.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.144+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 93985072043424] v30'111 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:16.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.144+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93985072025360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad555a0 con 0x557a9ad48090 2024-03-20T13:35:16.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.145+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 93985072025360] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:16.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.145+0000 7ff591922800 20 remove_watcher() i=0 2024-03-20T13:35:16.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.145+0000 7ff591922800 2 removed watcher, disabling cache 2024-03-20T13:35:16.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.145+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93985072028160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad507a0 con 0x557a9ad43b20 2024-03-20T13:35:16.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.146+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 93985072028160] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:16.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.146+0000 7ff591922800 20 remove_watcher() i=1 2024-03-20T13:35:16.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.146+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93985072032928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad507a0 con 0x557a9ad4cd40 2024-03-20T13:35:16.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.147+0000 7ff58ceb6640 1 -- 172.21.15.177:0/1526369425 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 93985072032928] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff584014190 con 0x557a9ad4cd40 2024-03-20T13:35:16.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.147+0000 7ff591922800 20 remove_watcher() i=2 2024-03-20T13:35:16.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.147+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93985072036592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad555a0 con 0x557a9ad48090 2024-03-20T13:35:16.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.148+0000 7ff58d6b7640 1 -- 172.21.15.177:0/1526369425 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 93985072036592] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff5800c8040 con 0x557a9ad48090 2024-03-20T13:35:16.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.148+0000 7ff591922800 20 remove_watcher() i=3 2024-03-20T13:35:16.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.148+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93985072041488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad51a00 con 0x557a9ad43b20 2024-03-20T13:35:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.149+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 93985072041488] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x557a9ad43b20 2024-03-20T13:35:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.150+0000 7ff591922800 20 remove_watcher() i=4 2024-03-20T13:35:16.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.150+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93985072029216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad53af0 con 0x7ff5800c2060 2024-03-20T13:35:16.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.151+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 93985072029216] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:16.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.151+0000 7ff591922800 20 remove_watcher() i=5 2024-03-20T13:35:16.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.151+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93985072045232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad555a0 con 0x7ff5800c2060 2024-03-20T13:35:16.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.153+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 93985072045232] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:16.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.153+0000 7ff591922800 20 remove_watcher() i=6 2024-03-20T13:35:16.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.153+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93985072047760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x557a9ad53af0 con 0x7ff5800c2060 2024-03-20T13:35:16.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 93985072047760] v30'116 uv114 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff58800a4a0 con 0x7ff5800c2060 2024-03-20T13:35:16.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 20 remove_watcher() i=7 2024-03-20T13:35:16.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff5800c2060 msgr2=0x7ff580097830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff5800c2060 0x7ff580097830 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557a9ad43b20 msgr2=0x557a9ad45fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x557a9ad43b20 0x557a9ad45fe0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad48090 msgr2=0x557a9ad4a480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad48090 0x557a9ad4a480 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557a9ad4cd40 msgr2=0x557a9ad4f200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x557a9ad4cd40 0x557a9ad4f200 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff458036830 msgr2=0x7ff458038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff458036830 0x7ff458038cf0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7ff584014fd0 tx=0x7ff584002000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 msgr2=0x557a9ad383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff58deb8640 1 -- 172.21.15.177:0/1526369425 reap_dead start 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad383c0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff580056860 tx=0x7ff58008ea20 comp rx=0 tx=0).stop 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 shutdown_connections 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/1526369425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ad313b0 0x557a9ad383c0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 >> 172.21.15.177:0/1526369425 conn(0x557a9ad2d710 msgr2=0x557a9ad2ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 shutdown_connections 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/1526369425 wait complete. 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff4640367e0 msgr2=0x7ff464038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff4640367e0 0x7ff464038ca0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x557a9ad0bab0 tx=0x7ff58400f000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 msgr2=0x557a9ac0b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.154+0000 7ff591922800 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 0x557a9ac0b620 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff58008cf50 tx=0x7ff58005fe70 comp rx=0 tx=0).stop 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 shutdown_connections 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff4640367e0 0x7ff464038ca0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/3508043682 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac0d1b0 0x557a9ac0b620 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 >> 172.21.15.177:0/3508043682 conn(0x557a9ad16190 msgr2=0x557a9ad16590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 shutdown_connections 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/3508043682 wait complete. 2024-03-20T13:35:16.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557a9ad113a0 msgr2=0x557a9ad13790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x557a9ad113a0 0x557a9ad13790 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7ff578002260 msgr2=0x557a9ad0ae20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7ff578002260 0x557a9ad0ae20 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad0d4f0 msgr2=0x557a9ad0f8e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x557a9ad0d4f0 0x557a9ad0f8e0 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff474036790 msgr2=0x7ff474038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff474036790 0x7ff474038c50 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ff584008530 tx=0x7ff584005600 comp rx=0 tx=0).stop 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac11120 msgr2=0x557a9ad04000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 --2- 172.21.15.177:0/1767663158 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x557a9ac11120 0x557a9ad04000 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff580001ed0 tx=0x7ff5780040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff58deb8640 1 -- 172.21.15.177:0/1767663158 reap_dead start 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 shutdown_connections 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 >> 172.21.15.177:0/1767663158 conn(0x557a9ac07060 msgr2=0x557a9acf67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 shutdown_connections 2024-03-20T13:35:16.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.155+0000 7ff591922800 1 -- 172.21.15.177:0/1767663158 wait complete. 2024-03-20T13:35:16.164 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-03-20T13:35:16.165 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-03-20T13:35:16.165 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-03-20T13:35:16.208 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:16.208 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:16.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.207+0000 7f9b9fc10800 1 Processor -- start 2024-03-20T13:35:16.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9fc10800 1 -- start start 2024-03-20T13:35:16.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9fc10800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b6c467b400 0x55b6c467b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9fc10800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b6c45c7cd0 con 0x55b6c467bd60 2024-03-20T13:35:16.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9fc10800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b6c457e500 con 0x55b6c467b400 2024-03-20T13:35:16.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9b3be640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b6c467b400 0x55b6c467b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9abbd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55b6c467bd60 0x55b6c467c210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50556/0 (socket says 172.21.15.177:50556) 2024-03-20T13:35:16.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9abbd640 1 -- 172.21.15.177:0/4059228503 learned_addr learned my addr 172.21.15.177:0/4059228503 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:16.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9b3be640 1 -- 172.21.15.177:0/4059228503 >> v1:172.21.15.28:6789/0 conn(0x55b6c467bd60 legacy=0x55b6c467c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.208+0000 7f9b9b3be640 1 -- 172.21.15.177:0/4059228503 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c45f0090 con 0x55b6c467b400 2024-03-20T13:35:16.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.210+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/4059228503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c467b820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00a470 tx=0x7f9b8c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d94bcef69c2722 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.210+0000 7f9b9a3bc640 1 -- 172.21.15.177:0/4059228503 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c052570 con 0x55b6c467b400 2024-03-20T13:35:16.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9a3bc640 1 -- 172.21.15.177:0/4059228503 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0526d0 con 0x55b6c467b400 2024-03-20T13:35:16.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9a3bc640 1 -- 172.21.15.177:0/4059228503 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c052990 con 0x55b6c467b400 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 -- 172.21.15.177:0/4059228503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 msgr2=0x55b6c467b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/4059228503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c467b820 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00a470 tx=0x7f9b8c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 -- 172.21.15.177:0/4059228503 shutdown_connections 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/4059228503 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c467b820 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 -- 172.21.15.177:0/4059228503 >> 172.21.15.177:0/4059228503 conn(0x55b6c4677040 msgr2=0x55b6c4679460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 -- 172.21.15.177:0/4059228503 shutdown_connections 2024-03-20T13:35:16.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.211+0000 7f9b9fc10800 1 -- 172.21.15.177:0/4059228503 wait complete. 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9fc10800 1 Processor -- start 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9fc10800 1 -- start start 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9fc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c476ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9fc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c457ba30 con 0x55b6c467b400 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c476ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c476ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41006/0 (socket says 172.21.15.177:41006) 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9b3be640 1 -- 172.21.15.177:0/3448346432 learned_addr learned my addr 172.21.15.177:0/3448346432 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.223+0000 7f9b9b3be640 1 -- 172.21.15.177:0/3448346432 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c005d20 con 0x55b6c467b400 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.224+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/3448346432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c476ec60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c055040 tx=0x7f9b8c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25ff21ab09fae6b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.224+0000 7f9a8960a640 1 -- 172.21.15.177:0/3448346432 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c00a180 con 0x55b6c467b400 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.224+0000 7f9a8960a640 1 -- 172.21.15.177:0/3448346432 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c00a2e0 con 0x55b6c467b400 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.224+0000 7f9a8960a640 1 -- 172.21.15.177:0/3448346432 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c0529b0 con 0x55b6c467b400 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3448346432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 msgr2=0x55b6c476ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3448346432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c476ec60 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c055040 tx=0x7f9b8c04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3448346432 shutdown_connections 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3448346432 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c476ec60 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3448346432 >> 172.21.15.177:0/3448346432 conn(0x55b6c4677040 msgr2=0x55b6c476a580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3448346432 shutdown_connections 2024-03-20T13:35:16.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3448346432 wait complete. 2024-03-20T13:35:16.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 Processor -- start 2024-03-20T13:35:16.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- start start 2024-03-20T13:35:16.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c47761f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.225+0000 7f9b9fc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c4577210 con 0x55b6c467b400 2024-03-20T13:35:16.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.226+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c47761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.226+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c47761f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41016/0 (socket says 172.21.15.177:41016) 2024-03-20T13:35:16.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.226+0000 7f9b9b3be640 1 -- 172.21.15.177:0/3177834919 learned_addr learned my addr 172.21.15.177:0/3177834919 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.227+0000 7f9b9b3be640 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c45f0090 con 0x55b6c467b400 2024-03-20T13:35:16.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.228+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c47761f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00a470 tx=0x7f9b8c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.228+0000 7f9a87e07640 1 -- 172.21.15.177:0/3177834919 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c06a070 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.228+0000 7f9a87e07640 1 -- 172.21.15.177:0/3177834919 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c05d420 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.228+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6c4776730 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.228+0000 7f9a87e07640 1 -- 172.21.15.177:0/3177834919 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c05d5d0 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.229+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6c4776c10 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9a87e07640 1 -- 172.21.15.177:0/3177834919 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9b8c05d730 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9a87e07640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9a87e07640 1 -- 172.21.15.177:0/3177834919 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9b8c08db60 con 0x55b6c467b400 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c467bd60 0x55b6c477cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c477d510 con 0x55b6c467bd60 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9b9bbbf640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c467bd60 0x55b6c477cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.230+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001d90 tx=0x7f9b900012f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9bbbf640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c467bd60 0x55b6c477cf20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/3177834919 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c467bd60 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c477a610 con 0x55b6c467bd60 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/3177834919 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c467bd60 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c477f770 0x55b6c4781b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c4782230 con 0x55b6c477f770 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.231+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c477f770 0x55b6c4781b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c477f770 0x55b6c4781b60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9b3be640 1 -- 172.21.15.177:0/3177834919 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9b8c07e040 con 0x55b6c477f770 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c477e6f0 con 0x55b6c467bd60 2024-03-20T13:35:16.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/3177834919 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c467bd60 2024-03-20T13:35:16.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b6c4783650 0x55b6c4785a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47861d0 con 0x55b6c4783650 2024-03-20T13:35:16.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.232+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b6c4783650 0x55b6c4785a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.233+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b6c4783650 0x55b6c4785a40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.233+0000 7f9b9abbd640 1 -- 172.21.15.177:0/3177834919 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c4783650 2024-03-20T13:35:16.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.233+0000 7f9b9fc10800 1 Processor -- start 2024-03-20T13:35:16.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.233+0000 7f9b9fc10800 1 -- start start 2024-03-20T13:35:16.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9fc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 0x55b6c47947f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9fc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c4519c70 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 0x55b6c47947f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 0x55b6c47947f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41018/0 (socket says 172.21.15.177:41018) 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1115708992 learned_addr learned my addr 172.21.15.177:0/1115708992 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1115708992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c4794d30 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 0x55b6c47947f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c08c1d0 tx=0x7f9b8c079d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9a85602640 1 -- 172.21.15.177:0/1115708992 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c077e50 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9a85602640 1 -- 172.21.15.177:0/1115708992 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0773b0 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6c47957a0 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.234+0000 7f9a85602640 1 -- 172.21.15.177:0/1115708992 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c077650 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.235+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6c4795c60 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.235+0000 7f9a85602640 1 -- 172.21.15.177:0/1115708992 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9b8c08d2d0 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.235+0000 7f9a85602640 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a74036790 0x7f9a74038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9a85602640 1 -- 172.21.15.177:0/1115708992 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9b8c08de40 con 0x55b6c47943d0 2024-03-20T13:35:16.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a74036790 0x7f9a74038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9b9fc10800 1 Processor -- start 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9b9fc10800 1 -- start start 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a74036790 0x7f9a74038c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55b6c477e130 tx=0x7f9b9000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9b9fc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.236+0000 7f9b9fc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c44ef5d0 con 0x55b6c47a1480 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.237+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.237+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41026/0 (socket says 172.21.15.177:41026) 2024-03-20T13:35:16.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.237+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1857240721 learned_addr learned my addr 172.21.15.177:0/1857240721 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.238+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1857240721 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c47a1e70 con 0x55b6c47a1480 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.239+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/1857240721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a18a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c06df70 tx=0x7f9b8c084b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ea276e09dd6752 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9a7effd640 1 -- 172.21.15.177:0/1857240721 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c084410 con 0x55b6c47a1480 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9a7effd640 1 -- 172.21.15.177:0/1857240721 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c084570 con 0x55b6c47a1480 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9a7effd640 1 -- 172.21.15.177:0/1857240721 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c04cdf0 con 0x55b6c47a1480 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1857240721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 msgr2=0x55b6c47a18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1857240721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a18a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c06df70 tx=0x7f9b8c084b60 comp rx=0 tx=0).stop 2024-03-20T13:35:16.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1857240721 shutdown_connections 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1857240721 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a18a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1857240721 >> 172.21.15.177:0/1857240721 conn(0x55b6c479d7e0 msgr2=0x55b6c479b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1857240721 shutdown_connections 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1857240721 wait complete. 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.240+0000 7f9b9fc10800 1 Processor -- start 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9fc10800 1 -- start start 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9fc10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9fc10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6c47a8910 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9b3be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41040/0 (socket says 172.21.15.177:41040) 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 learned_addr learned my addr 172.21.15.177:0/1351487681 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b6c47957a0 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.241+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a83d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0779e0 tx=0x7f9b8c063f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.242+0000 7f9a7d7fa640 1 -- 172.21.15.177:0/1351487681 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c08d900 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.242+0000 7f9a7d7fa640 1 -- 172.21.15.177:0/1351487681 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0b2070 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.242+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b6c47957a0 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.242+0000 7f9a7d7fa640 1 -- 172.21.15.177:0/1351487681 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c069590 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.242+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b6c47957a0 con 0x55b6c47a1480 2024-03-20T13:35:16.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9a7d7fa640 1 -- 172.21.15.177:0/1351487681 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9b8c0b4030 con 0x55b6c47a1480 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9a7d7fa640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a64036790 0x7f9a64038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9a7d7fa640 1 -- 172.21.15.177:0/1351487681 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f9b8c0b8c70 con 0x55b6c47a1480 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a64036790 0x7f9a64038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c47b3ba0 0x55b6c47b6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b67b0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9b9bbbf640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c47b3ba0 0x55b6c47b6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.243+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a64036790 0x7f9a64038c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55b6c4786590 tx=0x7f9b90010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9bbbf640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c47b3ba0 0x55b6c47b6060 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 realm 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b6b80 con 0x55b6c47b3ba0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:16.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7400 con 0x55b6c47b3ba0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.244+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c47b8470 0x55b6c47ba860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bae20 con 0x55b6c47b8470 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c47b8470 0x55b6c47ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c47b8470 0x55b6c47ba860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 20 searching for the correct realm 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6c47bd110 0x55b6c47bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bfca0 con 0x55b6c47bd110 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.245+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6c47bd110 0x55b6c47bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.246+0000 7f9b9abbd640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6c47bd110 0x55b6c47bf5d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.246+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.246+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bfca0 con 0x55b6c47b8470 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.246+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.246+0000 7f9b9b3be640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9b8c0ae040 0x7f9b8c069880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.246+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bfca0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.247+0000 7f9b9bbbf640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9b8c0ae040 0x7f9b8c069880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.248+0000 7f9b9bbbf640 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9b8c0ae040 0x7f9b8c069880 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.249+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.249+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.249+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.249+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.249+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.250+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.250+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.250+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.251+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.251+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b8470 2024-03-20T13:35:16.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.251+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.251+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.251+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.251+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b8470 2024-03-20T13:35:16.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.252+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.253+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.253+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.253+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.253+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.253+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.253+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.254+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.255+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.255+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.255+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.255+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b8470 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.256+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.256+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.256+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.256+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.257+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.257+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47bd110 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.257+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.257+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x7f9b8c0ae040 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.257+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.257+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9b94031040 con 0x55b6c47b8470 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9b94031040 con 0x55b6c47bd110 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9b94031040 con 0x7f9b8c0ae040 2024-03-20T13:35:16.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9b94031040 con 0x55b6c47b3ba0 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.258+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f9b94031040 con 0x55b6c47b8470 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47b7760 con 0x55b6c47b3ba0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bb510 con 0x55b6c47b3ba0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bb510 con 0x7f9b8c0ae040 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.259+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:16.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 zone default found 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 4 Realm: () 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 zonegroup default 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bbd90 con 0x7f9b8c0ae040 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47bc190 con 0x55b6c47bd110 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c1ac0 con 0x55b6c47bd110 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 started sync module instance, tier type = 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.260+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c13a0 con 0x55b6c47b8470 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.261+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.261+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94243468873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c1750 con 0x55b6c47b8470 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.262+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c28d0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.262+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94243468873472] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.263+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.263+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94243468878896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c2850 con 0x55b6c47b3ba0 2024-03-20T13:35:16.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.263+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c3730 con 0x55b6c47bd110 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.264+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94243468878896] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.264+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.264+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94243468882576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c3a90 con 0x55b6c47bd110 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.265+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c4460 con 0x55b6c47b8470 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.265+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.265+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94243468888080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c50d0 con 0x55b6c47b8470 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.266+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c5a80 con 0x55b6c47b3ba0 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.266+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94243468882576] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.266+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94243468888080] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.267+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.267+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94243468889136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c55a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.267+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c6470 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.268+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.268+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94243468894160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c6890 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.268+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c7240 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.268+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94243468889136] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.269+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.269+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94243468881024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c7200 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.269+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c7c30 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.269+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94243468894160] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94243468881024] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'117 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94243468900144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c6d60 con 0x7f9b8c0ae040 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=0 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=1 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=2 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=3 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=4 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=5 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.270+0000 7f9b9fc10800 20 add_watcher() i=6 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.271+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94243468900144] v30'118 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.271+0000 7f9b9fc10800 20 add_watcher() i=7 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.271+0000 7f9b9fc10800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.271+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47cad30 con 0x55b6c47b3ba0 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.271+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.271+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94243468895216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c81a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.272+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94243468895216] v30'112 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.272+0000 7f9a51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.272+0000 7f9b9fc10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.272+0000 7f9b9fc10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.273+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d33f0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.274+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.274+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d3810 con 0x7f9b8c0ae040 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.275+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'14 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.275+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d3810 con 0x55b6c47bd110 2024-03-20T13:35:16.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.276+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.276+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47cf110 con 0x55b6c47b3ba0 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.277+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'113 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.277+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47cec70 con 0x55b6c47b8470 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.278+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'33 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.278+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47cec70 con 0x55b6c47bd110 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.279+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'21 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.279+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d53c0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.280+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.280+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d23d0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.281+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'21 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.281+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d23d0 con 0x55b6c47b8470 2024-03-20T13:35:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.283+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.283+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d2370 con 0x55b6c47bd110 2024-03-20T13:35:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.284+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.284+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d6100 con 0x55b6c47b8470 2024-03-20T13:35:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.285+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'34 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.285+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d6630 con 0x7f9b8c0ae040 2024-03-20T13:35:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.286+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.286+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d6630 con 0x55b6c47b8470 2024-03-20T13:35:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.287+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.287+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d6770 con 0x7f9b8c0ae040 2024-03-20T13:35:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.289+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.289+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d65a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.289+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'114 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.290+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d65a0 con 0x55b6c47bd110 2024-03-20T13:35:16.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.291+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.291+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce310 con 0x55b6c47b8470 2024-03-20T13:35:16.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.292+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'35 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.292+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce310 con 0x55b6c47bd110 2024-03-20T13:35:16.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.293+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'14 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.293+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce8a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.294+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'22 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.294+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce8a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.295+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'115 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.295+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce520 con 0x55b6c47bd110 2024-03-20T13:35:16.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.296+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'27 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.296+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47b8470 2024-03-20T13:35:16.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.297+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'24 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.297+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47bd110 2024-03-20T13:35:16.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.298+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.298+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47bd110 2024-03-20T13:35:16.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.299+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.299+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47bd110 2024-03-20T13:35:16.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.299+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'10 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.299+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47bd110 2024-03-20T13:35:16.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.300+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.300+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.302+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.302+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47bd110 2024-03-20T13:35:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.303+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'14 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.303+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.304+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'22 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.304+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47bd110 2024-03-20T13:35:16.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.306+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'28 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.306+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.308+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'28 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.308+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47ce4e0 con 0x55b6c47b8470 2024-03-20T13:35:16.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'20 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9a50fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9b9fc10800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9b9fc10800 20 Filter name: none 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f99ca7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9b9fc10800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9b9fc10800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.309+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c4800520 con 0x7f9b8c0ae040 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9fc10800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9fc10800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9fc10800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9fc10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c4802a00 con 0x7f9b8c0ae040 2024-03-20T13:35:16.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.310+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f9b9400a4a0 con 0x7f9b8c0ae040 2024-03-20T13:35:16.313 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-03-20T13:35:16.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.311+0000 7f9a51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.311+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94243468895216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47d4f20 con 0x55b6c47b3ba0 2024-03-20T13:35:16.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.312+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94243468895216] v30'116 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.312+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94243468873472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c63f0 con 0x55b6c47b8470 2024-03-20T13:35:16.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.313+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94243468873472] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.313+0000 7f9b9fc10800 20 remove_watcher() i=0 2024-03-20T13:35:16.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.313+0000 7f9b9fc10800 2 removed watcher, disabling cache 2024-03-20T13:35:16.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.313+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94243468878896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c0f00 con 0x55b6c47b3ba0 2024-03-20T13:35:16.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.314+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94243468878896] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.314+0000 7f9b9fc10800 20 remove_watcher() i=1 2024-03-20T13:35:16.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.314+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94243468882576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c0f00 con 0x55b6c47bd110 2024-03-20T13:35:16.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.315+0000 7f9b9abbd640 1 -- 172.21.15.177:0/1351487681 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94243468882576] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b90006070 con 0x55b6c47bd110 2024-03-20T13:35:16.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.316+0000 7f9b9fc10800 20 remove_watcher() i=2 2024-03-20T13:35:16.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.316+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94243468888080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c3290 con 0x55b6c47b8470 2024-03-20T13:35:16.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.316+0000 7f9b9b3be640 1 -- 172.21.15.177:0/1351487681 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94243468888080] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b8c089070 con 0x55b6c47b8470 2024-03-20T13:35:16.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.316+0000 7f9b9fc10800 20 remove_watcher() i=3 2024-03-20T13:35:16.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.316+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94243468889136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c0f00 con 0x55b6c47b3ba0 2024-03-20T13:35:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.318+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94243468889136] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9400a4a0 con 0x55b6c47b3ba0 2024-03-20T13:35:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.318+0000 7f9b9fc10800 20 remove_watcher() i=4 2024-03-20T13:35:16.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.318+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94243468894160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c0f00 con 0x7f9b8c0ae040 2024-03-20T13:35:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.319+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94243468894160] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9404c040 con 0x7f9b8c0ae040 2024-03-20T13:35:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.320+0000 7f9b9fc10800 20 remove_watcher() i=5 2024-03-20T13:35:16.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.320+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94243468881024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c0f00 con 0x7f9b8c0ae040 2024-03-20T13:35:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.321+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94243468881024] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9404c040 con 0x7f9b8c0ae040 2024-03-20T13:35:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.321+0000 7f9b9fc10800 20 remove_watcher() i=6 2024-03-20T13:35:16.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.321+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94243468900144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b6c47c2c80 con 0x7f9b8c0ae040 2024-03-20T13:35:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.322+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94243468900144] v30'119 uv117 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9b9404c040 con 0x7f9b8c0ae040 2024-03-20T13:35:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.322+0000 7f9b9fc10800 20 remove_watcher() i=7 2024-03-20T13:35:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.322+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9b8c0ae040 msgr2=0x7f9b8c069880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.322+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9b8c0ae040 0x7f9b8c069880 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.322+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c47b3ba0 msgr2=0x55b6c47b6060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.322+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c47b3ba0 0x55b6c47b6060 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c47b8470 msgr2=0x55b6c47ba860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c47b8470 0x55b6c47ba860 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6c47bd110 msgr2=0x55b6c47bf5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b6c47bd110 0x55b6c47bf5d0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a64036790 msgr2=0x7f9a64038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a64036790 0x7f9a64038c50 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x55b6c4786590 tx=0x7f9b90010000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 msgr2=0x55b6c47a83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/1351487681 reap_dead start 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a83d0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0779e0 tx=0x7f9b8c063f20 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 shutdown_connections 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1351487681 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47a1480 0x55b6c47a83d0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 >> 172.21.15.177:0/1351487681 conn(0x55b6c479d7e0 msgr2=0x55b6c479ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 shutdown_connections 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1351487681 wait complete. 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a74036790 msgr2=0x7f9a74038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a74036790 0x7f9a74038c50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x55b6c477e130 tx=0x7f9b9000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 msgr2=0x55b6c47947f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 0x55b6c47947f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c08c1d0 tx=0x7f9b8c079d70 comp rx=0 tx=0).stop 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 shutdown_connections 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a74036790 0x7f9a74038c50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/1115708992 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c47943d0 0x55b6c47947f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 >> 172.21.15.177:0/1115708992 conn(0x55b6c4788470 msgr2=0x55b6c4788870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 shutdown_connections 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/1115708992 wait complete. 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b6c4783650 msgr2=0x55b6c4785a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b6c4783650 0x55b6c4785a40 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c467bd60 msgr2=0x55b6c477cf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b6c467bd60 0x55b6c477cf20 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c477f770 msgr2=0x55b6c4781b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.323+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b6c477f770 0x55b6c4781b60 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 msgr2=0x7f9a80038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9b90001d90 tx=0x7f9b900012f0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 msgr2=0x55b6c47761f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 --2- 172.21.15.177:0/3177834919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b6c467b400 0x55b6c47761f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c00a470 tx=0x7f9b8c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9bbbf640 1 -- 172.21.15.177:0/3177834919 reap_dead start 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 shutdown_connections 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 >> 172.21.15.177:0/3177834919 conn(0x55b6c4677040 msgr2=0x55b6c4768e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 shutdown_connections 2024-03-20T13:35:16.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.324+0000 7f9b9fc10800 1 -- 172.21.15.177:0/3177834919 wait complete. 2024-03-20T13:35:16.333 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:35:16.333 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-03-20T13:35:16.333 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-03-20T13:35:16.334 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-03-20T13:35:16.420 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:16.420 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:16.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.419+0000 7fdf7d933800 1 Processor -- start 2024-03-20T13:35:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.419+0000 7fdf7d933800 1 -- start start 2024-03-20T13:35:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.419+0000 7fdf7d933800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b54ec699e0 0x55b54ec69e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.419+0000 7fdf7d933800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b54ebb5cd0 con 0x55b54ec6ac40 2024-03-20T13:35:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.419+0000 7fdf7d933800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b54eb6c500 con 0x55b54ec699e0 2024-03-20T13:35:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.420+0000 7fdf796f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b54ec699e0 0x55b54ec69e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.420+0000 7fdf796f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b54ec699e0 0x55b54ec69e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41044/0 (socket says 172.21.15.177:41044) 2024-03-20T13:35:16.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.420+0000 7fdf796f9640 1 -- 172.21.15.177:0/2430031464 learned_addr learned my addr 172.21.15.177:0/2430031464 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.420+0000 7fdf796f9640 1 -- 172.21.15.177:0/2430031464 >> v1:172.21.15.28:6789/0 conn(0x55b54ec6ac40 legacy=0x55b54ec6b0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:35:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.420+0000 7fdf796f9640 1 -- 172.21.15.177:0/2430031464 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54ec6a4d0 con 0x55b54ec699e0 2024-03-20T13:35:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.422+0000 7fdf796f9640 1 --2- 172.21.15.177:0/2430031464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ec69e00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00a520 tx=0x7fdf6c01ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a8dd2043f949ba server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.422+0000 7fdf78ef8640 1 -- 172.21.15.177:0/2430031464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c052570 con 0x55b54ec699e0 2024-03-20T13:35:16.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.422+0000 7fdf78ef8640 1 -- 172.21.15.177:0/2430031464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0526d0 con 0x55b54ec699e0 2024-03-20T13:35:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.422+0000 7fdf78ef8640 1 -- 172.21.15.177:0/2430031464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c052990 con 0x55b54ec699e0 2024-03-20T13:35:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 -- 172.21.15.177:0/2430031464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 msgr2=0x55b54ec69e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 --2- 172.21.15.177:0/2430031464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ec69e00 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00a520 tx=0x7fdf6c01ce40 comp rx=0 tx=0).stop 2024-03-20T13:35:16.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 -- 172.21.15.177:0/2430031464 shutdown_connections 2024-03-20T13:35:16.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 --2- 172.21.15.177:0/2430031464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ec69e00 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 -- 172.21.15.177:0/2430031464 >> 172.21.15.177:0/2430031464 conn(0x55b54ec65040 msgr2=0x55b54ec67460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 -- 172.21.15.177:0/2430031464 shutdown_connections 2024-03-20T13:35:16.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.423+0000 7fdf7d933800 1 -- 172.21.15.177:0/2430031464 wait complete. 2024-03-20T13:35:16.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf7d933800 1 Processor -- start 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf7d933800 1 -- start start 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf7d933800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed59ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf7d933800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54eb69a30 con 0x55b54ec699e0 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed59ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed59ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41056/0 (socket says 172.21.15.177:41056) 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf796f9640 1 -- 172.21.15.177:0/3160821078 learned_addr learned my addr 172.21.15.177:0/3160821078 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.435+0000 7fdf796f9640 1 -- 172.21.15.177:0/3160821078 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c005de0 con 0x55b54ec699e0 2024-03-20T13:35:16.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.436+0000 7fdf796f9640 1 --2- 172.21.15.177:0/3160821078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed59ee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c055040 tx=0x7fdf6c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f197e624915310 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.436+0000 7fde67606640 1 -- 172.21.15.177:0/3160821078 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c052840 con 0x55b54ec699e0 2024-03-20T13:35:16.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.436+0000 7fde67606640 1 -- 172.21.15.177:0/3160821078 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0529c0 con 0x55b54ec699e0 2024-03-20T13:35:16.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.436+0000 7fde67606640 1 -- 172.21.15.177:0/3160821078 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c052ca0 con 0x55b54ec699e0 2024-03-20T13:35:16.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.436+0000 7fdf7d933800 1 -- 172.21.15.177:0/3160821078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 msgr2=0x55b54ed59ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.436+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3160821078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed59ee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c055040 tx=0x7fdf6c04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 -- 172.21.15.177:0/3160821078 shutdown_connections 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3160821078 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed59ee0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 -- 172.21.15.177:0/3160821078 >> 172.21.15.177:0/3160821078 conn(0x55b54ec65040 msgr2=0x55b54ed556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 -- 172.21.15.177:0/3160821078 shutdown_connections 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 -- 172.21.15.177:0/3160821078 wait complete. 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 Processor -- start 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 -- start start 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed650c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf7d933800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54eb65210 con 0x55b54ec699e0 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed650c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed650c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41060/0 (socket says 172.21.15.177:41060) 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.437+0000 7fdf796f9640 1 -- 172.21.15.177:0/1038547200 learned_addr learned my addr 172.21.15.177:0/1038547200 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fdf796f9640 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c04e070 con 0x55b54ec699e0 2024-03-20T13:35:16.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fdf796f9640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed650c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c01ce10 tx=0x7fdf6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fde65e03640 1 -- 172.21.15.177:0/1038547200 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c06c070 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fde65e03640 1 -- 172.21.15.177:0/1038547200 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c05d480 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b54ebddd60 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fde65e03640 1 -- 172.21.15.177:0/1038547200 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c05d760 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.438+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b54ed65680 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fde65e03640 1 -- 172.21.15.177:0/1038547200 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdf6c059040 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fde65e03640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde60036790 0x7fde60038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fde65e03640 1 -- 172.21.15.177:0/1038547200 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdf6c08d580 con 0x55b54ec699e0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde60036790 0x7fde60038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54ec6ac40 0x55b54ed690a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54ed696c0 con 0x55b54ec6ac40 2024-03-20T13:35:16.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.439+0000 7fdf79efa640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54ec6ac40 0x55b54ed690a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde60036790 0x7fde60038c50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400a430 tx=0x7fdf64005540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf79efa640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54ec6ac40 0x55b54ed690a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf79efa640 1 -- 172.21.15.177:0/1038547200 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54ec6ac40 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54ed667b0 con 0x55b54ec6ac40 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf79efa640 1 -- 172.21.15.177:0/1038547200 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54ec6ac40 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54ed6b950 0x55b54ed6dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54ed6e3e0 con 0x55b54ed6b950 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.440+0000 7fdf796f9640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54ed6b950 0x55b54ed6dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.441+0000 7fdf796f9640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54ed6b950 0x55b54ed6dd40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.441+0000 7fdf796f9640 1 -- 172.21.15.177:0/1038547200 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fdf6c05dc90 con 0x55b54ed6b950 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.441+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54ed6a8d0 con 0x55b54ec6ac40 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.441+0000 7fdf79efa640 1 -- 172.21.15.177:0/1038547200 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54ec6ac40 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.441+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b54ed6f800 0x55b54ed71bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.441+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54ed72350 con 0x55b54ed6f800 2024-03-20T13:35:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.442+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b54ed6f800 0x55b54ed71bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.442+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b54ed6f800 0x55b54ed71bf0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf70ef8640 1 -- 172.21.15.177:0/1038547200 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fdf64010040 con 0x55b54ed6f800 2024-03-20T13:35:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf7d933800 1 Processor -- start 2024-03-20T13:35:16.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf7d933800 1 -- start start 2024-03-20T13:35:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf7d933800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 0x55b54ed808c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf7d933800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54eb07c70 con 0x55b54ed804a0 2024-03-20T13:35:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 0x55b54ed808c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 0x55b54ed808c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41070/0 (socket says 172.21.15.177:41070) 2024-03-20T13:35:16.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.443+0000 7fdf796f9640 1 -- 172.21.15.177:0/2393792284 learned_addr learned my addr 172.21.15.177:0/2393792284 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fdf796f9640 1 -- 172.21.15.177:0/2393792284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54ed80e00 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fdf796f9640 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 0x55b54ed808c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c05da80 tx=0x7fdf6c054370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fde5effd640 1 -- 172.21.15.177:0/2393792284 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c08d3b0 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fde5effd640 1 -- 172.21.15.177:0/2393792284 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c08b3e0 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b54ed81870 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fde5effd640 1 -- 172.21.15.177:0/2393792284 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c08b6c0 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.444+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b54ed81d30 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fde5effd640 1 -- 172.21.15.177:0/2393792284 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdf6c08d860 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fde5effd640 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde50036790 0x7fde50038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fde5effd640 1 -- 172.21.15.177:0/2393792284 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdf6c098c80 con 0x55b54ed804a0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde50036790 0x7fde50038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fdf7d933800 1 Processor -- start 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fdf7d933800 1 -- start start 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde50036790 0x7fde50038c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55b54ed66710 tx=0x7fdf6400e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fdf7d933800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed8d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.445+0000 7fdf7d933800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54eadd5d0 con 0x55b54ed8d590 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.446+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed8d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.446+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed8d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41084/0 (socket says 172.21.15.177:41084) 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.446+0000 7fdf796f9640 1 -- 172.21.15.177:0/3620066121 learned_addr learned my addr 172.21.15.177:0/3620066121 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.446+0000 7fdf796f9640 1 -- 172.21.15.177:0/3620066121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54ed8df80 con 0x55b54ed8d590 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.447+0000 7fdf796f9640 1 --2- 172.21.15.177:0/3620066121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed8d9b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0849a0 tx=0x7fdf6c077de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb090885b020c33 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.447+0000 7fde5cff9640 1 -- 172.21.15.177:0/3620066121 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c084420 con 0x55b54ed8d590 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.447+0000 7fde5cff9640 1 -- 172.21.15.177:0/3620066121 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c09f070 con 0x55b54ed8d590 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.447+0000 7fde5cff9640 1 -- 172.21.15.177:0/3620066121 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c088d80 con 0x55b54ed8d590 2024-03-20T13:35:16.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- 172.21.15.177:0/3620066121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 msgr2=0x55b54ed8d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3620066121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed8d9b0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0849a0 tx=0x7fdf6c077de0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- 172.21.15.177:0/3620066121 shutdown_connections 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3620066121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed8d9b0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- 172.21.15.177:0/3620066121 >> 172.21.15.177:0/3620066121 conn(0x55b54ed898b0 msgr2=0x55b54ed87910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- 172.21.15.177:0/3620066121 shutdown_connections 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- 172.21.15.177:0/3620066121 wait complete. 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 Processor -- start 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- start start 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed62950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.448+0000 7fdf7d933800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b54ed62e90 con 0x55b54ed8d590 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.449+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed62950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.449+0000 7fdf796f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed62950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41098/0 (socket says 172.21.15.177:41098) 2024-03-20T13:35:16.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.449+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 learned_addr learned my addr 172.21.15.177:0/3132562694 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.451+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b54ed81870 con 0x55b54ed8d590 2024-03-20T13:35:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.451+0000 7fdf796f9640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed62950 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0849a0 tx=0x7fdf6c076ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.452+0000 7fde4effd640 1 -- 172.21.15.177:0/3132562694 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c078770 con 0x55b54ed8d590 2024-03-20T13:35:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.452+0000 7fde4effd640 1 -- 172.21.15.177:0/3132562694 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c0788d0 con 0x55b54ed8d590 2024-03-20T13:35:16.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.452+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b54ed81870 con 0x55b54ed8d590 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.452+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b54ed61250 con 0x55b54ed8d590 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.452+0000 7fde4effd640 1 -- 172.21.15.177:0/3132562694 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdf6c0754e0 con 0x55b54ed8d590 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.453+0000 7fde4effd640 1 -- 172.21.15.177:0/3132562694 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdf6c0aa040 con 0x55b54ed8d590 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.453+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.453+0000 7fde4effd640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde44036830 0x7fde44038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fde4effd640 1 -- 172.21.15.177:0/3132562694 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fdf6c0c19a0 con 0x55b54ed8d590 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde44036830 0x7fde44038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54eda1e70 0x55b54eda4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda4a80 con 0x55b54eda1e70 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf79efa640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54eda1e70 0x55b54eda4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde44036830 0x7fde44038cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf64011fd0 tx=0x7fdf64002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf79efa640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54eda1e70 0x55b54eda4330 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf7d933800 20 realm 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.454+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda4e50 con 0x55b54eda1e70 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda5a00 con 0x55b54eda1e70 2024-03-20T13:35:16.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54eda63b0 0x55b54eda87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf796f9640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54eda63b0 0x55b54eda87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda8df0 con 0x55b54eda63b0 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.455+0000 7fdf796f9640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54eda63b0 0x55b54eda87a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf7d933800 20 searching for the correct realm 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b54edab0a0 0x55b54edad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edadc30 con 0x55b54edab0a0 2024-03-20T13:35:16.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b54edab0a0 0x55b54edad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf70ef8640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b54edab0a0 0x55b54edad560 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.456+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edadc30 con 0x55b54eda63b0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.457+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.457+0000 7fdf796f9640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fdf6c097060 0x7fdf6c053020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.457+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edadc30 con 0x7fdf6c097060 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.457+0000 7fdf79efa640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fdf6c097060 0x7fdf6c053020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.459+0000 7fdf79efa640 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fdf6c097060 0x7fdf6c053020 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.460+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.460+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.460+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.460+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.460+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.460+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.461+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.461+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.461+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.461+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda63b0 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.461+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.461+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.462+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda63b0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.463+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.464+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda63b0 2024-03-20T13:35:16.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.465+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.466+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.466+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54edab0a0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.466+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.466+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x7fdf6c097060 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.467+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.467+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdf74031040 con 0x55b54eda63b0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.468+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.468+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdf74031040 con 0x55b54edab0a0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.468+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.468+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdf74031040 con 0x7fdf6c097060 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.469+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.469+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdf74031040 con 0x55b54eda1e70 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.469+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fdf74031040 con 0x55b54eda63b0 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:16.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda56a0 con 0x55b54eda1e70 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda94a0 con 0x55b54eda1e70 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.470+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda9470 con 0x7fdf6c097060 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:16.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 20 zone default found 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 4 Realm: () 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 20 zonegroup default 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.471+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda9d70 con 0x7fdf6c097060 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54eda9d70 con 0x55b54edab0a0 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edafa50 con 0x55b54edab0a0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.472+0000 7fdf7d933800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.473+0000 7fdf7d933800 20 started sync module instance, tier type = 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.473+0000 7fdf7d933800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.473+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edaf330 con 0x55b54eda63b0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.473+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.474+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94237200412304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edaf6e0 con 0x55b54eda63b0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.474+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb0860 con 0x55b54eda1e70 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.475+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94237200412304] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.475+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.475+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94237200417728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb0c80 con 0x55b54eda1e70 2024-03-20T13:35:16.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.475+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb15f0 con 0x55b54edab0a0 2024-03-20T13:35:16.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.476+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94237200417728] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.477+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.477+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94237200418784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb0c00 con 0x55b54edab0a0 2024-03-20T13:35:16.484 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.477+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb2480 con 0x55b54eda63b0 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.478+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.478+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94237200426976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb30a0 con 0x55b54eda63b0 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.478+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb3a50 con 0x55b54eda1e70 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.478+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94237200418784] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.479+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94237200426976] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.479+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.479+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94237200428032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb3570 con 0x55b54eda1e70 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.479+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb4410 con 0x7fdf6c097060 2024-03-20T13:35:16.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.480+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.480+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94237200433008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb4830 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.480+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb5220 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.480+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94237200428032] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.481+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94237200433008] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.481+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.481+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94237200436480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb4390 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.481+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb5a70 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94237200436480] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'120 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94237200423376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb4390 con 0x7fdf6c097060 2024-03-20T13:35:16.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=0 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=1 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=2 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=3 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=4 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=5 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.482+0000 7fdf7d933800 20 add_watcher() i=6 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.483+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94237200423376] v30'121 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.483+0000 7fdf7d933800 20 add_watcher() i=7 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.483+0000 7fdf7d933800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.483+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb8ab0 con 0x55b54eda1e70 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.484+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.484+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94237200438624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb5f50 con 0x55b54eda1e70 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94237200438624] v30'117 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fde2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 5 note: GC not initialized 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fde2e7e4640 20 reqs_thread_entry: start 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 20 Filter name: none 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdd9ffff640 20 reqs_thread_entry: start 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.485+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edeaa70 con 0x7fdf6c097060 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:35:16.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.486+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edec5d0 con 0x55b54eda63b0 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edee130 con 0x55b54eda1e70 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(64 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv4 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-03-20T13:35:16.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.487+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edf1620 con 0x7fdf6c097060 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(65 fud.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edf0630 con 0x55b54eda63b0 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) v8 ==== 233+0+288 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.489+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edf5010 con 0x55b54eda63b0 2024-03-20T13:35:16.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.490+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v30'21 uv21 ondisk = 0) v8 ==== 317+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.490+0000 7fdf7d933800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.490+0000 7fdf7d933800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.490+0000 7fdf7d933800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.490+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94237200681712 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edf2620 con 0x7fdf6c097060 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== watch-notify(notify (1) cookie 94237200436480 notify 128849018893 ret 0) v3 ==== 380+0+0 (crc 0 0 0) 0x7fdf7403d040 con 0x7fdf6c097060 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fde5cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94237200436480 notifier 4503 bl.length()=338 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fde5cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fde5cff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fde5cff9640 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fde3c003e90 con 0x7fdf6c097060 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(68 notify.6 [notify cookie 94237200681712 out=8b] v0'0 uv120 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.498 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== watch-notify(notify_complete (2) cookie 94237200681712 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fdf74005040 con 0x7fdf6c097060 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.491+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.492+0000 7fde2f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.492+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94237200438624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb85a0 con 0x55b54eda1e70 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.493+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94237200438624] v30'118 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.493+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94237200412304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb8100 con 0x55b54eda63b0 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.494+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94237200412304] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.494+0000 7fdf7d933800 20 remove_watcher() i=0 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.494+0000 7fdf7d933800 2 removed watcher, disabling cache 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.494+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94237200417728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edaee90 con 0x55b54eda1e70 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.495+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94237200417728] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.495+0000 7fdf7d933800 20 remove_watcher() i=1 2024-03-20T13:35:16.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.495+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94237200418784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edaee90 con 0x55b54edab0a0 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.497+0000 7fdf70ef8640 1 -- 172.21.15.177:0/3132562694 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94237200418784] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf64010040 con 0x55b54edab0a0 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.497+0000 7fdf7d933800 20 remove_watcher() i=2 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.497+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94237200426976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edee5c0 con 0x55b54eda63b0 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.498+0000 7fdf796f9640 1 -- 172.21.15.177:0/3132562694 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94237200426976] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf6c0b8020 con 0x55b54eda63b0 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.498+0000 7fdf7d933800 20 remove_watcher() i=3 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.498+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94237200428032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb27e0 con 0x55b54eda1e70 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.499+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94237200428032] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x55b54eda1e70 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.499+0000 7fdf7d933800 20 remove_watcher() i=4 2024-03-20T13:35:16.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.499+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94237200433008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edee5c0 con 0x7fdf6c097060 2024-03-20T13:35:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.500+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94237200433008] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.500+0000 7fdf7d933800 20 remove_watcher() i=5 2024-03-20T13:35:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.500+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94237200436480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb3f70 con 0x7fdf6c097060 2024-03-20T13:35:16.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.501+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94237200436480] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.503 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.501+0000 7fdf7d933800 20 remove_watcher() i=6 2024-03-20T13:35:16.503 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.501+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94237200423376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b54edb3f70 con 0x7fdf6c097060 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.502+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94237200423376] v30'122 uv120 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fdf7400a4a0 con 0x7fdf6c097060 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.502+0000 7fdf7d933800 20 remove_watcher() i=7 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fdf6c097060 msgr2=0x7fdf6c053020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fdf6c097060 0x7fdf6c053020 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54eda1e70 msgr2=0x55b54eda4330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54eda1e70 0x55b54eda4330 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54eda63b0 msgr2=0x55b54eda87a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54eda63b0 0x55b54eda87a0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b54edab0a0 msgr2=0x55b54edad560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b54edab0a0 0x55b54edad560 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde44036830 msgr2=0x7fde44038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde44036830 0x7fde44038cf0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdf64011fd0 tx=0x7fdf64002000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 msgr2=0x55b54ed62950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed62950 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c0849a0 tx=0x7fdf6c076ec0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf79efa640 1 -- 172.21.15.177:0/3132562694 reap_dead start 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 shutdown_connections 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/3132562694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed8d590 0x55b54ed62950 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 >> 172.21.15.177:0/3132562694 conn(0x55b54ed898b0 msgr2=0x55b54ed86f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 shutdown_connections 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/3132562694 wait complete. 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde50036790 msgr2=0x7fde50038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde50036790 0x7fde50038c50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55b54ed66710 tx=0x7fdf6400e000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 msgr2=0x55b54ed808c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 0x55b54ed808c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c05da80 tx=0x7fdf6c054370 comp rx=0 tx=0).stop 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 shutdown_connections 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde50036790 0x7fde50038c50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 --2- 172.21.15.177:0/2393792284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ed804a0 0x55b54ed808c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 >> 172.21.15.177:0/2393792284 conn(0x55b54ed74540 msgr2=0x55b54ed74940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 shutdown_connections 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.503+0000 7fdf7d933800 1 -- 172.21.15.177:0/2393792284 wait complete. 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b54ed6f800 msgr2=0x55b54ed71bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b54ed6f800 0x55b54ed71bf0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54ec6ac40 msgr2=0x55b54ed690a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b54ec6ac40 0x55b54ed690a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54ed6b950 msgr2=0x55b54ed6dd40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b54ed6b950 0x55b54ed6dd40 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde60036790 msgr2=0x7fde60038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fde60036790 0x7fde60038c50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdf6400a430 tx=0x7fdf64005540 comp rx=0 tx=0).stop 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 msgr2=0x55b54ed650c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 --2- 172.21.15.177:0/1038547200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b54ec699e0 0x55b54ed650c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c01ce10 tx=0x7fdf6c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf79efa640 1 -- 172.21.15.177:0/1038547200 reap_dead start 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 shutdown_connections 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 >> 172.21.15.177:0/1038547200 conn(0x55b54ec65040 msgr2=0x55b54ed53ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 shutdown_connections 2024-03-20T13:35:16.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.504+0000 7fdf7d933800 1 -- 172.21.15.177:0/1038547200 wait complete. 2024-03-20T13:35:16.514 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1'] 2024-03-20T13:35:16.514 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1'] 2024-03-20T13:35:16.514 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:16.600 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:16.601 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.600+0000 7ff7d9411800 1 Processor -- start 2024-03-20T13:35:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.600+0000 7ff7d9411800 1 -- start start 2024-03-20T13:35:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.600+0000 7ff7d9411800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c8ef4d0420 0x55c8ef4d0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.600+0000 7ff7d9411800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c8ef41cd70 con 0x55c8ef4d0d80 2024-03-20T13:35:16.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.600+0000 7ff7d9411800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c8ef3d3500 con 0x55c8ef4d0420 2024-03-20T13:35:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.601+0000 7ff7d4b09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c8ef4d0420 0x55c8ef4d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.601+0000 7ff7d4308640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55c8ef4d0d80 0x55c8ef4d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50578/0 (socket says 172.21.15.177:50578) 2024-03-20T13:35:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.601+0000 7ff7d4b09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c8ef4d0420 0x55c8ef4d0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41112/0 (socket says 172.21.15.177:41112) 2024-03-20T13:35:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.601+0000 7ff7d4308640 1 -- 172.21.15.177:0/2561090641 learned_addr learned my addr 172.21.15.177:0/2561090641 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.601+0000 7ff7d4b09640 1 -- 172.21.15.177:0/2561090641 >> v1:172.21.15.28:6789/0 conn(0x55c8ef4d0d80 legacy=0x55c8ef4d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.601+0000 7ff7d4b09640 1 -- 172.21.15.177:0/2561090641 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ef4450b0 con 0x55c8ef4d0420 2024-03-20T13:35:16.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.603+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/2561090641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef4d0840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400a470 tx=0x7ff7c401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9da9d2b17c2d34 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.603+0000 7ff7d3b07640 1 -- 172.21.15.177:0/2561090641 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c4052570 con 0x55c8ef4d0420 2024-03-20T13:35:16.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.603+0000 7ff7d3b07640 1 -- 172.21.15.177:0/2561090641 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40526d0 con 0x55c8ef4d0420 2024-03-20T13:35:16.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.603+0000 7ff7d3b07640 1 -- 172.21.15.177:0/2561090641 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c4052990 con 0x55c8ef4d0420 2024-03-20T13:35:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.603+0000 7ff7d9411800 1 -- 172.21.15.177:0/2561090641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 msgr2=0x55c8ef4d0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.603+0000 7ff7d9411800 1 --2- 172.21.15.177:0/2561090641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef4d0840 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff7c400a470 tx=0x7ff7c401cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.604+0000 7ff7d9411800 1 -- 172.21.15.177:0/2561090641 shutdown_connections 2024-03-20T13:35:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.604+0000 7ff7d9411800 1 --2- 172.21.15.177:0/2561090641 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef4d0840 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.604+0000 7ff7d9411800 1 -- 172.21.15.177:0/2561090641 >> 172.21.15.177:0/2561090641 conn(0x55c8ef4cc060 msgr2=0x55c8ef4ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.604+0000 7ff7d9411800 1 -- 172.21.15.177:0/2561090641 shutdown_connections 2024-03-20T13:35:16.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.604+0000 7ff7d9411800 1 -- 172.21.15.177:0/2561090641 wait complete. 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.615+0000 7ff7d9411800 1 Processor -- start 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.615+0000 7ff7d9411800 1 -- start start 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.615+0000 7ff7d9411800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5c3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.615+0000 7ff7d9411800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ef3d0a30 con 0x55c8ef4d0420 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.616+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5c3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.616+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5c3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41118/0 (socket says 172.21.15.177:41118) 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.616+0000 7ff7d4b09640 1 -- 172.21.15.177:0/2081834953 learned_addr learned my addr 172.21.15.177:0/2081834953 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.616+0000 7ff7d4b09640 1 -- 172.21.15.177:0/2081834953 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4005d20 con 0x55c8ef4d0420 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.616+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/2081834953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5c3cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4055040 tx=0x7ff7c404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38431932994add1b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff6c2e0d640 1 -- 172.21.15.177:0/2081834953 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c400a180 con 0x55c8ef4d0420 2024-03-20T13:35:16.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff6c2e0d640 1 -- 172.21.15.177:0/2081834953 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c400a300 con 0x55c8ef4d0420 2024-03-20T13:35:16.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff6c2e0d640 1 -- 172.21.15.177:0/2081834953 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c40529b0 con 0x55c8ef4d0420 2024-03-20T13:35:16.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 -- 172.21.15.177:0/2081834953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 msgr2=0x55c8ef5c3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 --2- 172.21.15.177:0/2081834953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5c3cc0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4055040 tx=0x7ff7c404c000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 -- 172.21.15.177:0/2081834953 shutdown_connections 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 --2- 172.21.15.177:0/2081834953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5c3cc0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 -- 172.21.15.177:0/2081834953 >> 172.21.15.177:0/2081834953 conn(0x55c8ef4cc060 msgr2=0x55c8ef5bf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 -- 172.21.15.177:0/2081834953 shutdown_connections 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.617+0000 7ff7d9411800 1 -- 172.21.15.177:0/2081834953 wait complete. 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d9411800 1 Processor -- start 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d9411800 1 -- start start 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d9411800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5cb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d9411800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ef3cc210 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41122/0 (socket says 172.21.15.177:41122) 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d4b09640 1 -- 172.21.15.177:0/1803826876 learned_addr learned my addr 172.21.15.177:0/1803826876 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.618+0000 7ff7d4b09640 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ef4450b0 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.619+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5cb310 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7c405f040 tx=0x7ff7c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.619+0000 7ff6c160a640 1 -- 172.21.15.177:0/1803826876 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c406a070 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.619+0000 7ff6c160a640 1 -- 172.21.15.177:0/1803826876 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c405d420 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.619+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8ef5cb850 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.619+0000 7ff6c160a640 1 -- 172.21.15.177:0/1803826876 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c405d6c0 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.619+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8ef5cbd30 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff6c160a640 1 -- 172.21.15.177:0/1803826876 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff7c405d820 con 0x55c8ef4d0420 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff6c160a640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6bc036790 0x7ff6bc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff6c160a640 1 -- 172.21.15.177:0/1803826876 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff7c408dbb0 con 0x55c8ef4d0420 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff7d4308640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6bc036790 0x7ff6bc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef4d0d80 0x55c8ef5d1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef5d25b0 con 0x55c8ef4d0d80 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff7d530a640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef4d0d80 0x55c8ef5d1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.620+0000 7ff7d4308640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6bc036790 0x7ff6bc038c50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f60 tx=0x7ff7c80012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d530a640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef4d0d80 0x55c8ef5d1fe0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d530a640 1 -- 172.21.15.177:0/1803826876 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef4d0d80 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef5cf710 con 0x55c8ef4d0d80 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d530a640 1 -- 172.21.15.177:0/1803826876 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef4d0d80 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef5d4820 0x55c8ef5d6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef5d7300 con 0x55c8ef5d4820 2024-03-20T13:35:16.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef5d4820 0x55c8ef5d6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.621+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef5d4820 0x55c8ef5d6c10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.622+0000 7ff7d4b09640 1 -- 172.21.15.177:0/1803826876 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7ff7c4059040 con 0x55c8ef5d4820 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.622+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef5d37a0 con 0x55c8ef4d0d80 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.622+0000 7ff7d530a640 1 -- 172.21.15.177:0/1803826876 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef4d0d80 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.622+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8ef5d8720 0x55c8ef5dab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.622+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef5db250 con 0x55c8ef5d8720 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.622+0000 7ff7d4308640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8ef5d8720 0x55c8ef5dab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.623+0000 7ff7d4308640 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8ef5d8720 0x55c8ef5dab10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.623+0000 7ff7d4308640 1 -- 172.21.15.177:0/1803826876 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef5d8720 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.623+0000 7ff7d9411800 1 Processor -- start 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.623+0000 7ff7d9411800 1 -- start start 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.623+0000 7ff7d9411800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 0x55c8ef5e9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.623+0000 7ff7d9411800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ef36ec70 con 0x55c8ef5e93e0 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 0x55c8ef5e9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 0x55c8ef5e9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41128/0 (socket says 172.21.15.177:41128) 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d4b09640 1 -- 172.21.15.177:0/671796474 learned_addr learned my addr 172.21.15.177:0/671796474 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d4b09640 1 -- 172.21.15.177:0/671796474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ef5e9d40 con 0x55c8ef5e93e0 2024-03-20T13:35:16.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 0x55c8ef5e9800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff7c408bf70 tx=0x7ff7c4077b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff6ba7fc640 1 -- 172.21.15.177:0/671796474 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c4077920 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff6ba7fc640 1 -- 172.21.15.177:0/671796474 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c408a040 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8ef5ea7b0 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff6ba7fc640 1 -- 172.21.15.177:0/671796474 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c406dac0 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.624+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8ef5eac70 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.625+0000 7ff6ba7fc640 1 -- 172.21.15.177:0/671796474 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff7c406dc20 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.625+0000 7ff6ba7fc640 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6ac036790 0x7ff6ac038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.625+0000 7ff6ba7fc640 1 -- 172.21.15.177:0/671796474 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff7c4097ca0 con 0x55c8ef5e93e0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.625+0000 7ff7d4308640 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6ac036790 0x7ff6ac038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d9411800 1 Processor -- start 2024-03-20T13:35:16.642 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d9411800 1 -- start start 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d4308640 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6ac036790 0x7ff6ac038c50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800bf50 tx=0x7ff7c800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d9411800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5f6940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d9411800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ef3445d0 con 0x55c8ef5f6520 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5f6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5f6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41140/0 (socket says 172.21.15.177:41140) 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d4b09640 1 -- 172.21.15.177:0/1305203535 learned_addr learned my addr 172.21.15.177:0/1305203535 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.626+0000 7ff7d4b09640 1 -- 172.21.15.177:0/1305203535 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ef5f6f10 con 0x55c8ef5f6520 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/1305203535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5f6940 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4052a90 tx=0x7ff7c40096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90e0bb7ae13637 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff6abfff640 1 -- 172.21.15.177:0/1305203535 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c405f790 con 0x55c8ef5f6520 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff6abfff640 1 -- 172.21.15.177:0/1305203535 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c405f8f0 con 0x55c8ef5f6520 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff6abfff640 1 -- 172.21.15.177:0/1305203535 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c4065980 con 0x55c8ef5f6520 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 -- 172.21.15.177:0/1305203535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 msgr2=0x55c8ef5f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1305203535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5f6940 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4052a90 tx=0x7ff7c40096a0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 -- 172.21.15.177:0/1305203535 shutdown_connections 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1305203535 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5f6940 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 -- 172.21.15.177:0/1305203535 >> 172.21.15.177:0/1305203535 conn(0x55c8ef5f27f0 msgr2=0x55c8ef5f0850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 -- 172.21.15.177:0/1305203535 shutdown_connections 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.627+0000 7ff7d9411800 1 -- 172.21.15.177:0/1305203535 wait complete. 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d9411800 1 Processor -- start 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d9411800 1 -- start start 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d9411800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5fd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d9411800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ef5fd7d0 con 0x55c8ef5f6520 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5fd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d4b09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5fd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41148/0 (socket says 172.21.15.177:41148) 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.628+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 learned_addr learned my addr 172.21.15.177:0/557683247 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ef5ea7b0 con 0x55c8ef5f6520 2024-03-20T13:35:16.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5fd290 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7c406df90 tx=0x7ff7c407cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff6aa7fc640 1 -- 172.21.15.177:0/557683247 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c408a1b0 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff6aa7fc640 1 -- 172.21.15.177:0/557683247 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40b8070 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c8ef5ea7b0 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff6aa7fc640 1 -- 172.21.15.177:0/557683247 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff7c408a460 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.629+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c8ef5ea7b0 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.630+0000 7ff6aa7fc640 1 -- 172.21.15.177:0/557683247 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff7c40ba030 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.630+0000 7ff6aa7fc640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6a0036790 0x7ff6a0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.630+0000 7ff6aa7fc640 1 -- 172.21.15.177:0/557683247 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7ff7c40bec70 con 0x55c8ef5f6520 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.630+0000 7ff7d4308640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6a0036790 0x7ff6a0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef6089c0 0x55c8ef60ae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60b5d0 con 0x55c8ef6089c0 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d4308640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6a0036790 0x7ff6a0038c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8001b60 tx=0x7ff7c8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d530a640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef6089c0 0x55c8ef60ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d530a640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef6089c0 0x55c8ef60ae80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 20 realm 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60b9a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.631+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c580 con 0x55c8ef6089c0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef60cf30 0x55c8ef60f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60f8e0 con 0x55c8ef60cf30 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef60cf30 0x55c8ef60f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef60cf30 0x55c8ef60f320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7ff7c4059040 con 0x55c8ef60cf30 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.632+0000 7ff7d9411800 20 searching for the correct realm 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.633+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8ef611bf0 0x55c8ef6140b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.633+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef614780 con 0x55c8ef611bf0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.633+0000 7ff7d4308640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8ef611bf0 0x55c8ef6140b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.633+0000 7ff7d4308640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8ef611bf0 0x55c8ef6140b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.633+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.633+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef614780 con 0x55c8ef60cf30 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.634+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c4059040 con 0x55c8ef60cf30 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.634+0000 7ff7d4b09640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff7c40b4040 0x7ff7c4087540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.634+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef614780 con 0x7ff7c40b4040 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.634+0000 7ff7d530a640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff7c40b4040 0x7ff7c4087540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.634+0000 7ff7d530a640 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff7c40b4040 0x7ff7c4087540 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.634+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.635+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef60cf30 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c4059040 con 0x55c8ef60cf30 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.636+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef60cf30 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.637+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.638+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef60cf30 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.639+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.640+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.640+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.640+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.640+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef611bf0 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.640+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.640+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x7ff7c40b4040 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff7cc031040 con 0x55c8ef60cf30 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff7cc031040 con 0x55c8ef611bf0 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff7c8045040 con 0x7ff7c40b4040 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.641+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff7c8045040 con 0x55c8ef6089c0 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff7c8045040 con 0x55c8ef60cf30 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:16.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60c220 con 0x55c8ef6089c0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60fff0 con 0x55c8ef6089c0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.642+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef60ffa0 con 0x7ff7c40b4040 2024-03-20T13:35:16.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 zone default found 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 4 Realm: () 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 zonegroup default 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef610870 con 0x7ff7c40b4040 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef610870 con 0x55c8ef611bf0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.643+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6165a0 con 0x55c8ef611bf0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.644+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.644+0000 7ff7d9411800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.644+0000 7ff7d9411800 20 started sync module instance, tier type = 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.644+0000 7ff7d9411800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.644+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef615a30 con 0x55c8ef60cf30 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.645+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.645+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94321497955808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef616200 con 0x55c8ef60cf30 2024-03-20T13:35:16.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.645+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6173b0 con 0x55c8ef6089c0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.646+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94321497955808] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.646+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.646+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94321497960208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6177d0 con 0x55c8ef6089c0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.646+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef618140 con 0x55c8ef611bf0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.647+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94321497960208] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.648+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.648+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94321497961264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef617750 con 0x55c8ef611bf0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.648+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef618f50 con 0x55c8ef60cf30 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.648+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.649+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94321497969328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef619b70 con 0x55c8ef60cf30 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.649+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61a520 con 0x55c8ef6089c0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.649+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94321497961264] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.650+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.650+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94321497965728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61a4e0 con 0x55c8ef6089c0 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.650+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61af50 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.650+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94321497969328] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.651+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94321497965728] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.651+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.651+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94321497970384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61a040 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.651+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61b7a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.653+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94321497970384] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.653+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.653+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94321497975408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61a040 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.653+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61bdb0 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'123 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94321497979056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61c210 con 0x7ff7c40b4040 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94321497975408] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=0 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=1 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=2 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=3 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=4 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=5 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.655+0000 7ff7d9411800 20 add_watcher() i=6 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.656+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94321497979056] v30'124 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.656+0000 7ff7d9411800 20 add_watcher() i=7 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.656+0000 7ff7d9411800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.656+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61c210 con 0x55c8ef6089c0 2024-03-20T13:35:16.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.656+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.656+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94321497980272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef61ca90 con 0x55c8ef6089c0 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.657+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94321497980272] v30'119 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.657+0000 7ff68afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 5 note: GC not initialized 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff689fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 20 Filter name: none 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff5fb7fe640 20 reqs_thread_entry: start 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6511b0 con 0x55c8ef6089c0 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.658+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef652d10 con 0x55c8ef60cf30 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef654540 con 0x55c8ef6089c0 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv4 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.659+0000 7ff7d9411800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.660+0000 7ff7d9411800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.660+0000 7ff7d9411800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.660+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef658890 con 0x7ff7c40b4040 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.661+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(65 fud.buckets [call] v30'3 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.661+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef65e690 con 0x55c8ef6089c0 2024-03-20T13:35:16.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'5 uv5 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d9411800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d9411800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d9411800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d9411800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94321498212816 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef658c80 con 0x55c8ef60cf30 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== watch-notify(notify (1) cookie 94321497969328 notify 128849018894 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x7ff7c40a5040 con 0x55c8ef60cf30 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff6abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94321497969328 notifier 4510 bl.length()=725 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff6abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff6abfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff6abfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(67 notify.3 [notify cookie 94321498212816 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff6abfff640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff698003e90 con 0x55c8ef60cf30 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.662+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.663+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== watch-notify(notify_complete (2) cookie 94321498212816 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55c8ef5e9d40 con 0x55c8ef60cf30 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.663+0000 7ff7d9411800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_sources= new_sources= 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.663+0000 7ff7d9411800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential sources added=[] removed=[] 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.663+0000 7ff7d9411800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_dests= new_dests= 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.663+0000 7ff7d9411800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential dests added=[] removed=[] 2024-03-20T13:35:16.677 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.663+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef65cf70 con 0x55c8ef60cf30 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.664+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(69 foo.buckets [call] v30'22 uv22 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.664+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x55c8ef60cf30 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.666+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'23 uv23 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.666+0000 7ff7d9411800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.666+0000 7ff7d9411800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.666+0000 7ff7d9411800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.666+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94321498223312 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x7ff7c40b4040 2024-03-20T13:35:16.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== watch-notify(notify (1) cookie 94321497975408 notify 128849018894 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7ff7cc03d040 con 0x7ff7c40b4040 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff6abfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94321497975408 notifier 4510 bl.length()=314 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff6abfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff6abfff640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [notify cookie 94321498223312 out=8b] v0'0 uv123 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff6abfff640 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7ff6980041f0 con 0x7ff7c40b4040 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.667+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== watch-notify(notify_complete (2) cookie 94321498223312 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7ff7cc018e40 con 0x7ff7c40b4040 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.668+0000 7ff68afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.668+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94321497980272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x55c8ef6089c0 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.669+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94321497980272] v30'120 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.669+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94321497955808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x55c8ef60cf30 2024-03-20T13:35:16.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.670+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94321497955808] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.670+0000 7ff7d9411800 20 remove_watcher() i=0 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.670+0000 7ff7d9411800 2 removed watcher, disabling cache 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.670+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94321497960208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef618f50 con 0x55c8ef6089c0 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.671+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94321497960208] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.671+0000 7ff7d9411800 20 remove_watcher() i=1 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.671+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94321497961264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x55c8ef611bf0 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.672+0000 7ff7d4308640 1 -- 172.21.15.177:0/557683247 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94321497961264] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c8006070 con 0x55c8ef611bf0 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.672+0000 7ff7d9411800 20 remove_watcher() i=2 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.672+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94321497969328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef618f50 con 0x55c8ef60cf30 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.673+0000 7ff7d4b09640 1 -- 172.21.15.177:0/557683247 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94321497969328] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7c40ce040 con 0x55c8ef60cf30 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.673+0000 7ff7d9411800 20 remove_watcher() i=3 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.673+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94321497965728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x55c8ef6089c0 2024-03-20T13:35:16.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.674+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94321497965728] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x55c8ef6089c0 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.674+0000 7ff7d9411800 20 remove_watcher() i=4 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.674+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94321497970384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x7ff7c40b4040 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.676+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94321497970384] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.676+0000 7ff7d9411800 20 remove_watcher() i=5 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.676+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94321497975408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x7ff7c40b4040 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.677+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94321497975408] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.677+0000 7ff7d9411800 20 remove_watcher() i=6 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.677+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94321497979056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55c8ef6549b0 con 0x7ff7c40b4040 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94321497979056] v30'125 uv123 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7ff7cc00a4a0 con 0x7ff7c40b4040 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 20 remove_watcher() i=7 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff7c40b4040 msgr2=0x7ff7c4087540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7ff7c40b4040 0x7ff7c4087540 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef6089c0 msgr2=0x55c8ef60ae80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef6089c0 0x55c8ef60ae80 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef60cf30 msgr2=0x55c8ef60f320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef60cf30 0x55c8ef60f320 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8ef611bf0 msgr2=0x55c8ef6140b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c8ef611bf0 0x55c8ef6140b0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6a0036790 msgr2=0x7ff6a0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6a0036790 0x7ff6a0038c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8001b60 tx=0x7ff7c8010000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 msgr2=0x55c8ef5fd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d530a640 1 -- 172.21.15.177:0/557683247 reap_dead start 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5fd290 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7ff7c406df90 tx=0x7ff7c407cf50 comp rx=0 tx=0).stop 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 shutdown_connections 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/557683247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5f6520 0x55c8ef5fd290 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 >> 172.21.15.177:0/557683247 conn(0x55c8ef5f27f0 msgr2=0x55c8ef5efe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 shutdown_connections 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/557683247 wait complete. 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6ac036790 msgr2=0x7ff6ac038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6ac036790 0x7ff6ac038c50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff7c800bf50 tx=0x7ff7c800f000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 msgr2=0x55c8ef5e9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 0x55c8ef5e9800 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7ff7c408bf70 tx=0x7ff7c4077b00 comp rx=0 tx=0).stop 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 shutdown_connections 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6ac036790 0x7ff6ac038c50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 --2- 172.21.15.177:0/671796474 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef5e93e0 0x55c8ef5e9800 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 >> 172.21.15.177:0/671796474 conn(0x55c8ef5dd480 msgr2=0x55c8ef5dd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 shutdown_connections 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.679+0000 7ff7d9411800 1 -- 172.21.15.177:0/671796474 wait complete. 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8ef5d8720 msgr2=0x55c8ef5dab10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c8ef5d8720 0x55c8ef5dab10 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef4d0d80 msgr2=0x55c8ef5d1fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c8ef4d0d80 0x55c8ef5d1fe0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef5d4820 msgr2=0x55c8ef5d6c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c8ef5d4820 0x55c8ef5d6c10 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6bc036790 msgr2=0x7ff6bc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff6bc036790 0x7ff6bc038c50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8000f60 tx=0x7ff7c80012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 msgr2=0x55c8ef5cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 --2- 172.21.15.177:0/1803826876 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c8ef4d0420 0x55c8ef5cb310 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7ff7c405f040 tx=0x7ff7c4002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d530a640 1 -- 172.21.15.177:0/1803826876 reap_dead start 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 shutdown_connections 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 >> 172.21.15.177:0/1803826876 conn(0x55c8ef4cc060 msgr2=0x55c8ef5bde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 shutdown_connections 2024-03-20T13:35:16.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.680+0000 7ff7d9411800 1 -- 172.21.15.177:0/1803826876 wait complete. 2024-03-20T13:35:16.691 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-03-20T13:35:16.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-03-20T13:35:16.692 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-03-20T13:35:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:16.735 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:16.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d3032f800 1 Processor -- start 2024-03-20T13:35:16.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d3032f800 1 -- start start 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d3032f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b7c431de70 0x55b7c4320260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d3032f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b7c4265cd0 con 0x55b7c43199e0 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d3032f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b7c421c500 con 0x55b7c431de70 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d2b7b2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b7c431de70 0x55b7c4320260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d2b7b2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b7c431de70 0x55b7c4320260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41156/0 (socket says 172.21.15.177:41156) 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1530084255 learned_addr learned my addr 172.21.15.177:0/1530084255 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.734+0000 7f2d2bfb3640 1 --1- 172.21.15.177:0/1530084255 >> v1:172.21.15.28:6789/0 conn(0x55b7c43199e0 0x55b7c4319e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50580/0 (socket says 172.21.15.177:50580) 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.735+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1530084255 >> v1:172.21.15.28:6789/0 conn(0x55b7c43199e0 legacy=0x55b7c4319e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.735+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1530084255 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c4321890 con 0x55b7c431de70 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.736+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/1530084255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c431de70 0x55b7c4320260 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000a520 tx=0x7f2d2001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4d156e903ffb4ba server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d2afb1640 1 -- 172.21.15.177:0/1530084255 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d20052570 con 0x55b7c431de70 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d2afb1640 1 -- 172.21.15.177:0/1530084255 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d200526d0 con 0x55b7c431de70 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d2afb1640 1 -- 172.21.15.177:0/1530084255 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d20052990 con 0x55b7c431de70 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 -- 172.21.15.177:0/1530084255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c431de70 msgr2=0x55b7c4320260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1530084255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c431de70 0x55b7c4320260 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2d2000a520 tx=0x7f2d2001cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 -- 172.21.15.177:0/1530084255 shutdown_connections 2024-03-20T13:35:16.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1530084255 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c431de70 0x55b7c4320260 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 -- 172.21.15.177:0/1530084255 >> 172.21.15.177:0/1530084255 conn(0x55b7c4315040 msgr2=0x55b7c4317460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 -- 172.21.15.177:0/1530084255 shutdown_connections 2024-03-20T13:35:16.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.737+0000 7f2d3032f800 1 -- 172.21.15.177:0/1530084255 wait complete. 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d3032f800 1 Processor -- start 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d3032f800 1 -- start start 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d3032f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c4409970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d3032f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c4219a30 con 0x55b7c43199e0 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c4409970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c4409970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41172/0 (socket says 172.21.15.177:41172) 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.749+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1994516594 learned_addr learned my addr 172.21.15.177:0/1994516594 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.750+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1994516594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d20005de0 con 0x55b7c43199e0 2024-03-20T13:35:16.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.750+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/1994516594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c4409970 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c001d30 tx=0x7f2d1c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bba713823d4a38e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.750+0000 7f2c19e0b640 1 -- 172.21.15.177:0/1994516594 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c014070 con 0x55b7c43199e0 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.750+0000 7f2c19e0b640 1 -- 172.21.15.177:0/1994516594 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c00f450 con 0x55b7c43199e0 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.750+0000 7f2c19e0b640 1 -- 172.21.15.177:0/1994516594 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c00f730 con 0x55b7c43199e0 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- 172.21.15.177:0/1994516594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 msgr2=0x55b7c4409970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1994516594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c4409970 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c001d30 tx=0x7f2d1c00b600 comp rx=0 tx=0).stop 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- 172.21.15.177:0/1994516594 shutdown_connections 2024-03-20T13:35:16.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1994516594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c4409970 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- 172.21.15.177:0/1994516594 >> 172.21.15.177:0/1994516594 conn(0x55b7c4315040 msgr2=0x55b7c4405290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- 172.21.15.177:0/1994516594 shutdown_connections 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- 172.21.15.177:0/1994516594 wait complete. 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 Processor -- start 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- start start 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c428dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.751+0000 7f2d3032f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c4215210 con 0x55b7c43199e0 2024-03-20T13:35:16.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.752+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c428dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.752+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c428dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41178/0 (socket says 172.21.15.177:41178) 2024-03-20T13:35:16.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.752+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/641303995 learned_addr learned my addr 172.21.15.177:0/641303995 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.754+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c4265cd0 con 0x55b7c43199e0 2024-03-20T13:35:16.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.755+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c428dcf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55b7c440a700 tx=0x7f2d1c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.757+0000 7f2c13fff640 1 -- 172.21.15.177:0/641303995 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c014050 con 0x55b7c43199e0 2024-03-20T13:35:16.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.757+0000 7f2c13fff640 1 -- 172.21.15.177:0/641303995 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c01b9b0 con 0x55b7c43199e0 2024-03-20T13:35:16.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.757+0000 7f2c13fff640 1 -- 172.21.15.177:0/641303995 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c01bc90 con 0x55b7c43199e0 2024-03-20T13:35:16.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.757+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7c4414dd0 con 0x55b7c43199e0 2024-03-20T13:35:16.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.757+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7c44152b0 con 0x55b7c43199e0 2024-03-20T13:35:16.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.760+0000 7f2c13fff640 1 -- 172.21.15.177:0/641303995 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2d1c022020 con 0x55b7c43199e0 2024-03-20T13:35:16.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.760+0000 7f2c13fff640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c14036830 0x7f2c14038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.760+0000 7f2c13fff640 1 -- 172.21.15.177:0/641303995 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2d1c008030 con 0x55b7c43199e0 2024-03-20T13:35:16.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.760+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c14036830 0x7f2c14038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.760+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c431de70 0x55b7c4418e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.760+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4419490 con 0x55b7c431de70 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d2c7b4640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c431de70 0x55b7c4418e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c14036830 0x7f2c14038cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d20054000 tx=0x7f2d2004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d2c7b4640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c431de70 0x55b7c4418e40 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/641303995 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c431de70 2024-03-20T13:35:16.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4416410 con 0x55b7c431de70 2024-03-20T13:35:16.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/641303995 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c431de70 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c441b700 0x55b7c441daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.761+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c441e190 con 0x55b7c441b700 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c441b700 0x55b7c441daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c441b700 0x55b7c441daf0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/641303995 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c441b700 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c441a680 con 0x55b7c431de70 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/641303995 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c431de70 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7c441f5b0 0x55b7c44219a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.762+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44220a0 con 0x55b7c441f5b0 2024-03-20T13:35:16.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.763+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7c441f5b0 0x55b7c44219a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.765+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7c441f5b0 0x55b7c44219a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.765+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/641303995 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c441f5b0 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d3032f800 1 Processor -- start 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d3032f800 1 -- start start 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d3032f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 0x55b7c4410df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d3032f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c41b7c70 con 0x55b7c4412980 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 0x55b7c4410df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 0x55b7c4410df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41186/0 (socket says 172.21.15.177:41186) 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/2696651768 learned_addr learned my addr 172.21.15.177:0/2696651768 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.766+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/2696651768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c4411330 con 0x55b7c4412980 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.767+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 0x55b7c4410df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c04a330 tx=0x7f2d1c03fe20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.767+0000 7f2c117fa640 1 -- 172.21.15.177:0/2696651768 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c034070 con 0x55b7c4412980 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.767+0000 7f2c117fa640 1 -- 172.21.15.177:0/2696651768 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c0434e0 con 0x55b7c4412980 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.767+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7c4411580 con 0x55b7c4412980 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.767+0000 7f2c117fa640 1 -- 172.21.15.177:0/2696651768 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c043780 con 0x55b7c4412980 2024-03-20T13:35:16.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.767+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7c4411a40 con 0x55b7c4412980 2024-03-20T13:35:16.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2c117fa640 1 -- 172.21.15.177:0/2696651768 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2d1c0438e0 con 0x55b7c4412980 2024-03-20T13:35:16.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2c117fa640 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c04036790 0x7f2c04038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2c117fa640 1 -- 172.21.15.177:0/2696651768 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2d1c03bc60 con 0x55b7c4412980 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c04036790 0x7f2c04038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d3032f800 1 Processor -- start 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d3032f800 1 -- start start 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c04036790 0x7f2c04038c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55b7c4419cc0 tx=0x7f2d20005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d3032f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c443faf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d3032f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c418d5d0 con 0x55b7c443f6d0 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c443faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c443faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41200/0 (socket says 172.21.15.177:41200) 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.768+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/3213140957 learned_addr learned my addr 172.21.15.177:0/3213140957 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.769+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/3213140957 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c44400c0 con 0x55b7c443f6d0 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.769+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/3213140957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c443faf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c020000 tx=0x7f2d1c0254e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346e1c2b803f2027 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.769+0000 7f2c0affd640 1 -- 172.21.15.177:0/3213140957 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c02d6b0 con 0x55b7c443f6d0 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.769+0000 7f2c0affd640 1 -- 172.21.15.177:0/3213140957 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c03e690 con 0x55b7c443f6d0 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.769+0000 7f2c0affd640 1 -- 172.21.15.177:0/3213140957 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c010c50 con 0x55b7c443f6d0 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.769+0000 7f2d3032f800 1 -- 172.21.15.177:0/3213140957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 msgr2=0x55b7c443faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 --2- 172.21.15.177:0/3213140957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c443faf0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c020000 tx=0x7f2d1c0254e0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 -- 172.21.15.177:0/3213140957 shutdown_connections 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 --2- 172.21.15.177:0/3213140957 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c443faf0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 -- 172.21.15.177:0/3213140957 >> 172.21.15.177:0/3213140957 conn(0x55b7c443b950 msgr2=0x55b7c44399b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 -- 172.21.15.177:0/3213140957 shutdown_connections 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 -- 172.21.15.177:0/3213140957 wait complete. 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 Processor -- start 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 -- start start 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c4446600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.770+0000 7f2d3032f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7c4446b40 con 0x55b7c443f6d0 2024-03-20T13:35:16.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.771+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c4446600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.771+0000 7f2d2bfb3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c4446600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41212/0 (socket says 172.21.15.177:41212) 2024-03-20T13:35:16.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.771+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 learned_addr learned my addr 172.21.15.177:0/1059928993 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.773+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7c4411a40 con 0x55b7c443f6d0 2024-03-20T13:35:16.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.775+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c4446600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c03df60 tx=0x7f2d1c03def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.776+0000 7f2c097fa640 1 -- 172.21.15.177:0/1059928993 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c025940 con 0x55b7c443f6d0 2024-03-20T13:35:16.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.776+0000 7f2c097fa640 1 -- 172.21.15.177:0/1059928993 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d1c017810 con 0x55b7c443f6d0 2024-03-20T13:35:16.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.776+0000 7f2c097fa640 1 -- 172.21.15.177:0/1059928993 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2d1c017af0 con 0x55b7c443f6d0 2024-03-20T13:35:16.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.776+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7c4411a40 con 0x55b7c443f6d0 2024-03-20T13:35:16.778 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.776+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7c4411a40 con 0x55b7c443f6d0 2024-03-20T13:35:16.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.777+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.779+0000 7f2c097fa640 1 -- 172.21.15.177:0/1059928993 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2d1c04a440 con 0x55b7c443f6d0 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2c097fa640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2bf4036830 0x7f2bf4038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2c097fa640 1 -- 172.21.15.177:0/1059928993 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f2d1c075ca0 con 0x55b7c443f6d0 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2bf4036830 0x7f2bf4038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c4451f00 0x55b7c44543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4454b10 con 0x55b7c4451f00 2024-03-20T13:35:16.785 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d2c7b4640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c4451f00 0x55b7c44543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2bf4036830 0x7f2bf4038cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d20052fd0 tx=0x7f2d2004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d2c7b4640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c4451f00 0x55b7c44543c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d3032f800 20 realm 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.780+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4454f30 con 0x55b7c4451f00 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.786 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455ae0 con 0x55b7c4451f00 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c4456490 0x55b7c4458880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4458ed0 con 0x55b7c4456490 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c4456490 0x55b7c4458880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.781+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c4456490 0x55b7c4458880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.787 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d3032f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d3032f800 20 searching for the correct realm 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7c445b180 0x55b7c445d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c445dd10 con 0x55b7c445b180 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7c445b180 0x55b7c445d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.782+0000 7f2d2b7b2640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7c445b180 0x55b7c445d640 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.783+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.783+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c445dd10 con 0x55b7c4456490 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.783+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.783+0000 7f2d2bfb3640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2d1c074060 0x7f2d1c05f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.783+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4458ed0 con 0x7f2d1c074060 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.783+0000 7f2d2c7b4640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2d1c074060 0x7f2d1c05f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.788 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2d1c074060 0x7f2d1c05f620 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.784+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4456490 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.785+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4456490 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.786+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.787+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.788+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.788+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.788+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.788+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.788+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.788+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4456490 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.789+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.801 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.790+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.790+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c445b180 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.790+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.790+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x7f2d1c074060 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.790+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.790+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2d24031040 con 0x55b7c4456490 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.791+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.791+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2d24031040 con 0x55b7c445b180 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.791+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.791+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2d24031040 con 0x7f2d1c074060 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.802 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2d24031040 con 0x55b7c4451f00 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2d24031040 con 0x55b7c4456490 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4458ed0 con 0x55b7c4451f00 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.803 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.792+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4455780 con 0x55b7c4451f00 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4459550 con 0x7f2d1c074060 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 zone default found 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 4 Realm: () 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 zonegroup default 2024-03-20T13:35:16.804 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4459940 con 0x7f2d1c074060 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.793+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4459d40 con 0x55b7c445b180 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c445a160 con 0x55b7c445b180 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 20 started sync module instance, tier type = 2024-03-20T13:35:16.805 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.794+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c445efc0 con 0x55b7c4456490 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.795+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.795+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247760292912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c445f630 con 0x55b7c4456490 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.795+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4460100 con 0x55b7c4451f00 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.796+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247760292912] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.796+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.796+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247760296928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44600c0 con 0x55b7c4451f00 2024-03-20T13:35:16.806 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.796+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4460b80 con 0x55b7c445b180 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.797+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247760296928] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.798+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.798+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247760299680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4460f60 con 0x55b7c445b180 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.798+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4461970 con 0x55b7c4456490 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.799+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.799+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247760303248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44621f0 con 0x55b7c4456490 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.799+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4462c90 con 0x55b7c4451f00 2024-03-20T13:35:16.809 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.799+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247760299680] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.800+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.800+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247760308080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4462c50 con 0x55b7c4451f00 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.800+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44636d0 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.800+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247760303248] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.801+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247760308080] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.801+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.802+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247760294032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4463690 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.802+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4463f20 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.804+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.804+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247760311952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4464030 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.804+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4464b00 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.804+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247760294032] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.810 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'126 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247760315872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4464ac0 con 0x7f2d1c074060 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=0 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=1 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=2 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=3 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=4 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=5 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247760311952] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.806+0000 7f2d3032f800 20 add_watcher() i=6 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.808+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247760315872] v30'127 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.808+0000 7f2d3032f800 20 add_watcher() i=7 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.808+0000 7f2d3032f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.808+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4463af0 con 0x55b7c4451f00 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.808+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.808+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247760310704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4463ab0 con 0x55b7c4451f00 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.809+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247760310704] v30'121 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.809+0000 7f2be1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.809+0000 7f2d3032f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.809+0000 7f2d3032f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:16.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.809+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4470360 con 0x55b7c4451f00 2024-03-20T13:35:16.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.811+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.811+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4470800 con 0x7f2d1c074060 2024-03-20T13:35:16.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.812+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'15 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.812+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4470800 con 0x55b7c445b180 2024-03-20T13:35:16.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.813+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.813+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44711d0 con 0x55b7c4451f00 2024-03-20T13:35:16.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.814+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'122 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.814+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4471700 con 0x55b7c4456490 2024-03-20T13:35:16.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.815+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'36 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.815+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4471700 con 0x55b7c445b180 2024-03-20T13:35:16.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.816+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'23 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.816+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44722a0 con 0x55b7c4451f00 2024-03-20T13:35:16.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.817+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.817+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c446c1a0 con 0x7f2d1c074060 2024-03-20T13:35:16.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.818+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'23 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.818+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c446c1a0 con 0x55b7c4456490 2024-03-20T13:35:16.820 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.819+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.819+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c446c1a0 con 0x55b7c445b180 2024-03-20T13:35:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.820+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.821 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.820+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4472fe0 con 0x55b7c4456490 2024-03-20T13:35:16.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.821+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'37 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.822 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.821+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4473510 con 0x7f2d1c074060 2024-03-20T13:35:16.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.823+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.824 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.823+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c446c0a0 con 0x55b7c4456490 2024-03-20T13:35:16.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.824+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.825 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.824+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44736e0 con 0x7f2d1c074060 2024-03-20T13:35:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.827+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'29 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.827+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44736e0 con 0x55b7c4451f00 2024-03-20T13:35:16.829 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.827+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'123 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.828+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44736e0 con 0x55b7c445b180 2024-03-20T13:35:16.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.830+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.830+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44736e0 con 0x55b7c4456490 2024-03-20T13:35:16.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.831+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'38 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.831+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44736e0 con 0x55b7c445b180 2024-03-20T13:35:16.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.832+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'15 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.832+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44736e0 con 0x55b7c4451f00 2024-03-20T13:35:16.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.833+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'23 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.833+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c4451f00 2024-03-20T13:35:16.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.834+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'124 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.834+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c445b180 2024-03-20T13:35:16.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.836+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'30 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.836+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c4456490 2024-03-20T13:35:16.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.837+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'25 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.837+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c445b180 2024-03-20T13:35:16.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.838+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.838+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c445b180 2024-03-20T13:35:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.839+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.839+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c445b180 2024-03-20T13:35:16.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.840+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'11 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.840+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x55b7c445b180 2024-03-20T13:35:16.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.841+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.841+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44738b0 con 0x7f2d1c074060 2024-03-20T13:35:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.842+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.844 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.842+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4473e40 con 0x55b7c445b180 2024-03-20T13:35:16.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.843+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'15 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.845 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.843+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4473e40 con 0x7f2d1c074060 2024-03-20T13:35:16.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.845+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'24 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.847 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.846+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4473e40 con 0x55b7c445b180 2024-03-20T13:35:16.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.848+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'31 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.848+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4473e40 con 0x7f2d1c074060 2024-03-20T13:35:16.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.851+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'30 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.851+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4473e40 con 0x55b7c4456490 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'21 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2be0fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2d3032f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2d3032f800 20 Filter name: none 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2b5a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2d3032f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2d3032f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:16.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.853+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c449d250 con 0x7f2d1c074060 2024-03-20T13:35:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:35:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:35:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:35:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:16.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c449f5f0 con 0x7f2d1c074060 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 155+0+15 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.854+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94247759994336 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c449faf0 con 0x55b7c445b180 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== watch-notify(notify (1) cookie 94247760299680 notify 128849018883 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x55b7c4321890 con 0x55b7c445b180 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2c0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018883 cookie 94247760299680 notifier 4517 bl.length()=170 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(96 notify.2 [notify cookie 94247759994336 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2c0affd640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bf0003d50 con 0x55b7c445b180 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== watch-notify(notify_complete (2) cookie 94247759994336 notify 128849018883 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2d2004e070 con 0x55b7c445b180 2024-03-20T13:35:16.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.855+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4415de0 con 0x7f2d1c074060 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'4 uv4 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d3032f800 10 removing email index: 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d3032f800 10 removing user buckets index 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d3032f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94247759994336 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c449fa90 con 0x7f2d1c074060 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== watch-notify(notify (1) cookie 94247760311952 notify 128849018895 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f2d2403d040 con 0x7f2d1c074060 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2c0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94247760311952 notifier 4517 bl.length()=160 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2c0affd640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2bf0003d50 con 0x7f2d1c074060 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(99 notify.6 [notify cookie 94247759994336 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.864 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.857+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.858+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== watch-notify(notify_complete (2) cookie 94247759994336 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2d24018ce0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.858+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4415de0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(101 fud.buckets [delete] v30'4 uv4 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d3032f800 10 removing user index: fud 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d3032f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d3032f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94247759994336 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c449ea80 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== watch-notify(notify (1) cookie 94247760294032 notify 128849018896 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f2d24018ce0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2c0a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94247760294032 notifier 4517 bl.length()=152 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(102 notify.5 [notify cookie 94247759994336 out=8b] v0'0 uv126 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.859+0000 7f2c0a7fc640 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f2b600032b0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.860+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== watch-notify(notify_complete (2) cookie 94247759994336 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2d240050f0 con 0x7f2d1c074060 2024-03-20T13:35:16.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.860+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.860+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c449ea40 con 0x7f2d1c074060 2024-03-20T13:35:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.862+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(104 fud [call,call,delete] v30'2 uv2 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.863+0000 7f2be1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:16.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.863+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247760310704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44722a0 con 0x55b7c4451f00 2024-03-20T13:35:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.864+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94247760310704] v30'125 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.864+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247760292912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44631b0 con 0x55b7c4456490 2024-03-20T13:35:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.865+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94247760292912] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.865+0000 7f2d3032f800 20 remove_watcher() i=0 2024-03-20T13:35:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.865+0000 7f2d3032f800 2 removed watcher, disabling cache 2024-03-20T13:35:16.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.865+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247760296928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44631b0 con 0x55b7c4451f00 2024-03-20T13:35:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.866+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94247760296928] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.866+0000 7f2d3032f800 20 remove_watcher() i=1 2024-03-20T13:35:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.866+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247760299680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44631b0 con 0x55b7c445b180 2024-03-20T13:35:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.867+0000 7f2d2b7b2640 1 -- 172.21.15.177:0/1059928993 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94247760299680] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d20052b40 con 0x55b7c445b180 2024-03-20T13:35:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.867+0000 7f2d3032f800 20 remove_watcher() i=2 2024-03-20T13:35:16.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.867+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247760303248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44606a0 con 0x55b7c4456490 2024-03-20T13:35:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.868+0000 7f2d2bfb3640 1 -- 172.21.15.177:0/1059928993 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94247760303248] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d1c016070 con 0x55b7c4456490 2024-03-20T13:35:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.868+0000 7f2d3032f800 20 remove_watcher() i=3 2024-03-20T13:35:16.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.868+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247760308080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44631b0 con 0x55b7c4451f00 2024-03-20T13:35:16.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.869+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94247760308080] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x55b7c4451f00 2024-03-20T13:35:16.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.869+0000 7f2d3032f800 20 remove_watcher() i=4 2024-03-20T13:35:16.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.869+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247760294032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c4461490 con 0x7f2d1c074060 2024-03-20T13:35:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.870+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94247760294032] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.870+0000 7f2d3032f800 20 remove_watcher() i=5 2024-03-20T13:35:16.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.870+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247760311952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c445f0d0 con 0x7f2d1c074060 2024-03-20T13:35:16.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.871+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94247760311952] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.871+0000 7f2d3032f800 20 remove_watcher() i=6 2024-03-20T13:35:16.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.871+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247760315872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b7c44606a0 con 0x7f2d1c074060 2024-03-20T13:35:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.872+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94247760315872] v30'128 uv126 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2d2400a4a0 con 0x7f2d1c074060 2024-03-20T13:35:16.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.872+0000 7f2d3032f800 20 remove_watcher() i=7 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2d1c074060 msgr2=0x7f2d1c05f620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2d1c074060 0x7f2d1c05f620 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c4451f00 msgr2=0x55b7c44543c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c4451f00 0x55b7c44543c0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c4456490 msgr2=0x55b7c4458880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c4456490 0x55b7c4458880 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7c445b180 msgr2=0x55b7c445d640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7c445b180 0x55b7c445d640 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2bf4036830 msgr2=0x7f2bf4038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2bf4036830 0x7f2bf4038cf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d20052fd0 tx=0x7f2d2004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 msgr2=0x55b7c4446600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/1059928993 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c443f6d0 0x55b7c4446600 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c03df60 tx=0x7f2d1c03def0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 reap_dead start 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/1059928993 reap_dead start 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 shutdown_connections 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 >> 172.21.15.177:0/1059928993 conn(0x55b7c443b950 msgr2=0x55b7c4438fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 shutdown_connections 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/1059928993 wait complete. 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c04036790 msgr2=0x7f2c04038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c04036790 0x7f2c04038c50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x55b7c4419cc0 tx=0x7f2d20005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 msgr2=0x55b7c4410df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 0x55b7c4410df0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f2d1c04a330 tx=0x7f2d1c03fe20 comp rx=0 tx=0).stop 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 shutdown_connections 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c04036790 0x7f2c04038c50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 --2- 172.21.15.177:0/2696651768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c4412980 0x55b7c4410df0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 >> 172.21.15.177:0/2696651768 conn(0x55b7c4424270 msgr2=0x55b7c4424670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 shutdown_connections 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.873+0000 7f2d3032f800 1 -- 172.21.15.177:0/2696651768 wait complete. 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7c441f5b0 msgr2=0x55b7c44219a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7c441f5b0 0x55b7c44219a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c431de70 msgr2=0x55b7c4418e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7c431de70 0x55b7c4418e40 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c441b700 msgr2=0x55b7c441daf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7c441b700 0x55b7c441daf0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c14036830 msgr2=0x7f2c14038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2c14036830 0x7f2c14038cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f2d20054000 tx=0x7f2d2004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 msgr2=0x55b7c428dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 --2- 172.21.15.177:0/641303995 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7c43199e0 0x55b7c428dcf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x55b7c440a700 tx=0x7f2d1c000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d2c7b4640 1 -- 172.21.15.177:0/641303995 reap_dead start 2024-03-20T13:35:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 shutdown_connections 2024-03-20T13:35:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 >> 172.21.15.177:0/641303995 conn(0x55b7c4315040 msgr2=0x55b7c4403af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 shutdown_connections 2024-03-20T13:35:16.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.874+0000 7f2d3032f800 1 -- 172.21.15.177:0/641303995 wait complete. 2024-03-20T13:35:16.883 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:35:16.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-03-20T13:35:16.883 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-03-20T13:35:16.978 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:16.979 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:16.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f35af800 1 Processor -- start 2024-03-20T13:35:16.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f35af800 1 -- start start 2024-03-20T13:35:16.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f35af800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5619a249b5b0 0x5619a249d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f35af800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5619a23e5c70 con 0x5619a249dee0 2024-03-20T13:35:16.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f35af800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5619a239c500 con 0x5619a249b5b0 2024-03-20T13:35:16.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f10ae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5619a249b5b0 0x5619a249d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f10ae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5619a249b5b0 0x5619a249d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41222/0 (socket says 172.21.15.177:41222) 2024-03-20T13:35:16.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f08ad640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5619a249dee0 0x5619a24a02d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50588/0 (socket says 172.21.15.177:50588) 2024-03-20T13:35:16.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.978+0000 7f10f10ae640 1 -- 172.21.15.177:0/2999888719 learned_addr learned my addr 172.21.15.177:0/2999888719 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.981 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.979+0000 7f10f10ae640 1 -- 172.21.15.177:0/2999888719 >> v1:172.21.15.28:6789/0 conn(0x5619a249dee0 legacy=0x5619a24a02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.979+0000 7f10f10ae640 1 -- 172.21.15.177:0/2999888719 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a24a2a00 con 0x5619a249b5b0 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f10ae640 1 --2- 172.21.15.177:0/2999888719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a249d9a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00a520 tx=0x7f10ec01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1cb2c881c87deff server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10e3fff640 1 -- 172.21.15.177:0/2999888719 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec052570 con 0x5619a249b5b0 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10e3fff640 1 -- 172.21.15.177:0/2999888719 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0526d0 con 0x5619a249b5b0 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10e3fff640 1 -- 172.21.15.177:0/2999888719 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec052990 con 0x5619a249b5b0 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 -- 172.21.15.177:0/2999888719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 msgr2=0x5619a249d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 --2- 172.21.15.177:0/2999888719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a249d9a0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00a520 tx=0x7f10ec01cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 -- 172.21.15.177:0/2999888719 shutdown_connections 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 --2- 172.21.15.177:0/2999888719 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a249d9a0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 -- 172.21.15.177:0/2999888719 >> 172.21.15.177:0/2999888719 conn(0x5619a2494fe0 msgr2=0x5619a2497400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 -- 172.21.15.177:0/2999888719 shutdown_connections 2024-03-20T13:35:16.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.981+0000 7f10f35af800 1 -- 172.21.15.177:0/2999888719 wait complete. 2024-03-20T13:35:16.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.993+0000 7f10f35af800 1 Processor -- start 2024-03-20T13:35:16.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.993+0000 7f10f35af800 1 -- start start 2024-03-20T13:35:16.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.993+0000 7f10f35af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a258aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.993+0000 7f10f35af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a2399a30 con 0x5619a249b5b0 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.994+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a258aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.994+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a258aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41228/0 (socket says 172.21.15.177:41228) 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.994+0000 7f10f10ae640 1 -- 172.21.15.177:0/2103579082 learned_addr learned my addr 172.21.15.177:0/2103579082 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.994+0000 7f10f10ae640 1 -- 172.21.15.177:0/2103579082 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec005de0 con 0x5619a249b5b0 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.994+0000 7f10f10ae640 1 --2- 172.21.15.177:0/2103579082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a258aa40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f10ec01cf20 tx=0x7f10ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe88dfc99e4a63d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f0fdf606640 1 -- 172.21.15.177:0/2103579082 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec052840 con 0x5619a249b5b0 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f0fdf606640 1 -- 172.21.15.177:0/2103579082 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec0529a0 con 0x5619a249b5b0 2024-03-20T13:35:16.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f0fdf606640 1 -- 172.21.15.177:0/2103579082 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec052c80 con 0x5619a249b5b0 2024-03-20T13:35:16.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 -- 172.21.15.177:0/2103579082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 msgr2=0x5619a258aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:16.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 --2- 172.21.15.177:0/2103579082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a258aa40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f10ec01cf20 tx=0x7f10ec04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:16.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 -- 172.21.15.177:0/2103579082 shutdown_connections 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 --2- 172.21.15.177:0/2103579082 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a258aa40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 -- 172.21.15.177:0/2103579082 >> 172.21.15.177:0/2103579082 conn(0x5619a2494fe0 msgr2=0x5619a2586360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 -- 172.21.15.177:0/2103579082 shutdown_connections 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.995+0000 7f10f35af800 1 -- 172.21.15.177:0/2103579082 wait complete. 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.996+0000 7f10f35af800 1 Processor -- start 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.996+0000 7f10f35af800 1 -- start start 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.996+0000 7f10f35af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a259ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.996+0000 7f10f35af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a2395210 con 0x5619a249b5b0 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a259ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:16.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a259ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41242/0 (socket says 172.21.15.177:41242) 2024-03-20T13:35:17.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f10ae640 1 -- 172.21.15.177:0/1038759944 learned_addr learned my addr 172.21.15.177:0/1038759944 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f10ae640 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a24a2a00 con 0x5619a249b5b0 2024-03-20T13:35:17.000 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f10ae640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a259ad00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f10ec01ceb0 tx=0x7f10ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f0fdde03640 1 -- 172.21.15.177:0/1038759944 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec06c070 con 0x5619a249b5b0 2024-03-20T13:35:17.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f0fdde03640 1 -- 172.21.15.177:0/1038759944 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec05d7c0 con 0x5619a249b5b0 2024-03-20T13:35:17.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619a259b240 con 0x5619a249b5b0 2024-03-20T13:35:17.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f0fdde03640 1 -- 172.21.15.177:0/1038759944 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec05da60 con 0x5619a249b5b0 2024-03-20T13:35:17.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.997+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619a259b720 con 0x5619a249b5b0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.998+0000 7f0fdde03640 1 -- 172.21.15.177:0/1038759944 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f10ec059040 con 0x5619a249b5b0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.998+0000 7f0fdde03640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fd8036790 0x7f0fd8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f0fdde03640 1 -- 172.21.15.177:0/1038759944 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f10ec08d8a0 con 0x5619a249b5b0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f08ad640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fd8036790 0x7f0fd8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a249dee0 0x5619a259f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a259f950 con 0x5619a249dee0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f18af640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a249dee0 0x5619a259f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f08ad640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fd8036790 0x7f0fd8038c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e8000f60 tx=0x7f10e8001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f18af640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a249dee0 0x5619a259f300 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f18af640 1 -- 172.21.15.177:0/1038759944 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a249dee0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:16.999+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a259c8c0 con 0x5619a249dee0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f18af640 1 -- 172.21.15.177:0/1038759944 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a249dee0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25a1b90 0x5619a25a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25a4650 con 0x5619a25a1b90 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f10ae640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25a1b90 0x5619a25a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f10ae640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25a1b90 0x5619a25a3f80 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f10ae640 1 -- 172.21.15.177:0/1038759944 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f10ec0673f0 con 0x5619a25a1b90 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.000+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25a0b10 con 0x5619a249dee0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.001+0000 7f10f18af640 1 -- 172.21.15.177:0/1038759944 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a249dee0 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.001+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5619a25a5a50 0x5619a25a7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.001+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25a8580 con 0x5619a25a5a50 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.002+0000 7f10f08ad640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5619a25a5a50 0x5619a25a7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.005+0000 7f10f08ad640 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5619a25a5a50 0x5619a25a7e40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.005+0000 7f10f08ad640 1 -- 172.21.15.177:0/1038759944 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f10e800f690 con 0x5619a25a5a50 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.005+0000 7f10f35af800 1 Processor -- start 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.005+0000 7f10f35af800 1 -- start start 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.005+0000 7f10f35af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 0x5619a25b6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f35af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a2337c70 con 0x5619a25b6710 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 0x5619a25b6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 0x5619a25b6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41252/0 (socket says 172.21.15.177:41252) 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f10ae640 1 -- 172.21.15.177:0/1801438132 learned_addr learned my addr 172.21.15.177:0/1801438132 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f10ae640 1 -- 172.21.15.177:0/1801438132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a25b7070 con 0x5619a25b6710 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f10ae640 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 0x5619a25b6b30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f10ec08d010 tx=0x7f10ec004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f0fd6ffd640 1 -- 172.21.15.177:0/1801438132 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec079ba0 con 0x5619a25b6710 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f0fd6ffd640 1 -- 172.21.15.177:0/1801438132 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec079d00 con 0x5619a25b6710 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619a25b7ae0 con 0x5619a25b6710 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f0fd6ffd640 1 -- 172.21.15.177:0/1801438132 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec004600 con 0x5619a25b6710 2024-03-20T13:35:17.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.006+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619a25b7ae0 con 0x5619a25b6710 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.007+0000 7f0fd6ffd640 1 -- 172.21.15.177:0/1801438132 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f10ec004760 con 0x5619a25b6710 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.007+0000 7f0fd6ffd640 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fc80367e0 0x7f0fc8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.007+0000 7f0fd6ffd640 1 -- 172.21.15.177:0/1801438132 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f10ec002000 con 0x5619a25b6710 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.007+0000 7f10f08ad640 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fc80367e0 0x7f0fc8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f35af800 1 Processor -- start 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f35af800 1 -- start start 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f08ad640 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fc80367e0 0x7f0fc8038ca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5619a259c800 tx=0x7f10e800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f35af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f35af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a230d5d0 con 0x5619a25c36b0 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.008+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41254/0 (socket says 172.21.15.177:41254) 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.009+0000 7f10f10ae640 1 -- 172.21.15.177:0/3887372680 learned_addr learned my addr 172.21.15.177:0/3887372680 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.009+0000 7f10f10ae640 1 -- 172.21.15.177:0/3887372680 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a25c40a0 con 0x5619a25c36b0 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.009+0000 7f10f10ae640 1 --2- 172.21.15.177:0/3887372680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25c3ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10ec098fd0 tx=0x7f10ec08f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613734feda153907 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f0fd4ff9640 1 -- 172.21.15.177:0/3887372680 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec05ca60 con 0x5619a25c36b0 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f0fd4ff9640 1 -- 172.21.15.177:0/3887372680 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec05cbc0 con 0x5619a25c36b0 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f0fd4ff9640 1 -- 172.21.15.177:0/3887372680 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec05cea0 con 0x5619a25c36b0 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 -- 172.21.15.177:0/3887372680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 msgr2=0x5619a25c3ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 --2- 172.21.15.177:0/3887372680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25c3ad0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f10ec098fd0 tx=0x7f10ec08f1d0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 -- 172.21.15.177:0/3887372680 shutdown_connections 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 --2- 172.21.15.177:0/3887372680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25c3ad0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 -- 172.21.15.177:0/3887372680 >> 172.21.15.177:0/3887372680 conn(0x5619a25bf9c0 msgr2=0x5619a25bda20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 -- 172.21.15.177:0/3887372680 shutdown_connections 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 -- 172.21.15.177:0/3887372680 wait complete. 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.010+0000 7f10f35af800 1 Processor -- start 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f35af800 1 -- start start 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f35af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25ca490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f35af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5619a25ca9d0 con 0x5619a25c36b0 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25ca490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f10ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25ca490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41264/0 (socket says 172.21.15.177:41264) 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 learned_addr learned my addr 172.21.15.177:0/2831945154 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.011+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5619a25b7070 con 0x5619a25c36b0 2024-03-20T13:35:17.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.012+0000 7f10f10ae640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25ca490 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10ec050ee0 tx=0x7f10ec09df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.012+0000 7f0fc6ffd640 1 -- 172.21.15.177:0/2831945154 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec0981f0 con 0x5619a25c36b0 2024-03-20T13:35:17.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.012+0000 7f0fc6ffd640 1 -- 172.21.15.177:0/2831945154 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ec098350 con 0x5619a25c36b0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.012+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5619a25b7070 con 0x5619a25c36b0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.012+0000 7f0fc6ffd640 1 -- 172.21.15.177:0/2831945154 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10ec0988d0 con 0x5619a25c36b0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.012+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5619a25b7070 con 0x5619a25c36b0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f0fc6ffd640 1 -- 172.21.15.177:0/2831945154 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f10ec098a30 con 0x5619a25c36b0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f0fc6ffd640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fbc036790 0x7f0fbc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f0fc6ffd640 1 -- 172.21.15.177:0/2831945154 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f10ec0c0c80 con 0x5619a25c36b0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f10f08ad640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fbc036790 0x7f0fbc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a25d5bc0 0x5619a25d8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.013+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d87d0 con 0x5619a25d5bc0 2024-03-20T13:35:17.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f18af640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a25d5bc0 0x5619a25d8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f08ad640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fbc036790 0x7f0fbc038c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5619a25a8940 tx=0x7f10e8010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f18af640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a25d5bc0 0x5619a25d8080 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 20 realm 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d8ba0 con 0x5619a25d5bc0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.014+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9780 con 0x5619a25d5bc0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25da130 0x5619a25dc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25dcb30 con 0x5619a25da130 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f10ae640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25da130 0x5619a25dc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.015+0000 7f10f10ae640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25da130 0x5619a25dc520 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f35af800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f35af800 20 searching for the correct realm 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5619a25dedd0 0x5619a25e1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e1910 con 0x5619a25dedd0 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f08ad640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5619a25dedd0 0x5619a25e1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f08ad640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5619a25dedd0 0x5619a25e1290 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.016+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e1910 con 0x5619a25da130 2024-03-20T13:35:17.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.017+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.017+0000 7f10f10ae640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f10ec0bf060 0x7f10ec083920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.017+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e1910 con 0x7f10ec0bf060 2024-03-20T13:35:17.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.017+0000 7f10f18af640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f10ec0bf060 0x7f10ec083920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.019+0000 7f10f18af640 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f10ec0bf060 0x7f10ec083920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.020+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.020+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.020+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.020+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25da130 2024-03-20T13:35:17.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.021+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.022+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25da130 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.023+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.024+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25da130 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25d5bc0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.025+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x5619a25dedd0 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9420 con 0x7f10ec0bf060 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f10e4031040 con 0x5619a25da130 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f10e4031040 con 0x5619a25dedd0 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.026+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f10e4031040 con 0x7f10ec0bf060 2024-03-20T13:35:17.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f10e4031040 con 0x5619a25d5bc0 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f10e4031040 con 0x5619a25da130 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:17.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25d9400 con 0x5619a25d5bc0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.027+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25dd1f0 con 0x5619a25d5bc0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25dd5d0 con 0x7f10ec0bf060 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 zone default found 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 4 Realm: () 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 zonegroup default 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25dd9c0 con 0x7f10ec0bf060 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.028+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25dddc0 con 0x5619a25dedd0 2024-03-20T13:35:17.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e3730 con 0x5619a25dedd0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 20 started sync module instance, tier type = 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.029+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e3010 con 0x5619a25da130 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.030+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.030+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94668098251632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e33c0 con 0x5619a25da130 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.030+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e4540 con 0x5619a25d5bc0 2024-03-20T13:35:17.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.031+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94668098251632] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.032+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.032+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94668098257056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e44c0 con 0x5619a25d5bc0 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.032+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e5290 con 0x5619a25dedd0 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.033+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94668098257056] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.034+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.034+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94668098259184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e5670 con 0x5619a25dedd0 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.034+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e6080 con 0x5619a25da130 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.035+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.035+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94668098266160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e6cf0 con 0x5619a25da130 2024-03-20T13:35:17.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.035+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e76c0 con 0x5619a25d5bc0 2024-03-20T13:35:17.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.035+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94668098259184] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.036+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.036+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94668098269632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e7aa0 con 0x5619a25d5bc0 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.036+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e84a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.036+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94668098266160] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.037+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94668098269632] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.038+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.038+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94668098260240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e8460 con 0x7f10ec0bf060 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.038+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e8cf0 con 0x7f10ec0bf060 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.039+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94668098260240] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.040+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.040+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94668098273184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e8900 con 0x7f10ec0bf060 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.040+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e92e0 con 0x7f10ec0bf060 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.041+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94668098273184] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.041+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'129 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.041+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94668098274400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e92a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=0 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=1 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=2 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=3 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=4 2024-03-20T13:35:17.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=5 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.042+0000 7f10f35af800 20 add_watcher() i=6 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.043+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94668098274400] v30'130 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.043+0000 7f10f35af800 20 add_watcher() i=7 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.043+0000 7f10f35af800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.043+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25ec770 con 0x5619a25d5bc0 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.043+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.043+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94668098277328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e9c50 con 0x5619a25d5bc0 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.044+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94668098277328] v30'126 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.044+0000 7f0fa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.044+0000 7f10f35af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:17.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.044+0000 7f10f35af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.044+0000 7f10f35af800 5 note: GC not initialized 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.044+0000 7f0fa67e4640 20 reqs_thread_entry: start 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 20 Filter name: none 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f0f17fff640 20 reqs_thread_entry: start 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a261e840 con 0x7f10ec0bf060 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 246+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-03-20T13:35:17.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.045+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a261ce00 con 0x7f10ec0bf060 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f35af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f35af800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f35af800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f35af800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f35af800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.046+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~385 in=385b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a26211e0 con 0x7f10ec0bf060 2024-03-20T13:35:17.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.047+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~385] v30'5 uv5 ondisk = 0) v8 ==== 288+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.047+0000 7f10f35af800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.047+0000 7f10f35af800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.047+0000 7f10f35af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.047+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 94668098502256 in=588b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a2621b00 con 0x5619a25da130 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== watch-notify(notify (1) cookie 94668098266160 notify 128849018895 ret 0) v3 ==== 618+0+0 (crc 0 0 0) 0x5619a25c40a0 con 0x5619a25da130 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f0fd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94668098266160 notifier 4524 bl.length()=576 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.3 [notify cookie 94668098502256 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f0fd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f0fd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f0fd4ff9640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0fb4003e90 con 0x5619a25da130 2024-03-20T13:35:17.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec085070 con 0x5619a25da130 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== watch-notify(notify_complete (2) cookie 94668098502256 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f10ec0d3020 con 0x5619a25da130 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.048+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a261ee60 con 0x7f10ec0bf060 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v30'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f35af800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f35af800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f35af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94668098508128 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a261ee60 con 0x5619a25dedd0 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== watch-notify(notify (1) cookie 94668098259184 notify 128849018884 ret 0) v3 ==== 234+0+0 (crc 0 0 0) 0x7f10e8043040 con 0x5619a25dedd0 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f0fd4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018884 cookie 94668098259184 notifier 4524 bl.length()=192 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f0fd4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f0fd4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:35:17.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(68 notify.2 [notify cookie 94668098508128 out=8b] v0'0 uv129 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f0fd4ff9640 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f0fb4003e90 con 0x5619a25dedd0 2024-03-20T13:35:17.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.050+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== watch-notify(notify_complete (2) cookie 94668098508128 notify 128849018884 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f10e8006070 con 0x5619a25dedd0 2024-03-20T13:35:17.061 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:17.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.051+0000 7f0fa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.051+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94668098277328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25ec180 con 0x5619a25d5bc0 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.052+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94668098277328] v30'127 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.052+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94668098251632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25ebce0 con 0x5619a25da130 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.053+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94668098251632] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec0d5040 con 0x5619a25da130 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.053+0000 7f10f35af800 20 remove_watcher() i=0 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.053+0000 7f10f35af800 2 removed watcher, disabling cache 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.053+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94668098257056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e2b70 con 0x5619a25d5bc0 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.054+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94668098257056] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.054+0000 7f10f35af800 20 remove_watcher() i=1 2024-03-20T13:35:17.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.054+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94668098259184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e2b70 con 0x5619a25dedd0 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.056+0000 7f10f08ad640 1 -- 172.21.15.177:0/2831945154 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94668098259184] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e8033040 con 0x5619a25dedd0 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.056+0000 7f10f35af800 20 remove_watcher() i=2 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.056+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94668098266160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e48f0 con 0x5619a25da130 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.057+0000 7f10f10ae640 1 -- 172.21.15.177:0/2831945154 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94668098266160] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10ec0d5040 con 0x5619a25da130 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.057+0000 7f10f35af800 20 remove_watcher() i=3 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.057+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94668098269632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e2b70 con 0x5619a25d5bc0 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.058+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94668098269632] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x5619a25d5bc0 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.058+0000 7f10f35af800 20 remove_watcher() i=4 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.058+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94668098260240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e6430 con 0x7f10ec0bf060 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.059+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94668098260240] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.059+0000 7f10f35af800 20 remove_watcher() i=5 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.059+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94668098273184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e2b70 con 0x7f10ec0bf060 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.060+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94668098273184] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.060+0000 7f10f35af800 20 remove_watcher() i=6 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.060+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94668098274400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5619a25e6430 con 0x7f10ec0bf060 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.061+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94668098274400] v30'131 uv129 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f10e400a4a0 con 0x7f10ec0bf060 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.061+0000 7f10f35af800 20 remove_watcher() i=7 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f10ec0bf060 msgr2=0x7f10ec083920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f10ec0bf060 0x7f10ec083920 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a25d5bc0 msgr2=0x5619a25d8080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a25d5bc0 0x5619a25d8080 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25da130 msgr2=0x5619a25dc520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25da130 0x5619a25dc520 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5619a25dedd0 msgr2=0x5619a25e1290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5619a25dedd0 0x5619a25e1290 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fbc036790 msgr2=0x7f0fbc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fbc036790 0x7f0fbc038c50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x5619a25a8940 tx=0x7f10e8010000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f18af640 1 -- 172.21.15.177:0/2831945154 reap_dead start 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 msgr2=0x5619a25ca490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25ca490 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f10ec050ee0 tx=0x7f10ec09df10 comp rx=0 tx=0).stop 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 shutdown_connections 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/2831945154 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25c36b0 0x5619a25ca490 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 >> 172.21.15.177:0/2831945154 conn(0x5619a25bf9c0 msgr2=0x5619a25bd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 shutdown_connections 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/2831945154 wait complete. 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fc80367e0 msgr2=0x7f0fc8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fc80367e0 0x7f0fc8038ca0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x5619a259c800 tx=0x7f10e800f000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 msgr2=0x5619a25b6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 0x5619a25b6b30 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f10ec08d010 tx=0x7f10ec004520 comp rx=0 tx=0).stop 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 shutdown_connections 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fc80367e0 0x7f0fc8038ca0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 --2- 172.21.15.177:0/1801438132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a25b6710 0x5619a25b6b30 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 >> 172.21.15.177:0/1801438132 conn(0x5619a25aa7b0 msgr2=0x5619a25aabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 shutdown_connections 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.062+0000 7f10f35af800 1 -- 172.21.15.177:0/1801438132 wait complete. 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5619a25a5a50 msgr2=0x5619a25a7e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5619a25a5a50 0x5619a25a7e40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a249dee0 msgr2=0x5619a259f300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5619a249dee0 0x5619a259f300 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25a1b90 msgr2=0x5619a25a3f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5619a25a1b90 0x5619a25a3f80 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fd8036790 msgr2=0x7f0fd8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0fd8036790 0x7f0fd8038c50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f10e8000f60 tx=0x7f10e8001370 comp rx=0 tx=0).stop 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 msgr2=0x5619a259ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 --2- 172.21.15.177:0/1038759944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5619a249b5b0 0x5619a259ad00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f10ec01ceb0 tx=0x7f10ec002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f18af640 1 -- 172.21.15.177:0/1038759944 reap_dead start 2024-03-20T13:35:17.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 shutdown_connections 2024-03-20T13:35:17.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 >> 172.21.15.177:0/1038759944 conn(0x5619a2494fe0 msgr2=0x5619a2584b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 shutdown_connections 2024-03-20T13:35:17.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.063+0000 7f10f35af800 1 -- 172.21.15.177:0/1038759944 wait complete. 2024-03-20T13:35:17.077 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:17.077 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:35:17.077 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:35:17.077 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-03-20T13:35:17.124 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:17.124 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:17.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.123+0000 7feac1416800 1 Processor -- start 2024-03-20T13:35:17.125 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.123+0000 7feac1416800 1 -- start start 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.123+0000 7feac1416800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55fb6503de90 0x55fb65040280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.123+0000 7feac1416800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55fb64f85d70 con 0x55fb65039a00 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.123+0000 7feac1416800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55fb64f3c500 con 0x55fb6503de90 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.124+0000 7feab4360640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55fb6503de90 0x55fb65040280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.124+0000 7feab4360640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55fb6503de90 0x55fb65040280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41268/0 (socket says 172.21.15.177:41268) 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.124+0000 7feab4360640 1 -- 172.21.15.177:0/2101335087 learned_addr learned my addr 172.21.15.177:0/2101335087 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.124+0000 7feabcb61640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55fb65039a00 0x55fb65039e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50598/0 (socket says 172.21.15.177:50598) 2024-03-20T13:35:17.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.124+0000 7feab4360640 1 -- 172.21.15.177:0/2101335087 >> v1:172.21.15.28:6789/0 conn(0x55fb65039a00 legacy=0x55fb65039e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.124+0000 7feab4360640 1 -- 172.21.15.177:0/2101335087 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb650418b0 con 0x55fb6503de90 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.126+0000 7feab4360640 1 --2- 172.21.15.177:0/2101335087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6503de90 0x55fb65040280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7feaa400a520 tx=0x7feaa401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f5d79cfa676dad server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.126+0000 7feab7fff640 1 -- 172.21.15.177:0/2101335087 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaa4052570 con 0x55fb6503de90 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.126+0000 7feab7fff640 1 -- 172.21.15.177:0/2101335087 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaa40526d0 con 0x55fb6503de90 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.126+0000 7feab7fff640 1 -- 172.21.15.177:0/2101335087 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaa4052990 con 0x55fb6503de90 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 -- 172.21.15.177:0/2101335087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6503de90 msgr2=0x55fb65040280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 --2- 172.21.15.177:0/2101335087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6503de90 0x55fb65040280 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7feaa400a520 tx=0x7feaa401cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 -- 172.21.15.177:0/2101335087 shutdown_connections 2024-03-20T13:35:17.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 --2- 172.21.15.177:0/2101335087 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6503de90 0x55fb65040280 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 -- 172.21.15.177:0/2101335087 >> 172.21.15.177:0/2101335087 conn(0x55fb65035060 msgr2=0x55fb65037480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 -- 172.21.15.177:0/2101335087 shutdown_connections 2024-03-20T13:35:17.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.127+0000 7feac1416800 1 -- 172.21.15.177:0/2101335087 wait complete. 2024-03-20T13:35:17.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.138+0000 7feac1416800 1 Processor -- start 2024-03-20T13:35:17.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.138+0000 7feac1416800 1 -- start start 2024-03-20T13:35:17.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.138+0000 7feac1416800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb64fadcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.138+0000 7feac1416800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb64f39a30 con 0x55fb65039a00 2024-03-20T13:35:17.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.139+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb64fadcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.139+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb64fadcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41272/0 (socket says 172.21.15.177:41272) 2024-03-20T13:35:17.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.139+0000 7feabcb61640 1 -- 172.21.15.177:0/4168593329 learned_addr learned my addr 172.21.15.177:0/4168593329 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.140+0000 7feabcb61640 1 -- 172.21.15.177:0/4168593329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa4005de0 con 0x55fb65039a00 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.140+0000 7feabcb61640 1 --2- 172.21.15.177:0/4168593329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb64fadcd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7feaac001d30 tx=0x7feaac00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866f26bb3cf5387e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.140+0000 7fe9aae0d640 1 -- 172.21.15.177:0/4168593329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac014070 con 0x55fb65039a00 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.140+0000 7fe9aae0d640 1 -- 172.21.15.177:0/4168593329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac00f450 con 0x55fb65039a00 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.140+0000 7fe9aae0d640 1 -- 172.21.15.177:0/4168593329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac00f730 con 0x55fb65039a00 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- 172.21.15.177:0/4168593329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 msgr2=0x55fb64fadcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 --2- 172.21.15.177:0/4168593329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb64fadcd0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7feaac001d30 tx=0x7feaac00b600 comp rx=0 tx=0).stop 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- 172.21.15.177:0/4168593329 shutdown_connections 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 --2- 172.21.15.177:0/4168593329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb64fadcd0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- 172.21.15.177:0/4168593329 >> 172.21.15.177:0/4168593329 conn(0x55fb65035060 msgr2=0x55fb651252b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- 172.21.15.177:0/4168593329 shutdown_connections 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- 172.21.15.177:0/4168593329 wait complete. 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 Processor -- start 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- start start 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb6512b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.141+0000 7feac1416800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb64f35210 con 0x55fb65039a00 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb6512b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb6512b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41286/0 (socket says 172.21.15.177:41286) 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feabcb61640 1 -- 172.21.15.177:0/3272743472 learned_addr learned my addr 172.21.15.177:0/3272743472 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feabcb61640 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb64f85d70 con 0x55fb65039a00 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feabcb61640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb6512b0f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55fb64fad300 tx=0x7feaac000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7fe9a960a640 1 -- 172.21.15.177:0/3272743472 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac014050 con 0x55fb65039a00 2024-03-20T13:35:17.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7fe9a960a640 1 -- 172.21.15.177:0/3272743472 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac01b9b0 con 0x55fb65039a00 2024-03-20T13:35:17.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb651297e0 con 0x55fb65039a00 2024-03-20T13:35:17.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7fe9a960a640 1 -- 172.21.15.177:0/3272743472 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac01bc90 con 0x55fb65039a00 2024-03-20T13:35:17.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.142+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb65129cc0 con 0x55fb65039a00 2024-03-20T13:35:17.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.143+0000 7fe9a960a640 1 -- 172.21.15.177:0/3272743472 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feaac022020 con 0x55fb65039a00 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.143+0000 7fe9a960a640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe9a4036790 0x7fe9a4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.143+0000 7fe9a960a640 1 -- 172.21.15.177:0/3272743472 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7feaac008030 con 0x55fb65039a00 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.143+0000 7feab4360640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe9a4036790 0x7fe9a4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.143+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb6503de90 0x55fb6513b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.143+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6513b980 con 0x55fb6503de90 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feabd362640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb6503de90 0x55fb6513b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feab4360640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe9a4036790 0x7fe9a4038c50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feaa4054000 tx=0x7feaa404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feabd362640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb6503de90 0x55fb6513b440 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feabd362640 1 -- 172.21.15.177:0/3272743472 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb6503de90 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6513bce0 con 0x55fb6503de90 2024-03-20T13:35:17.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feabd362640 1 -- 172.21.15.177:0/3272743472 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb6503de90 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb6513d760 0x55fb6513fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.144+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65140380 con 0x55fb6513d760 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feabcb61640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb6513d760 0x55fb6513fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feabcb61640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb6513d760 0x55fb6513fbf0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feabcb61640 1 -- 172.21.15.177:0/3272743472 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7feaac016070 con 0x55fb6513d760 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6513c4e0 con 0x55fb6503de90 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feabd362640 1 -- 172.21.15.177:0/3272743472 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb6503de90 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55fb651417a0 0x55fb65143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.145+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651442f0 con 0x55fb651417a0 2024-03-20T13:35:17.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.146+0000 7feab4360640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55fb651417a0 0x55fb65143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.149+0000 7feab4360640 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55fb651417a0 0x55fb65143b90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.150+0000 7feab4360640 1 -- 172.21.15.177:0/3272743472 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb651417a0 2024-03-20T13:35:17.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.150+0000 7feac1416800 1 Processor -- start 2024-03-20T13:35:17.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.150+0000 7feac1416800 1 -- start start 2024-03-20T13:35:17.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.151+0000 7feac1416800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 0x55fb651528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.151+0000 7feac1416800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb64ed7c70 con 0x55fb651524a0 2024-03-20T13:35:17.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.152+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 0x55fb651528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.152+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 0x55fb651528c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41292/0 (socket says 172.21.15.177:41292) 2024-03-20T13:35:17.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.152+0000 7feabcb61640 1 -- 172.21.15.177:0/3435609664 learned_addr learned my addr 172.21.15.177:0/3435609664 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.153+0000 7feabcb61640 1 -- 172.21.15.177:0/3435609664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb65152e00 con 0x55fb651524a0 2024-03-20T13:35:17.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.155+0000 7feabcb61640 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 0x55fb651528c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7feaac04a370 tx=0x7feaac018eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.156+0000 7fe9a27fc640 1 -- 172.21.15.177:0/3435609664 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac03ebb0 con 0x55fb651524a0 2024-03-20T13:35:17.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.156+0000 7fe9a27fc640 1 -- 172.21.15.177:0/3435609664 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac03ed10 con 0x55fb651524a0 2024-03-20T13:35:17.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.156+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb65153870 con 0x55fb651524a0 2024-03-20T13:35:17.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.156+0000 7fe9a27fc640 1 -- 172.21.15.177:0/3435609664 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac02d990 con 0x55fb651524a0 2024-03-20T13:35:17.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.156+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb65153d30 con 0x55fb651524a0 2024-03-20T13:35:17.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.157+0000 7fe9a27fc640 1 -- 172.21.15.177:0/3435609664 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feaac02daf0 con 0x55fb651524a0 2024-03-20T13:35:17.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.157+0000 7fe9a27fc640 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe994036830 0x7fe994038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.157+0000 7fe9a27fc640 1 -- 172.21.15.177:0/3435609664 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7feaac039cd0 con 0x55fb651524a0 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.157+0000 7feab4360640 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe994036830 0x7fe994038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.158+0000 7feac1416800 1 Processor -- start 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.158+0000 7feac1416800 1 -- start start 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.158+0000 7feab4360640 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe994036830 0x7fe994038cf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55fb6512a5b0 tx=0x7feaa4005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.158+0000 7feac1416800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb6515fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.158+0000 7feac1416800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb64ead5d0 con 0x55fb6515f770 2024-03-20T13:35:17.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.159+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb6515fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.159+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb6515fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41304/0 (socket says 172.21.15.177:41304) 2024-03-20T13:35:17.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.159+0000 7feabcb61640 1 -- 172.21.15.177:0/1747735149 learned_addr learned my addr 172.21.15.177:0/1747735149 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.162 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.160+0000 7feabcb61640 1 -- 172.21.15.177:0/1747735149 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb65160160 con 0x55fb6515f770 2024-03-20T13:35:17.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.161+0000 7feabcb61640 1 --2- 172.21.15.177:0/1747735149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb6515fb90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7feaac02a310 tx=0x7feaac043890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57164e43968089f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.162+0000 7fe993fff640 1 -- 172.21.15.177:0/1747735149 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac02f480 con 0x55fb6515f770 2024-03-20T13:35:17.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.162+0000 7fe993fff640 1 -- 172.21.15.177:0/1747735149 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac04d070 con 0x55fb6515f770 2024-03-20T13:35:17.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.162+0000 7fe993fff640 1 -- 172.21.15.177:0/1747735149 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac02a060 con 0x55fb6515f770 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 -- 172.21.15.177:0/1747735149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 msgr2=0x55fb6515fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 --2- 172.21.15.177:0/1747735149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb6515fb90 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7feaac02a310 tx=0x7feaac043890 comp rx=0 tx=0).stop 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 -- 172.21.15.177:0/1747735149 shutdown_connections 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 --2- 172.21.15.177:0/1747735149 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb6515fb90 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 -- 172.21.15.177:0/1747735149 >> 172.21.15.177:0/1747735149 conn(0x55fb6515ba40 msgr2=0x55fb65159aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 -- 172.21.15.177:0/1747735149 shutdown_connections 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 -- 172.21.15.177:0/1747735149 wait complete. 2024-03-20T13:35:17.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 Processor -- start 2024-03-20T13:35:17.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.163+0000 7feac1416800 1 -- start start 2024-03-20T13:35:17.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.164+0000 7feac1416800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb651666b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.164+0000 7feac1416800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fb65166bf0 con 0x55fb6515f770 2024-03-20T13:35:17.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.165+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb651666b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.165+0000 7feabcb61640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb651666b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41312/0 (socket says 172.21.15.177:41312) 2024-03-20T13:35:17.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.165+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 learned_addr learned my addr 172.21.15.177:0/80851849 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.167+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fb65153d30 con 0x55fb6515f770 2024-03-20T13:35:17.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.168+0000 7feabcb61640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb651666b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feaac02f850 tx=0x7feaac02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.168+0000 7fe9927fc640 1 -- 172.21.15.177:0/80851849 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac02f480 con 0x55fb6515f770 2024-03-20T13:35:17.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.168+0000 7fe9927fc640 1 -- 172.21.15.177:0/80851849 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feaac04ad80 con 0x55fb6515f770 2024-03-20T13:35:17.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.168+0000 7fe9927fc640 1 -- 172.21.15.177:0/80851849 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feaac01c440 con 0x55fb6515f770 2024-03-20T13:35:17.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.168+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fb65153d30 con 0x55fb6515f770 2024-03-20T13:35:17.170 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.168+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fb65153d30 con 0x55fb6515f770 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7fe9927fc640 1 -- 172.21.15.177:0/80851849 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7feaac043140 con 0x55fb6515f770 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7fe9927fc640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe988036830 0x7fe988038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7fe9927fc640 1 -- 172.21.15.177:0/80851849 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7feaac06bc40 con 0x55fb6515f770 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7feab4360640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe988036830 0x7fe988038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7feab4360640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe988036830 0x7fe988038cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feaa4052fd0 tx=0x7feaa404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb65171ef0 0x55fb651743b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65174b00 con 0x55fb65171ef0 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.169+0000 7feabd362640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb65171ef0 0x55fb651743b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feabd362640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb65171ef0 0x55fb651743b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 realm 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65174ed0 con 0x55fb65171ef0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.170+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175ab0 con 0x55fb65171ef0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb65176460 0x55fb65178850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65178e60 con 0x55fb65176460 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feabcb61640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb65176460 0x55fb65178850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feabcb61640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb65176460 0x55fb65178850 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7feaac016070 con 0x55fb65176460 2024-03-20T13:35:17.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 20 searching for the correct realm 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55fb6517b110 0x55fb6517d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6517dc50 con 0x55fb6517b110 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.171+0000 7feab4360640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55fb6517b110 0x55fb6517d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.172+0000 7feab4360640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55fb6517b110 0x55fb6517d5d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.172+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.172+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6517dc50 con 0x55fb65176460 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.172+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaac016070 con 0x55fb65176460 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.172+0000 7feabcb61640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7feaac074060 0x7feaac05e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.172+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6517dc50 con 0x7feaac074060 2024-03-20T13:35:17.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.173+0000 7feabd362640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7feaac074060 0x7feaac05e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.173+0000 7feabd362640 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7feaac074060 0x7feaac05e450 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.174+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.174+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.174+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.174+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.174+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.174+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.175+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.175+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.175+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.175+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65176460 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.176+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaac016070 con 0x55fb65176460 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.176+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.176+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.176+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.176+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.176+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.177+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.177+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.177+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.177+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65176460 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.177+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7feaac016070 con 0x55fb65176460 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.177+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.178+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.178+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.178+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.178+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.179+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.180+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.180+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.181+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.181+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.181+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.181+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65176460 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.181+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.181+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.182+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.182+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.182+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.182+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb6517b110 2024-03-20T13:35:17.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.183+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.183+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x7feaac074060 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.184+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.184+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7feab8031040 con 0x55fb65176460 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.184+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.184+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7feab8031040 con 0x55fb6517b110 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.184+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.184+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7feab8031040 con 0x7feaac074060 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.185+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.195 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.185+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7feab8031040 con 0x55fb65171ef0 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7feab8031040 con 0x55fb65176460 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65175750 con 0x55fb65171ef0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65179550 con 0x55fb65171ef0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.186+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65179520 con 0x7feaac074060 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 20 zone default found 2024-03-20T13:35:17.197 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 4 Realm: () 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 20 zonegroup default 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.188+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65179e20 con 0x7feaac074060 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.189+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.189+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.189+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.189+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65179e20 con 0x55fb6517b110 2024-03-20T13:35:17.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.189+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6517fa70 con 0x55fb6517b110 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 20 started sync module instance, tier type = 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.190+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6517ef00 con 0x55fb65176460 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.191+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.191+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94538221220528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb6517f6d0 con 0x55fb65176460 2024-03-20T13:35:17.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.191+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65180880 con 0x55fb65171ef0 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.192+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94538221220528] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.192+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.192+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94538221224928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65180ca0 con 0x55fb65171ef0 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.192+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65181610 con 0x55fb6517b110 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.193+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94538221224928] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.193+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.193+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94538221225984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65180c20 con 0x55fb6517b110 2024-03-20T13:35:17.200 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.193+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65182420 con 0x55fb65176460 2024-03-20T13:35:17.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.194+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.194+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94538221225984] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.194+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94538221232480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65182b80 con 0x55fb65176460 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.194+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65183130 con 0x55fb65171ef0 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.195+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.195+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94538221230448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65183130 con 0x55fb65171ef0 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.195+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651840a0 con 0x7feaac074060 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.195+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94538221232480] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.197+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.197+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94538221239168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65184060 con 0x7feaac074060 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.197+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65184a80 con 0x7feaac074060 2024-03-20T13:35:17.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.197+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94538221230448] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.197+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94538221239168] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.198+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.198+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94538221233632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65183510 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.198+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65184f60 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94538221233632] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'132 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94538221241792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65184f20 con 0x7feaac074060 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=0 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=1 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=2 2024-03-20T13:35:17.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=3 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=4 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=5 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.199+0000 7feac1416800 20 add_watcher() i=6 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.200+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94538221241792] v30'133 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.200+0000 7feac1416800 20 add_watcher() i=7 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.200+0000 7feac1416800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.200+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65188370 con 0x55fb65171ef0 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.201+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.201+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94538221243472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb65185850 con 0x55fb65171ef0 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94538221243472] v30'128 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feab800a4a0 con 0x55fb65171ef0 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7fe972fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 5 note: GC not initialized 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7fe971fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 20 Filter name: none 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7fe8e37fe640 20 reqs_thread_entry: start 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.202+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651ba470 con 0x7feaac074060 2024-03-20T13:35:17.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7feab800a4a0 con 0x7feaac074060 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=385 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.203+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651bbfb0 con 0x55fb65176460 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:17.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651bd6a0 con 0x55fb65171ef0 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(64 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv5 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-03-20T13:35:17.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.204+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c1970 con 0x55fb65176460 2024-03-20T13:35:17.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.206+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 foo.buckets [call] v30'24 uv24 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.206+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 8.f 8:f2b88cd0:root::.bucket.meta.testx%3amyfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [create,call version.inc in=38b,writefull 0~371 in=371b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c5230 con 0x55fb6517b110 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.207+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [create,call,writefull 0~371,setxattr (203)] v30'1 uv1 ondisk = 0) v8 ==== 338+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.207+0000 7feac1416800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x7 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.207+0000 7feac1416800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.207+0000 7feac1416800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.207+0000 7feac1416800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.207+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 94538221498480 in=818b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4d40 con 0x55fb6517b110 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== watch-notify(notify (1) cookie 94538221225984 notify 128849018885 ret 0) v3 ==== 848+0+0 (crc 0 0 0) 0x55fb650418b0 con 0x55fb6517b110 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7fe993fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018885 cookie 94538221225984 notifier 4531 bl.length()=806 2024-03-20T13:35:17.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7fe993fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x7 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(67 notify.2 [notify cookie 94538221498480 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7fe993fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7fe993fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7fe993fff640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe980003e90 con 0x55fb6517b110 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== watch-notify(notify_complete (2) cookie 94538221498480 notify 128849018885 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7feaa404e070 con 0x55fb6517b110 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feac1416800 20 handle_bi_update(): bucket=testx:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_sources= new_sources= 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feac1416800 20 handle_bi_update(): bucket=testx:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential sources added=[] removed=[] 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feac1416800 20 handle_bi_update(): bucket=testx:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_dests= new_dests= 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feac1416800 20 handle_bi_update(): bucket=testx:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential dests added=[] removed=[] 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.208+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c3070 con 0x55fb65171ef0 2024-03-20T13:35:17.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.209+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v30'1 uv1 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.209+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c57f0 con 0x55fb65171ef0 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.210+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v30'1 uv1 ondisk = 0) v8 ==== 281+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.210+0000 7feac1416800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.210+0000 7feac1416800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.210+0000 7feac1416800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.210+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94538221498480 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4980 con 0x55fb65171ef0 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== watch-notify(notify (1) cookie 94538221230448 notify 128849018891 ret 0) v3 ==== 390+0+0 (crc 0 0 0) 0x7feab803d040 con 0x55fb65171ef0 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7fe993fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018891 cookie 94538221230448 notifier 4531 bl.length()=348 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7fe993fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7fe993fff640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(71 notify.4 [notify cookie 94538221498480 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7fe993fff640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe980003e90 con 0x55fb65171ef0 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94538221498480 notify 128849018891 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7feab8043510 con 0x55fb65171ef0 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feac1416800 10 removing default.rgw.meta+root+myfoo from cache 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feac1416800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.211+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94538221465504 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x7feaac074060 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== watch-notify(notify (1) cookie 94538221233632 notify 128849018897 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7feab8043510 con 0x7feaac074060 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7fe9937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94538221233632 notifier 4531 bl.length()=149 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 notify.6 [notify cookie 94538221465504 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feab8049040 con 0x7feaac074060 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7fe9937fe640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe8f00032b0 con 0x7feaac074060 2024-03-20T13:35:17.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== watch-notify(notify_complete (2) cookie 94538221465504 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7feab8043770 con 0x7feaac074060 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(74 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x7feaac074060 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.212+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:75 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65176460 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(75 myfoo [call,delete] v30'25 uv25 ondisk = 0) v8 ==== 191+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feac1416800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 from cache 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feac1416800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [notify cookie 94538221476688 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65176460 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== watch-notify(notify (1) cookie 94538221232480 notify 128849018896 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x55fb65160160 con 0x55fb65176460 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7fe9937fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018896 cookie 94538221232480 notifier 4531 bl.length()=206 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(76 notify.3 [notify cookie 94538221476688 out=8b] v0'0 uv132 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7fe9937fe640 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fe8f00032b0 con 0x55fb65176460 2024-03-20T13:35:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(77 notify.3 [notify-ack] v0'0 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== watch-notify(notify_complete (2) cookie 94538221476688 notify 128849018896 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55fb65153870 con 0x55fb65176460 2024-03-20T13:35:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.214+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65171ef0 2024-03-20T13:35:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.215+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(78 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call,delete] v30'6 uv6 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.216+0000 7fe972fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.216+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94538221243472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65171ef0 2024-03-20T13:35:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.217+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94538221243472] v30'129 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.217+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94538221220528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65176460 2024-03-20T13:35:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.218+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94538221220528] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.218+0000 7feac1416800 20 remove_watcher() i=0 2024-03-20T13:35:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.218+0000 7feac1416800 2 removed watcher, disabling cache 2024-03-20T13:35:17.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.218+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94538221224928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65171ef0 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.219+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94538221224928] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.219+0000 7feac1416800 20 remove_watcher() i=1 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.219+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94538221225984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb6517b110 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.220+0000 7feab4360640 1 -- 172.21.15.177:0/80851849 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94538221225984] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaa4052b40 con 0x55fb6517b110 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.220+0000 7feac1416800 20 remove_watcher() i=2 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.220+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94538221232480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65176460 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.221+0000 7feabcb61640 1 -- 172.21.15.177:0/80851849 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94538221232480] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feaac087080 con 0x55fb65176460 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.221+0000 7feac1416800 20 remove_watcher() i=3 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.221+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94538221230448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x55fb65171ef0 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.222+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94538221230448] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x55fb65171ef0 2024-03-20T13:35:17.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.222+0000 7feac1416800 20 remove_watcher() i=4 2024-03-20T13:35:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.222+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94538221239168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x7feaac074060 2024-03-20T13:35:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.224+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94538221239168] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x7feaac074060 2024-03-20T13:35:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.224+0000 7feac1416800 20 remove_watcher() i=5 2024-03-20T13:35:17.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.224+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94538221233632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x7feaac074060 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.226+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94538221233632] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x7feaac074060 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.226+0000 7feac1416800 20 remove_watcher() i=6 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.226+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94538221241792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55fb651c4960 con 0x7feaac074060 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94538221241792] v30'134 uv132 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7feab8049040 con 0x7feaac074060 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 20 remove_watcher() i=7 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7feaac074060 msgr2=0x7feaac05e450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7feaac074060 0x7feaac05e450 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb65171ef0 msgr2=0x55fb651743b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb65171ef0 0x55fb651743b0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb65176460 msgr2=0x55fb65178850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb65176460 0x55fb65178850 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55fb6517b110 msgr2=0x55fb6517d5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55fb6517b110 0x55fb6517d5d0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe988036830 msgr2=0x7fe988038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe988036830 0x7fe988038cf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7feaa4052fd0 tx=0x7feaa404f000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 msgr2=0x55fb651666b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 --2- 172.21.15.177:0/80851849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb6515f770 0x55fb651666b0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feaac02f850 tx=0x7feaac02a2a0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 reap_dead start 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feabd362640 1 -- 172.21.15.177:0/80851849 reap_dead start 2024-03-20T13:35:17.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 shutdown_connections 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 >> 172.21.15.177:0/80851849 conn(0x55fb6515ba40 msgr2=0x55fb651590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.227+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 shutdown_connections 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/80851849 wait complete. 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe994036830 msgr2=0x7fe994038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe994036830 0x7fe994038cf0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x55fb6512a5b0 tx=0x7feaa4005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 msgr2=0x55fb651528c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 0x55fb651528c0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7feaac04a370 tx=0x7feaac018eb0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 shutdown_connections 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe994036830 0x7fe994038cf0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3435609664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb651524a0 0x55fb651528c0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 >> 172.21.15.177:0/3435609664 conn(0x55fb65146540 msgr2=0x55fb65146940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 shutdown_connections 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3435609664 wait complete. 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55fb651417a0 msgr2=0x55fb65143b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55fb651417a0 0x55fb65143b90 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb6503de90 msgr2=0x55fb6513b440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55fb6503de90 0x55fb6513b440 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb6513d760 msgr2=0x55fb6513fbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55fb6513d760 0x55fb6513fbf0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe9a4036790 msgr2=0x7fe9a4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe9a4036790 0x7fe9a4038c50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7feaa4054000 tx=0x7feaa404e000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 msgr2=0x55fb6512b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 --2- 172.21.15.177:0/3272743472 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55fb65039a00 0x55fb6512b0f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x55fb64fad300 tx=0x7feaac000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feabd362640 1 -- 172.21.15.177:0/3272743472 reap_dead start 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 shutdown_connections 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 >> 172.21.15.177:0/3272743472 conn(0x55fb65035060 msgr2=0x55fb65123b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 shutdown_connections 2024-03-20T13:35:17.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.228+0000 7feac1416800 1 -- 172.21.15.177:0/3272743472 wait complete. 2024-03-20T13:35:17.238 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-03-20T13:35:17.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-03-20T13:35:17.238 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-03-20T13:35:17.280 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:17.280 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba85816800 1 Processor -- start 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba85816800 1 -- start start 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba85816800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56527613a080 0x56527613c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba85816800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x565276080cd0 con 0x565276136570 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba85816800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x565276037500 con 0x56527613a080 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba7bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56527613a080 0x56527613c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba7bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56527613a080 0x56527613c470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41320/0 (socket says 172.21.15.177:41320) 2024-03-20T13:35:17.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba7bfff640 1 -- 172.21.15.177:0/1474936480 learned_addr learned my addr 172.21.15.177:0/1474936480 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba80e84640 1 --1- 172.21.15.177:0/1474936480 >> v1:172.21.15.28:6789/0 conn(0x565276136570 0x565276138960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50608/0 (socket says 172.21.15.177:50608) 2024-03-20T13:35:17.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba7bfff640 1 -- 172.21.15.177:0/1474936480 >> v1:172.21.15.28:6789/0 conn(0x565276136570 legacy=0x565276138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.280+0000 7fba7bfff640 1 -- 172.21.15.177:0/1474936480 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56527613d9c0 con 0x56527613a080 2024-03-20T13:35:17.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.282+0000 7fba7bfff640 1 --2- 172.21.15.177:0/1474936480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527613a080 0x56527613c470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00a520 tx=0x7fba6c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec037a8600e10a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba7b7fe640 1 -- 172.21.15.177:0/1474936480 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba6c052570 con 0x56527613a080 2024-03-20T13:35:17.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba7b7fe640 1 -- 172.21.15.177:0/1474936480 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba6c0526d0 con 0x56527613a080 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba7b7fe640 1 -- 172.21.15.177:0/1474936480 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba6c052990 con 0x56527613a080 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 -- 172.21.15.177:0/1474936480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527613a080 msgr2=0x56527613c470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 --2- 172.21.15.177:0/1474936480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527613a080 0x56527613c470 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fba6c00a520 tx=0x7fba6c01cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 -- 172.21.15.177:0/1474936480 shutdown_connections 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 --2- 172.21.15.177:0/1474936480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527613a080 0x56527613c470 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 -- 172.21.15.177:0/1474936480 >> 172.21.15.177:0/1474936480 conn(0x565276130040 msgr2=0x565276132460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 -- 172.21.15.177:0/1474936480 shutdown_connections 2024-03-20T13:35:17.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.283+0000 7fba85816800 1 -- 172.21.15.177:0/1474936480 wait complete. 2024-03-20T13:35:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.295+0000 7fba85816800 1 Processor -- start 2024-03-20T13:35:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.295+0000 7fba85816800 1 -- start start 2024-03-20T13:35:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.295+0000 7fba85816800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276225a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.295+0000 7fba85816800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x565276034a30 con 0x565276136570 2024-03-20T13:35:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.296+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276225a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.296+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276225a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41332/0 (socket says 172.21.15.177:41332) 2024-03-20T13:35:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.296+0000 7fba80e84640 1 -- 172.21.15.177:0/1404403309 learned_addr learned my addr 172.21.15.177:0/1404403309 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.296+0000 7fba80e84640 1 -- 172.21.15.177:0/1404403309 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba6c005de0 con 0x565276136570 2024-03-20T13:35:17.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.297+0000 7fba80e84640 1 --2- 172.21.15.177:0/1404403309 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276225a80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fba74001c80 tx=0x7fba7400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b8b44389a60464 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.297+0000 7fb96ee05640 1 -- 172.21.15.177:0/1404403309 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba74014070 con 0x565276136570 2024-03-20T13:35:17.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.297+0000 7fb96ee05640 1 -- 172.21.15.177:0/1404403309 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7400f450 con 0x565276136570 2024-03-20T13:35:17.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.297+0000 7fb96ee05640 1 -- 172.21.15.177:0/1404403309 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7400f790 con 0x565276136570 2024-03-20T13:35:17.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 -- 172.21.15.177:0/1404403309 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 msgr2=0x565276225a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 --2- 172.21.15.177:0/1404403309 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276225a80 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fba74001c80 tx=0x7fba7400b600 comp rx=0 tx=0).stop 2024-03-20T13:35:17.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 -- 172.21.15.177:0/1404403309 shutdown_connections 2024-03-20T13:35:17.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 --2- 172.21.15.177:0/1404403309 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276225a80 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 -- 172.21.15.177:0/1404403309 >> 172.21.15.177:0/1404403309 conn(0x565276130040 msgr2=0x5652762213a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 -- 172.21.15.177:0/1404403309 shutdown_connections 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 -- 172.21.15.177:0/1404403309 wait complete. 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.298+0000 7fba85816800 1 Processor -- start 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba85816800 1 -- start start 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba85816800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276135e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba85816800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x565276030210 con 0x565276136570 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276135e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276135e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41348/0 (socket says 172.21.15.177:41348) 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba80e84640 1 -- 172.21.15.177:0/454865408 learned_addr learned my addr 172.21.15.177:0/454865408 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba80e84640 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565276080cd0 con 0x565276136570 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fba80e84640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276135e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fba74004000 tx=0x7fba74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.299+0000 7fb96d602640 1 -- 172.21.15.177:0/454865408 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba74014070 con 0x565276136570 2024-03-20T13:35:17.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.300+0000 7fb96d602640 1 -- 172.21.15.177:0/454865408 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba74020070 con 0x565276136570 2024-03-20T13:35:17.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.300+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5652761363a0 con 0x565276136570 2024-03-20T13:35:17.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.300+0000 7fb96d602640 1 -- 172.21.15.177:0/454865408 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba740198e0 con 0x565276136570 2024-03-20T13:35:17.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.300+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5652761348f0 con 0x565276136570 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.300+0000 7fb96d602640 1 -- 172.21.15.177:0/454865408 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fba74019a40 con 0x565276136570 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fb96d602640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb968036790 0x7fb968038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fb96d602640 1 -- 172.21.15.177:0/454865408 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fba74008030 con 0x565276136570 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba7bfff640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb968036790 0x7fb968038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527613a080 0x565276236470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276135240 con 0x56527613a080 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba81685640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527613a080 0x565276236470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba7bfff640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb968036790 0x7fb968038c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba6c054000 tx=0x7fba6c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba81685640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527613a080 0x565276236470 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba81685640 1 -- 172.21.15.177:0/454865408 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527613a080 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.301+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276134cd0 con 0x56527613a080 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba81685640 1 -- 172.21.15.177:0/454865408 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527613a080 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276238890 0x56527623ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527623b350 con 0x565276238890 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba80e84640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276238890 0x56527623ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba80e84640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276238890 0x56527623ac80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba80e84640 1 -- 172.21.15.177:0/454865408 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fba74016070 con 0x565276238890 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.302+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276237810 con 0x56527613a080 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.303+0000 7fba81685640 1 -- 172.21.15.177:0/454865408 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527613a080 2024-03-20T13:35:17.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.303+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56527623c770 0x56527623eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.303+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527623f250 con 0x56527623c770 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.303+0000 7fba7bfff640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56527623c770 0x56527623eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba7bfff640 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56527623c770 0x56527623eb60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba7bfff640 1 -- 172.21.15.177:0/454865408 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fba6c066040 con 0x56527623c770 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba85816800 1 Processor -- start 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba85816800 1 -- start start 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba85816800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 0x56527624d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba85816800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x565275fd2c70 con 0x56527624d450 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 0x56527624d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 0x56527624d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41360/0 (socket says 172.21.15.177:41360) 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.304+0000 7fba80e84640 1 -- 172.21.15.177:0/1312460464 learned_addr learned my addr 172.21.15.177:0/1312460464 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fba80e84640 1 -- 172.21.15.177:0/1312460464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56527624ddb0 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fba80e84640 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 0x56527624d870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fba7404aa20 tx=0x7fba74044dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fb9667fc640 1 -- 172.21.15.177:0/1312460464 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba74035070 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fb9667fc640 1 -- 172.21.15.177:0/1312460464 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7401bb30 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56527624e820 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fb9667fc640 1 -- 172.21.15.177:0/1312460464 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7400e520 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.305+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56527624ece0 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fb9667fc640 1 -- 172.21.15.177:0/1312460464 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fba7401b440 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fb9667fc640 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9580367e0 0x7fb958038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fb9667fc640 1 -- 172.21.15.177:0/1312460464 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fba7403bc50 con 0x56527624d450 2024-03-20T13:35:17.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fba7bfff640 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9580367e0 0x7fb958038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fba85816800 1 Processor -- start 2024-03-20T13:35:17.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fba7bfff640 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9580367e0 0x7fb958038ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x565276236e50 tx=0x7fba6c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fba85816800 1 -- start start 2024-03-20T13:35:17.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fba85816800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x56527625ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.312 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.306+0000 7fba85816800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x565275fa85d0 con 0x56527625a770 2024-03-20T13:35:17.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.307+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x56527625ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.307+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x56527625ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41374/0 (socket says 172.21.15.177:41374) 2024-03-20T13:35:17.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.307+0000 7fba80e84640 1 -- 172.21.15.177:0/3081387727 learned_addr learned my addr 172.21.15.177:0/3081387727 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.315 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.308+0000 7fba80e84640 1 -- 172.21.15.177:0/3081387727 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56527625b160 con 0x56527625a770 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.310+0000 7fba80e84640 1 --2- 172.21.15.177:0/3081387727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x56527625ab90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fba7401bcc0 tx=0x7fba7403bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bf4e89267ce902d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fb957fff640 1 -- 172.21.15.177:0/3081387727 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7404cc70 con 0x56527625a770 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fb957fff640 1 -- 172.21.15.177:0/3081387727 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba740447b0 con 0x56527625a770 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fb957fff640 1 -- 172.21.15.177:0/3081387727 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba74043a50 con 0x56527625a770 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 -- 172.21.15.177:0/3081387727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 msgr2=0x56527625ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 --2- 172.21.15.177:0/3081387727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x56527625ab90 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fba7401bcc0 tx=0x7fba7403bfb0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 -- 172.21.15.177:0/3081387727 shutdown_connections 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 --2- 172.21.15.177:0/3081387727 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x56527625ab90 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 -- 172.21.15.177:0/3081387727 >> 172.21.15.177:0/3081387727 conn(0x5652762569f0 msgr2=0x565276254a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 -- 172.21.15.177:0/3081387727 shutdown_connections 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.311+0000 7fba85816800 1 -- 172.21.15.177:0/3081387727 wait complete. 2024-03-20T13:35:17.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba85816800 1 Processor -- start 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba85816800 1 -- start start 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba85816800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x565276261630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba85816800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x565276261b70 con 0x56527625a770 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x565276261630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba80e84640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x565276261630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41376/0 (socket says 172.21.15.177:41376) 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.312+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 learned_addr learned my addr 172.21.15.177:0/2149287794 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.313+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56527624ece0 con 0x56527625a770 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.314+0000 7fba80e84640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x565276261630 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fba7400ffb0 tx=0x7fba74011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.314+0000 7fb9567fc640 1 -- 172.21.15.177:0/2149287794 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7404cc70 con 0x56527625a770 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.314+0000 7fb9567fc640 1 -- 172.21.15.177:0/2149287794 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba7401a5e0 con 0x56527625a770 2024-03-20T13:35:17.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.314+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56527624ece0 con 0x56527625a770 2024-03-20T13:35:17.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.314+0000 7fb9567fc640 1 -- 172.21.15.177:0/2149287794 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba7401a880 con 0x56527625a770 2024-03-20T13:35:17.318 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.314+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56527624ece0 con 0x56527625a770 2024-03-20T13:35:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fb9567fc640 1 -- 172.21.15.177:0/2149287794 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fba7401a9e0 con 0x56527625a770 2024-03-20T13:35:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fb9567fc640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb94c0367e0 0x7fb94c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fb9567fc640 1 -- 172.21.15.177:0/2149287794 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fba74075c80 con 0x56527625a770 2024-03-20T13:35:17.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fba7bfff640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb94c0367e0 0x7fb94c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527626cef0 0x56527626f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.315+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527626fae0 con 0x56527626cef0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba81685640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527626cef0 0x56527626f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba7bfff640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb94c0367e0 0x7fb94c038ca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba6c052fd0 tx=0x7fba6c05f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba81685640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527626cef0 0x56527626f390 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 realm 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527626feb0 con 0x56527626cef0 2024-03-20T13:35:17.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.316+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270a60 con 0x56527626cef0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276271410 0x565276273800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276273d80 con 0x565276271410 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba80e84640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276271410 0x565276273800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba80e84640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276271410 0x565276273800 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 20 searching for the correct realm 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565276275d20 0x5652762781e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652762788b0 con 0x565276275d20 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.317+0000 7fba7bfff640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565276275d20 0x5652762781e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.318+0000 7fba7bfff640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565276275d20 0x5652762781e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.318+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.318+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652762788b0 con 0x565276271410 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.318+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.318+0000 7fba80e84640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fba74074060 0x7fba7402e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.318+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652762788b0 con 0x7fba74074060 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.319+0000 7fba81685640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fba74074060 0x7fba7402e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.319+0000 7fba81685640 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fba74074060 0x7fba7402e580 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.319+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.320+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276271410 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.321+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276271410 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.322+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.323+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276271410 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.324+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x565276275d20 2024-03-20T13:35:17.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x7fba74074060 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fba7c031040 con 0x565276271410 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.325+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fba7c031040 con 0x565276275d20 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fba7c031040 con 0x7fba74074060 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fba7c031040 con 0x56527626cef0 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fba7c031040 con 0x565276271410 2024-03-20T13:35:17.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.326+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276270700 con 0x56527626cef0 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276274650 con 0x56527626cef0 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276274650 con 0x7fba74074060 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 zone default found 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 4 Realm: () 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:17.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 zonegroup default 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.327+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276274f20 con 0x7fba74074060 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276274f20 con 0x565276275d20 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627a6d0 con 0x565276275d20 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 started sync module instance, tier type = 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.328+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276279b60 con 0x565276271410 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.329+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.329+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94912169615040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627a2e0 con 0x565276271410 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.329+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627b3d0 con 0x56527626cef0 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.330+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94912169615040] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.330+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.330+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94912169617968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627b7b0 con 0x56527626cef0 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.330+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627c1d0 con 0x565276275d20 2024-03-20T13:35:17.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.331+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94912169617968] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.332+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.332+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94912169622704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627c580 con 0x565276275d20 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.332+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627cff0 con 0x565276271410 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.333+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94912169622704] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.333+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.333+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94912169619024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627d840 con 0x565276271410 2024-03-20T13:35:17.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.333+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627e0c0 con 0x56527626cef0 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.334+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94912169619024] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.334+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.334+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94912169628576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627dc60 con 0x56527626cef0 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.334+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627eb20 con 0x7fba74074060 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.335+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94912169628576] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.335+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.335+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94912169633296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627dc60 con 0x7fba74074060 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.335+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627f520 con 0x7fba74074060 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.338+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94912169633296] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.338+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.338+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94912169635904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627dc60 con 0x7fba74074060 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.338+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627fee0 con 0x7fba74074060 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94912169635904] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'135 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94912169629632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627fee0 con 0x7fba74074060 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=0 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=1 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=2 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=3 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=4 2024-03-20T13:35:17.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=5 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.340+0000 7fba85816800 20 add_watcher() i=6 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.343+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94912169629632] v30'136 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.343+0000 7fba85816800 20 add_watcher() i=7 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.343+0000 7fba85816800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.343+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652762832f0 con 0x56527626cef0 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.343+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.343+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94912169638928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652762807d0 con 0x56527626cef0 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.344+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94912169638928] v30'130 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.344+0000 7fb936fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.344+0000 7fba85816800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:17.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.344+0000 7fba85816800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.344+0000 7fba85816800 5 note: GC not initialized 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.344+0000 7fb935fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fba85816800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fba85816800 20 Filter name: none 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fb8a77fe640 20 reqs_thread_entry: start 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fba85816800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x5652762b4c10 con 0x56527626cef0 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv1 ondisk = 0) v8 ==== 281+0+332 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.345+0000 7fba85816800 20 rados_obj.operate() r=0 bl.length=193 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.346+0000 7fb936fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.346+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94912169638928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276282720 con 0x56527626cef0 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.347+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94912169638928] v30'131 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.347+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94912169615040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627fbe0 con 0x565276271410 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.348+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94912169615040] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.348+0000 7fba85816800 20 remove_watcher() i=0 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.348+0000 7fba85816800 2 removed watcher, disabling cache 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.348+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94912169617968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276279ec0 con 0x56527626cef0 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.349+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94912169617968] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.349+0000 7fba85816800 20 remove_watcher() i=1 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.349+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94912169622704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x565276279ec0 con 0x565276275d20 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.351+0000 7fba7bfff640 1 -- 172.21.15.177:0/2149287794 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94912169622704] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba6c066040 con 0x565276275d20 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.351+0000 7fba85816800 20 remove_watcher() i=2 2024-03-20T13:35:17.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.351+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94912169619024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627bcb0 con 0x565276271410 2024-03-20T13:35:17.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.352+0000 7fba80e84640 1 -- 172.21.15.177:0/2149287794 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94912169619024] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba74016070 con 0x565276271410 2024-03-20T13:35:17.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.352+0000 7fba85816800 20 remove_watcher() i=3 2024-03-20T13:35:17.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.352+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94912169628576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627bcb0 con 0x56527626cef0 2024-03-20T13:35:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.353+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94912169628576] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x56527626cef0 2024-03-20T13:35:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.353+0000 7fba85816800 20 remove_watcher() i=4 2024-03-20T13:35:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.353+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94912169633296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627bcb0 con 0x7fba74074060 2024-03-20T13:35:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.355+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94912169633296] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.355+0000 7fba85816800 20 remove_watcher() i=5 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.355+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94912169635904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627bcb0 con 0x7fba74074060 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.357+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94912169635904] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.357+0000 7fba85816800 20 remove_watcher() i=6 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.357+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94912169629632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56527627f040 con 0x7fba74074060 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94912169629632] v30'137 uv135 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fba7c00a4a0 con 0x7fba74074060 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 20 remove_watcher() i=7 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fba74074060 msgr2=0x7fba7402e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fba74074060 0x7fba7402e580 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527626cef0 msgr2=0x56527626f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527626cef0 0x56527626f390 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276271410 msgr2=0x565276273800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276271410 0x565276273800 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565276275d20 msgr2=0x5652762781e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x565276275d20 0x5652762781e0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb94c0367e0 msgr2=0x7fb94c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb94c0367e0 0x7fb94c038ca0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fba6c052fd0 tx=0x7fba6c05f040 comp rx=0 tx=0).stop 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 msgr2=0x565276261630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/2149287794 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527625a770 0x565276261630 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fba7400ffb0 tx=0x7fba74011f00 comp rx=0 tx=0).stop 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 reap_dead start 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba81685640 1 -- 172.21.15.177:0/2149287794 reap_dead start 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 shutdown_connections 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 >> 172.21.15.177:0/2149287794 conn(0x5652762569f0 msgr2=0x565276254050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 shutdown_connections 2024-03-20T13:35:17.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/2149287794 wait complete. 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9580367e0 msgr2=0x7fb958038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9580367e0 0x7fb958038ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x565276236e50 tx=0x7fba6c005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 msgr2=0x56527624d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 0x56527624d870 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fba7404aa20 tx=0x7fba74044dc0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 shutdown_connections 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9580367e0 0x7fb958038ca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 --2- 172.21.15.177:0/1312460464 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56527624d450 0x56527624d870 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.358+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 >> 172.21.15.177:0/1312460464 conn(0x5652762414f0 msgr2=0x5652762418f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 shutdown_connections 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/1312460464 wait complete. 2024-03-20T13:35:17.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56527623c770 msgr2=0x56527623eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56527623c770 0x56527623eb60 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527613a080 msgr2=0x565276236470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56527613a080 0x565276236470 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276238890 msgr2=0x56527623ac80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x565276238890 0x56527623ac80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb968036790 msgr2=0x7fb968038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb968036790 0x7fb968038c50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fba6c054000 tx=0x7fba6c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 msgr2=0x565276135e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 --2- 172.21.15.177:0/454865408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x565276136570 0x565276135e60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fba74004000 tx=0x7fba74000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba81685640 1 -- 172.21.15.177:0/454865408 reap_dead start 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 shutdown_connections 2024-03-20T13:35:17.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 >> 172.21.15.177:0/454865408 conn(0x565276130040 msgr2=0x565276224470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 shutdown_connections 2024-03-20T13:35:17.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.359+0000 7fba85816800 1 -- 172.21.15.177:0/454865408 wait complete. 2024-03-20T13:35:17.369 INFO:teuthology.orchestra.run.smithi177.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"ulz9APH8lYNQz14lPrl4pkSd","ver":2},"mtime":"2024-03-20T13:35:17.210569Z","data":{"bucket":{"name":"myfoo","marker":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","bucket_id":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-03-20T13:35:12.979038Z","linked":true,"has_bucket_info":false}} 2024-03-20T13:35:17.369 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': 'ulz9APH8lYNQz14lPrl4pkSd', 'ver': 2}, 'mtime': '2024-03-20T13:35:17.210569Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'bucket_id': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-03-20T13:35:12.979038Z', 'linked': True, 'has_bucket_info': False}} 2024-03-20T13:35:17.369 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-03-20T13:35:17.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-03-20T13:35:17.369 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-03-20T13:35:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.455+0000 7f3352311800 1 Processor -- start 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.455+0000 7f3352311800 1 -- start start 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.455+0000 7f3352311800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d73689e020 0x55d7368a0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.455+0000 7f3352311800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d7367e4cd0 con 0x55d736899b90 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.455+0000 7f3352311800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d73679b500 con 0x55d73689e020 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334f60f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d73689e020 0x55d7368a0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334fe10640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55d736899b90 0x55d736899fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50612/0 (socket says 172.21.15.177:50612) 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334fe10640 1 -- 172.21.15.177:0/3097827817 learned_addr learned my addr 172.21.15.177:0/3097827817 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334ee0e640 1 -- 172.21.15.177:0/3097827817 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2217271414 0 0) 0x55d7367e4cd0 con 0x55d736899b90 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334ee0e640 1 -- 172.21.15.177:0/3097827817 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3338001e10 con 0x55d736899b90 2024-03-20T13:35:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334f60f640 1 -- 172.21.15.177:0/3097827817 >> v1:172.21.15.28:6789/0 conn(0x55d736899b90 legacy=0x55d736899fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.456+0000 7f334f60f640 1 -- 172.21.15.177:0/3097827817 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7368a1a40 con 0x55d73689e020 2024-03-20T13:35:17.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.459+0000 7f334f60f640 1 --2- 172.21.15.177:0/3097827817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73689e020 0x55d7368a0410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f334400a470 tx=0x7f334401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af99c64df2effddc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.459+0000 7f334ee0e640 1 -- 172.21.15.177:0/3097827817 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f334404ad60 con 0x55d73689e020 2024-03-20T13:35:17.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.459+0000 7f334ee0e640 1 -- 172.21.15.177:0/3097827817 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3344052440 con 0x55d73689e020 2024-03-20T13:35:17.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.459+0000 7f334ee0e640 1 -- 172.21.15.177:0/3097827817 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3344052700 con 0x55d73689e020 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 -- 172.21.15.177:0/3097827817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73689e020 msgr2=0x55d7368a0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 --2- 172.21.15.177:0/3097827817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73689e020 0x55d7368a0410 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f334400a470 tx=0x7f334401cc80 comp rx=0 tx=0).stop 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 -- 172.21.15.177:0/3097827817 shutdown_connections 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 --2- 172.21.15.177:0/3097827817 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73689e020 0x55d7368a0410 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 -- 172.21.15.177:0/3097827817 >> 172.21.15.177:0/3097827817 conn(0x55d736895190 msgr2=0x55d7368975b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 -- 172.21.15.177:0/3097827817 shutdown_connections 2024-03-20T13:35:17.462 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.460+0000 7f3352311800 1 -- 172.21.15.177:0/3097827817 wait complete. 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f3352311800 1 Processor -- start 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f3352311800 1 -- start start 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f3352311800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d7369898d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f3352311800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d736798a30 con 0x55d736899b90 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d7369898d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d7369898d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41394/0 (socket says 172.21.15.177:41394) 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f334fe10640 1 -- 172.21.15.177:0/982179325 learned_addr learned my addr 172.21.15.177:0/982179325 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.476 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.472+0000 7f334fe10640 1 -- 172.21.15.177:0/982179325 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3344005d20 con 0x55d736899b90 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f334fe10640 1 --2- 172.21.15.177:0/982179325 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d7369898d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3340001c20 tx=0x7f334000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88c12e31e27d4846 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f323de0b640 1 -- 172.21.15.177:0/982179325 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f334000e470 con 0x55d736899b90 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f323de0b640 1 -- 172.21.15.177:0/982179325 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334000e5d0 con 0x55d736899b90 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f323de0b640 1 -- 172.21.15.177:0/982179325 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f334000e930 con 0x55d736899b90 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f3352311800 1 -- 172.21.15.177:0/982179325 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 msgr2=0x55d7369898d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f3352311800 1 --2- 172.21.15.177:0/982179325 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d7369898d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f3340001c20 tx=0x7f334000b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f3352311800 1 -- 172.21.15.177:0/982179325 shutdown_connections 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f3352311800 1 --2- 172.21.15.177:0/982179325 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d7369898d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.473+0000 7f3352311800 1 -- 172.21.15.177:0/982179325 >> 172.21.15.177:0/982179325 conn(0x55d736895190 msgr2=0x55d7369851f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.474+0000 7f3352311800 1 -- 172.21.15.177:0/982179325 shutdown_connections 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.474+0000 7f3352311800 1 -- 172.21.15.177:0/982179325 wait complete. 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.474+0000 7f3352311800 1 Processor -- start 2024-03-20T13:35:17.477 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.474+0000 7f3352311800 1 -- start start 2024-03-20T13:35:17.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.474+0000 7f3352311800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d736990fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.474+0000 7f3352311800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d736794210 con 0x55d736899b90 2024-03-20T13:35:17.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.475+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d736990fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.475+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d736990fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41406/0 (socket says 172.21.15.177:41406) 2024-03-20T13:35:17.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.475+0000 7f334fe10640 1 -- 172.21.15.177:0/1688552049 learned_addr learned my addr 172.21.15.177:0/1688552049 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.477+0000 7f334fe10640 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338001e10 con 0x55d736899b90 2024-03-20T13:35:17.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.479+0000 7f334fe10640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d736990fc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x55d73698a660 tx=0x7f3340000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.480+0000 7f3237fff640 1 -- 172.21.15.177:0/1688552049 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f334001f070 con 0x55d736899b90 2024-03-20T13:35:17.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.480+0000 7f3237fff640 1 -- 172.21.15.177:0/1688552049 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340018770 con 0x55d736899b90 2024-03-20T13:35:17.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.480+0000 7f3237fff640 1 -- 172.21.15.177:0/1688552049 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3340018a30 con 0x55d736899b90 2024-03-20T13:35:17.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.480+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d736991500 con 0x55d736899b90 2024-03-20T13:35:17.482 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.480+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7369919e0 con 0x55d736899b90 2024-03-20T13:35:17.483 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3237fff640 1 -- 172.21.15.177:0/1688552049 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3340018b90 con 0x55d736899b90 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3237fff640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3238036830 0x7f3238038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3237fff640 1 -- 172.21.15.177:0/1688552049 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f334004c350 con 0x55d736899b90 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f334f60f640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3238036830 0x7f3238038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d73689e020 0x55d736997c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736998270 con 0x55d73689e020 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3350611640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d73689e020 0x55d736997c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f334f60f640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3238036830 0x7f3238038cf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3344054000 tx=0x7f334404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.483+0000 7f3350611640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d73689e020 0x55d736997c70 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f3350611640 1 -- 172.21.15.177:0/1688552049 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d73689e020 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736995380 con 0x55d73689e020 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f3350611640 1 -- 172.21.15.177:0/1688552049 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x55d73689e020 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d73699a4b0 0x55d73699c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d73699cf40 con 0x55d73699a4b0 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f334fe10640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d73699a4b0 0x55d73699c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.484+0000 7f334fe10640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d73699a4b0 0x55d73699c8a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f334fe10640 1 -- 172.21.15.177:0/1688552049 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3340014070 con 0x55d73699a4b0 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736999400 con 0x55d73689e020 2024-03-20T13:35:17.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f3350611640 1 -- 172.21.15.177:0/1688552049 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x55d73689e020 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d73699e360 0x55d7369a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369a0e90 con 0x55d73699e360 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f334f60f640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d73699e360 0x55d7369a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.485+0000 7f334f60f640 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d73699e360 0x55d7369a0750 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.486+0000 7f334f60f640 1 -- 172.21.15.177:0/1688552049 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3344059040 con 0x55d73699e360 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.486+0000 7f3352311800 1 Processor -- start 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.486+0000 7f3352311800 1 -- start start 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.486+0000 7f3352311800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 0x55d7369af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.486+0000 7f3352311800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d736736c70 con 0x55d7369af070 2024-03-20T13:35:17.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.487+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 0x55d7369af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.487+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 0x55d7369af490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41418/0 (socket says 172.21.15.177:41418) 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.487+0000 7f334fe10640 1 -- 172.21.15.177:0/1109213735 learned_addr learned my addr 172.21.15.177:0/1109213735 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f334fe10640 1 -- 172.21.15.177:0/1109213735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7369af9d0 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f334fe10640 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 0x55d7369af490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f334000eec0 tx=0x7f334002dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f32357fa640 1 -- 172.21.15.177:0/1109213735 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3340032040 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f32357fa640 1 -- 172.21.15.177:0/1109213735 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340023740 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f32357fa640 1 -- 172.21.15.177:0/1109213735 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f33400239e0 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d7369b0440 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.488+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7369b0440 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f32357fa640 1 -- 172.21.15.177:0/1109213735 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f334001c0e0 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f32357fa640 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3228036790 0x7f3228038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f32357fa640 1 -- 172.21.15.177:0/1109213735 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f334004de30 con 0x55d7369af070 2024-03-20T13:35:17.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f334f60f640 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3228036790 0x7f3228038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f3352311800 1 Processor -- start 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f3352311800 1 -- start start 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.489+0000 7f334f60f640 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3228036790 0x7f3228038c50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55d7369952e0 tx=0x7f3344005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f3352311800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d73680d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f3352311800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d73670c5d0 con 0x55d73680eb50 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d73680d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d73680d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41420/0 (socket says 172.21.15.177:41420) 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f334fe10640 1 -- 172.21.15.177:0/609351444 learned_addr learned my addr 172.21.15.177:0/609351444 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f334fe10640 1 -- 172.21.15.177:0/609351444 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d73680f000 con 0x55d73680eb50 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f334fe10640 1 --2- 172.21.15.177:0/609351444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d73680d280 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3340023be0 tx=0x7f3340039180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62eb392e764300a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f322effd640 1 -- 172.21.15.177:0/609351444 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3340045d80 con 0x55d73680eb50 2024-03-20T13:35:17.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f322effd640 1 -- 172.21.15.177:0/609351444 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340010d40 con 0x55d73680eb50 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.490+0000 7f322effd640 1 -- 172.21.15.177:0/609351444 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3340025940 con 0x55d73680eb50 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- 172.21.15.177:0/609351444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 msgr2=0x55d73680d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 --2- 172.21.15.177:0/609351444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d73680d280 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f3340023be0 tx=0x7f3340039180 comp rx=0 tx=0).stop 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- 172.21.15.177:0/609351444 shutdown_connections 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 --2- 172.21.15.177:0/609351444 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d73680d280 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- 172.21.15.177:0/609351444 >> 172.21.15.177:0/609351444 conn(0x55d7369b82e0 msgr2=0x55d7369b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- 172.21.15.177:0/609351444 shutdown_connections 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- 172.21.15.177:0/609351444 wait complete. 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 Processor -- start 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- start start 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d7369c5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f3352311800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7369c56a0 con 0x55d73680eb50 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d7369c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.496 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f334fe10640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d7369c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41434/0 (socket says 172.21.15.177:41434) 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.491+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 learned_addr learned my addr 172.21.15.177:0/2092196283 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f334003b030 con 0x55d73680eb50 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f334fe10640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d7369c5160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f334003e8e0 tx=0x7f3340048570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f322d7fa640 1 -- 172.21.15.177:0/2092196283 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3340025940 con 0x55d73680eb50 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f322d7fa640 1 -- 172.21.15.177:0/2092196283 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3340025aa0 con 0x55d73680eb50 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d7369c58a0 con 0x55d73680eb50 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f322d7fa640 1 -- 172.21.15.177:0/2092196283 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3340045850 con 0x55d73680eb50 2024-03-20T13:35:17.497 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.492+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d7369c58a0 con 0x55d73680eb50 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.493+0000 7f322d7fa640 1 -- 172.21.15.177:0/2092196283 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f334006a020 con 0x55d73680eb50 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.493+0000 7f322d7fa640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3218036790 0x7f3218038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.493+0000 7f322d7fa640 1 -- 172.21.15.177:0/2092196283 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f334006ec60 con 0x55d73680eb50 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.493+0000 7f334f60f640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3218036790 0x7f3218038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d7369d0bd0 0x55d7369d3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d37e0 con 0x55d7369d0bd0 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f334f60f640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3218036790 0x7f3218038c50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3344052fd0 tx=0x7f334404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3350611640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d7369d0bd0 0x55d7369d3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3350611640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d7369d0bd0 0x55d7369d3090 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 20 realm 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d3bb0 con 0x55d7369d0bd0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.494+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4790 con 0x55d7369d0bd0 2024-03-20T13:35:17.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d7369d5140 0x55d7369d7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d7b80 con 0x55d7369d5140 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f334fe10640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d7369d5140 0x55d7369d7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f334fe10640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d7369d5140 0x55d7369d7530 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3340014070 con 0x55d7369d5140 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.495+0000 7f3352311800 20 searching for the correct realm 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.496+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d7369d9e30 0x55d7369dc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.496+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369dc9c0 con 0x55d7369d9e30 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.496+0000 7f334f60f640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d7369d9e30 0x55d7369dc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.496+0000 7f334f60f640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d7369d9e30 0x55d7369dc2f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.496+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.496+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369dc9c0 con 0x55d7369d5140 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.497+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3340014070 con 0x55d7369d5140 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.497+0000 7f334fe10640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f3340017050 0x7f334004c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.497+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369dc9c0 con 0x7f3340017050 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.497+0000 7f3350611640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f3340017050 0x7f334004c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.497+0000 7f3350611640 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f3340017050 0x7f334004c950 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.497+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.498+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d5140 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.499+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d5140 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.500+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.501+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.501+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.501+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.501+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.501+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.501+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d5140 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.502+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.503+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.503+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.503+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.503+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d9e30 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.503+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.503+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x7f3340017050 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3348031040 con 0x55d7369d5140 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3348031040 con 0x55d7369d9e30 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3348031040 con 0x7f3340017050 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.504+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3348031040 con 0x55d7369d0bd0 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.517 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3348031040 con 0x55d7369d5140 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d4430 con 0x55d7369d0bd0 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.518 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d8230 con 0x55d7369d0bd0 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.505+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d8200 con 0x7f3340017050 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 zone default found 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 4 Realm: () 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:17.519 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 zonegroup default 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d8b00 con 0x7f3340017050 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369d8b00 con 0x55d7369d9e30 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.506+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369de7e0 con 0x55d7369d9e30 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.507+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.507+0000 7f3352311800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.520 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.507+0000 7f3352311800 20 started sync module instance, tier type = 2024-03-20T13:35:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.507+0000 7f3352311800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.507+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369ddc70 con 0x55d7369d5140 2024-03-20T13:35:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.508+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.508+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94382822645792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369de440 con 0x55d7369d5140 2024-03-20T13:35:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.508+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369df480 con 0x55d7369d0bd0 2024-03-20T13:35:17.521 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.509+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94382822645792] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.509+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.509+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94382822649120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369df830 con 0x55d7369d0bd0 2024-03-20T13:35:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.509+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e0240 con 0x55d7369d9e30 2024-03-20T13:35:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.510+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94382822649120] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.510+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.510+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94382822650272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e0620 con 0x55d7369d9e30 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.510+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e10c0 con 0x55d7369d5140 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.511+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.511+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94382822656928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e1910 con 0x55d7369d5140 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.511+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e23c0 con 0x55d7369d0bd0 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.512+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94382822650272] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.512+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94382822656928] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.513+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.513+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94382822661824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e1470 con 0x55d7369d0bd0 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.513+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e2c10 con 0x7f3340017050 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.514+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94382822661824] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.514+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.514+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94382822653280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e2b30 con 0x7f3340017050 2024-03-20T13:35:17.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.514+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e3330 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.516+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94382822653280] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.516+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.516+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94382822664304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e3190 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.516+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e3c50 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'138 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94382822668048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e40b0 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=0 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=1 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=2 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=3 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=4 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=5 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94382822664304] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.519+0000 7f3352311800 20 add_watcher() i=6 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.521+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94382822668048] v30'139 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.521+0000 7f3352311800 20 add_watcher() i=7 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.521+0000 7f3352311800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.521+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e40b0 con 0x55d7369d0bd0 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.522+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.522+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94382822669328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d7369e4a20 con 0x55d7369d0bd0 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94382822669328] v30'132 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 5 note: GC not initialized 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3204fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:17.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 20 Filter name: none 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f317e7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.523+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a18f80 con 0x55d7369d0bd0 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a1aae0 con 0x55d7369d0bd0 2024-03-20T13:35:17.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv1 ondisk = 0) v8 ==== 197+0+241 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=193 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.524+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 8.f 8:f2b88cd0:root::.bucket.meta.testx%3amyfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a1c340 con 0x55d7369d9e30 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~371 out=371b,getxattrs out=298b] v0'0 uv1 ondisk = 0) v8 ==== 338+0+733 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 20 rados_obj.operate() r=0 bl.length=371 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-03-20T13:35:17.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.525+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a20b20 con 0x55d7369d0bd0 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.526+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v30'2 uv2 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.526+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [create,call version.inc in=38b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a243e0 con 0x55d7369d0bd0 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(66 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [create,call,writefull 0~352,setxattr (123)] v30'7 uv7 ondisk = 0) v8 ==== 332+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x7 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94382822924688 in=713b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ea0 con 0x55d7369d5140 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== watch-notify(notify (1) cookie 94382822656928 notify 128849018897 ret 0) v3 ==== 743+0+0 (crc 0 0 0) 0x55d73680f000 con 0x55d7369d5140 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f322effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018897 cookie 94382822656928 notifier 4545 bl.length()=701 2024-03-20T13:35:17.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f322effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x7 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f322effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f322effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.3 [notify cookie 94382822924688 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f322effd640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3214003e90 con 0x55d7369d5140 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3340081040 con 0x55d7369d5140 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== watch-notify(notify_complete (2) cookie 94382822924688 notify 128849018897 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3340088020 con 0x55d7369d5140 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_sources= new_sources= 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential sources added=[] removed=[] 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_dests= new_dests= 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential dests added=[] removed=[] 2024-03-20T13:35:17.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.527+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23fe0 con 0x55d7369d5140 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.529+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(69 foo.buckets [call] v30'26 uv26 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f334008a040 con 0x55d7369d5140 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.529+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23fe0 con 0x55d7369d5140 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v30'27 uv27 ondisk = 0) v8 ==== 275+0+0 (crc 0 0 0) 0x7f334008a040 con 0x55d7369d5140 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94382822931264 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23f60 con 0x7f3340017050 2024-03-20T13:35:17.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== watch-notify(notify (1) cookie 94382822664304 notify 128849018898 ret 0) v3 ==== 356+0+0 (crc 0 0 0) 0x7f334803d040 con 0x7f3340017050 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f322e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94382822664304 notifier 4545 bl.length()=314 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f322e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f322e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(71 notify.6 [notify cookie 94382822931264 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f322e7fc640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f31840033f0 con 0x7f3340017050 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== watch-notify(notify_complete (2) cookie 94382822931264 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3348018d20 con 0x7f3340017050 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.530+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:73 7.d 7:b4812045:::notify.4:head [notify cookie 94382822931264 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23f60 con 0x55d7369d0bd0 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== watch-notify(notify (1) cookie 94382822661824 notify 128849018892 ret 0) v3 ==== 197+0+0 (crc 0 0 0) 0x7f3348018d20 con 0x55d7369d0bd0 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f322e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018892 cookie 94382822661824 notifier 4545 bl.length()=155 2024-03-20T13:35:17.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(73 notify.4 [notify cookie 94382822931264 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f322e7fc640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f31840033f0 con 0x55d7369d0bd0 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== watch-notify(notify_complete (2) cookie 94382822931264 notify 128849018892 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3348043510 con 0x55d7369d0bd0 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(74 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.531+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23370 con 0x55d7369d0bd0 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(75 testx/myfoo [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f3352311800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 from cache 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f3352311800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [notify cookie 94382822901744 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23370 con 0x55d7369d9e30 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== watch-notify(notify (1) cookie 94382822650272 notify 128849018886 ret 0) v3 ==== 254+0+0 (crc 0 0 0) 0x7f334407a070 con 0x55d7369d9e30 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f322effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018886 cookie 94382822650272 notifier 4545 bl.length()=212 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f322effd640 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3214003e90 con 0x55d7369d9e30 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.532+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(76 notify.2 [notify cookie 94382822901744 out=8b] v0'0 uv138 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.533+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== watch-notify(notify_complete (2) cookie 94382822901744 notify 128849018886 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55d7368a1a40 con 0x55d7369d9e30 2024-03-20T13:35:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.533+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(77 notify.2 [notify-ack] v0'0 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.533+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:78 8.f 8:f2b88cd0:root::.bucket.meta.testx%3amyfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d9e30 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.534+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(78 .bucket.meta.testx:myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call,delete] v30'2 uv2 ondisk = 0) v8 ==== 254+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.535+0000 7f3205fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.535+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94382822669328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d0bd0 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.536+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94382822669328] v30'133 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.536+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94382822645792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d5140 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.537+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94382822645792] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334008a040 con 0x55d7369d5140 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.537+0000 7f3352311800 20 remove_watcher() i=0 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.537+0000 7f3352311800 2 removed watcher, disabling cache 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.537+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94382822649120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d0bd0 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.538+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94382822649120] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.538+0000 7f3352311800 20 remove_watcher() i=1 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.538+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94382822650272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d9e30 2024-03-20T13:35:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.539+0000 7f334f60f640 1 -- 172.21.15.177:0/2092196283 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94382822650272] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3344059040 con 0x55d7369d9e30 2024-03-20T13:35:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.539+0000 7f3352311800 20 remove_watcher() i=2 2024-03-20T13:35:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.539+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94382822656928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d5140 2024-03-20T13:35:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.540+0000 7f334fe10640 1 -- 172.21.15.177:0/2092196283 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94382822656928] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334008a040 con 0x55d7369d5140 2024-03-20T13:35:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.540+0000 7f3352311800 20 remove_watcher() i=3 2024-03-20T13:35:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.540+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94382822661824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x55d7369d0bd0 2024-03-20T13:35:17.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.541+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94382822661824] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x55d7369d0bd0 2024-03-20T13:35:17.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.541+0000 7f3352311800 20 remove_watcher() i=4 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.541+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94382822653280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x7f3340017050 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.542+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94382822653280] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.542+0000 7f3352311800 20 remove_watcher() i=5 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.542+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94382822664304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x7f3340017050 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.543+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94382822664304] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.543+0000 7f3352311800 20 remove_watcher() i=6 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.543+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94382822668048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55d736a23ac0 con 0x7f3340017050 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94382822668048] v30'140 uv138 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f334800a4a0 con 0x7f3340017050 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 20 remove_watcher() i=7 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f3340017050 msgr2=0x7f334004c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f3340017050 0x7f334004c950 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d7369d0bd0 msgr2=0x55d7369d3090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d7369d0bd0 0x55d7369d3090 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d7369d5140 msgr2=0x55d7369d7530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d7369d5140 0x55d7369d7530 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d7369d9e30 msgr2=0x55d7369dc2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d7369d9e30 0x55d7369dc2f0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3218036790 msgr2=0x7f3218038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3218036790 0x7f3218038c50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f3344052fd0 tx=0x7f334404f000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 msgr2=0x55d7369c5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3350611640 1 -- 172.21.15.177:0/2092196283 reap_dead start 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d7369c5160 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f334003e8e0 tx=0x7f3340048570 comp rx=0 tx=0).stop 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 shutdown_connections 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 --2- 172.21.15.177:0/2092196283 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d73680eb50 0x55d7369c5160 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 >> 172.21.15.177:0/2092196283 conn(0x55d7369b82e0 msgr2=0x55d7369b5940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 shutdown_connections 2024-03-20T13:35:17.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.544+0000 7f3352311800 1 -- 172.21.15.177:0/2092196283 wait complete. 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3228036790 msgr2=0x7f3228038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3228036790 0x7f3228038c50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x55d7369952e0 tx=0x7f3344005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 msgr2=0x55d7369af490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 0x55d7369af490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f334000eec0 tx=0x7f334002dbe0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 shutdown_connections 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3228036790 0x7f3228038c50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1109213735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d7369af070 0x55d7369af490 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 >> 172.21.15.177:0/1109213735 conn(0x55d7369a3110 msgr2=0x55d7369a3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 shutdown_connections 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1109213735 wait complete. 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d73699e360 msgr2=0x55d7369a0750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55d73699e360 0x55d7369a0750 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d73689e020 msgr2=0x55d736997c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d73689e020 0x55d736997c70 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d73699a4b0 msgr2=0x55d73699c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d73699a4b0 0x55d73699c8a0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3238036830 msgr2=0x7f3238038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3238036830 0x7f3238038cf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f3344054000 tx=0x7f334404e000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 msgr2=0x55d736990fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 --2- 172.21.15.177:0/1688552049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d736899b90 0x55d736990fc0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x55d73698a660 tx=0x7f3340000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3350611640 1 -- 172.21.15.177:0/1688552049 reap_dead start 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 shutdown_connections 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 >> 172.21.15.177:0/1688552049 conn(0x55d736895190 msgr2=0x55d7369882c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 shutdown_connections 2024-03-20T13:35:17.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.545+0000 7f3352311800 1 -- 172.21.15.177:0/1688552049 wait complete. 2024-03-20T13:35:17.554 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:35:17.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-03-20T13:35:17.555 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-03-20T13:35:17.600 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:17.600 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d77011800 1 Processor -- start 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d77011800 1 -- start start 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d77011800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55a2753ee400 0x55a2753ee820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d77011800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a27533acd0 con 0x55a2753eed60 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d77011800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a2752f1500 con 0x55a2753ee400 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d71e71640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55a2753eed60 0x55a2753ef210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50628/0 (socket says 172.21.15.177:50628) 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d71e71640 1 -- 172.21.15.177:0/3354321728 learned_addr learned my addr 172.21.15.177:0/3354321728 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4262707301 0 0) 0x55a27533acd0 con 0x55a2753eed60 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.599+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d5c001e10 con 0x55a2753eed60 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2850589426 0 0) 0x7f5d5c001e10 con 0x55a2753eed60 2024-03-20T13:35:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 >> v2:172.21.15.28:3300/0 conn(0x55a2753ee400 msgr2=0x55a2753ee820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 --2- 172.21.15.177:0/3354321728 >> v2:172.21.15.28:3300/0 conn(0x55a2753ee400 0x55a2753ee820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a275363090 con 0x55a2753eed60 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7f5d680015a0 con 0x55a2753eed60 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 >> v1:172.21.15.28:6789/0 conn(0x55a2753eed60 legacy=0x55a2753ef210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 --2- 172.21.15.177:0/3354321728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d5c002260 0x7f5d5c002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2752f1500 con 0x7f5d5c002260 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d72672640 1 --2- 172.21.15.177:0/3354321728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d5c002260 0x7f5d5c002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.600+0000 7f5d72672640 1 -- 172.21.15.177:0/3354321728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c001e10 con 0x7f5d5c002260 2024-03-20T13:35:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.602+0000 7f5d72672640 1 --2- 172.21.15.177:0/3354321728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d5c002260 0x7f5d5c002660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400a520 tx=0x7f5d6401cd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a841cdba4f5fcfb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.602+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d6404acd0 con 0x7f5d5c002260 2024-03-20T13:35:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.602+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6404ae30 con 0x7f5d5c002260 2024-03-20T13:35:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.602+0000 7f5d71670640 1 -- 172.21.15.177:0/3354321728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d640535e0 con 0x7f5d5c002260 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 -- 172.21.15.177:0/3354321728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d5c002260 msgr2=0x7f5d5c002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 --2- 172.21.15.177:0/3354321728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d5c002260 0x7f5d5c002660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5d6400a520 tx=0x7f5d6401cd10 comp rx=0 tx=0).stop 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 -- 172.21.15.177:0/3354321728 shutdown_connections 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 --2- 172.21.15.177:0/3354321728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5d5c002260 0x7f5d5c002660 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 --2- 172.21.15.177:0/3354321728 >> v2:172.21.15.28:3300/0 conn(0x55a2753ee400 0x55a2753ee820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 -- 172.21.15.177:0/3354321728 >> 172.21.15.177:0/3354321728 conn(0x55a2753ea040 msgr2=0x55a2753ec460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 -- 172.21.15.177:0/3354321728 shutdown_connections 2024-03-20T13:35:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.603+0000 7f5d77011800 1 -- 172.21.15.177:0/3354321728 wait complete. 2024-03-20T13:35:17.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.614+0000 7f5d77011800 1 Processor -- start 2024-03-20T13:35:17.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d77011800 1 -- start start 2024-03-20T13:35:17.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d77011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d77011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2752eea30 con 0x55a2753ee400 2024-03-20T13:35:17.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41450/0 (socket says 172.21.15.177:41450) 2024-03-20T13:35:17.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d72672640 1 -- 172.21.15.177:0/1197724858 learned_addr learned my addr 172.21.15.177:0/1197724858 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d72672640 1 -- 172.21.15.177:0/1197724858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2754e1e50 con 0x55a2753ee400 2024-03-20T13:35:17.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.615+0000 7f5d72672640 1 --2- 172.21.15.177:0/1197724858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e1880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5d6404bfd0 tx=0x7f5d6404c070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f4d0fea1b6c0b75 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5c60608640 1 -- 172.21.15.177:0/1197724858 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d64053470 con 0x55a2753ee400 2024-03-20T13:35:17.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5c60608640 1 -- 172.21.15.177:0/1197724858 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d640535d0 con 0x55a2753ee400 2024-03-20T13:35:17.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5c60608640 1 -- 172.21.15.177:0/1197724858 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d64053870 con 0x55a2753ee400 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 -- 172.21.15.177:0/1197724858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 msgr2=0x55a2754e1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 --2- 172.21.15.177:0/1197724858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e1880 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5d6404bfd0 tx=0x7f5d6404c070 comp rx=0 tx=0).stop 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 -- 172.21.15.177:0/1197724858 shutdown_connections 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 --2- 172.21.15.177:0/1197724858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e1880 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 -- 172.21.15.177:0/1197724858 >> 172.21.15.177:0/1197724858 conn(0x55a2753ea040 msgr2=0x55a2754dd1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 -- 172.21.15.177:0/1197724858 shutdown_connections 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.616+0000 7f5d77011800 1 -- 172.21.15.177:0/1197724858 wait complete. 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d77011800 1 Processor -- start 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d77011800 1 -- start start 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d77011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d77011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2752ea210 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e9020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41464/0 (socket says 172.21.15.177:41464) 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d72672640 1 -- 172.21.15.177:0/3643116874 learned_addr learned my addr 172.21.15.177:0/3643116874 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.617+0000 7f5d72672640 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5c001e10 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.618+0000 7f5d72672640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e9020 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5d6404bfd0 tx=0x7f5d5c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.618+0000 7f5c5ee05640 1 -- 172.21.15.177:0/3643116874 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d64053cc0 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.618+0000 7f5c5ee05640 1 -- 172.21.15.177:0/3643116874 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d64053e20 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.618+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a2754e9560 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.618+0000 7f5c5ee05640 1 -- 172.21.15.177:0/3643116874 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d6405e590 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.618+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2754e9aa0 con 0x55a2753ee400 2024-03-20T13:35:17.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5c5ee05640 1 -- 172.21.15.177:0/3643116874 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5d64065040 con 0x55a2753ee400 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5c5ee05640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c58036790 0x7f5c58038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5c5ee05640 1 -- 172.21.15.177:0/3643116874 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5d6408c9b0 con 0x55a2753ee400 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5d71e71640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c58036790 0x7f5c58038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2753eed60 0x55a2754efdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754f0330 con 0x55a2753eed60 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5d72e73640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2753eed60 0x55a2754efdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5d71e71640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c58036790 0x7f5c58038c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000f60 tx=0x7f5d68001430 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.619+0000 7f5d72e73640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2753eed60 0x55a2754efdf0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d72e73640 1 -- 172.21.15.177:0/3643116874 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2753eed60 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754ed3b0 con 0x55a2753eed60 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d72e73640 1 -- 172.21.15.177:0/3643116874 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2753eed60 2024-03-20T13:35:17.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f5d5c002260 0x55a2754f4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754f4c50 con 0x7f5d5c002260 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d72672640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f5d5c002260 0x55a2754f4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.620+0000 7f5d72672640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f5d5c002260 0x55a2754f4580 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.621+0000 7f5d72672640 1 -- 172.21.15.177:0/3643116874 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5d6404f030 con 0x7f5d5c002260 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.621+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754f14f0 con 0x55a2753eed60 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.621+0000 7f5d72e73640 1 -- 172.21.15.177:0/3643116874 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2753eed60 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.621+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a2754f6050 0x55a2754f8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.621+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754f8ba0 con 0x55a2754f6050 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.621+0000 7f5d71e71640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a2754f6050 0x55a2754f8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.622+0000 7f5d71e71640 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a2754f6050 0x55a2754f8440 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.627 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.622+0000 7f5d71e71640 1 -- 172.21.15.177:0/3643116874 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5d6800f430 con 0x55a2754f6050 2024-03-20T13:35:17.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.622+0000 7f5d77011800 1 Processor -- start 2024-03-20T13:35:17.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.622+0000 7f5d77011800 1 -- start start 2024-03-20T13:35:17.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.623+0000 7f5d77011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 0x55a2755071c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.628 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.623+0000 7f5d77011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27528cc70 con 0x55a275506da0 2024-03-20T13:35:17.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.624+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 0x55a2755071c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.624+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 0x55a2755071c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41468/0 (socket says 172.21.15.177:41468) 2024-03-20T13:35:17.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.624+0000 7f5d72672640 1 -- 172.21.15.177:0/83434973 learned_addr learned my addr 172.21.15.177:0/83434973 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.629 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.627+0000 7f5d72672640 1 -- 172.21.15.177:0/83434973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a275507700 con 0x55a275506da0 2024-03-20T13:35:17.631 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.629+0000 7f5d72672640 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 0x55a2755071c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5d64000c00 tx=0x7f5d64055260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.630+0000 7f5c57fff640 1 -- 172.21.15.177:0/83434973 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d6408c580 con 0x55a275506da0 2024-03-20T13:35:17.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.630+0000 7f5c57fff640 1 -- 172.21.15.177:0/83434973 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6408c6e0 con 0x55a275506da0 2024-03-20T13:35:17.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.630+0000 7f5c57fff640 1 -- 172.21.15.177:0/83434973 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d640557f0 con 0x55a275506da0 2024-03-20T13:35:17.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.630+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a275508170 con 0x55a275506da0 2024-03-20T13:35:17.632 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.630+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a275508630 con 0x55a275506da0 2024-03-20T13:35:17.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.633+0000 7f5c57fff640 1 -- 172.21.15.177:0/83434973 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5d6408cd50 con 0x55a275506da0 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5c57fff640 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c4c036880 0x7f5c4c038d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5c57fff640 1 -- 172.21.15.177:0/83434973 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5d64096c40 con 0x55a275506da0 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d71e71640 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c4c036880 0x7f5c4c038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d77011800 1 Processor -- start 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d77011800 1 -- start start 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d71e71640 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c4c036880 0x7f5c4c038d40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a2754ed2f0 tx=0x7f5d68006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d77011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a275514380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d77011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2752625d0 con 0x55a275513f60 2024-03-20T13:35:17.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a275514380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a275514380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41484/0 (socket says 172.21.15.177:41484) 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.634+0000 7f5d72672640 1 -- 172.21.15.177:0/6945939 learned_addr learned my addr 172.21.15.177:0/6945939 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.635+0000 7f5d72672640 1 -- 172.21.15.177:0/6945939 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a275514970 con 0x55a275513f60 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.635+0000 7f5d72672640 1 --2- 172.21.15.177:0/6945939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a275514380 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5d64096f70 tx=0x7f5d64089310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=136cb93b40375347 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.635+0000 7f5c55ffb640 1 -- 172.21.15.177:0/6945939 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d64066bc0 con 0x55a275513f60 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.635+0000 7f5c55ffb640 1 -- 172.21.15.177:0/6945939 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d6406d2c0 con 0x55a275513f60 2024-03-20T13:35:17.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.635+0000 7f5c55ffb640 1 -- 172.21.15.177:0/6945939 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d6406d430 con 0x55a275513f60 2024-03-20T13:35:17.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- 172.21.15.177:0/6945939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 msgr2=0x55a275514380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 --2- 172.21.15.177:0/6945939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a275514380 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f5d64096f70 tx=0x7f5d64089310 comp rx=0 tx=0).stop 2024-03-20T13:35:17.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- 172.21.15.177:0/6945939 shutdown_connections 2024-03-20T13:35:17.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 --2- 172.21.15.177:0/6945939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a275514380 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- 172.21.15.177:0/6945939 >> 172.21.15.177:0/6945939 conn(0x55a2755102a0 msgr2=0x55a27550e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- 172.21.15.177:0/6945939 shutdown_connections 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- 172.21.15.177:0/6945939 wait complete. 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 Processor -- start 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- start start 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a27551add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d77011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a27551b310 con 0x55a275513f60 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a27551add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d72672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a27551add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41488/0 (socket says 172.21.15.177:41488) 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.636+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 learned_addr learned my addr 172.21.15.177:0/2071959674 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a275508630 con 0x55a275513f60 2024-03-20T13:35:17.646 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5d72672640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a27551add0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5d640891e0 tx=0x7f5d64086f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5c43fff640 1 -- 172.21.15.177:0/2071959674 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d64070450 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5c43fff640 1 -- 172.21.15.177:0/2071959674 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d640705b0 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a275508630 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5c43fff640 1 -- 172.21.15.177:0/2071959674 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5d64054c80 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.637+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a275508630 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.638+0000 7f5c43fff640 1 -- 172.21.15.177:0/2071959674 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5d64050070 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.638+0000 7f5c43fff640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c3c036790 0x7f5c3c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.638+0000 7f5c43fff640 1 -- 172.21.15.177:0/2071959674 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f5d640b5c40 con 0x55a275513f60 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.638+0000 7f5d71e71640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c3c036790 0x7f5c3c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.638+0000 7f5d71e71640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c3c036790 0x7f5c3c038c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a2754f8f60 tx=0x7f5d68010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2755264f0 0x55a2755289b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529100 con 0x55a2755264f0 2024-03-20T13:35:17.647 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d72e73640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2755264f0 0x55a2755289b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d72e73640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2755264f0 0x55a2755289b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 20 realm 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755294d0 con 0x55a2755264f0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.639+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27552a0b0 con 0x55a2755264f0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a27552aa60 0x55a27552ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27552d460 con 0x55a27552aa60 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d72672640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a27552aa60 0x55a27552ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d72672640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a27552aa60 0x55a27552ce50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.640+0000 7f5d77011800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d77011800 20 searching for the correct realm 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a27552f710 0x55a275531bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275532250 con 0x55a27552f710 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d71e71640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a27552f710 0x55a275531bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d71e71640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a27552f710 0x55a275531bd0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.641+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275532250 con 0x55a27552aa60 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.642+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.642+0000 7f5d72672640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5d640be040 0x7f5d64066500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.642+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275532250 con 0x7f5d640be040 2024-03-20T13:35:17.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.643+0000 7f5d72e73640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5d640be040 0x7f5d64066500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.645+0000 7f5d72e73640 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5d640be040 0x7f5d64066500 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.645+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.645+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.646+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.646+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.646+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.646+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.661 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.646+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.646+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552aa60 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.647+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.662 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552aa60 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.648+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.649+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.649+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.649+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.649+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.649+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.649+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.650+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552aa60 2024-03-20T13:35:17.664 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.651+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.651+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.651+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.651+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a27552f710 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x7f5d640be040 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d6c031040 con 0x55a27552aa60 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d6c031040 con 0x55a27552f710 2024-03-20T13:35:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.652+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d6c031040 con 0x7f5d640be040 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d6c031040 con 0x55a2755264f0 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5d6c031040 con 0x55a27552aa60 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275529d50 con 0x55a2755264f0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.653+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27552db50 con 0x55a2755264f0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27552db20 con 0x7f5d640be040 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 zone default found 2024-03-20T13:35:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 4 Realm: () 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 zonegroup default 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.654+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27552e420 con 0x7f5d640be040 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27552e420 con 0x55a27552f710 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275534070 con 0x55a27552f710 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 started sync module instance, tier type = 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.655+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275533950 con 0x55a27552aa60 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.656+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.656+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94156241450160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275533d00 con 0x55a27552aa60 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.656+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275534e80 con 0x55a2755264f0 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.657+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94156241450160] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.658+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.658+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94156241455584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755352a0 con 0x55a2755264f0 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.658+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275535c10 con 0x55a27552f710 2024-03-20T13:35:17.669 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.659+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.659+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94156241459056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275536410 con 0x55a27552f710 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.659+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275536ee0 con 0x55a27552aa60 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.659+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94156241455584] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.660+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94156241459056] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.660+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.660+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94156241463744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275537290 con 0x55a27552aa60 2024-03-20T13:35:17.670 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.660+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275537a90 con 0x55a2755264f0 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.661+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.661+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94156241467344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755382e0 con 0x55a2755264f0 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.661+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275538d50 con 0x7f5d640be040 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.661+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94156241463744] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.662+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94156241467344] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.662+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.662+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94156241471632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275537d70 con 0x7f5d640be040 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.662+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275539360 con 0x7f5d640be040 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.664+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94156241471632] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.664+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.664+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94156241456640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275539360 con 0x7f5d640be040 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.664+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275539cd0 con 0x7f5d640be040 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'141 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94156241456640] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94156241475632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275539c50 con 0x7f5d640be040 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=0 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=1 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=2 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=3 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=4 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=5 2024-03-20T13:35:17.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.665+0000 7f5d77011800 20 add_watcher() i=6 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.666+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94156241475632] v30'142 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.666+0000 7f5d77011800 20 add_watcher() i=7 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.666+0000 7f5d77011800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.666+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27553d010 con 0x55a2755264f0 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.667+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.667+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94156241473216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a27553a520 con 0x55a2755264f0 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.668+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94156241473216] v30'134 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.668+0000 7f5c28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.668+0000 7f5d77011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.668+0000 7f5d77011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.668+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755459b0 con 0x55a2755264f0 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.669+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.669+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275545a70 con 0x7f5d640be040 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.670+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'16 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.670+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275545ef0 con 0x55a27552f710 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.671+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.671+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755468c0 con 0x55a2755264f0 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.672+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'135 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.679 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.672+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275543970 con 0x55a27552aa60 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.673+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'39 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.673+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275547430 con 0x55a27552f710 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.674+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'25 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.674+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275547960 con 0x55a2755264f0 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.675+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.675+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275547e90 con 0x7f5d640be040 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.676+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'25 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.676+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755480e0 con 0x55a27552aa60 2024-03-20T13:35:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.678+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.678+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755417f0 con 0x55a27552f710 2024-03-20T13:35:17.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.679+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.679+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755417f0 con 0x55a27552aa60 2024-03-20T13:35:17.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.680+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'40 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.680+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275548e20 con 0x7f5d640be040 2024-03-20T13:35:17.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.682+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.682+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275548e20 con 0x55a27552aa60 2024-03-20T13:35:17.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.683+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'16 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.683+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x7f5d640be040 2024-03-20T13:35:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.685+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'31 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.685+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a2755264f0 2024-03-20T13:35:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.686+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'136 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.686+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.689 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.688+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'32 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.688+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552aa60 2024-03-20T13:35:17.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.689+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'41 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.689+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.690+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'16 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.690+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a2755264f0 2024-03-20T13:35:17.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.691+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'24 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.691+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a2755264f0 2024-03-20T13:35:17.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.691+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'137 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.691+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.693+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'33 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.693+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552aa60 2024-03-20T13:35:17.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.694+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'26 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.694+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.695+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.695+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.696+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.696+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.696+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'12 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.696+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.697+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'26 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.697+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x7f5d640be040 2024-03-20T13:35:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.699+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.699+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.700+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'16 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.700+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x7f5d640be040 2024-03-20T13:35:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.701+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'26 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.701+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552f710 2024-03-20T13:35:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.703+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'34 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.703+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x7f5d640be040 2024-03-20T13:35:17.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.705+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'32 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.705+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755490f0 con 0x55a27552aa60 2024-03-20T13:35:17.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.706+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'22 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.706+0000 7f5ba37fe640 20 reqs_thread_entry: start 2024-03-20T13:35:17.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.706+0000 7f5d77011800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.706+0000 7f5d77011800 20 Filter name: none 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5ba17fa640 20 reqs_thread_entry: start 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275572bc0 con 0x7f5d640be040 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~385 out=385b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 246+0+508 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 20 rados_obj.operate() r=0 bl.length=385 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-03-20T13:35:17.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755750c0 con 0x55a2755264f0 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) v8 ==== 170+0+15 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.707+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:96 7.15 7:a93a5511:::notify.2:head [notify cookie 94156241161472 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275575560 con 0x55a27552f710 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== watch-notify(notify (1) cookie 94156241459056 notify 128849018887 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f5d68043040 con 0x55a27552f710 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5c55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018887 cookie 94156241459056 notifier 4551 bl.length()=170 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5c55ffb640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c38003d50 con 0x55a27552f710 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(96 notify.2 [notify cookie 94156241161472 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(97 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== watch-notify(notify_complete (2) cookie 94156241161472 notify 128849018887 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a275363090 con 0x55a27552f710 2024-03-20T13:35:17.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.708+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:98 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754ecd00 con 0x7f5d640be040 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(98 p5YnriCv1nAtykxBrupQ [delete] v30'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5d77011800 10 removing email index: 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5d77011800 10 removing user buckets index 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5d77011800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [notify cookie 94156241161472 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275575560 con 0x55a2755264f0 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== watch-notify(notify (1) cookie 94156241467344 notify 128849018893 ret 0) v3 ==== 217+0+0 (crc 0 0 0) 0x7f5d6c03d040 con 0x55a2755264f0 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.709+0000 7f5c557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018893 cookie 94156241467344 notifier 4551 bl.length()=175 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.710+0000 7f5c557fa640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5ba80032b0 con 0x55a2755264f0 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.710+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(99 notify.4 [notify cookie 94156241161472 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.710+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(100 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.710+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== watch-notify(notify_complete (2) cookie 94156241161472 notify 128849018893 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f5d6c018e40 con 0x55a2755264f0 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.710+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2754ecd00 con 0x55a2755264f0 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(101 testx$tenanteduser.buckets [delete] v30'3 uv3 ondisk = 0) v8 ==== 170+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d77011800 10 removing user index: testx$tenanteduser 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d77011800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d77011800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:102 7.e 7:7759931f:::notify.3:head [notify cookie 94156241711264 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275574970 con 0x55a27552aa60 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== watch-notify(notify (1) cookie 94156241463744 notify 128849018898 ret 0) v3 ==== 209+0+0 (crc 0 0 0) 0x55a275514970 con 0x55a27552aa60 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5c55ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018898 cookie 94156241463744 notifier 4551 bl.length()=167 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5c55ffb640 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f5c38003d50 con 0x55a27552aa60 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(102 notify.3 [notify cookie 94156241711264 out=8b] v0'0 uv141 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(103 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== watch-notify(notify_complete (2) cookie 94156241711264 notify 128849018898 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55a275508170 con 0x55a27552aa60 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.711+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275576570 con 0x7f5d640be040 2024-03-20T13:35:17.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.713+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(104 testx$tenanteduser [call,call,delete] v30'8 uv8 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.713+0000 7f5c28fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.713+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94156241473216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755468c0 con 0x55a2755264f0 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.714+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94156241473216] v30'138 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.714+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94156241450160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275538ec0 con 0x55a27552aa60 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.715+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94156241450160] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.715+0000 7f5d77011800 20 remove_watcher() i=0 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.715+0000 7f5d77011800 2 removed watcher, disabling cache 2024-03-20T13:35:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.715+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94156241455584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275538ec0 con 0x55a2755264f0 2024-03-20T13:35:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.716+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94156241455584] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.716+0000 7f5d77011800 20 remove_watcher() i=1 2024-03-20T13:35:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.716+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94156241459056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755349e0 con 0x55a27552f710 2024-03-20T13:35:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.717+0000 7f5d71e71640 1 -- 172.21.15.177:0/2071959674 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94156241459056] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d68033040 con 0x55a27552f710 2024-03-20T13:35:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.717+0000 7f5d77011800 20 remove_watcher() i=2 2024-03-20T13:35:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.717+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94156241463744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275538ec0 con 0x55a27552aa60 2024-03-20T13:35:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.718+0000 7f5d72672640 1 -- 172.21.15.177:0/2071959674 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94156241463744] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d640b1070 con 0x55a27552aa60 2024-03-20T13:35:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.718+0000 7f5d77011800 20 remove_watcher() i=3 2024-03-20T13:35:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.718+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94156241467344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755349e0 con 0x55a2755264f0 2024-03-20T13:35:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.719+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94156241467344] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x55a2755264f0 2024-03-20T13:35:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.719+0000 7f5d77011800 20 remove_watcher() i=4 2024-03-20T13:35:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.719+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94156241471632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a2755369c0 con 0x7f5d640be040 2024-03-20T13:35:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.720+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94156241471632] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.720+0000 7f5d77011800 20 remove_watcher() i=5 2024-03-20T13:35:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.720+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94156241456640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275538ec0 con 0x7f5d640be040 2024-03-20T13:35:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.721+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94156241456640] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.721+0000 7f5d77011800 20 remove_watcher() i=6 2024-03-20T13:35:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.721+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94156241475632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55a275534e80 con 0x7f5d640be040 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.722+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94156241475632] v30'143 uv141 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5d6c00a4a0 con 0x7f5d640be040 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.722+0000 7f5d77011800 20 remove_watcher() i=7 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5d640be040 msgr2=0x7f5d64066500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5d640be040 0x7f5d64066500 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2755264f0 msgr2=0x55a2755289b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2755264f0 0x55a2755289b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a27552aa60 msgr2=0x55a27552ce50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a27552aa60 0x55a27552ce50 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a27552f710 msgr2=0x55a275531bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a27552f710 0x55a275531bd0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c3c036790 msgr2=0x7f5c3c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c3c036790 0x7f5c3c038c50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55a2754f8f60 tx=0x7f5d68010000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d72e73640 1 -- 172.21.15.177:0/2071959674 reap_dead start 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 msgr2=0x55a27551add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a27551add0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f5d640891e0 tx=0x7f5d64086f90 comp rx=0 tx=0).stop 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 shutdown_connections 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/2071959674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275513f60 0x55a27551add0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 >> 172.21.15.177:0/2071959674 conn(0x55a2755102a0 msgr2=0x55a27550e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 shutdown_connections 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/2071959674 wait complete. 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c4c036880 msgr2=0x7f5c4c038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c4c036880 0x7f5c4c038d40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55a2754ed2f0 tx=0x7f5d68006000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 msgr2=0x55a2755071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 0x55a2755071c0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f5d64000c00 tx=0x7f5d64055260 comp rx=0 tx=0).stop 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 shutdown_connections 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c4c036880 0x7f5c4c038d40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 --2- 172.21.15.177:0/83434973 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a275506da0 0x55a2755071c0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 >> 172.21.15.177:0/83434973 conn(0x55a2754fae40 msgr2=0x55a2754fb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 shutdown_connections 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.723+0000 7f5d77011800 1 -- 172.21.15.177:0/83434973 wait complete. 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a2754f6050 msgr2=0x55a2754f8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a2754f6050 0x55a2754f8440 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2753eed60 msgr2=0x55a2754efdf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a2753eed60 0x55a2754efdf0 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f5d5c002260 msgr2=0x55a2754f4580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f5d5c002260 0x55a2754f4580 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c58036790 msgr2=0x7f5c58038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5c58036790 0x7f5c58038c50 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5d68000f60 tx=0x7f5d68001430 comp rx=0 tx=0).stop 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 msgr2=0x55a2754e9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 --2- 172.21.15.177:0/3643116874 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a2753ee400 0x55a2754e9020 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5d6404bfd0 tx=0x7f5d5c0040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d72e73640 1 -- 172.21.15.177:0/3643116874 reap_dead start 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 shutdown_connections 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 >> 172.21.15.177:0/3643116874 conn(0x55a2753ea040 msgr2=0x55a2754dba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 shutdown_connections 2024-03-20T13:35:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.724+0000 7f5d77011800 1 -- 172.21.15.177:0/3643116874 wait complete. 2024-03-20T13:35:17.741 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-03-20T13:35:17.745 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-03-20T13:35:17.791 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:17.792 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-03-20T13:35:17.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-03-20T13:35:17.792 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-03-20T13:35:17.837 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:17.837 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:17.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.836+0000 7fb007531800 1 Processor -- start 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.836+0000 7fb007531800 1 -- start start 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb007531800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f79cad7120 0x55f79cad9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb007531800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f79ca1dcd0 con 0x55f79cad3610 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb007531800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f79c9d4500 con 0x55f79cad7120 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb0029f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f79cad7120 0x55f79cad9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb0031fa640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55f79cad3610 0x55f79cad5a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50634/0 (socket says 172.21.15.177:50634) 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb0029f9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f79cad7120 0x55f79cad9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41498/0 (socket says 172.21.15.177:41498) 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb0031fa640 1 -- 172.21.15.177:0/2134160439 learned_addr learned my addr 172.21.15.177:0/2134160439 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb0029f9640 1 -- 172.21.15.177:0/2134160439 >> v1:172.21.15.28:6789/0 conn(0x55f79cad3610 legacy=0x55f79cad5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.839 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.837+0000 7fb0029f9640 1 -- 172.21.15.177:0/2134160439 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f79cadaa60 con 0x55f79cad7120 2024-03-20T13:35:17.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.839+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2134160439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad7120 0x55f79cad9510 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faff800a470 tx=0x7faff801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b394fd95287b5e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.839+0000 7fb0021f8640 1 -- 172.21.15.177:0/2134160439 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff8052570 con 0x55f79cad7120 2024-03-20T13:35:17.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.839+0000 7fb0021f8640 1 -- 172.21.15.177:0/2134160439 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff80526d0 con 0x55f79cad7120 2024-03-20T13:35:17.840 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.839+0000 7fb0021f8640 1 -- 172.21.15.177:0/2134160439 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff8052990 con 0x55f79cad7120 2024-03-20T13:35:17.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 -- 172.21.15.177:0/2134160439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad7120 msgr2=0x55f79cad9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 --2- 172.21.15.177:0/2134160439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad7120 0x55f79cad9510 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7faff800a470 tx=0x7faff801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:17.841 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 -- 172.21.15.177:0/2134160439 shutdown_connections 2024-03-20T13:35:17.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 --2- 172.21.15.177:0/2134160439 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad7120 0x55f79cad9510 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 -- 172.21.15.177:0/2134160439 >> 172.21.15.177:0/2134160439 conn(0x55f79cacd040 msgr2=0x55f79cacf460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 -- 172.21.15.177:0/2134160439 shutdown_connections 2024-03-20T13:35:17.842 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.840+0000 7fb007531800 1 -- 172.21.15.177:0/2134160439 wait complete. 2024-03-20T13:35:17.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.851+0000 7fb007531800 1 Processor -- start 2024-03-20T13:35:17.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.851+0000 7fb007531800 1 -- start start 2024-03-20T13:35:17.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.852+0000 7fb007531800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cad2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.852+0000 7fb007531800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79c9d1a30 con 0x55f79cad3610 2024-03-20T13:35:17.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.852+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cad2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.852+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cad2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41512/0 (socket says 172.21.15.177:41512) 2024-03-20T13:35:17.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.852+0000 7fb0031fa640 1 -- 172.21.15.177:0/2334797892 learned_addr learned my addr 172.21.15.177:0/2334797892 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.853+0000 7fb0031fa640 1 -- 172.21.15.177:0/2334797892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff8005d20 con 0x55f79cad3610 2024-03-20T13:35:17.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.853+0000 7fb0031fa640 1 --2- 172.21.15.177:0/2334797892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cad2f50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7faff4001c50 tx=0x7faff400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57be752fd309e45 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.853+0000 7faef160a640 1 -- 172.21.15.177:0/2334797892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff400e470 con 0x55f79cad3610 2024-03-20T13:35:17.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.853+0000 7faef160a640 1 -- 172.21.15.177:0/2334797892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff400e5d0 con 0x55f79cad3610 2024-03-20T13:35:17.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.853+0000 7faef160a640 1 -- 172.21.15.177:0/2334797892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff400e8d0 con 0x55f79cad3610 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- 172.21.15.177:0/2334797892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 msgr2=0x55f79cad2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 --2- 172.21.15.177:0/2334797892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cad2f50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7faff4001c50 tx=0x7faff400b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- 172.21.15.177:0/2334797892 shutdown_connections 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 --2- 172.21.15.177:0/2334797892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cad2f50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- 172.21.15.177:0/2334797892 >> 172.21.15.177:0/2334797892 conn(0x55f79cacd040 msgr2=0x55f79cbbe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- 172.21.15.177:0/2334797892 shutdown_connections 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- 172.21.15.177:0/2334797892 wait complete. 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 Processor -- start 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- start start 2024-03-20T13:35:17.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cbcc300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb007531800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79c9cd210 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cbcc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cbcc300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41516/0 (socket says 172.21.15.177:41516) 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.854+0000 7fb0031fa640 1 -- 172.21.15.177:0/2385563477 learned_addr learned my addr 172.21.15.177:0/2385563477 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7fb0031fa640 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f79ca1dcd0 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7fb0031fa640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cbcc300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7faff4001c50 tx=0x7faff4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7faeefe07640 1 -- 172.21.15.177:0/2385563477 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff401f070 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7faeefe07640 1 -- 172.21.15.177:0/2385563477 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4018850 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f79cbcc840 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7faeefe07640 1 -- 172.21.15.177:0/2385563477 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4018b30 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.855+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f79cbccd20 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7faeefe07640 1 -- 172.21.15.177:0/2385563477 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7faff4018c90 con 0x55f79cad3610 2024-03-20T13:35:17.860 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7faeefe07640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faee80367e0 0x7faee8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7faeefe07640 1 -- 172.21.15.177:0/2385563477 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7faff404c370 con 0x55f79cad3610 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faee80367e0 0x7faee8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cad7120 0x55f79cbd3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cbd3600 con 0x55f79cad7120 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.856+0000 7fb0039fb640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cad7120 0x55f79cbd3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faee80367e0 0x7faee8038ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faff8054000 tx=0x7faff804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb0039fb640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cad7120 0x55f79cbd3030 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb0039fb640 1 -- 172.21.15.177:0/2385563477 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cad7120 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cbd06e0 con 0x55f79cad7120 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb0039fb640 1 -- 172.21.15.177:0/2385563477 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cad7120 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cbd5840 0x55f79cbd7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cbd8300 con 0x55f79cbd5840 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb0031fa640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cbd5840 0x55f79cbd7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.861 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.857+0000 7fb0031fa640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cbd5840 0x55f79cbd7c30 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.858+0000 7fb0031fa640 1 -- 172.21.15.177:0/2385563477 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7faff4014070 con 0x55f79cbd5840 2024-03-20T13:35:17.862 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.858+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cbd47c0 con 0x55f79cad7120 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.858+0000 7fb0039fb640 1 -- 172.21.15.177:0/2385563477 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cad7120 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.858+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f79cbd9700 0x55f79cbdbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.858+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cbdc250 con 0x55f79cbd9700 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.858+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f79cbd9700 0x55f79cbdbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.859+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f79cbd9700 0x55f79cbdbaf0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.859+0000 7fb0029f9640 1 -- 172.21.15.177:0/2385563477 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7faff8059040 con 0x55f79cbd9700 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.859+0000 7fb007531800 1 Processor -- start 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.859+0000 7fb007531800 1 -- start start 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.859+0000 7fb007531800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 0x55f79cbea820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.859+0000 7fb007531800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79c96fc70 con 0x55f79cbea400 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 0x55f79cbea820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 0x55f79cbea820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41532/0 (socket says 172.21.15.177:41532) 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb0031fa640 1 -- 172.21.15.177:0/2981722584 learned_addr learned my addr 172.21.15.177:0/2981722584 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb0031fa640 1 -- 172.21.15.177:0/2981722584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f79cbead60 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb0031fa640 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 0x55f79cbea820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faff404c2e0 tx=0x7faff40166c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7faeed602640 1 -- 172.21.15.177:0/2981722584 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff40236b0 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7faeed602640 1 -- 172.21.15.177:0/2981722584 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4023810 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7faeed602640 1 -- 172.21.15.177:0/2981722584 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff40229b0 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f79cbeb7d0 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.860+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f79cbeb7d0 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.861+0000 7faeed602640 1 -- 172.21.15.177:0/2981722584 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7faff4022d20 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.861+0000 7faeed602640 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faedc0367e0 0x7faedc038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.861+0000 7faeed602640 1 -- 172.21.15.177:0/2981722584 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7faff404de10 con 0x55f79cbea400 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.861+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faedc0367e0 0x7faedc038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.861+0000 7fb007531800 1 Processor -- start 2024-03-20T13:35:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb007531800 1 -- start start 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb0029f9640 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faedc0367e0 0x7faedc038ca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55f79cbd0620 tx=0x7faff8005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb007531800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbf77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb007531800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79c9455d0 con 0x55f79cbf73c0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbf77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbf77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41540/0 (socket says 172.21.15.177:41540) 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb0031fa640 1 -- 172.21.15.177:0/431757002 learned_addr learned my addr 172.21.15.177:0/431757002 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb0031fa640 1 -- 172.21.15.177:0/431757002 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f79cbf7db0 con 0x55f79cbf73c0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7fb0031fa640 1 --2- 172.21.15.177:0/431757002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbf77e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faff4035e60 tx=0x7faff4035f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2a69696e33a97af server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7faee6ffd640 1 -- 172.21.15.177:0/431757002 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4055070 con 0x55f79cbf73c0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7faee6ffd640 1 -- 172.21.15.177:0/431757002 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4044b60 con 0x55f79cbf73c0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.862+0000 7faee6ffd640 1 -- 172.21.15.177:0/431757002 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4044e00 con 0x55f79cbf73c0 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- 172.21.15.177:0/431757002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 msgr2=0x55f79cbf77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 --2- 172.21.15.177:0/431757002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbf77e0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7faff4035e60 tx=0x7faff4035f50 comp rx=0 tx=0).stop 2024-03-20T13:35:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- 172.21.15.177:0/431757002 shutdown_connections 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 --2- 172.21.15.177:0/431757002 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbf77e0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- 172.21.15.177:0/431757002 >> 172.21.15.177:0/431757002 conn(0x55f79cbf3690 msgr2=0x55f79cbf16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- 172.21.15.177:0/431757002 shutdown_connections 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- 172.21.15.177:0/431757002 wait complete. 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 Processor -- start 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- start start 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbfe330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.863+0000 7fb007531800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f79cbfe870 con 0x55f79cbf73c0 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.864+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbfe330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.864+0000 7fb0031fa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbfe330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41546/0 (socket says 172.21.15.177:41546) 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.864+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 learned_addr learned my addr 172.21.15.177:0/1682129146 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.865+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff403a030 con 0x55f79cbf73c0 2024-03-20T13:35:17.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.866+0000 7fb0031fa640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbfe330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faff4016fd0 tx=0x7faff403fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.866+0000 7faee57fa640 1 -- 172.21.15.177:0/1682129146 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4061070 con 0x55f79cbf73c0 2024-03-20T13:35:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.866+0000 7faee57fa640 1 -- 172.21.15.177:0/1682129146 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faff4035970 con 0x55f79cbf73c0 2024-03-20T13:35:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.867+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f79cbfea70 con 0x55f79cbf73c0 2024-03-20T13:35:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.867+0000 7faee57fa640 1 -- 172.21.15.177:0/1682129146 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7faff4035c10 con 0x55f79cbf73c0 2024-03-20T13:35:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.867+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f79cbfea70 con 0x55f79cbf73c0 2024-03-20T13:35:17.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.868+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.869+0000 7faee57fa640 1 -- 172.21.15.177:0/1682129146 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7faff4024420 con 0x55f79cbf73c0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.869+0000 7faee57fa640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faecc036790 0x7faecc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.869+0000 7faee57fa640 1 -- 172.21.15.177:0/1682129146 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7faff4066c50 con 0x55f79cbf73c0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb0029f9640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faecc036790 0x7faecc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cc09dd0 0x55f79cc0c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0c9b0 con 0x55f79cc09dd0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb0039fb640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cc09dd0 0x55f79cc0c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb0029f9640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faecc036790 0x7faecc038c50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faff8055040 tx=0x7faff804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb0039fb640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cc09dd0 0x55f79cc0c260 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 20 realm 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0cd80 con 0x55f79cc09dd0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.870+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d960 con 0x55f79cc09dd0 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cc0e310 0x55f79cc10700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc10d10 con 0x55f79cc0e310 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb0031fa640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cc0e310 0x55f79cc10700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.871+0000 7fb0031fa640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cc0e310 0x55f79cc10700 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7faff4014070 con 0x55f79cc0e310 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb007531800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb007531800 20 searching for the correct realm 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f79cc12fc0 0x55f79cc15480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc15b00 con 0x55f79cc12fc0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb0029f9640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f79cc12fc0 0x55f79cc15480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb0029f9640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f79cc12fc0 0x55f79cc15480 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.872+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc15b00 con 0x55f79cc0e310 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.873+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff4014070 con 0x55f79cc0e310 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.873+0000 7fb0031fa640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7faff4073040 0x7faff4010410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.873+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc15b00 con 0x7faff4073040 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.873+0000 7fb0039fb640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7faff4073040 0x7faff4010410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.873+0000 7fb0039fb640 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7faff4073040 0x7faff4010410 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.874+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc0e310 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff4014070 con 0x55f79cc0e310 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.875+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc0e310 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7faff4014070 con 0x55f79cc0e310 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.876+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.877+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc0e310 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.878+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.879+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.879+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.879+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.879+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc12fc0 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.879+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.879+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x7faff4073040 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.880+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.880+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faffc031040 con 0x55f79cc0e310 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.880+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.880+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faffc031040 con 0x55f79cc12fc0 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.880+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.880+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faffc031040 con 0x7faff4073040 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faffc031040 con 0x55f79cc09dd0 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7faffc031040 con 0x55f79cc0e310 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc0d600 con 0x55f79cc09dd0 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.881+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc11400 con 0x55f79cc09dd0 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc117e0 con 0x7faff4073040 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 20 zone default found 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 4 Realm: () 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:17.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 20 zonegroup default 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.882+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc11bd0 con 0x7faff4073040 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc11fd0 con 0x55f79cc12fc0 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc17920 con 0x55f79cc12fc0 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 started sync module instance, tier type = 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.883+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc17200 con 0x55f79cc0e310 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.884+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.884+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94521975205216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc175b0 con 0x55f79cc0e310 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.884+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc18730 con 0x55f79cc09dd0 2024-03-20T13:35:17.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.885+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94521975205216] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.886+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.886+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94521975210640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc18b50 con 0x55f79cc09dd0 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.886+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc194c0 con 0x55f79cc12fc0 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.887+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94521975210640] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.887+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.887+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94521975211696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc18ad0 con 0x55f79cc12fc0 2024-03-20T13:35:17.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.887+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1a320 con 0x55f79cc0e310 2024-03-20T13:35:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.888+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94521975211696] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.888+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.888+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94521975216240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1ab20 con 0x55f79cc0e310 2024-03-20T13:35:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.888+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1b3a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.889+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94521975216240] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.889+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.889+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94521975221888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1b750 con 0x55f79cc09dd0 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.889+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1c120 con 0x7faff4073040 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.890+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.890+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94521975221888] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.890+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94521975225376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1c0e0 con 0x7faff4073040 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.890+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1a6c0 con 0x7faff4073040 2024-03-20T13:35:17.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.891+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94521975225376] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.891+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.891+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94521975219904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1cbc0 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.891+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1d530 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94521975219904] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'144 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94521975227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1d530 con 0x7faff4073040 2024-03-20T13:35:17.910 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=0 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=1 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=2 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=3 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=4 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=5 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.892+0000 7fb007531800 20 add_watcher() i=6 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.893+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94521975227440] v30'145 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.894+0000 7fb007531800 20 add_watcher() i=7 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.894+0000 7fb007531800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.894+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc20950 con 0x55f79cc09dd0 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.894+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.894+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94521975231072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc1de30 con 0x55f79cc09dd0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.895+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94521975231072] v30'139 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.895+0000 7faeb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.895+0000 7fb007531800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.895+0000 7fb007531800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.895+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc20410 con 0x55f79cc09dd0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.896+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.896+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc20850 con 0x7faff4073040 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.897+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v30'17 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.897+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc20850 con 0x55f79cc12fc0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.898+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 gc.2 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.898+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2a170 con 0x55f79cc09dd0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.899+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v30'140 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.899+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc291c0 con 0x55f79cc0e310 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.900+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v30'42 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.900+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ace0 con 0x55f79cc12fc0 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.901+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 gc.5 [create,call,call,call] v30'27 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.901+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2b6b0 con 0x55f79cc09dd0 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.902+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v30'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.902+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2b6b0 con 0x7faff4073040 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.904+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v30'27 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.904+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2b740 con 0x55f79cc0e310 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.905+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.905+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2bcb0 con 0x55f79cc12fc0 2024-03-20T13:35:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.906+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(71 gc.9 [create,call,call,call] v30'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.906+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc0e310 2024-03-20T13:35:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.907+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v30'43 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.907+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c710 con 0x7faff4073040 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.908+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v30'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.908+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c710 con 0x55f79cc0e310 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.909+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v30'17 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.909+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2cbb0 con 0x7faff4073040 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.912+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v30'33 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.912+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc09dd0 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.913+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v30'141 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.913+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc12fc0 2024-03-20T13:35:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.914+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(77 gc.15 [create,call,call,call] v30'35 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.914+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc0e310 2024-03-20T13:35:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.915+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v30'44 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.915+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc12fc0 2024-03-20T13:35:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.916+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(79 gc.17 [create,call,call,call] v30'17 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.916+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc09dd0 2024-03-20T13:35:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.917+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v30'25 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.917+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc09dd0 2024-03-20T13:35:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.918+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v30'142 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.918+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc12fc0 2024-03-20T13:35:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.919+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(82 gc.20 [create,call,call,call] v30'36 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.919+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2c1e0 con 0x55f79cc0e310 2024-03-20T13:35:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.920+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v30'27 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.920+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc12fc0 2024-03-20T13:35:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.921+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(84 gc.22 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.921+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc12fc0 2024-03-20T13:35:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.922+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(85 gc.23 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.922+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc12fc0 2024-03-20T13:35:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.923+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(86 gc.24 [create,call,call,call] v30'13 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.923+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc12fc0 2024-03-20T13:35:17.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.924+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(87 gc.25 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.925 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.924+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x7faff4073040 2024-03-20T13:35:17.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.925+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v30'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.927 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.925+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc12fc0 2024-03-20T13:35:17.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.926+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(89 gc.27 [create,call,call,call] v30'17 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.928 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.926+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x7faff4073040 2024-03-20T13:35:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.928+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v30'28 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.928+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc12fc0 2024-03-20T13:35:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.929+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(91 gc.29 [create,call,call,call] v30'37 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.929+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x7faff4073040 2024-03-20T13:35:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.930+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v30'34 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.930+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc2ce60 con 0x55f79cc0e310 2024-03-20T13:35:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.931+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v30'23 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.931+0000 7faeb8fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 20 Filter name: none 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fae327fc640 20 reqs_thread_entry: start 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc56710 con 0x55f79cc0e310 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 20 rados->read ofs=0 len=0 2024-03-20T13:35:17.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc58020 con 0x55f79cc09dd0 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(95 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.932+0000 7fb007531800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 20 get_obj_state: octx=0x7faff404cec0 obj=myfoo:four state=0x55f79cc58d08 s->prefetch_data=0 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:96 3.cs0 3:30bb9752:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1_four:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc59df0 con 0x55f79cc12fc0 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(96 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1_four [getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 234+0+867 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 10 manifest: total_size = 4 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.14641227721770035569 2024-03-20T13:35:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 20 get_obj_state: octx=0x7faff404cec0 obj=myfoo:four state=0x55f79cc58d08 s->prefetch_data=0 2024-03-20T13:35:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 20 prepare_atomic_modification: state is not atomic. state=0x55f79cc58d08 2024-03-20T13:35:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 2024-03-20T13:35:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.933+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:97 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5e7e0 con 0x55f79cc0e310 2024-03-20T13:35:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.934+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(97 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [stat,call,call] v30'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.934+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:98 3.cs0 3:30bb9752:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5e7e0 con 0x55f79cc12fc0 2024-03-20T13:35:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.935+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(98 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1_four [call] v30'2 uv2 ondisk = 0) v8 ==== 192+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.935+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:99 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc0e310 2024-03-20T13:35:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.937+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(99 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [stat,call,call] v30'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.937+0000 7faee6ffd640 20 handle_completion(): completion ok for obj=four 2024-03-20T13:35:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.937+0000 7faeb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.937+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94521975231072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc09dd0 2024-03-20T13:35:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.938+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94521975231072] v30'143 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.938+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94521975205216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc0e310 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.938+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94521975205216] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.938+0000 7fb007531800 20 remove_watcher() i=0 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.938+0000 7fb007531800 2 removed watcher, disabling cache 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.938+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94521975210640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc09dd0 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.939+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94521975210640] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.939+0000 7fb007531800 20 remove_watcher() i=1 2024-03-20T13:35:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.939+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94521975211696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc12fc0 2024-03-20T13:35:17.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.941+0000 7fb0029f9640 1 -- 172.21.15.177:0/1682129146 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94521975211696] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff8059040 con 0x55f79cc12fc0 2024-03-20T13:35:17.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.941+0000 7fb007531800 20 remove_watcher() i=2 2024-03-20T13:35:17.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.941+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94521975216240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc0e310 2024-03-20T13:35:17.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.942+0000 7fb0031fa640 1 -- 172.21.15.177:0/1682129146 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94521975216240] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faff407b080 con 0x55f79cc0e310 2024-03-20T13:35:17.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.942+0000 7fb007531800 20 remove_watcher() i=3 2024-03-20T13:35:17.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.942+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94521975221888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x55f79cc09dd0 2024-03-20T13:35:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.943+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94521975221888] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x55f79cc09dd0 2024-03-20T13:35:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.943+0000 7fb007531800 20 remove_watcher() i=4 2024-03-20T13:35:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.943+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94521975225376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x7faff4073040 2024-03-20T13:35:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.944+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94521975225376] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.945+0000 7fb007531800 20 remove_watcher() i=5 2024-03-20T13:35:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.945+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94521975219904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x7faff4073040 2024-03-20T13:35:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.947+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94521975219904] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.947+0000 7fb007531800 20 remove_watcher() i=6 2024-03-20T13:35:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.947+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94521975227440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f79cc5ed80 con 0x7faff4073040 2024-03-20T13:35:17.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94521975227440] v30'146 uv144 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7faffc00a4a0 con 0x7faff4073040 2024-03-20T13:35:17.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 20 remove_watcher() i=7 2024-03-20T13:35:17.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7faff4073040 msgr2=0x7faff4010410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7faff4073040 0x7faff4010410 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.956 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cc09dd0 msgr2=0x55f79cc0c260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cc09dd0 0x55f79cc0c260 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cc0e310 msgr2=0x55f79cc10700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cc0e310 0x55f79cc10700 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f79cc12fc0 msgr2=0x55f79cc15480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.957 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f79cc12fc0 0x55f79cc15480 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faecc036790 msgr2=0x7faecc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faecc036790 0x7faecc038c50 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7faff8055040 tx=0x7faff804f000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 msgr2=0x55f79cbfe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 --2- 172.21.15.177:0/1682129146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbf73c0 0x55f79cbfe330 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7faff4016fd0 tx=0x7faff403fe90 comp rx=0 tx=0).stop 2024-03-20T13:35:17.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 reap_dead start 2024-03-20T13:35:17.958 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb0039fb640 1 -- 172.21.15.177:0/1682129146 reap_dead start 2024-03-20T13:35:17.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 shutdown_connections 2024-03-20T13:35:17.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 >> 172.21.15.177:0/1682129146 conn(0x55f79cbf3690 msgr2=0x55f79cbf0cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 shutdown_connections 2024-03-20T13:35:17.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.949+0000 7fb007531800 1 -- 172.21.15.177:0/1682129146 wait complete. 2024-03-20T13:35:17.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faedc0367e0 msgr2=0x7faedc038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.959 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faedc0367e0 0x7faedc038ca0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55f79cbd0620 tx=0x7faff8005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:17.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 msgr2=0x55f79cbea820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 0x55f79cbea820 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7faff404c2e0 tx=0x7faff40166c0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 shutdown_connections 2024-03-20T13:35:17.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faedc0367e0 0x7faedc038ca0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.960 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2981722584 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cbea400 0x55f79cbea820 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 >> 172.21.15.177:0/2981722584 conn(0x55f79cbde4a0 msgr2=0x55f79cbde8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 shutdown_connections 2024-03-20T13:35:17.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2981722584 wait complete. 2024-03-20T13:35:17.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f79cbd9700 msgr2=0x55f79cbdbaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f79cbd9700 0x55f79cbdbaf0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cad7120 msgr2=0x55f79cbd3030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f79cad7120 0x55f79cbd3030 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cbd5840 msgr2=0x55f79cbd7c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f79cbd5840 0x55f79cbd7c30 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faee80367e0 msgr2=0x7faee8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7faee80367e0 0x7faee8038ca0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faff8054000 tx=0x7faff804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:17.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 msgr2=0x55f79cbcc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:17.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 --2- 172.21.15.177:0/2385563477 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f79cad3610 0x55f79cbcc300 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7faff4001c50 tx=0x7faff4000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:17.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb0039fb640 1 -- 172.21.15.177:0/2385563477 reap_dead start 2024-03-20T13:35:17.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 shutdown_connections 2024-03-20T13:35:17.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 >> 172.21.15.177:0/2385563477 conn(0x55f79cacd040 msgr2=0x55f79cad19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:17.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 shutdown_connections 2024-03-20T13:35:17.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:17.950+0000 7fb007531800 1 -- 172.21.15.177:0/2385563477 wait complete. 2024-03-20T13:35:17.965 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:35:17.965 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-03-20T13:35:17.966 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-03-20T13:35:18.011 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:18.012 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:18.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.008+0000 7f7eedf21800 1 Processor -- start 2024-03-20T13:35:18.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.008+0000 7f7eedf21800 1 -- start start 2024-03-20T13:35:18.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.008+0000 7f7eedf21800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b35493b100 0x55b35493d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.008+0000 7f7eedf21800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b354881cd0 con 0x55b3549375f0 2024-03-20T13:35:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.008+0000 7f7eedf21800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b354838500 con 0x55b35493b100 2024-03-20T13:35:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee9b1b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55b3549375f0 0x55b3549399e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50638/0 (socket says 172.21.15.177:50638) 2024-03-20T13:35:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/4088145892 learned_addr learned my addr 172.21.15.177:0/4088145892 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 28038732 0 0) 0x55b354881cd0 con 0x55b3549375f0 2024-03-20T13:35:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed4001e10 con 0x55b3549375f0 2024-03-20T13:35:18.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2377900223 0 0) 0x7f7ed4001e10 con 0x55b3549375f0 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 >> v2:172.21.15.28:3300/0 conn(0x55b35493b100 msgr2=0x55b35493d4f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 --2- 172.21.15.177:0/4088145892 >> v2:172.21.15.28:3300/0 conn(0x55b35493b100 0x55b35493d4f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b35493ea40 con 0x55b3549375f0 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (unknown 2634750674 0 0) 0x7f7edc0015a0 con 0x55b3549375f0 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 >> v1:172.21.15.28:6789/0 conn(0x55b3549375f0 legacy=0x55b3549399e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 --2- 172.21.15.177:0/4088145892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ed4002260 0x7f7ed4002660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b354838500 con 0x7f7ed4002260 2024-03-20T13:35:18.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.009+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/4088145892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ed4002260 0x7f7ed4002660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.010+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/4088145892 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4001e10 con 0x7f7ed4002260 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.011+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/4088145892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ed4002260 0x7f7ed4002660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0099c0 tx=0x7f7edc01d6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a905fe20eccba3a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc04ba40 con 0x7f7ed4002260 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc04bba0 con 0x7f7ed4002260 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7ee8b19640 1 -- 172.21.15.177:0/4088145892 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc04be60 con 0x7f7ed4002260 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 -- 172.21.15.177:0/4088145892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ed4002260 msgr2=0x7f7ed4002660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 --2- 172.21.15.177:0/4088145892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ed4002260 0x7f7ed4002660 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7edc0099c0 tx=0x7f7edc01d6b0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 -- 172.21.15.177:0/4088145892 shutdown_connections 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 --2- 172.21.15.177:0/4088145892 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7ed4002260 0x7f7ed4002660 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 --2- 172.21.15.177:0/4088145892 >> v2:172.21.15.28:3300/0 conn(0x55b35493b100 0x55b35493d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 -- 172.21.15.177:0/4088145892 >> 172.21.15.177:0/4088145892 conn(0x55b354931040 msgr2=0x55b354933460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 -- 172.21.15.177:0/4088145892 shutdown_connections 2024-03-20T13:35:18.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.012+0000 7f7eedf21800 1 -- 172.21.15.177:0/4088145892 wait complete. 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7eedf21800 1 Processor -- start 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7eedf21800 1 -- start start 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7eedf21800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354936e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7eedf21800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b354835a30 con 0x55b3549375f0 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354936e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354936e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41566/0 (socket says 172.21.15.177:41566) 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/1847091350 learned_addr learned my addr 172.21.15.177:0/1847091350 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.024+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/1847091350 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b354937460 con 0x55b3549375f0 2024-03-20T13:35:18.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.025+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/1847091350 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354936e90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7edc01dde0 tx=0x7f7edc04d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d91cb17e712bf64 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.025+0000 7f7dd7e07640 1 -- 172.21.15.177:0/1847091350 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc04ba40 con 0x55b3549375f0 2024-03-20T13:35:18.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.025+0000 7f7dd7e07640 1 -- 172.21.15.177:0/1847091350 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc001430 con 0x55b3549375f0 2024-03-20T13:35:18.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.025+0000 7f7dd7e07640 1 -- 172.21.15.177:0/1847091350 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc05f480 con 0x55b3549375f0 2024-03-20T13:35:18.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- 172.21.15.177:0/1847091350 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 msgr2=0x55b354936e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 --2- 172.21.15.177:0/1847091350 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354936e90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7edc01dde0 tx=0x7f7edc04d070 comp rx=0 tx=0).stop 2024-03-20T13:35:18.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- 172.21.15.177:0/1847091350 shutdown_connections 2024-03-20T13:35:18.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 --2- 172.21.15.177:0/1847091350 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354936e90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- 172.21.15.177:0/1847091350 >> 172.21.15.177:0/1847091350 conn(0x55b354931040 msgr2=0x55b354a21f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- 172.21.15.177:0/1847091350 shutdown_connections 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- 172.21.15.177:0/1847091350 wait complete. 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 Processor -- start 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- start start 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354a2ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7eedf21800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b354831210 con 0x55b3549375f0 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354a2ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354a2ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41582/0 (socket says 172.21.15.177:41582) 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.026+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2901618994 learned_addr learned my addr 172.21.15.177:0/2901618994 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4001e10 con 0x55b3549375f0 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354a2ff10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7edc061040 tx=0x7f7ed40040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.032 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7dd6604640 1 -- 172.21.15.177:0/2901618994 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc0015a0 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7dd6604640 1 -- 172.21.15.177:0/2901618994 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc06f070 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b354a30450 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7dd6604640 1 -- 172.21.15.177:0/2901618994 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc04b910 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.027+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b354a30990 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7dd6604640 1 -- 172.21.15.177:0/2901618994 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7edc06b420 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7dd6604640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dd0036790 0x7f7dd0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7dd6604640 1 -- 172.21.15.177:0/2901618994 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7edc08ecc0 con 0x55b3549375f0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dd0036790 0x7f7dd0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b35493b100 0x55b354a36d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a37270 con 0x55b35493b100 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7eea31c640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b35493b100 0x55b354a36d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dd0036790 0x7f7dd0038c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a430 tx=0x7f7ee0005540 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.028+0000 7f7eea31c640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b35493b100 0x55b354a36d30 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7eea31c640 1 -- 172.21.15.177:0/2901618994 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b35493b100 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a342d0 con 0x55b35493b100 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7eea31c640 1 -- 172.21.15.177:0/2901618994 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b35493b100 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7ed4002260 0x55b354a3b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a3bb30 con 0x7f7ed4002260 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7ed4002260 0x55b354a3b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.029+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7ed4002260 0x55b354a3b490 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.030+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2901618994 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7edc065020 con 0x7f7ed4002260 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.030+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a38400 con 0x55b35493b100 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.030+0000 7f7eea31c640 1 -- 172.21.15.177:0/2901618994 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b35493b100 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.030+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b354a3cf50 0x55b354a3f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.030+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a3faa0 con 0x55b354a3cf50 2024-03-20T13:35:18.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.030+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b354a3cf50 0x55b354a3f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.031+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b354a3cf50 0x55b354a3f340 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.031+0000 7f7ee931a640 1 -- 172.21.15.177:0/2901618994 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a3cf50 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.031+0000 7f7eedf21800 1 Processor -- start 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.031+0000 7f7eedf21800 1 -- start start 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7eedf21800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 0x55b354a4e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7eedf21800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3547d3c70 con 0x55b354a4dc80 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 0x55b354a4e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 0x55b354a4e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41596/0 (socket says 172.21.15.177:41596) 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/3300552759 learned_addr learned my addr 172.21.15.177:0/3300552759 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/3300552759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b354a4e5e0 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 0x55b354a4e0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7edc04bb70 tx=0x7f7edc06bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7dcf7fe640 1 -- 172.21.15.177:0/3300552759 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc0853b0 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7dcf7fe640 1 -- 172.21.15.177:0/3300552759 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc092070 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b354a4f050 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.032+0000 7f7dcf7fe640 1 -- 172.21.15.177:0/3300552759 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc055de0 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.033+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b354a4f510 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.033+0000 7f7dcf7fe640 1 -- 172.21.15.177:0/3300552759 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7edc094070 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.033+0000 7f7dcf7fe640 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dc4036740 0x7f7dc4038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.033+0000 7f7dcf7fe640 1 -- 172.21.15.177:0/3300552759 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7edc098cb0 con 0x55b354a4dc80 2024-03-20T13:35:18.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.033+0000 7f7ee931a640 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dc4036740 0x7f7dc4038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7eedf21800 1 Processor -- start 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7eedf21800 1 -- start start 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7ee931a640 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dc4036740 0x7f7dc4038c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b700 tx=0x7f7ee000e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7eedf21800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a5b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7eedf21800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3547a95d0 con 0x55b354a5ad10 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a5b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a5b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41598/0 (socket says 172.21.15.177:41598) 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/3332510282 learned_addr learned my addr 172.21.15.177:0/3332510282 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.034+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/3332510282 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b354a5b700 con 0x55b354a5ad10 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.035+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/3332510282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a5b130 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009760 tx=0x7f7edc07f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28209a314854519f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.035+0000 7f7dcd7fa640 1 -- 172.21.15.177:0/3332510282 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc0552b0 con 0x55b354a5ad10 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.035+0000 7f7dcd7fa640 1 -- 172.21.15.177:0/3332510282 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc08e2c0 con 0x55b354a5ad10 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.035+0000 7f7dcd7fa640 1 -- 172.21.15.177:0/3332510282 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc055590 con 0x55b354a5ad10 2024-03-20T13:35:18.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.035+0000 7f7eedf21800 1 -- 172.21.15.177:0/3332510282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 msgr2=0x55b354a5b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.035+0000 7f7eedf21800 1 --2- 172.21.15.177:0/3332510282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a5b130 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7edc009760 tx=0x7f7edc07f590 comp rx=0 tx=0).stop 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 -- 172.21.15.177:0/3332510282 shutdown_connections 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 --2- 172.21.15.177:0/3332510282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a5b130 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 -- 172.21.15.177:0/3332510282 >> 172.21.15.177:0/3332510282 conn(0x55b354a57070 msgr2=0x55b354a550d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 -- 172.21.15.177:0/3332510282 shutdown_connections 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 -- 172.21.15.177:0/3332510282 wait complete. 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 Processor -- start 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 -- start start 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a61cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.036+0000 7f7eedf21800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b354a62200 con 0x55b354a5ad10 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.037+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a61cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.037+0000 7f7ee9b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a61cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41610/0 (socket says 172.21.15.177:41610) 2024-03-20T13:35:18.060 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.037+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 learned_addr learned my addr 172.21.15.177:0/2704081097 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.037+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b354a4f050 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.038+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a61cc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7edc07f5d0 tx=0x7f7edc096f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.038+0000 7f7dbb7fe640 1 -- 172.21.15.177:0/2704081097 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc0bc070 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.038+0000 7f7dbb7fe640 1 -- 172.21.15.177:0/2704081097 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7edc069af0 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.038+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b354a4f050 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.038+0000 7f7dbb7fe640 1 -- 172.21.15.177:0/2704081097 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7edc069dd0 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.038+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b354a4f050 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7dbb7fe640 1 -- 172.21.15.177:0/2704081097 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7edc0a9070 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7dbb7fe640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7db4036790 0x7f7db4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7dbb7fe640 1 -- 172.21.15.177:0/2704081097 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f7edc0a6040 con 0x55b354a5ad10 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7db4036790 0x7f7db4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b354a6d480 0x55b354a6f940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70090 con 0x55b354a6d480 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.039+0000 7f7eea31c640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b354a6d480 0x55b354a6f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7db4036790 0x7f7db4038c50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55b354a34230 tx=0x7f7ee0002000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eea31c640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b354a6d480 0x55b354a6f940 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 realm 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70460 con 0x55b354a6d480 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:18.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.040+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a71010 con 0x55b354a6d480 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b354a719c0 0x55b354a73db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a742f0 con 0x55b354a719c0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b354a719c0 0x55b354a73db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b354a719c0 0x55b354a73db0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 20 searching for the correct realm 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b354a762f0 0x55b354a787b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a78e80 con 0x55b354a762f0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.041+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b354a762f0 0x55b354a787b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.042+0000 7f7ee931a640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b354a762f0 0x55b354a787b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.042+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.042+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a78e80 con 0x55b354a719c0 2024-03-20T13:35:18.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.042+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.042+0000 7f7ee9b1b640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7edc068070 0x7f7edc0963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.042+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a78e80 con 0x7f7edc068070 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.043+0000 7f7eea31c640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7edc068070 0x7f7edc0963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.043+0000 7f7eea31c640 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7edc068070 0x7f7edc0963d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.043+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.043+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.044+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a719c0 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.045+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a719c0 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.046+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.047+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a719c0 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.048+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a762f0 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x7f7edc068070 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.049+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7ee4031040 con 0x55b354a719c0 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.050+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.050+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7ee4031040 con 0x55b354a762f0 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.050+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.050+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7ee4031040 con 0x7f7edc068070 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.050+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.050+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7ee4031040 con 0x55b354a6d480 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f7ee4031040 con 0x55b354a719c0 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a70cb0 con 0x55b354a6d480 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a74bf0 con 0x55b354a6d480 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.051+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a74bf0 con 0x7f7edc068070 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 zone default found 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 4 Realm: () 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:18.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 zonegroup default 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a75470 con 0x7f7edc068070 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a75470 con 0x55b354a762f0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.052+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7aca0 con 0x55b354a762f0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.053+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.053+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.053+0000 7f7eedf21800 20 started sync module instance, tier type = 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.053+0000 7f7eedf21800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.053+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7a130 con 0x55b354a719c0 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.054+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.054+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94228707779728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7a8b0 con 0x55b354a719c0 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.054+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7b9c0 con 0x55b354a6d480 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.054+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94228707779728] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.055+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.055+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94228707782656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7bda0 con 0x55b354a6d480 2024-03-20T13:35:18.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.055+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7c820 con 0x55b354a762f0 2024-03-20T13:35:18.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.056+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94228707782656] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.056+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.056+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94228707787552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7cc00 con 0x55b354a762f0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.056+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7d610 con 0x55b354a719c0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.058+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94228707787552] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.058+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.058+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94228707783712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7d9f0 con 0x55b354a719c0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.058+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7e3d0 con 0x55b354a6d480 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.059+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94228707783712] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.059+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.059+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94228707791152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7e390 con 0x55b354a6d480 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.059+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7eeb0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.060+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94228707791152] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.061+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.061+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94228707797408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7e390 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.061+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7f890 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.062+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.062+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94228707800016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7fd30 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.062+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a807b0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.062+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94228707797408] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v30'147 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94228707800016] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94228707803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a80770 con 0x7f7edc068070 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=0 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=1 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=2 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=3 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=4 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=5 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.063+0000 7f7eedf21800 20 add_watcher() i=6 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.064+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94228707803824] v30'148 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.065+0000 7f7eedf21800 20 add_watcher() i=7 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.065+0000 7f7eedf21800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.065+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a837a0 con 0x55b354a6d480 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.065+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.065+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94228707794672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a80c10 con 0x55b354a6d480 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94228707794672] v30'144 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7d9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7eedf21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7eedf21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7eedf21800 5 note: GC not initialized 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7d9a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7eedf21800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.066+0000 7f7eedf21800 20 Filter name: none 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7d0bfff640 20 reqs_thread_entry: start 2024-03-20T13:35:18.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ab5510 con 0x55b354a719c0 2024-03-20T13:35:18.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:18.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ab5bd0 con 0x55b354a6d480 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(63 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.067+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ab4b20 con 0x55b354a719c0 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ab7090 con 0x55b354a6d480 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 4.c 4:308e6e23:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ab6ae0 con 0x55b354a6d480 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 4.1f 4:fad6e193:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354abbaa0 con 0x55b354a762f0 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 4.3e 4:7ce6a172:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354abe2c0 con 0x55b354a719c0 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 4.17 4:e9d229c3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ac0bc0 con 0x7f7edc068070 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 4.21 4:87353121:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ac3590 con 0x7f7edc068070 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 4.1b 4:db926116:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ac6400 con 0x55b354a719c0 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 4.18 4:19f6715e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ac9220 con 0x55b354a719c0 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 4.3b 4:ddf15168:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354acc060 con 0x55b354a762f0 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 4.1a 4:59833ee6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ac9260 con 0x55b354a719c0 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 4.33 4:cc074805:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ad13e0 con 0x7f7edc068070 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.068+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 4.20 4:0726f43c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ad40d0 con 0x55b354a6d480 2024-03-20T13:35:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(71 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.5 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(72 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.6 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(73 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.7 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(74 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.8 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(75 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.1.9 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eedf21800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e0a0517e:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ac8ba0 con 0x55b354a762f0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.069+0000 7f7eedf21800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.070+0000 7f7d9b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.070+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94228707794672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354ab56e0 con 0x55b354a6d480 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.071+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 94228707794672] v30'145 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.071+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94228707779728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7def0 con 0x55b354a719c0 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.072+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 94228707779728] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.072+0000 7f7eedf21800 20 remove_watcher() i=0 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.072+0000 7f7eedf21800 2 removed watcher, disabling cache 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.072+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94228707782656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7def0 con 0x55b354a6d480 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.073+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 94228707782656] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.073+0000 7f7eedf21800 20 remove_watcher() i=1 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.073+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94228707787552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7b000 con 0x55b354a762f0 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.075+0000 7f7ee931a640 1 -- 172.21.15.177:0/2704081097 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 94228707787552] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee0010040 con 0x55b354a762f0 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.075+0000 7f7eedf21800 20 remove_watcher() i=2 2024-03-20T13:35:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.075+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94228707783712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7def0 con 0x55b354a719c0 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.076+0000 7f7ee9b1b640 1 -- 172.21.15.177:0/2704081097 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 94228707783712] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7edc0be070 con 0x55b354a719c0 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.076+0000 7f7eedf21800 20 remove_watcher() i=3 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.076+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94228707791152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7def0 con 0x55b354a6d480 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.077+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 94228707791152] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x55b354a6d480 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.077+0000 7f7eedf21800 20 remove_watcher() i=4 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.077+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94228707797408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7d130 con 0x7f7edc068070 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.079+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 94228707797408] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.079+0000 7f7eedf21800 20 remove_watcher() i=5 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.079+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94228707800016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7def0 con 0x7f7edc068070 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.080+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 94228707800016] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.080+0000 7f7eedf21800 20 remove_watcher() i=6 2024-03-20T13:35:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.080+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94228707803824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55b354a7e9a0 con 0x7f7edc068070 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 94228707803824] v30'149 uv147 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7ee400a4a0 con 0x7f7edc068070 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 20 remove_watcher() i=7 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7edc068070 msgr2=0x7f7edc0963d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7edc068070 0x7f7edc0963d0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b354a6d480 msgr2=0x55b354a6f940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b354a6d480 0x55b354a6f940 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b354a719c0 msgr2=0x55b354a73db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b354a719c0 0x55b354a73db0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b354a762f0 msgr2=0x55b354a787b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b354a762f0 0x55b354a787b0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7db4036790 msgr2=0x7f7db4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7db4036790 0x7f7db4038c50 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x55b354a34230 tx=0x7f7ee0002000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 msgr2=0x55b354a61cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eea31c640 1 -- 172.21.15.177:0/2704081097 reap_dead start 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a61cc0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7edc07f5d0 tx=0x7f7edc096f50 comp rx=0 tx=0).stop 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 shutdown_connections 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2704081097 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a5ad10 0x55b354a61cc0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 >> 172.21.15.177:0/2704081097 conn(0x55b354a57070 msgr2=0x55b354a546d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 shutdown_connections 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/2704081097 wait complete. 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dc4036740 msgr2=0x7f7dc4038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dc4036740 0x7f7dc4038c00 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000b700 tx=0x7f7ee000e000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 msgr2=0x55b354a4e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 0x55b354a4e0a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f7edc04bb70 tx=0x7f7edc06bee0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 shutdown_connections 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dc4036740 0x7f7dc4038c00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 --2- 172.21.15.177:0/3300552759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b354a4dc80 0x55b354a4e0a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 >> 172.21.15.177:0/3300552759 conn(0x55b354a41d20 msgr2=0x55b354a42120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.082+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 shutdown_connections 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/3300552759 wait complete. 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b354a3cf50 msgr2=0x55b354a3f340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b354a3cf50 0x55b354a3f340 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b35493b100 msgr2=0x55b354a36d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b35493b100 0x55b354a36d30 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7ed4002260 msgr2=0x55b354a3b490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7f7ed4002260 0x55b354a3b490 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dd0036790 msgr2=0x7f7dd0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7dd0036790 0x7f7dd0038c50 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7ee000a430 tx=0x7f7ee0005540 comp rx=0 tx=0).stop 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 msgr2=0x55b354a2ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 --2- 172.21.15.177:0/2901618994 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b3549375f0 0x55b354a2ff10 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7edc061040 tx=0x7f7ed40040e0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eea31c640 1 -- 172.21.15.177:0/2901618994 reap_dead start 2024-03-20T13:35:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 shutdown_connections 2024-03-20T13:35:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 >> 172.21.15.177:0/2901618994 conn(0x55b354931040 msgr2=0x55b354a21b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 shutdown_connections 2024-03-20T13:35:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.083+0000 7f7eedf21800 1 -- 172.21.15.177:0/2901618994 wait complete. 2024-03-20T13:35:18.103 INFO:teuthology.orchestra.run.smithi177.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"7b38e3a9-8d74-4698-af71-c25b0690d394","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","marker":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1","index_type":"Normal","index_generation":0,"num_shards":11,"object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-03-20T13:35:17.526953Z","creation_time":"2024-03-20T13:35:12.979038Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"notifications":[]} 2024-03-20T13:35:18.103 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '7b38e3a9-8d74-4698-af71-c25b0690d394', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'marker': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-03-20T13:35:17.526953Z', 'creation_time': '2024-03-20T13:35:12.979038Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'notifications': []} 2024-03-20T13:35:18.103 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-03-20T13:35:18.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-03-20T13:35:18.104 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-03-20T13:35:18.186 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:18.186 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:18.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.183+0000 7fb71ce0f800 1 Processor -- start 2024-03-20T13:35:18.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.183+0000 7fb71ce0f800 1 -- start start 2024-03-20T13:35:18.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.183+0000 7fb71ce0f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556c1cc095e0 0x556c1cc0b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.183+0000 7fb71ce0f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556c1cb53cc0 con 0x556c1cc0bf10 2024-03-20T13:35:18.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.183+0000 7fb71ce0f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x556c1cb0a500 con 0x556c1cc095e0 2024-03-20T13:35:18.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.184+0000 7fb7184e4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556c1cc095e0 0x556c1cc0b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.184+0000 7fb7184e4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556c1cc095e0 0x556c1cc0b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41616/0 (socket says 172.21.15.177:41616) 2024-03-20T13:35:18.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.184+0000 7fb7184e4640 1 -- 172.21.15.177:0/1313528896 learned_addr learned my addr 172.21.15.177:0/1313528896 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.184+0000 7fb7184e4640 1 -- 172.21.15.177:0/1313528896 >> v1:172.21.15.28:6789/0 conn(0x556c1cc0bf10 legacy=0x556c1cc0e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.184+0000 7fb7184e4640 1 -- 172.21.15.177:0/1313528896 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1cc10a30 con 0x556c1cc095e0 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.186+0000 7fb7184e4640 1 --2- 172.21.15.177:0/1313528896 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cc0b9d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb70800a520 tx=0x7fb70801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f7a1ebf170b50fc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.187+0000 7fb7174e2640 1 -- 172.21.15.177:0/1313528896 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb708052570 con 0x556c1cc095e0 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.187+0000 7fb7174e2640 1 -- 172.21.15.177:0/1313528896 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080526d0 con 0x556c1cc095e0 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.187+0000 7fb7174e2640 1 -- 172.21.15.177:0/1313528896 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb708052990 con 0x556c1cc095e0 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.187+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1313528896 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 msgr2=0x556c1cc0b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.187+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1313528896 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cc0b9d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb70800a520 tx=0x7fb70801cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.188+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1313528896 shutdown_connections 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.188+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1313528896 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cc0b9d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.188+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1313528896 >> 172.21.15.177:0/1313528896 conn(0x556c1cc03030 msgr2=0x556c1cc05450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.188+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1313528896 shutdown_connections 2024-03-20T13:35:18.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.188+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1313528896 wait complete. 2024-03-20T13:35:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.199+0000 7fb71ce0f800 1 Processor -- start 2024-03-20T13:35:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.199+0000 7fb71ce0f800 1 -- start start 2024-03-20T13:35:18.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.199+0000 7fb71ce0f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1ccf8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.199+0000 7fb71ce0f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1cb07a30 con 0x556c1cc095e0 2024-03-20T13:35:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1ccf8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1ccf8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41624/0 (socket says 172.21.15.177:41624) 2024-03-20T13:35:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb7184e4640 1 -- 172.21.15.177:0/302654231 learned_addr learned my addr 172.21.15.177:0/302654231 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb7184e4640 1 -- 172.21.15.177:0/302654231 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb708005de0 con 0x556c1cc095e0 2024-03-20T13:35:18.202 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb7184e4640 1 --2- 172.21.15.177:0/302654231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1ccf8a40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb708055040 tx=0x7fb70804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51757616a762be9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb60660c640 1 -- 172.21.15.177:0/302654231 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb708052840 con 0x556c1cc095e0 2024-03-20T13:35:18.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb60660c640 1 -- 172.21.15.177:0/302654231 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7080529c0 con 0x556c1cc095e0 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.200+0000 7fb60660c640 1 -- 172.21.15.177:0/302654231 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb708052ca0 con 0x556c1cc095e0 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- 172.21.15.177:0/302654231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 msgr2=0x556c1ccf8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/302654231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1ccf8a40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb708055040 tx=0x7fb70804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- 172.21.15.177:0/302654231 shutdown_connections 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/302654231 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1ccf8a40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- 172.21.15.177:0/302654231 >> 172.21.15.177:0/302654231 conn(0x556c1cc03030 msgr2=0x556c1ccf4360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- 172.21.15.177:0/302654231 shutdown_connections 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- 172.21.15.177:0/302654231 wait complete. 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 Processor -- start 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- start start 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cd00090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.201+0000 7fb71ce0f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1cb03210 con 0x556c1cc095e0 2024-03-20T13:35:18.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.203+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cd00090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.203+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cd00090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41628/0 (socket says 172.21.15.177:41628) 2024-03-20T13:35:18.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.203+0000 7fb7184e4640 1 -- 172.21.15.177:0/4236640987 learned_addr learned my addr 172.21.15.177:0/4236640987 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.205+0000 7fb7184e4640 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1cc10a30 con 0x556c1cc095e0 2024-03-20T13:35:18.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.207+0000 7fb7184e4640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cd00090 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb70801ceb0 tx=0x7fb708002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.207+0000 7fb604e09640 1 -- 172.21.15.177:0/4236640987 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb70806c070 con 0x556c1cc095e0 2024-03-20T13:35:18.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.207+0000 7fb604e09640 1 -- 172.21.15.177:0/4236640987 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70805d690 con 0x556c1cc095e0 2024-03-20T13:35:18.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.208+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c1cd005d0 con 0x556c1cc095e0 2024-03-20T13:35:18.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.208+0000 7fb604e09640 1 -- 172.21.15.177:0/4236640987 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb70805d970 con 0x556c1cc095e0 2024-03-20T13:35:18.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.208+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c1cd00b10 con 0x556c1cc095e0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb604e09640 1 -- 172.21.15.177:0/4236640987 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb708059040 con 0x556c1cc095e0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb604e09640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb6000367e0 0x7fb600038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb604e09640 1 -- 172.21.15.177:0/4236640987 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb70808d860 con 0x556c1cc095e0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb717ce3640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb6000367e0 0x7fb600038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cc0bf10 0x556c1cd06eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd073f0 con 0x556c1cc0bf10 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.209+0000 7fb718ce5640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cc0bf10 0x556c1cd06eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb717ce3640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb6000367e0 0x7fb600038ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb70c001e10 tx=0x7fb70c001390 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb718ce5640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cc0bf10 0x556c1cd06eb0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb718ce5640 1 -- 172.21.15.177:0/4236640987 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cc0bf10 2024-03-20T13:35:18.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd04450 con 0x556c1cc0bf10 2024-03-20T13:35:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb718ce5640 1 -- 172.21.15.177:0/4236640987 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cc0bf10 2024-03-20T13:35:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd09630 0x556c1cd0ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd0c0c0 con 0x556c1cd09630 2024-03-20T13:35:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.210+0000 7fb7184e4640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd09630 0x556c1cd0ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb7184e4640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd09630 0x556c1cd0ba20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb7184e4640 1 -- 172.21.15.177:0/4236640987 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb70805dad0 con 0x556c1cd09630 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd085b0 con 0x556c1cc0bf10 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb718ce5640 1 -- 172.21.15.177:0/4236640987 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cc0bf10 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556c1cd0d4e0 0x556c1cd0f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd10030 con 0x556c1cd0d4e0 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.211+0000 7fb717ce3640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556c1cd0d4e0 0x556c1cd0f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.212+0000 7fb717ce3640 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556c1cd0d4e0 0x556c1cd0f8d0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.212+0000 7fb717ce3640 1 -- 172.21.15.177:0/4236640987 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb70c0106a0 con 0x556c1cd0d4e0 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb71ce0f800 1 Processor -- start 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb71ce0f800 1 -- start start 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb71ce0f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 0x556c1cd1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb71ce0f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1caa5c70 con 0x556c1cd1e1c0 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 0x556c1cd1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 0x556c1cd1e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41642/0 (socket says 172.21.15.177:41642) 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.213+0000 7fb7184e4640 1 -- 172.21.15.177:0/339193083 learned_addr learned my addr 172.21.15.177:0/339193083 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb7184e4640 1 -- 172.21.15.177:0/339193083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1cd1eb20 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb7184e4640 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 0x556c1cd1e5e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb70808bf10 tx=0x7fb70806f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb5fdffb640 1 -- 172.21.15.177:0/339193083 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb70808dac0 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb5fdffb640 1 -- 172.21.15.177:0/339193083 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70808dc20 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c1cd1f590 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb5fdffb640 1 -- 172.21.15.177:0/339193083 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb708079a50 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.214+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c1cd1fa50 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb5fdffb640 1 -- 172.21.15.177:0/339193083 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb708079bb0 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb5fdffb640 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5f0036790 0x7fb5f0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb5fdffb640 1 -- 172.21.15.177:0/339193083 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb708097c80 con 0x556c1cd1e1c0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb717ce3640 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5f0036790 0x7fb5f0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb71ce0f800 1 Processor -- start 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb71ce0f800 1 -- start start 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb717ce3640 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5f0036790 0x7fb5f0038c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556c1cd043b0 tx=0x7fb70c006000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb71ce0f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd2b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb71ce0f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1ca7b5d0 con 0x556c1cd2b2a0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd2b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd2b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41658/0 (socket says 172.21.15.177:41658) 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.215+0000 7fb7184e4640 1 -- 172.21.15.177:0/2074670540 learned_addr learned my addr 172.21.15.177:0/2074670540 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb7184e4640 1 -- 172.21.15.177:0/2074670540 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1cd2bc70 con 0x556c1cd2b2a0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb7184e4640 1 --2- 172.21.15.177:0/2074670540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd2b6a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb708052dd0 tx=0x7fb708079f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d850fd93f94584f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb5f77fe640 1 -- 172.21.15.177:0/2074670540 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7080a5070 con 0x556c1cd2b2a0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb5f77fe640 1 -- 172.21.15.177:0/2074670540 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70808b170 con 0x556c1cd2b2a0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb5f77fe640 1 -- 172.21.15.177:0/2074670540 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb708072240 con 0x556c1cd2b2a0 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb71ce0f800 1 -- 172.21.15.177:0/2074670540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 msgr2=0x556c1cd2b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/2074670540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd2b6a0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fb708052dd0 tx=0x7fb708079f20 comp rx=0 tx=0).stop 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb71ce0f800 1 -- 172.21.15.177:0/2074670540 shutdown_connections 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/2074670540 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd2b6a0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb71ce0f800 1 -- 172.21.15.177:0/2074670540 >> 172.21.15.177:0/2074670540 conn(0x556c1cd27570 msgr2=0x556c1cd255d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.216+0000 7fb71ce0f800 1 -- 172.21.15.177:0/2074670540 shutdown_connections 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb71ce0f800 1 -- 172.21.15.177:0/2074670540 wait complete. 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb71ce0f800 1 Processor -- start 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb71ce0f800 1 -- start start 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb71ce0f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd321e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb71ce0f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556c1cd32720 con 0x556c1cd2b2a0 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd321e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb7184e4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd321e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41662/0 (socket says 172.21.15.177:41662) 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 learned_addr learned my addr 172.21.15.177:0/1054766109 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.217+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556c1cd1f590 con 0x556c1cd2b2a0 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb7184e4640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd321e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb708052dd0 tx=0x7fb708072180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb5f5ffb640 1 -- 172.21.15.177:0/1054766109 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb7080a5040 con 0x556c1cd2b2a0 2024-03-20T13:35:18.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb5f5ffb640 1 -- 172.21.15.177:0/1054766109 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb708079730 con 0x556c1cd2b2a0 2024-03-20T13:35:18.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556c1cd1f590 con 0x556c1cd2b2a0 2024-03-20T13:35:18.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb5f5ffb640 1 -- 172.21.15.177:0/1054766109 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb70807bd20 con 0x556c1cd2b2a0 2024-03-20T13:35:18.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556c1cd1f590 con 0x556c1cd2b2a0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.218+0000 7fb5f5ffb640 1 -- 172.21.15.177:0/1054766109 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb70807b450 con 0x556c1cd2b2a0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb5f5ffb640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5e8036790 0x7fb5e8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb5f5ffb640 1 -- 172.21.15.177:0/1054766109 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fb7080b9c40 con 0x556c1cd2b2a0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb717ce3640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5e8036790 0x7fb5e8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cd3d8f0 0x556c1cd3fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd404e0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb718ce5640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cd3d8f0 0x556c1cd3fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb718ce5640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cd3d8f0 0x556c1cd3fd90 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.219+0000 7fb717ce3640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5e8036790 0x7fb5e8038c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x556c1cd103f0 tx=0x7fb70c011000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 realm 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd408b0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41460 con 0x556c1cd3d8f0 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd41e10 0x556c1cd44200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd44740 con 0x556c1cd41e10 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.220+0000 7fb7184e4640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd41e10 0x556c1cd44200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb7184e4640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd41e10 0x556c1cd44200 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb71ce0f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb71ce0f800 20 searching for the correct realm 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556c1cd46740 0x556c1cd48c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd492d0 con 0x556c1cd46740 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb717ce3640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556c1cd46740 0x556c1cd48c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.221+0000 7fb717ce3640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556c1cd46740 0x556c1cd48c00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.222+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.222+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd492d0 con 0x556c1cd41e10 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.222+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.222+0000 7fb7184e4640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb7080b8020 0x7fb70806c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.222+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd492d0 con 0x7fb7080b8020 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.222+0000 7fb718ce5640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb7080b8020 0x7fb70806c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb7080b8020 0x7fb70806c1d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.223+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd41e10 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.224+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd41e10 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.225+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.226+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.227+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd41e10 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.228+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.228+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.228+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.228+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.228+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.228+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb710031040 con 0x556c1cd41e10 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb710031040 con 0x556c1cd46740 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.229+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb710031040 con 0x7fb7080b8020 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb710031040 con 0x556c1cd3d8f0 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb710031040 con 0x556c1cd41e10 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.230+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd45040 con 0x556c1cd3d8f0 2024-03-20T13:35:18.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd45040 con 0x7fb7080b8020 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 zone default found 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 4 Realm: () 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 zonegroup default 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.231+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd458c0 con 0x7fb7080b8020 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd458c0 con 0x556c1cd46740 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4b0f0 con 0x556c1cd46740 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 started sync module instance, tier type = 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.232+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4a580 con 0x556c1cd41e10 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.233+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.233+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93922828527840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4ad00 con 0x556c1cd41e10 2024-03-20T13:35:18.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.233+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4bf00 con 0x556c1cd3d8f0 2024-03-20T13:35:18.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.234+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93922828527840] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.234+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.234+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93922828532320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4c320 con 0x556c1cd3d8f0 2024-03-20T13:35:18.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.235+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4cc90 con 0x556c1cd46740 2024-03-20T13:35:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.235+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93922828532320] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.236+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.236+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93922828533376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4c2a0 con 0x556c1cd46740 2024-03-20T13:35:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.236+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4daf0 con 0x556c1cd41e10 2024-03-20T13:35:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.237+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 93922828533376] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.237+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.237+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93922828537920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd41e10 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.237+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4ec60 con 0x556c1cd3d8f0 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.238+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.238+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93922828544416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4f3e0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.238+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4feb0 con 0x7fb7080b8020 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.238+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93922828537920] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.239+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93922828544416] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.239+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.239+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93922828548496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4fe70 con 0x7fb7080b8020 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.239+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4efb0 con 0x7fb7080b8020 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.240+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93922828548496] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.240+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.240+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93922828541520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd50700 con 0x7fb7080b8020 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.240+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd51070 con 0x7fb7080b8020 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93922828541520] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'150 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93922828550576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd51250 con 0x7fb7080b8020 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=0 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=1 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=2 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=3 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=4 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=5 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.241+0000 7fb71ce0f800 20 add_watcher() i=6 2024-03-20T13:35:18.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.242+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93922828550576] v30'151 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.242+0000 7fb71ce0f800 20 add_watcher() i=7 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.242+0000 7fb71ce0f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.242+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd54440 con 0x556c1cd3d8f0 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.243+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.243+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93922828553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd516d0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93922828553744] v30'146 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb5ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb71ce0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb71ce0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb71ce0f800 5 note: GC not initialized 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb5cd7e2640 20 reqs_thread_entry: start 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb71ce0f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:18.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb71ce0f800 20 Filter name: none 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb53effd640 20 reqs_thread_entry: start 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.244+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd85910 con 0x7fb7080b8020 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.245+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 [pgnls start_epoch 30 out=254b] v30'34 uv18 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.245+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.245+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(63 [pgnls start_epoch 30 out=131b] v30'5 uv4 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.245+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd46740 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.246+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.246+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x7fb7080b8020 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.246+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(65 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.246+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd3d8f0 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.247+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(66 [pgnls start_epoch 30 out=335b] v30'146 uv23 ondisk = 1) v8 ==== 144+0+335 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.247+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd41100 con 0x556c1cd41e10 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.247+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(67 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.247+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.248+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(68 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.248+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.248+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(69 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.248+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.248+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(70 [pgnls start_epoch 30 out=213b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.248+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd41e10 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(71 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd41e10 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(72 [pgnls start_epoch 30 out=336b] v30'27 uv19 ondisk = 1) v8 ==== 144+0+336 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(73 [pgnls start_epoch 30 out=131b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(74 [pgnls start_epoch 30 out=254b] v30'12 uv12 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.249+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(75 [pgnls start_epoch 30 out=90b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(76 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(77 [pgnls start_epoch 30 out=254b] v30'10 uv10 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(78 [pgnls start_epoch 30 out=254b] v30'14 uv14 ondisk = 1) v8 ==== 144+0+254 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.250+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(79 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(80 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(81 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd41e10 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(82 [pgnls start_epoch 30 out=276b] v30'15 uv15 ondisk = 1) v8 ==== 144+0+276 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.251+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd41e10 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.252+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(83 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.252+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd3d8f0 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.252+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(84 [pgnls start_epoch 30 out=295b] v30'25 uv17 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.252+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x7fb7080b8020 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.253+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(85 [pgnls start_epoch 30 out=172b] v30'28 uv12 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.253+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd41e10 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.253+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(86 [pgnls start_epoch 30 out=213b] v30'44 uv19 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.253+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x7fb7080b8020 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.253+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(87 [pgnls start_epoch 30 out=172b] v30'20 uv11 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.253+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd46740 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(88 [pgnls start_epoch 30 out=172b] v30'17 uv9 ondisk = 1) v8 ==== 144+0+172 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd46740 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(89 [pgnls start_epoch 30 out=90b] v30'13 uv5 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd46740 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(90 [pgnls start_epoch 30 out=90b] v30'37 uv13 ondisk = 1) v8 ==== 144+0+90 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd3d8f0 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(91 [pgnls start_epoch 30 out=131b] v30'6 uv6 ondisk = 1) v8 ==== 144+0+131 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.254+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x556c1cd41e10 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.255+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(92 [pgnls start_epoch 30 out=295b] v30'23 uv15 ondisk = 1) v8 ==== 144+0+295 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.255+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fb7080dc040 con 0x7fb7080b8020 2024-03-20T13:35:18.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.255+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(93 [pgnls start_epoch 30 out=213b] v30'19 uv11 ondisk = 1) v8 ==== 144+0+213 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.266 INFO:teuthology.orchestra.run.smithi177.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-03-20T13:35:18.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.257+0000 7fb5ce7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.257+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93922828553744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.258+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 93922828553744] v30'147 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.258+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93922828527840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e2f0 con 0x556c1cd41e10 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.259+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 93922828527840] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.259+0000 7fb71ce0f800 20 remove_watcher() i=0 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.259+0000 7fb71ce0f800 2 removed watcher, disabling cache 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.259+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93922828532320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4a8e0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.260+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 93922828532320] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.260+0000 7fb71ce0f800 20 remove_watcher() i=1 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.260+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93922828533376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4ba60 con 0x556c1cd46740 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.262+0000 7fb717ce3640 1 -- 172.21.15.177:0/1054766109 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 93922828533376] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb70c032040 con 0x556c1cd46740 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.262+0000 7fb71ce0f800 20 remove_watcher() i=2 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.262+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93922828537920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4a8e0 con 0x556c1cd41e10 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.263+0000 7fb7184e4640 1 -- 172.21.15.177:0/1054766109 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 93922828537920] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb7080b5070 con 0x556c1cd41e10 2024-03-20T13:35:18.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.263+0000 7fb71ce0f800 20 remove_watcher() i=3 2024-03-20T13:35:18.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.263+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93922828544416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4d040 con 0x556c1cd3d8f0 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.264+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 93922828544416] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x556c1cd3d8f0 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.264+0000 7fb71ce0f800 20 remove_watcher() i=4 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.264+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93922828548496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4a8e0 con 0x7fb7080b8020 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.266+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 93922828548496] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.267+0000 7fb71ce0f800 20 remove_watcher() i=5 2024-03-20T13:35:18.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.267+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93922828541520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4e9a0 con 0x7fb7080b8020 2024-03-20T13:35:18.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.270+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 93922828541520] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.270+0000 7fb71ce0f800 20 remove_watcher() i=6 2024-03-20T13:35:18.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.270+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93922828550576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x556c1cd4d040 con 0x7fb7080b8020 2024-03-20T13:35:18.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 93922828550576] v30'152 uv150 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb71000a4a0 con 0x7fb7080b8020 2024-03-20T13:35:18.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 20 remove_watcher() i=7 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb7080b8020 msgr2=0x7fb70806c1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb7080b8020 0x7fb70806c1d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cd3d8f0 msgr2=0x556c1cd3fd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cd3d8f0 0x556c1cd3fd90 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd41e10 msgr2=0x556c1cd44200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd41e10 0x556c1cd44200 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556c1cd46740 msgr2=0x556c1cd48c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556c1cd46740 0x556c1cd48c00 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5e8036790 msgr2=0x7fb5e8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5e8036790 0x7fb5e8038c50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x556c1cd103f0 tx=0x7fb70c011000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 msgr2=0x556c1cd321e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb718ce5640 1 -- 172.21.15.177:0/1054766109 reap_dead start 2024-03-20T13:35:18.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd321e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb708052dd0 tx=0x7fb708072180 comp rx=0 tx=0).stop 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 shutdown_connections 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/1054766109 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd2b2a0 0x556c1cd321e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 >> 172.21.15.177:0/1054766109 conn(0x556c1cd27570 msgr2=0x556c1cd24bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 shutdown_connections 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.273+0000 7fb71ce0f800 1 -- 172.21.15.177:0/1054766109 wait complete. 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5f0036790 msgr2=0x7fb5f0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5f0036790 0x7fb5f0038c50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x556c1cd043b0 tx=0x7fb70c006000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 msgr2=0x556c1cd1e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 0x556c1cd1e5e0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fb70808bf10 tx=0x7fb70806f9f0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 shutdown_connections 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb5f0036790 0x7fb5f0038c50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/339193083 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cd1e1c0 0x556c1cd1e5e0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 >> 172.21.15.177:0/339193083 conn(0x556c1cd12260 msgr2=0x556c1cd12660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 shutdown_connections 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/339193083 wait complete. 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556c1cd0d4e0 msgr2=0x556c1cd0f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556c1cd0d4e0 0x556c1cd0f8d0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cc0bf10 msgr2=0x556c1cd06eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556c1cc0bf10 0x556c1cd06eb0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd09630 msgr2=0x556c1cd0ba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556c1cd09630 0x556c1cd0ba20 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb6000367e0 msgr2=0x7fb600038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb6000367e0 0x7fb600038ca0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb70c001e10 tx=0x7fb70c001390 comp rx=0 tx=0).stop 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 msgr2=0x556c1cd00090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 --2- 172.21.15.177:0/4236640987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556c1cc095e0 0x556c1cd00090 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb70801ceb0 tx=0x7fb708002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb718ce5640 1 -- 172.21.15.177:0/4236640987 reap_dead start 2024-03-20T13:35:18.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 shutdown_connections 2024-03-20T13:35:18.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 >> 172.21.15.177:0/4236640987 conn(0x556c1cc03030 msgr2=0x556c1ccf2ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 shutdown_connections 2024-03-20T13:35:18.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.274+0000 7fb71ce0f800 1 -- 172.21.15.177:0/4236640987 wait complete. 2024-03-20T13:35:18.285 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-03-20T13:35:18.285 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-03-20T13:35:18.285 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-03-20T13:35:18.285 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-03-20T13:35:18.369 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:18.369 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.368+0000 7fc747016800 1 Processor -- start 2024-03-20T13:35:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.368+0000 7fc747016800 1 -- start start 2024-03-20T13:35:18.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc747016800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56363d730e70 0x56363d733260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc747016800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56363d678cd0 con 0x56363d72c9e0 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc747016800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56363d62f500 con 0x56363d730e70 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc739e9c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56363d730e70 0x56363d733260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc739e9c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56363d730e70 0x56363d733260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41666/0 (socket says 172.21.15.177:41666) 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc74269d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56363d72c9e0 0x56363d72ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50652/0 (socket says 172.21.15.177:50652) 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc739e9c640 1 -- 172.21.15.177:0/2929582318 learned_addr learned my addr 172.21.15.177:0/2929582318 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc739e9c640 1 -- 172.21.15.177:0/2929582318 >> v1:172.21.15.28:6789/0 conn(0x56363d72c9e0 legacy=0x56363d72ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.369+0000 7fc739e9c640 1 -- 172.21.15.177:0/2929582318 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56363d734890 con 0x56363d730e70 2024-03-20T13:35:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.371+0000 7fc739e9c640 1 --2- 172.21.15.177:0/2929582318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d730e70 0x56363d733260 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00a6b0 tx=0x7fc72c01eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b0d1a2a866d460 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.371+0000 7fc741e9c640 1 -- 172.21.15.177:0/2929582318 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc72c00a200 con 0x56363d730e70 2024-03-20T13:35:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.371+0000 7fc741e9c640 1 -- 172.21.15.177:0/2929582318 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00a360 con 0x56363d730e70 2024-03-20T13:35:18.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.371+0000 7fc741e9c640 1 -- 172.21.15.177:0/2929582318 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc72c0086e0 con 0x56363d730e70 2024-03-20T13:35:18.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 -- 172.21.15.177:0/2929582318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d730e70 msgr2=0x56363d733260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 --2- 172.21.15.177:0/2929582318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d730e70 0x56363d733260 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc72c00a6b0 tx=0x7fc72c01eda0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 -- 172.21.15.177:0/2929582318 shutdown_connections 2024-03-20T13:35:18.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 --2- 172.21.15.177:0/2929582318 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d730e70 0x56363d733260 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 -- 172.21.15.177:0/2929582318 >> 172.21.15.177:0/2929582318 conn(0x56363d728040 msgr2=0x56363d72a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 -- 172.21.15.177:0/2929582318 shutdown_connections 2024-03-20T13:35:18.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.372+0000 7fc747016800 1 -- 172.21.15.177:0/2929582318 wait complete. 2024-03-20T13:35:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.383+0000 7fc747016800 1 Processor -- start 2024-03-20T13:35:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.383+0000 7fc747016800 1 -- start start 2024-03-20T13:35:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc747016800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d81b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc747016800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56363d62ca30 con 0x56363d72c9e0 2024-03-20T13:35:18.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d81b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d81b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41676/0 (socket says 172.21.15.177:41676) 2024-03-20T13:35:18.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc74269d640 1 -- 172.21.15.177:0/2795087145 learned_addr learned my addr 172.21.15.177:0/2795087145 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc74269d640 1 -- 172.21.15.177:0/2795087145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c005de0 con 0x56363d72c9e0 2024-03-20T13:35:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.384+0000 7fc74269d640 1 --2- 172.21.15.177:0/2795087145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d81b780 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc734001d30 tx=0x7fc73400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c08d893c19c36e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc630608640 1 -- 172.21.15.177:0/2795087145 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc734014070 con 0x56363d72c9e0 2024-03-20T13:35:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc630608640 1 -- 172.21.15.177:0/2795087145 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73400f450 con 0x56363d72c9e0 2024-03-20T13:35:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc630608640 1 -- 172.21.15.177:0/2795087145 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73400f730 con 0x56363d72c9e0 2024-03-20T13:35:18.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 -- 172.21.15.177:0/2795087145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 msgr2=0x56363d81b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 --2- 172.21.15.177:0/2795087145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d81b780 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fc734001d30 tx=0x7fc73400b600 comp rx=0 tx=0).stop 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 -- 172.21.15.177:0/2795087145 shutdown_connections 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 --2- 172.21.15.177:0/2795087145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d81b780 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 -- 172.21.15.177:0/2795087145 >> 172.21.15.177:0/2795087145 conn(0x56363d728040 msgr2=0x56363d8170a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 -- 172.21.15.177:0/2795087145 shutdown_connections 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.385+0000 7fc747016800 1 -- 172.21.15.177:0/2795087145 wait complete. 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc747016800 1 Processor -- start 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc747016800 1 -- start start 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc747016800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d822e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc747016800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56363d628210 con 0x56363d72c9e0 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d822e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d822e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41688/0 (socket says 172.21.15.177:41688) 2024-03-20T13:35:18.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc74269d640 1 -- 172.21.15.177:0/3385311898 learned_addr learned my addr 172.21.15.177:0/3385311898 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc74269d640 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56363d678cd0 con 0x56363d72c9e0 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.386+0000 7fc74269d640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d822e90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x56363d81c510 tx=0x7fc734000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.387+0000 7fc62ee05640 1 -- 172.21.15.177:0/3385311898 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc734014050 con 0x56363d72c9e0 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.387+0000 7fc62ee05640 1 -- 172.21.15.177:0/3385311898 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73401b850 con 0x56363d72c9e0 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.387+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56363d8233d0 con 0x56363d72c9e0 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.387+0000 7fc62ee05640 1 -- 172.21.15.177:0/3385311898 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73401bb30 con 0x56363d72c9e0 2024-03-20T13:35:18.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.387+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56363d8238b0 con 0x56363d72c9e0 2024-03-20T13:35:18.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc62ee05640 1 -- 172.21.15.177:0/3385311898 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc734022020 con 0x56363d72c9e0 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc62ee05640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc628036790 0x7fc628038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc62ee05640 1 -- 172.21.15.177:0/3385311898 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc734008030 con 0x56363d72c9e0 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc739e9c640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc628036790 0x7fc628038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d730e70 0x56363d829b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d82a160 con 0x56363d730e70 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc742e9e640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d730e70 0x56363d829b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc739e9c640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc628036790 0x7fc628038c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc72c056000 tx=0x7fc72c00a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.388+0000 7fc742e9e640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d730e70 0x56363d829b40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc742e9e640 1 -- 172.21.15.177:0/3385311898 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d730e70 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d827290 con 0x56363d730e70 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc742e9e640 1 -- 172.21.15.177:0/3385311898 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d730e70 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d82c3d0 0x56363d82e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d82ee90 con 0x56363d82c3d0 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc74269d640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d82c3d0 0x56363d82e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.389+0000 7fc74269d640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d82c3d0 0x56363d82e7c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.390+0000 7fc74269d640 1 -- 172.21.15.177:0/3385311898 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fc734016070 con 0x56363d82c3d0 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.390+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d82b350 con 0x56363d730e70 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.390+0000 7fc742e9e640 1 -- 172.21.15.177:0/3385311898 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d730e70 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.390+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56363d8302b0 0x56363d8326a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.390+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d832e00 con 0x56363d8302b0 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.391+0000 7fc739e9c640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56363d8302b0 0x56363d8326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.391+0000 7fc739e9c640 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56363d8302b0 0x56363d8326a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.392+0000 7fc739e9c640 1 -- 172.21.15.177:0/3385311898 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fc72c008810 con 0x56363d8302b0 2024-03-20T13:35:18.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.392+0000 7fc747016800 1 Processor -- start 2024-03-20T13:35:18.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.392+0000 7fc747016800 1 -- start start 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.392+0000 7fc747016800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 0x56363d8457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.392+0000 7fc747016800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56363d5cac70 con 0x56363d8453a0 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.393+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 0x56363d8457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.393+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 0x56363d8457c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41692/0 (socket says 172.21.15.177:41692) 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.393+0000 7fc74269d640 1 -- 172.21.15.177:0/2426081443 learned_addr learned my addr 172.21.15.177:0/2426081443 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.394+0000 7fc74269d640 1 -- 172.21.15.177:0/2426081443 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56363d845d00 con 0x56363d8453a0 2024-03-20T13:35:18.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.394+0000 7fc74269d640 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 0x56363d8457c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc73404a410 tx=0x7fc73403eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.395+0000 7fc627fff640 1 -- 172.21.15.177:0/2426081443 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73402d790 con 0x56363d8453a0 2024-03-20T13:35:18.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.395+0000 7fc627fff640 1 -- 172.21.15.177:0/2426081443 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73402d8f0 con 0x56363d8453a0 2024-03-20T13:35:18.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.395+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56363d846770 con 0x56363d8453a0 2024-03-20T13:35:18.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.395+0000 7fc627fff640 1 -- 172.21.15.177:0/2426081443 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73402dbb0 con 0x56363d8453a0 2024-03-20T13:35:18.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.395+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56363d846c30 con 0x56363d8453a0 2024-03-20T13:35:18.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc627fff640 1 -- 172.21.15.177:0/2426081443 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc73404f020 con 0x56363d8453a0 2024-03-20T13:35:18.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc627fff640 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc61c036830 0x7fc61c038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc627fff640 1 -- 172.21.15.177:0/2426081443 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc734039cb0 con 0x56363d8453a0 2024-03-20T13:35:18.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc739e9c640 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc61c036830 0x7fc61c038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc747016800 1 Processor -- start 2024-03-20T13:35:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc747016800 1 -- start start 2024-03-20T13:35:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.398+0000 7fc739e9c640 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc61c036830 0x7fc61c038cf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x56363d8271e0 tx=0x7fc72c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.399+0000 7fc747016800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d852a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.399+0000 7fc747016800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56363d5a05d0 con 0x56363d852630 2024-03-20T13:35:18.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.399+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d852a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.399+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d852a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41700/0 (socket says 172.21.15.177:41700) 2024-03-20T13:35:18.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.399+0000 7fc74269d640 1 -- 172.21.15.177:0/2405544375 learned_addr learned my addr 172.21.15.177:0/2405544375 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.400+0000 7fc74269d640 1 -- 172.21.15.177:0/2405544375 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56363d853020 con 0x56363d852630 2024-03-20T13:35:18.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.402+0000 7fc74269d640 1 --2- 172.21.15.177:0/2405544375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d852a50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc734000fd0 tx=0x7fc73400d4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92e228e8308aa03 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.402+0000 7fc625ffb640 1 -- 172.21.15.177:0/2405544375 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc734017750 con 0x56363d852630 2024-03-20T13:35:18.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.402+0000 7fc625ffb640 1 -- 172.21.15.177:0/2405544375 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73402fd70 con 0x56363d852630 2024-03-20T13:35:18.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.402+0000 7fc625ffb640 1 -- 172.21.15.177:0/2405544375 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73402de40 con 0x56363d852630 2024-03-20T13:35:18.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- 172.21.15.177:0/2405544375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 msgr2=0x56363d852a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 --2- 172.21.15.177:0/2405544375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d852a50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fc734000fd0 tx=0x7fc73400d4f0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- 172.21.15.177:0/2405544375 shutdown_connections 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 --2- 172.21.15.177:0/2405544375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d852a50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- 172.21.15.177:0/2405544375 >> 172.21.15.177:0/2405544375 conn(0x56363d84e940 msgr2=0x56363d84c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- 172.21.15.177:0/2405544375 shutdown_connections 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- 172.21.15.177:0/2405544375 wait complete. 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 Processor -- start 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- start start 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d859600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.403+0000 7fc747016800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56363d859b40 con 0x56363d852630 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.404+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d859600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.404+0000 7fc74269d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d859600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41716/0 (socket says 172.21.15.177:41716) 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.404+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 learned_addr learned my addr 172.21.15.177:0/321316532 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.404+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56363d846c30 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.404+0000 7fc74269d640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d859600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc73401dba0 tx=0x7fc73402a2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.404+0000 7fc613fff640 1 -- 172.21.15.177:0/321316532 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73403e770 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.405+0000 7fc613fff640 1 -- 172.21.15.177:0/321316532 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc73403e8f0 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.405+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56363d846c30 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.405+0000 7fc613fff640 1 -- 172.21.15.177:0/321316532 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc73403e3c0 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.405+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56363d846c30 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.405+0000 7fc613fff640 1 -- 172.21.15.177:0/321316532 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc73402f480 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.405+0000 7fc613fff640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc60c036740 0x7fc60c038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc613fff640 1 -- 172.21.15.177:0/321316532 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7fc734073c80 con 0x56363d852630 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc739e9c640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc60c036740 0x7fc60c038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc739e9c640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc60c036740 0x7fc60c038c00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc72c008fd0 tx=0x7fc72c052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d864dc0 0x56363d867280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8679d0 con 0x56363d864dc0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc742e9e640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d864dc0 0x56363d867280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.406+0000 7fc742e9e640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d864dc0 0x56363d867280 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 realm 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d867da0 con 0x56363d864dc0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868980 con 0x56363d864dc0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d869330 0x56363d86b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.407+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d86bd30 con 0x56363d869330 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc74269d640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d869330 0x56363d86b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc74269d640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d869330 0x56363d86b720 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc747016800 20 searching for the correct realm 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56363d86dfe0 0x56363d8704a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d870b20 con 0x56363d86dfe0 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc739e9c640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56363d86dfe0 0x56363d8704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.408+0000 7fc739e9c640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56363d86dfe0 0x56363d8704a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.409+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.409+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d870b20 con 0x56363d869330 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.409+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.409+0000 7fc74269d640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc734072060 0x7fc734058a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.409+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d870b20 con 0x7fc734072060 2024-03-20T13:35:18.417 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.410+0000 7fc742e9e640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc734072060 0x7fc734058a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.412+0000 7fc742e9e640 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc734072060 0x7fc734058a10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.414+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.414+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.414+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.414+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.414+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.414+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.415+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.415+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.416+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.416+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d869330 2024-03-20T13:35:18.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.417+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.417+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.417+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.417+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.417+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.417+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.418+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.418+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d869330 2024-03-20T13:35:18.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.419+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.421+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.421+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.421+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.421+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.421+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.421+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.422+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.422+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.422+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.422+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.422+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.422+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.423+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.423+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d869330 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.423+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.423+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.423+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.423+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.424+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.424+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d86dfe0 2024-03-20T13:35:18.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.424+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.424+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x7fc734072060 2024-03-20T13:35:18.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.425+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.425+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc73c031040 con 0x56363d869330 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.425+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.425+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc73c031040 con 0x56363d86dfe0 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.425+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.425+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc73c031040 con 0x7fc734072060 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.426+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.426+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc73c031040 con 0x56363d864dc0 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc73c031040 con 0x56363d869330 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:18.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d868620 con 0x56363d864dc0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d86c420 con 0x56363d864dc0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.427+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d86c420 con 0x7fc734072060 2024-03-20T13:35:18.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 zone default found 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 4 Realm: () 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 zonegroup default 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d86cd30 con 0x7fc734072060 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d86cd30 con 0x56363d86dfe0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.428+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d872940 con 0x56363d86dfe0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.429+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.429+0000 7fc747016800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.429+0000 7fc747016800 20 started sync module instance, tier type = 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.429+0000 7fc747016800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.429+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d871dd0 con 0x56363d869330 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.430+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.430+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94790960488752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d872550 con 0x56363d869330 2024-03-20T13:35:18.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.430+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873620 con 0x56363d864dc0 2024-03-20T13:35:18.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.431+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94790960488752] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.432+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.432+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94790960491680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873a00 con 0x56363d864dc0 2024-03-20T13:35:18.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.432+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d874420 con 0x56363d86dfe0 2024-03-20T13:35:18.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.433+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94790960491680] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.433+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.433+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94790960496384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d874800 con 0x56363d86dfe0 2024-03-20T13:35:18.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.433+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d875250 con 0x56363d869330 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.434+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.434+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94790960500016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d875aa0 con 0x56363d869330 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.434+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d876530 con 0x56363d864dc0 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.434+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94790960496384] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.435+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.435+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94790960492736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8764f0 con 0x56363d864dc0 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.435+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d876fe0 con 0x7fc734072060 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.435+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94790960500016] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.436+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94790960492736] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.437+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.437+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94790960502272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d876050 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.437+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d877830 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.438+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94790960502272] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.438+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.438+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94790960507600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d876050 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.438+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d877e80 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94790960507600] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'153 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94790960509760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d877e40 con 0x7fc734072060 2024-03-20T13:35:18.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=0 2024-03-20T13:35:18.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=1 2024-03-20T13:35:18.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=2 2024-03-20T13:35:18.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=3 2024-03-20T13:35:18.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=4 2024-03-20T13:35:18.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=5 2024-03-20T13:35:18.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.439+0000 7fc747016800 20 add_watcher() i=6 2024-03-20T13:35:18.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.440+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94790960509760] v30'154 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.450 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.440+0000 7fc747016800 20 add_watcher() i=7 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.440+0000 7fc747016800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.440+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d87b290 con 0x56363d864dc0 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.441+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.441+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94790960511856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d878770 con 0x56363d864dc0 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94790960511856] v30'148 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc5f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 5 note: GC not initialized 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc5737fe640 20 reqs_thread_entry: start 2024-03-20T13:35:18.451 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 20 Filter name: none 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc5717fa640 20 reqs_thread_entry: start 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.442+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8ad210 con 0x56363d864dc0 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv11 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:18.452 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8af730 con 0x56363d869330 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 20 disabling bucket name=myfoo 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8adbb0 con 0x56363d869330 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-03-20T13:35:18.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.443+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8b0190 con 0x56363d864dc0 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv7 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:18.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.444+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8b77c0 con 0x56363d864dc0 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'8 uv8 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc747016800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc747016800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc747016800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc747016800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94790960744000 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8b1b80 con 0x56363d869330 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== watch-notify(notify (1) cookie 94790960500016 notify 128849018899 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x56363d853020 con 0x56363d869330 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc625ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018899 cookie 94790960500016 notifier 4578 bl.length()=725 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc625ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc625ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:18.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc625ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(67 notify.3 [notify cookie 94790960744000 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc625ffb640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc608003e90 con 0x56363d869330 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.445+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.446+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== watch-notify(notify_complete (2) cookie 94790960744000 notify 128849018899 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x56363d846770 con 0x56363d869330 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.446+0000 7fc747016800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_sources= new_sources= 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.446+0000 7fc747016800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential sources added=[] removed=[] 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.446+0000 7fc747016800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_dests= new_dests= 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.446+0000 7fc747016800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential dests added=[] removed=[] 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.446+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8b3af0 con 0x56363d864dc0 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v30'12 uv12 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc747016800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc747016800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:18.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc747016800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94790960724128 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8b5540 con 0x56363d864dc0 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== watch-notify(notify (1) cookie 94790960492736 notify 128849018894 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7fc73c03d040 con 0x56363d864dc0 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc625ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018894 cookie 94790960492736 notifier 4578 bl.length()=533 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc625ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc625ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc625ffb640 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7fc6080041f0 con 0x56363d864dc0 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(70 notify.4 [notify cookie 94790960724128 out=8b] v0'0 uv153 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== watch-notify(notify_complete (2) cookie 94790960724128 notify 128849018894 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fc73c005040 con 0x56363d864dc0 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.447+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.457 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:18.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.448+0000 7fc5f8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.448+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94790960511856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d8b6380 con 0x56363d864dc0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.449+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94790960511856] v30'149 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.449+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94790960488752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d860410 con 0x56363d869330 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.450+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94790960488752] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.450+0000 7fc747016800 20 remove_watcher() i=0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.450+0000 7fc747016800 2 removed watcher, disabling cache 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.450+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94790960491680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d872550 con 0x56363d864dc0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.451+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94790960491680] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.451+0000 7fc747016800 20 remove_watcher() i=1 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.451+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94790960496384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d872ca0 con 0x56363d86dfe0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.453+0000 7fc739e9c640 1 -- 172.21.15.177:0/321316532 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94790960496384] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc72c008810 con 0x56363d86dfe0 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.453+0000 7fc747016800 20 remove_watcher() i=2 2024-03-20T13:35:18.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.453+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94790960500016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873f00 con 0x56363d869330 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.454+0000 7fc74269d640 1 -- 172.21.15.177:0/321316532 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94790960500016] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc734016070 con 0x56363d869330 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.454+0000 7fc747016800 20 remove_watcher() i=3 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.454+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94790960492736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873f00 con 0x56363d864dc0 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.455+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94790960492736] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x56363d864dc0 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.455+0000 7fc747016800 20 remove_watcher() i=4 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.455+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94790960502272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873f00 con 0x7fc734072060 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.456+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94790960502272] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.456+0000 7fc747016800 20 remove_watcher() i=5 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.456+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94790960507600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873f00 con 0x7fc734072060 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.457+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94790960507600] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.457+0000 7fc747016800 20 remove_watcher() i=6 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.457+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94790960509760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x56363d873f00 con 0x7fc734072060 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94790960509760] v30'155 uv153 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fc73c00a4a0 con 0x7fc734072060 2024-03-20T13:35:18.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 20 remove_watcher() i=7 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc734072060 msgr2=0x7fc734058a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fc734072060 0x7fc734058a10 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d864dc0 msgr2=0x56363d867280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d864dc0 0x56363d867280 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d869330 msgr2=0x56363d86b720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d869330 0x56363d86b720 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56363d86dfe0 msgr2=0x56363d8704a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56363d86dfe0 0x56363d8704a0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc60c036740 msgr2=0x7fc60c038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc60c036740 0x7fc60c038c00 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc72c008fd0 tx=0x7fc72c052000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 msgr2=0x56363d859600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc742e9e640 1 -- 172.21.15.177:0/321316532 reap_dead start 2024-03-20T13:35:18.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d859600 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fc73401dba0 tx=0x7fc73402a2f0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 shutdown_connections 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/321316532 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d852630 0x56363d859600 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 >> 172.21.15.177:0/321316532 conn(0x56363d84e940 msgr2=0x56363d84c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 shutdown_connections 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/321316532 wait complete. 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc61c036830 msgr2=0x7fc61c038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc61c036830 0x7fc61c038cf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x56363d8271e0 tx=0x7fc72c005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 msgr2=0x56363d8457c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 0x56363d8457c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc73404a410 tx=0x7fc73403eec0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 shutdown_connections 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc61c036830 0x7fc61c038cf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 --2- 172.21.15.177:0/2426081443 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d8453a0 0x56363d8457c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.467 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 >> 172.21.15.177:0/2426081443 conn(0x56363d835030 msgr2=0x56363d835430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 shutdown_connections 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.459+0000 7fc747016800 1 -- 172.21.15.177:0/2426081443 wait complete. 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56363d8302b0 msgr2=0x56363d8326a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56363d8302b0 0x56363d8326a0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d730e70 msgr2=0x56363d829b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56363d730e70 0x56363d829b40 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d82c3d0 msgr2=0x56363d82e7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56363d82c3d0 0x56363d82e7c0 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc628036790 msgr2=0x7fc628038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc628036790 0x7fc628038c50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc72c056000 tx=0x7fc72c00a000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 msgr2=0x56363d822e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 --2- 172.21.15.177:0/3385311898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56363d72c9e0 0x56363d822e90 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x56363d81c510 tx=0x7fc734000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc742e9e640 1 -- 172.21.15.177:0/3385311898 reap_dead start 2024-03-20T13:35:18.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 shutdown_connections 2024-03-20T13:35:18.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 >> 172.21.15.177:0/3385311898 conn(0x56363d728040 msgr2=0x56363d8158e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 shutdown_connections 2024-03-20T13:35:18.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.460+0000 7fc747016800 1 -- 172.21.15.177:0/3385311898 wait complete. 2024-03-20T13:35:18.470 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:18.474 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-03-20T13:35:18.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-03-20T13:35:18.474 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-03-20T13:35:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:18.556 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:18.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a67fa2800 1 Processor -- start 2024-03-20T13:35:18.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a67fa2800 1 -- start start 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a67fa2800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f0c30b7e70 0x55f0c30ba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a67fa2800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55f0c2fffcd0 con 0x55f0c30b39e0 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a67fa2800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55f0c2fb6500 con 0x55f0c30b7e70 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a652a0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f0c30b7e70 0x55f0c30ba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a65aa1640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55f0c30b39e0 0x55f0c30b3e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:50656/0 (socket says 172.21.15.177:50656) 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a652a0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55f0c30b7e70 0x55f0c30ba260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41720/0 (socket says 172.21.15.177:41720) 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.555+0000 7f3a65aa1640 1 -- 172.21.15.177:0/713453760 learned_addr learned my addr 172.21.15.177:0/713453760 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.556+0000 7f3a652a0640 1 -- 172.21.15.177:0/713453760 >> v1:172.21.15.28:6789/0 conn(0x55f0c30b39e0 legacy=0x55f0c30b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.556+0000 7f3a652a0640 1 -- 172.21.15.177:0/713453760 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c30bb890 con 0x55f0c30b7e70 2024-03-20T13:35:18.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.556+0000 7f3a64a9f640 1 -- 172.21.15.177:0/713453760 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 613293357 0 0) 0x55f0c2fffcd0 con 0x55f0c30b39e0 2024-03-20T13:35:18.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.557+0000 7f3a652a0640 1 --2- 172.21.15.177:0/713453760 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b7e70 0x55f0c30ba260 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00a470 tx=0x7f3a5c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d17c46f0a63cfa63 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.559 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.557+0000 7f3a64a9f640 1 -- 172.21.15.177:0/713453760 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c052570 con 0x55f0c30b7e70 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a64a9f640 1 -- 172.21.15.177:0/713453760 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5c0526d0 con 0x55f0c30b7e70 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a64a9f640 1 -- 172.21.15.177:0/713453760 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5c052990 con 0x55f0c30b7e70 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 -- 172.21.15.177:0/713453760 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b7e70 msgr2=0x55f0c30ba260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/713453760 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b7e70 0x55f0c30ba260 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c00a470 tx=0x7f3a5c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 -- 172.21.15.177:0/713453760 shutdown_connections 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/713453760 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b7e70 0x55f0c30ba260 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 -- 172.21.15.177:0/713453760 >> 172.21.15.177:0/713453760 conn(0x55f0c30af040 msgr2=0x55f0c30b1460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 -- 172.21.15.177:0/713453760 shutdown_connections 2024-03-20T13:35:18.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.558+0000 7f3a67fa2800 1 -- 172.21.15.177:0/713453760 wait complete. 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a67fa2800 1 Processor -- start 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a67fa2800 1 -- start start 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a67fa2800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c3027cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a67fa2800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c2fb3a30 con 0x55f0c30b39e0 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c3027cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c3027cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41722/0 (socket says 172.21.15.177:41722) 2024-03-20T13:35:18.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.570+0000 7f3a65aa1640 1 -- 172.21.15.177:0/4169596492 learned_addr learned my addr 172.21.15.177:0/4169596492 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.571+0000 7f3a65aa1640 1 -- 172.21.15.177:0/4169596492 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c005d20 con 0x55f0c30b39e0 2024-03-20T13:35:18.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.571+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/4169596492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c3027cb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800b240 tx=0x7f3a5800b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2110c833a54cde9a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.571+0000 7f3953e07640 1 -- 172.21.15.177:0/4169596492 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a58014070 con 0x55f0c30b39e0 2024-03-20T13:35:18.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.571+0000 7f3953e07640 1 -- 172.21.15.177:0/4169596492 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800d500 con 0x55f0c30b39e0 2024-03-20T13:35:18.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.571+0000 7f3953e07640 1 -- 172.21.15.177:0/4169596492 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5800d820 con 0x55f0c30b39e0 2024-03-20T13:35:18.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- 172.21.15.177:0/4169596492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 msgr2=0x55f0c3027cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/4169596492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c3027cb0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800b240 tx=0x7f3a5800b700 comp rx=0 tx=0).stop 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- 172.21.15.177:0/4169596492 shutdown_connections 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/4169596492 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c3027cb0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- 172.21.15.177:0/4169596492 >> 172.21.15.177:0/4169596492 conn(0x55f0c30af040 msgr2=0x55f0c319f110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- 172.21.15.177:0/4169596492 shutdown_connections 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- 172.21.15.177:0/4169596492 wait complete. 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 Processor -- start 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- start start 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c31b25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.572+0000 7f3a67fa2800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c2faf210 con 0x55f0c30b39e0 2024-03-20T13:35:18.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.574+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c31b25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.574+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c31b25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41728/0 (socket says 172.21.15.177:41728) 2024-03-20T13:35:18.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.574+0000 7f3a65aa1640 1 -- 172.21.15.177:0/3588993061 learned_addr learned my addr 172.21.15.177:0/3588993061 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.576+0000 7f3a65aa1640 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58001ba0 con 0x55f0c30b39e0 2024-03-20T13:35:18.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.579+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c31b25d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000f60 tx=0x7f3a58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.580+0000 7f3952604640 1 -- 172.21.15.177:0/3588993061 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a58019870 con 0x55f0c30b39e0 2024-03-20T13:35:18.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.580+0000 7f3952604640 1 -- 172.21.15.177:0/3588993061 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58020070 con 0x55f0c30b39e0 2024-03-20T13:35:18.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.580+0000 7f3952604640 1 -- 172.21.15.177:0/3588993061 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a58019b20 con 0x55f0c30b39e0 2024-03-20T13:35:18.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.580+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0c31b2b10 con 0x55f0c30b39e0 2024-03-20T13:35:18.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.580+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0c31b2ff0 con 0x55f0c30b39e0 2024-03-20T13:35:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.583+0000 7f3952604640 1 -- 172.21.15.177:0/3588993061 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3a5800d040 con 0x55f0c30b39e0 2024-03-20T13:35:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3952604640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f394c036880 0x7f394c038d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3952604640 1 -- 172.21.15.177:0/3588993061 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3a5800a040 con 0x55f0c30b39e0 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a652a0640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f394c036880 0x7f394c038d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c30b7e70 0x55f0c31b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31b9830 con 0x55f0c30b7e70 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a662a2640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c30b7e70 0x55f0c31b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a652a0640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f394c036880 0x7f394c038d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c054000 tx=0x7f3a5c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a662a2640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c30b7e70 0x55f0c31b9280 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a662a2640 1 -- 172.21.15.177:0/3588993061 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c30b7e70 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.584+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31b6990 con 0x55f0c30b7e70 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a662a2640 1 -- 172.21.15.177:0/3588993061 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c30b7e70 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31bba70 0x55f0c31bde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31be500 con 0x55f0c31bba70 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31bba70 0x55f0c31bde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31bba70 0x55f0c31bde60 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a65aa1640 1 -- 172.21.15.177:0/3588993061 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f3a58016070 con 0x55f0c31bba70 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.585+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31ba9c0 con 0x55f0c30b7e70 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.586+0000 7f3a662a2640 1 -- 172.21.15.177:0/3588993061 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c30b7e70 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.586+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31bf920 0x55f0c31c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.586+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31c2450 con 0x55f0c31bf920 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.586+0000 7f3a652a0640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31bf920 0x55f0c31c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.586+0000 7f3a652a0640 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31bf920 0x55f0c31c1d10 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a652a0640 1 -- 172.21.15.177:0/3588993061 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31bf920 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a67fa2800 1 Processor -- start 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a67fa2800 1 -- start start 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a67fa2800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 0x55f0c31d09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a67fa2800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c2f51c70 con 0x55f0c31d05c0 2024-03-20T13:35:18.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 0x55f0c31d09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 0x55f0c31d09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41738/0 (socket says 172.21.15.177:41738) 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1506315685 learned_addr learned my addr 172.21.15.177:0/1506315685 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.587+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1506315685 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c31d0f20 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.588+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 0x55f0c31d09e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3a5804ab00 tx=0x7f3a5801ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.588+0000 7f394b7fe640 1 -- 172.21.15.177:0/1506315685 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a58036070 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.588+0000 7f394b7fe640 1 -- 172.21.15.177:0/1506315685 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800f7d0 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.588+0000 7f394b7fe640 1 -- 172.21.15.177:0/1506315685 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a58019db0 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.588+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0c31d1990 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.588+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0c31d1e50 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f394b7fe640 1 -- 172.21.15.177:0/1506315685 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3a58039070 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f394b7fe640 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f39400367e0 0x7f3940038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f394b7fe640 1 -- 172.21.15.177:0/1506315685 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3a58027c70 con 0x55f0c31d05c0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f3a652a0640 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f39400367e0 0x7f3940038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f3a67fa2800 1 Processor -- start 2024-03-20T13:35:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f3a67fa2800 1 -- start start 2024-03-20T13:35:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f3a652a0640 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f39400367e0 0x7f3940038ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f0c31b68f0 tx=0x7f3a5c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f3a67fa2800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 0x55f0c31ddb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.589+0000 7f3a67fa2800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c2f275d0 con 0x55f0c31dd750 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.591+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 0x55f0c31ddb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.591+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 0x55f0c31ddb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41744/0 (socket says 172.21.15.177:41744) 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.591+0000 7f3a65aa1640 1 -- 172.21.15.177:0/2009623705 learned_addr learned my addr 172.21.15.177:0/2009623705 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.592+0000 7f3a65aa1640 1 -- 172.21.15.177:0/2009623705 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0c31de140 con 0x55f0c31dd750 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.593+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/2009623705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 0x55f0c31ddb70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800f960 tx=0x7f3a5804c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e1c9cf1b8ca161 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.594+0000 7f39497fa640 1 -- 172.21.15.177:0/2009623705 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5805c070 con 0x55f0c31dd750 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.594+0000 7f39497fa640 1 -- 172.21.15.177:0/2009623705 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a5800c970 con 0x55f0c31dd750 2024-03-20T13:35:18.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.594+0000 7f39497fa640 1 -- 172.21.15.177:0/2009623705 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a58049710 con 0x55f0c31dd750 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- 172.21.15.177:0/2009623705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 msgr2=0x55f0c31ddb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/2009623705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 0x55f0c31ddb70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800f960 tx=0x7f3a5804c630 comp rx=0 tx=0).stop 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- 172.21.15.177:0/2009623705 shutdown_connections 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/2009623705 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31dd750 0x55f0c31ddb70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- 172.21.15.177:0/2009623705 >> 172.21.15.177:0/2009623705 conn(0x55f0c31d9a20 msgr2=0x55f0c31d7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- 172.21.15.177:0/2009623705 shutdown_connections 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- 172.21.15.177:0/2009623705 wait complete. 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 Processor -- start 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- start start 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 0x55f0c31e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.595+0000 7f3a67fa2800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0c31e51d0 con 0x55f0c31e4870 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 0x55f0c31e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a65aa1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 0x55f0c31e4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:41752/0 (socket says 172.21.15.177:41752) 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 learned_addr learned my addr 172.21.15.177:0/1183796463 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58050020 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 0x55f0c31e4c90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800efb0 tx=0x7f3a58020ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f39377fe640 1 -- 172.21.15.177:0/1183796463 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a5805c040 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f39377fe640 1 -- 172.21.15.177:0/1183796463 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a58044ec0 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f0c31e53d0 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f39377fe640 1 -- 172.21.15.177:0/1183796463 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3a580183d0 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.596+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f0c31e53d0 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.597+0000 7f39377fe640 1 -- 172.21.15.177:0/1183796463 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3a5800e950 con 0x55f0c31e4870 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.597+0000 7f39377fe640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3930036790 0x7f3930038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.597+0000 7f39377fe640 1 -- 172.21.15.177:0/1183796463 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6110+0+0 (secure 0 0 0) 0x7f3a580509a0 con 0x55f0c31e4870 2024-03-20T13:35:18.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.597+0000 7f3a652a0640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3930036790 0x7f3930038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a652a0640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3930036790 0x7f3930038c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c055040 tx=0x7f3a5c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c31f0750 0x55f0c31f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3360 con 0x55f0c31f0750 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a662a2640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c31f0750 0x55f0c31f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a662a2640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c31f0750 0x55f0c31f2c10 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.598+0000 7f3a67fa2800 20 realm 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3730 con 0x55f0c31f0750 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.616 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f4310 con 0x55f0c31f0750 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31f4cc0 0x55f0c31f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f7700 con 0x55f0c31f4cc0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31f4cc0 0x55f0c31f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.599+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31f4cc0 0x55f0c31f70b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a67fa2800 20 searching for the correct realm 2024-03-20T13:35:18.617 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f0c31f9990 0x55f0c31fbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fc520 con 0x55f0c31f9990 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a652a0640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f0c31f9990 0x55f0c31fbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.600+0000 7f3a652a0640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f0c31f9990 0x55f0c31fbe50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fc520 con 0x55f0c31f4cc0 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a65aa1640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31dd750 0x7f3a58050380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fc520 con 0x55f0c31dd750 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a662a2640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31dd750 0x7f3a58050380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.601+0000 7f3a662a2640 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31dd750 0x7f3a58050380 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.618 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.602+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.603+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.619 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 30 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.604+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.605+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.605+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.605+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.605+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.605+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.605+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 30 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.606+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 30 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 30 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f9990 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(31 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.607+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31dd750 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3a60031040 con 0x55f0c31f4cc0 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(33 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3a60031040 con 0x55f0c31f9990 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(34 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3a60031040 con 0x55f0c31dd750 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.608+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3a60031040 con 0x55f0c31f0750 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 30 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 30 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3a60031040 con 0x55f0c31f4cc0 2024-03-20T13:35:18.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(37 [pgnls start_epoch 30 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f3fb0 con 0x55f0c31f0750 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f7db0 con 0x55f0c31f0750 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.609+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f7db0 con 0x55f0c31dd750 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 zone default found 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 4 Realm: () 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 zonegroup default 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f86c0 con 0x55f0c31dd750 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31f86c0 con 0x55f0c31f9990 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.610+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fe340 con 0x55f0c31f9990 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.611+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.611+0000 7f3a67fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.611+0000 7f3a67fa2800 20 started sync module instance, tier type = 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.611+0000 7f3a67fa2800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.611+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fd7d0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.612+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(44 notify.0 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.612+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492554156848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fdf50 con 0x55f0c31f4cc0 2024-03-20T13:35:18.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.612+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31ff000 con 0x55f0c31f0750 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.613+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94492554156848] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.613+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.613+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94492554159776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31ff3b0 con 0x55f0c31f0750 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.613+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31ffe00 con 0x55f0c31f9990 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.614+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(48 notify.2 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.614+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94492554164448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3200690 con 0x55f0c31f9990 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.614+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3201130 con 0x55f0c31f4cc0 2024-03-20T13:35:18.626 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.614+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94492554159776] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.615+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(50 notify.3 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.615+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94492554160832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3201980 con 0x55f0c31f4cc0 2024-03-20T13:35:18.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.615+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c32022f0 con 0x55f0c31f0750 2024-03-20T13:35:18.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.615+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(49 notify.2 [watch watch cookie 94492554164448] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.633 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.616+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.616+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94492554166704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c32022f0 con 0x55f0c31f0750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.616+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3202ca0 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.616+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94492554160832] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.617+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94492554166704] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.617+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.617+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94492554171616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3201e50 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.617+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c32034f0 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.619+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94492554171616] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.619+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.619+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94492554176448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3201e50 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.619+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3203b00 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94492554176448] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.634 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v30'156 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94492554178560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3203b00 con 0x55f0c31dd750 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=0 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=1 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=2 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=3 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=4 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=5 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.620+0000 7f3a67fa2800 20 add_watcher() i=6 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.622+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94492554178560] v30'157 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.622+0000 7f3a67fa2800 20 add_watcher() i=7 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.622+0000 7f3a67fa2800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.622+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3206f20 con 0x55f0c31f0750 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.622+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.635 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.622+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94492554180656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3204400 con 0x55f0c31f0750 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94492554180656] v30'150 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f39177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f3a67fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f3a67fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f3a67fa2800 5 note: GC not initialized 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f39167fc640 20 reqs_thread_entry: start 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.623+0000 7f3a67fa2800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.624+0000 7f3a67fa2800 20 Filter name: none 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.624+0000 7f3887fff640 20 reqs_thread_entry: start 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.624+0000 7f3a67fa2800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.624+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.624+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3238e20 con 0x55f0c31f0750 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv12 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.636 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c323b340 con 0x55f0c31f4cc0 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 20 enabling bucket name=myfoo 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c32397c0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+165 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:18.637 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 : miss 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 20 rados->read ofs=0 len=0 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.627+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c323be00 con 0x55f0c31f0750 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv8 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.628+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 8.8 8:17a6f514:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.1:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~352 in=352b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3243490 con 0x55f0c31f0750 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 [delete,create,call,call,writefull 0~352,setxattr (123)] v30'9 uv9 ondisk = 0) v8 ==== 416+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a67fa2800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:18.638 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a67fa2800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a67fa2800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a67fa2800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1, ofs0, ns] 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [notify cookie 94492554412720 in=737b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c323a7d0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== watch-notify(notify (1) cookie 94492554160832 notify 128849018900 ret 0) v3 ==== 767+0+0 (crc 0 0 0) 0x55f0c31de140 con 0x55f0c31f4cc0 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f39497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018900 cookie 94492554160832 notifier 4585 bl.length()=725 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f39497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 info.flags=0x17 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f39497fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1 to cache LRU end 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f39497fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(67 notify.3 [notify cookie 94492554412720 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.629+0000 7f39497fa640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f3928003e90 con 0x55f0c31f4cc0 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(68 notify.3 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== watch-notify(notify_complete (2) cookie 94492554412720 notify 128849018900 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55f0c31d1990 con 0x55f0c31f4cc0 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a67fa2800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_sources= new_sources= 2024-03-20T13:35:18.639 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a67fa2800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential sources added=[] removed=[] 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a67fa2800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): orig_dests= new_dests= 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a67fa2800 20 handle_bi_update(): bucket=:myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.1]): potential dests added=[] removed=[] 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.630+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c323f870 con 0x55f0c31f0750 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~357] v30'13 uv13 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a67fa2800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a67fa2800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a67fa2800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94492554404656 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c323f830 con 0x55f0c31f0750 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== watch-notify(notify (1) cookie 94492554166704 notify 128849018895 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f3a6003d040 con 0x55f0c31f0750 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f39497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 128849018895 cookie 94492554166704 notifier 4585 bl.length()=533 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f39497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f39497fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(70 notify.4 [notify cookie 94492554404656 out=8b] v0'0 uv156 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.640 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f39497fa640 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e30) v8 -- 0x7f39280041f0 con 0x55f0c31f0750 2024-03-20T13:35:18.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.631+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.641 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.632+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== watch-notify(notify_complete (2) cookie 94492554404656 notify 128849018895 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f3a600437b0 con 0x55f0c31f0750 2024-03-20T13:35:18.641 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:18.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.632+0000 7f39177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:18.643 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.632+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94492554180656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3222e70 con 0x55f0c31f0750 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.633+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94492554180656] v30'151 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.633+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94492554156848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3237af0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.634+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94492554156848] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.634+0000 7f3a67fa2800 20 remove_watcher() i=0 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.634+0000 7f3a67fa2800 2 removed watcher, disabling cache 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.634+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94492554159776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3201130 con 0x55f0c31f0750 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.635+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94492554159776] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.635+0000 7f3a67fa2800 20 remove_watcher() i=1 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.635+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94492554164448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c3201130 con 0x55f0c31f9990 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.637+0000 7f3a652a0640 1 -- 172.21.15.177:0/1183796463 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94492554164448] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5c059040 con 0x55f0c31f9990 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.637+0000 7f3a67fa2800 20 remove_watcher() i=2 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.637+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94492554160832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31fe6a0 con 0x55f0c31f4cc0 2024-03-20T13:35:18.644 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.638+0000 7f3a65aa1640 1 -- 172.21.15.177:0/1183796463 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94492554160832] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a5805e070 con 0x55f0c31f4cc0 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.638+0000 7f3a67fa2800 20 remove_watcher() i=3 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.638+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94492554166704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31ff8e0 con 0x55f0c31f0750 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.639+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94492554166704] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31f0750 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.639+0000 7f3a67fa2800 20 remove_watcher() i=4 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.639+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94492554171616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c32001b0 con 0x55f0c31dd750 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.641+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94492554171616] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.641+0000 7f3a67fa2800 20 remove_watcher() i=5 2024-03-20T13:35:18.645 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.641+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94492554176448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c31ff8e0 con 0x55f0c31dd750 2024-03-20T13:35:18.648 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.643+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94492554176448] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.643+0000 7f3a67fa2800 20 remove_watcher() i=6 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.643+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94492554178560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e30) v8 -- 0x55f0c32027c0 con 0x55f0c31dd750 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94492554178560] v30'158 uv156 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f3a6000a4a0 con 0x55f0c31dd750 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 20 remove_watcher() i=7 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31dd750 msgr2=0x7f3a58050380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31dd750 0x7f3a58050380 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c31f0750 msgr2=0x55f0c31f2c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c31f0750 0x55f0c31f2c10 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31f4cc0 msgr2=0x55f0c31f70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31f4cc0 0x55f0c31f70b0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f0c31f9990 msgr2=0x55f0c31fbe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55f0c31f9990 0x55f0c31fbe50 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3930036790 msgr2=0x7f3930038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.649 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3930036790 0x7f3930038c50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c055040 tx=0x7f3a5c04f000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 msgr2=0x55f0c31e4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a662a2640 1 -- 172.21.15.177:0/1183796463 reap_dead start 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.644+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 0x55f0c31e4c90 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3a5800efb0 tx=0x7f3a58020ec0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 shutdown_connections 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1183796463 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31e4870 0x55f0c31e4c90 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 >> 172.21.15.177:0/1183796463 conn(0x55f0c31d9a20 msgr2=0x55f0c31d7080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 shutdown_connections 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1183796463 wait complete. 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f39400367e0 msgr2=0x7f3940038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f39400367e0 0x7f3940038ca0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x55f0c31b68f0 tx=0x7f3a5c005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 msgr2=0x55f0c31d09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 0x55f0c31d09e0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f3a5804ab00 tx=0x7f3a5801ab10 comp rx=0 tx=0).stop 2024-03-20T13:35:18.650 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 shutdown_connections 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f39400367e0 0x7f3940038ca0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/1506315685 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c31d05c0 0x55f0c31d09e0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 >> 172.21.15.177:0/1506315685 conn(0x55f0c31c4660 msgr2=0x55f0c31c4a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 shutdown_connections 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/1506315685 wait complete. 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31bf920 msgr2=0x55f0c31c1d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55f0c31bf920 0x55f0c31c1d10 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c30b7e70 msgr2=0x55f0c31b9280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55f0c30b7e70 0x55f0c31b9280 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31bba70 msgr2=0x55f0c31bde60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55f0c31bba70 0x55f0c31bde60 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f394c036880 msgr2=0x7f394c038d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f394c036880 0x7f394c038d40 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c054000 tx=0x7f3a5c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:18.651 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 msgr2=0x55f0c31b25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:18.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 --2- 172.21.15.177:0/3588993061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55f0c30b39e0 0x55f0c31b25d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3a58000f60 tx=0x7f3a58000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:18.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a662a2640 1 -- 172.21.15.177:0/3588993061 reap_dead start 2024-03-20T13:35:18.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 shutdown_connections 2024-03-20T13:35:18.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.645+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 >> 172.21.15.177:0/3588993061 conn(0x55f0c30af040 msgr2=0x55f0c319d990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:18.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.646+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 shutdown_connections 2024-03-20T13:35:18.652 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:18.646+0000 7f3a67fa2800 1 -- 172.21.15.177:0/3588993061 wait complete. 2024-03-20T13:35:18.655 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:18.664 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:35:18.916 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-03-20T13:35:18.923 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:33.925 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-03-20T13:35:33.925 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-03-20T13:35:33.925 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-03-20T13:35:33.975 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:33.975 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:33.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f518dd2c800 1 Processor -- start 2024-03-20T13:35:33.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f518dd2c800 1 -- start start 2024-03-20T13:35:33.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f518dd2c800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x560cf2357080 0x560cf2359470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:33.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f518dd2c800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x560cf229dcd0 con 0x560cf2353570 2024-03-20T13:35:33.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f518dd2c800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x560cf2254500 con 0x560cf2357080 2024-03-20T13:35:33.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f51891f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x560cf2357080 0x560cf2359470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:33.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f51891f6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x560cf2357080 0x560cf2359470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:32940/0 (socket says 172.21.15.177:32940) 2024-03-20T13:35:33.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f51891f6640 1 -- 172.21.15.177:0/566123021 learned_addr learned my addr 172.21.15.177:0/566123021 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:33.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.975+0000 7f51899f7640 1 --1- 172.21.15.177:0/566123021 >> v1:172.21.15.28:6789/0 conn(0x560cf2353570 0x560cf2355960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46286/0 (socket says 172.21.15.177:46286) 2024-03-20T13:35:33.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.976+0000 7f51891f6640 1 -- 172.21.15.177:0/566123021 >> v1:172.21.15.28:6789/0 conn(0x560cf2353570 legacy=0x560cf2355960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:33.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.976+0000 7f51891f6640 1 -- 172.21.15.177:0/566123021 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf235a9c0 con 0x560cf2357080 2024-03-20T13:35:33.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f51891f6640 1 --2- 172.21.15.177:0/566123021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2357080 0x560cf2359470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f517400a520 tx=0x7f517401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8ec597a661f5e61 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:33.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f51889f5640 1 -- 172.21.15.177:0/566123021 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5174052570 con 0x560cf2357080 2024-03-20T13:35:33.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f51889f5640 1 -- 172.21.15.177:0/566123021 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51740526d0 con 0x560cf2357080 2024-03-20T13:35:33.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f51889f5640 1 -- 172.21.15.177:0/566123021 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5174052990 con 0x560cf2357080 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f518dd2c800 1 -- 172.21.15.177:0/566123021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2357080 msgr2=0x560cf2359470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f518dd2c800 1 --2- 172.21.15.177:0/566123021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2357080 0x560cf2359470 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f517400a520 tx=0x7f517401cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f518dd2c800 1 -- 172.21.15.177:0/566123021 shutdown_connections 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.978+0000 7f518dd2c800 1 --2- 172.21.15.177:0/566123021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2357080 0x560cf2359470 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.979+0000 7f518dd2c800 1 -- 172.21.15.177:0/566123021 >> 172.21.15.177:0/566123021 conn(0x560cf234d040 msgr2=0x560cf234f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.979+0000 7f518dd2c800 1 -- 172.21.15.177:0/566123021 shutdown_connections 2024-03-20T13:35:33.980 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.979+0000 7f518dd2c800 1 -- 172.21.15.177:0/566123021 wait complete. 2024-03-20T13:35:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.992+0000 7f518dd2c800 1 Processor -- start 2024-03-20T13:35:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.993+0000 7f518dd2c800 1 -- start start 2024-03-20T13:35:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.993+0000 7f518dd2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf2352eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:33.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.993+0000 7f518dd2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf2251a30 con 0x560cf2353570 2024-03-20T13:35:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.993+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf2352eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.993+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf2352eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:32950/0 (socket says 172.21.15.177:32950) 2024-03-20T13:35:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.993+0000 7f51899f7640 1 -- 172.21.15.177:0/4142764920 learned_addr learned my addr 172.21.15.177:0/4142764920 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.994+0000 7f51899f7640 1 -- 172.21.15.177:0/4142764920 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5174005de0 con 0x560cf2353570 2024-03-20T13:35:33.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.994+0000 7f51899f7640 1 --2- 172.21.15.177:0/4142764920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf2352eb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f517c006f80 tx=0x7f517c0019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b006ce8e5dd107a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.994+0000 7f5077e07640 1 -- 172.21.15.177:0/4142764920 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c013420 con 0x560cf2353570 2024-03-20T13:35:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.994+0000 7f5077e07640 1 -- 172.21.15.177:0/4142764920 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c013580 con 0x560cf2353570 2024-03-20T13:35:33.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.994+0000 7f5077e07640 1 -- 172.21.15.177:0/4142764920 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c013860 con 0x560cf2353570 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 -- 172.21.15.177:0/4142764920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 msgr2=0x560cf2352eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 --2- 172.21.15.177:0/4142764920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf2352eb0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f517c006f80 tx=0x7f517c0019a0 comp rx=0 tx=0).stop 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 -- 172.21.15.177:0/4142764920 shutdown_connections 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 --2- 172.21.15.177:0/4142764920 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf2352eb0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 -- 172.21.15.177:0/4142764920 >> 172.21.15.177:0/4142764920 conn(0x560cf234d040 msgr2=0x560cf243e390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 -- 172.21.15.177:0/4142764920 shutdown_connections 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 -- 172.21.15.177:0/4142764920 wait complete. 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 Processor -- start 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.995+0000 7f518dd2c800 1 -- start start 2024-03-20T13:35:33.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f518dd2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf244c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f518dd2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf224d210 con 0x560cf2353570 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf244c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf244c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:32966/0 (socket says 172.21.15.177:32966) 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f51899f7640 1 -- 172.21.15.177:0/3910140858 learned_addr learned my addr 172.21.15.177:0/3910140858 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f51899f7640 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf229dcd0 con 0x560cf2353570 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.996+0000 7f51899f7640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf244c320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f517c000f80 tx=0x7f517c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.997+0000 7f5076604640 1 -- 172.21.15.177:0/3910140858 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c006800 con 0x560cf2353570 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.997+0000 7f5076604640 1 -- 172.21.15.177:0/3910140858 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c004a40 con 0x560cf2353570 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.997+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560cf244c860 con 0x560cf2353570 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.997+0000 7f5076604640 1 -- 172.21.15.177:0/3910140858 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c004d00 con 0x560cf2353570 2024-03-20T13:35:33.999 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.997+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf244cd40 con 0x560cf2353570 2024-03-20T13:35:34.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f5076604640 1 -- 172.21.15.177:0/3910140858 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f517c01e3f0 con 0x560cf2353570 2024-03-20T13:35:34.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f5076604640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f50700367e0 0x7f5070038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f5076604640 1 -- 172.21.15.177:0/3910140858 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f517c04c370 con 0x560cf2353570 2024-03-20T13:35:34.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f51891f6640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f50700367e0 0x7f5070038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2357080 0x560cf2453050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2453670 con 0x560cf2357080 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.998+0000 7f518a1f8640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2357080 0x560cf2453050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f51891f6640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f50700367e0 0x7f5070038ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5174054000 tx=0x7f517404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f518a1f8640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2357080 0x560cf2453050 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f518a1f8640 1 -- 172.21.15.177:0/3910140858 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2357080 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2450700 con 0x560cf2357080 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f518a1f8640 1 -- 172.21.15.177:0/3910140858 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2357080 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf2455880 0x560cf2457c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2458370 con 0x560cf2455880 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:33.999+0000 7f51899f7640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf2455880 0x560cf2457c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.000+0000 7f51899f7640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf2455880 0x560cf2457c70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.000+0000 7f51899f7640 1 -- 172.21.15.177:0/3910140858 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f517c024070 con 0x560cf2455880 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.000+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2454800 con 0x560cf2357080 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.000+0000 7f518a1f8640 1 -- 172.21.15.177:0/3910140858 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2357080 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.000+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560cf2459790 0x560cf245bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.000+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf245c2f0 con 0x560cf2459790 2024-03-20T13:35:34.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.001+0000 7f51891f6640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560cf2459790 0x560cf245bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.004 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.001+0000 7f51891f6640 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560cf2459790 0x560cf245bb80 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f51891f6640 1 -- 172.21.15.177:0/3910140858 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2459790 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f518dd2c800 1 Processor -- start 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f518dd2c800 1 -- start start 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f518dd2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 0x560cf246a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f518dd2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf21efc70 con 0x560cf246a4a0 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 0x560cf246a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 0x560cf246a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:32980/0 (socket says 172.21.15.177:32980) 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.002+0000 7f51899f7640 1 -- 172.21.15.177:0/1604961666 learned_addr learned my addr 172.21.15.177:0/1604961666 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f51899f7640 1 -- 172.21.15.177:0/1604961666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf246ae00 con 0x560cf246a4a0 2024-03-20T13:35:34.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f51899f7640 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 0x560cf246a8c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f517c04a6d0 tx=0x7f517c04adb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f506f7fe640 1 -- 172.21.15.177:0/1604961666 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c01e820 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f506f7fe640 1 -- 172.21.15.177:0/1604961666 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c01d580 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560cf246b870 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f506f7fe640 1 -- 172.21.15.177:0/1604961666 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c01d840 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.003+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf246b870 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.004+0000 7f506f7fe640 1 -- 172.21.15.177:0/1604961666 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f517c03ed50 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.004+0000 7f506f7fe640 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5064036790 0x7f5064038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.004+0000 7f506f7fe640 1 -- 172.21.15.177:0/1604961666 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f517c007000 con 0x560cf246a4a0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.004+0000 7f51891f6640 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5064036790 0x7f5064038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.004+0000 7f518dd2c800 1 Processor -- start 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.004+0000 7f518dd2c800 1 -- start start 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f518dd2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf2477800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f51891f6640 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5064036790 0x7f5064038c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x560cf2454240 tx=0x7f5174005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f518dd2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf21c55d0 con 0x560cf2477420 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf2477800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf2477800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:32982/0 (socket says 172.21.15.177:32982) 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f51899f7640 1 -- 172.21.15.177:0/413506754 learned_addr learned my addr 172.21.15.177:0/413506754 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f51899f7640 1 -- 172.21.15.177:0/413506754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf2477dd0 con 0x560cf2477420 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.005+0000 7f51899f7640 1 --2- 172.21.15.177:0/413506754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf2477800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f517c04c010 tx=0x7f517c02e5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846cba9aeaed5389 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f506d7fa640 1 -- 172.21.15.177:0/413506754 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c052050 con 0x560cf2477420 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f506d7fa640 1 -- 172.21.15.177:0/413506754 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c053040 con 0x560cf2477420 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f506d7fa640 1 -- 172.21.15.177:0/413506754 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c02eb20 con 0x560cf2477420 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 -- 172.21.15.177:0/413506754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 msgr2=0x560cf2477800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 --2- 172.21.15.177:0/413506754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf2477800 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f517c04c010 tx=0x7f517c02e5a0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 -- 172.21.15.177:0/413506754 shutdown_connections 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 --2- 172.21.15.177:0/413506754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf2477800 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 -- 172.21.15.177:0/413506754 >> 172.21.15.177:0/413506754 conn(0x560cf24736f0 msgr2=0x560cf2471750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 -- 172.21.15.177:0/413506754 shutdown_connections 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 -- 172.21.15.177:0/413506754 wait complete. 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 Processor -- start 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.006+0000 7f518dd2c800 1 -- start start 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f518dd2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf247e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f518dd2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x560cf247e8d0 con 0x560cf2477420 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf247e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f51899f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf247e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:32998/0 (socket says 172.21.15.177:32998) 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 learned_addr learned my addr 172.21.15.177:0/613202036 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560cf246ae00 con 0x560cf2477420 2024-03-20T13:35:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f51899f7640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf247e390 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f517c049440 tx=0x7f517c00ff10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.007+0000 7f505b7fe640 1 -- 172.21.15.177:0/613202036 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c06a070 con 0x560cf2477420 2024-03-20T13:35:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.008+0000 7f505b7fe640 1 -- 172.21.15.177:0/613202036 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f517c044b20 con 0x560cf2477420 2024-03-20T13:35:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.008+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560cf246ae00 con 0x560cf2477420 2024-03-20T13:35:34.020 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.008+0000 7f505b7fe640 1 -- 172.21.15.177:0/613202036 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f517c044e00 con 0x560cf2477420 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.008+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560cf246ae00 con 0x560cf2477420 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.008+0000 7f505b7fe640 1 -- 172.21.15.177:0/613202036 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f517c03e3c0 con 0x560cf2477420 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f505b7fe640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5054036790 0x7f5054038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f505b7fe640 1 -- 172.21.15.177:0/613202036 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f517c0679a0 con 0x560cf2477420 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f51891f6640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5054036790 0x7f5054038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2489bf0 0x560cf248c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248c800 con 0x560cf2489bf0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f518a1f8640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2489bf0 0x560cf248c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f51891f6640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5054036790 0x7f5054038c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x560cf245c6b0 tx=0x7f517404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.009+0000 7f518a1f8640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2489bf0 0x560cf248c0b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 realm 2024-03-20T13:35:34.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248cbd0 con 0x560cf2489bf0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d780 con 0x560cf2489bf0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf248e130 0x560cf2490520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2490aa0 con 0x560cf248e130 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.010+0000 7f51899f7640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf248e130 0x560cf2490520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f51899f7640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf248e130 0x560cf2490520 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f518dd2c800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f518dd2c800 20 searching for the correct realm 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x560cf2492a40 0x560cf2494f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24955d0 con 0x560cf2492a40 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f51891f6640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x560cf2492a40 0x560cf2494f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.011+0000 7f51891f6640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x560cf2492a40 0x560cf2494f00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.012+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.012+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24955d0 con 0x560cf248e130 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.012+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.012+0000 7f51899f7640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f517c027020 0x7f517c0341c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.012+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24955d0 con 0x7f517c027020 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.012+0000 7f518a1f8640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f517c027020 0x7f517c0341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.013+0000 7f518a1f8640 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f517c027020 0x7f517c0341c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.013+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.013+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.013+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.013+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf248e130 2024-03-20T13:35:34.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.014+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.015+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf248e130 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.016+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.017+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf248e130 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.018+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.019+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.019+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.019+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.019+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf248e130 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.019+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.019+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf248e130 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2492a40 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x7f517c027020 2024-03-20T13:35:34.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.020+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf2489bf0 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf248d420 con 0x560cf248e130 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2491370 con 0x560cf2489bf0 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.021+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2491720 con 0x560cf2489bf0 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2491720 con 0x7f517c027020 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 zone default found 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 4 Realm: () 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 zonegroup default 2024-03-20T13:35:34.035 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2491fa0 con 0x7f517c027020 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.022+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2491fa0 con 0x560cf2492a40 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2497560 con 0x560cf2492a40 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 20 started sync module instance, tier type = 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.023+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2496cd0 con 0x560cf248e130 2024-03-20T13:35:34.036 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.024+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.024+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94613604493360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2497080 con 0x560cf248e130 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.024+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24984b0 con 0x560cf2489bf0 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.025+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94613604493360] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.026+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.026+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94613604499344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2498860 con 0x560cf2489bf0 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.026+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf2499290 con 0x560cf2492a40 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.027+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94613604499344] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.027+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.027+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94613604502928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24995f0 con 0x560cf2492a40 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.027+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249a090 con 0x560cf248e130 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.028+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94613604502928] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.028+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.028+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94613604497792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249a8e0 con 0x560cf248e130 2024-03-20T13:35:34.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.028+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249b250 con 0x560cf2489bf0 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.029+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94613604497792] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.030+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.030+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94613604511152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249b670 con 0x560cf2489bf0 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.030+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249bfe0 con 0x7f517c027020 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.031+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94613604511152] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.032+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.032+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94613604512688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249bfe0 con 0x7f517c027020 2024-03-20T13:35:34.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.032+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249c950 con 0x7f517c027020 2024-03-20T13:35:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.033+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94613604512688] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.033+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.033+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94613604514624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249cb30 con 0x7f517c027020 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.033+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249d330 con 0x7f517c027020 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94613604514624] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'159 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94613604518000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249d230 con 0x7f517c027020 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=0 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=1 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=2 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=3 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=4 2024-03-20T13:35:34.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=5 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.035+0000 7f518dd2c800 20 add_watcher() i=6 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.036+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94613604518000] v32'160 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.036+0000 7f518dd2c800 20 add_watcher() i=7 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.036+0000 7f518dd2c800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.036+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a0730 con 0x560cf2489bf0 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.036+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.036+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94613604519120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249dbe0 con 0x560cf2489bf0 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.037+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94613604519120] v32'152 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.038+0000 7f503b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.038+0000 7f518dd2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:34.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.038+0000 7f518dd2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:34.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.038+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249ff50 con 0x560cf2489bf0 2024-03-20T13:35:34.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.039+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.039+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249fab0 con 0x7f517c027020 2024-03-20T13:35:34.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.040+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'18 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.040+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf249fef0 con 0x560cf2492a40 2024-03-20T13:35:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.041+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.041+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a98f0 con 0x560cf2489bf0 2024-03-20T13:35:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.043+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'153 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.044 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.043+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a98f0 con 0x560cf248e130 2024-03-20T13:35:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.044+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'45 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.045 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.044+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a9060 con 0x560cf2492a40 2024-03-20T13:35:34.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.045+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'29 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.045+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24aae30 con 0x560cf2489bf0 2024-03-20T13:35:34.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.047+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'20 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.048 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.047+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab100 con 0x7f517c027020 2024-03-20T13:35:34.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.048+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'30 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.049 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.048+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab100 con 0x560cf248e130 2024-03-20T13:35:34.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.049+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.049+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab630 con 0x560cf2492a40 2024-03-20T13:35:34.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.050+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'24 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.050+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24abb60 con 0x560cf248e130 2024-03-20T13:35:34.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.051+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'46 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.051+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab000 con 0x7f517c027020 2024-03-20T13:35:34.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.052+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'22 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.052+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab000 con 0x560cf248e130 2024-03-20T13:35:34.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.053+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'18 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.053+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab000 con 0x7f517c027020 2024-03-20T13:35:34.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.054+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'35 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.054+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab000 con 0x560cf2489bf0 2024-03-20T13:35:34.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.055+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'154 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.056 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.055+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ab000 con 0x560cf2492a40 2024-03-20T13:35:34.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.056+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'38 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.057 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.056+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf248e130 2024-03-20T13:35:34.058 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.057+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'47 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.057+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.058+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'18 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.059 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.058+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2489bf0 2024-03-20T13:35:34.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.059+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'26 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.059+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2489bf0 2024-03-20T13:35:34.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.060+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'155 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.061 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.060+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.062 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.061+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'39 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.063 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.061+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf248e130 2024-03-20T13:35:34.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.062+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'28 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.063+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.063+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.063+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.064+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.064+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.067+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'14 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.067+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.068+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'30 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.068+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x7f517c027020 2024-03-20T13:35:34.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.069+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'20 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.069+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.070+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'18 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.070+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x7f517c027020 2024-03-20T13:35:34.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.071+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.071+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf2492a40 2024-03-20T13:35:34.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.072+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'40 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.072+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x7f517c027020 2024-03-20T13:35:34.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.073+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'36 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.073+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24ac000 con 0x560cf248e130 2024-03-20T13:35:34.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.074+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'24 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.074+0000 7f503a7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.074+0000 7f518dd2c800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f518dd2c800 20 Filter name: none 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f4fabfff640 20 reqs_thread_entry: start 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.075+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.076+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.076+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.076+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.076+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.076+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.076+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.077+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv15 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.078+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv10 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.079+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv10 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.080+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.081+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.081+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.081+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.081+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv8 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.090 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.082+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.083+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.084+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.084+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.091 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.084+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.084+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.084+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.084+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.085+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.086+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.092 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.086+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.086+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.086+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.086+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.086+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.087+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.088+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 38 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.089+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 39 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv4 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.090+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv13 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 40 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 41 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.091+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 42 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.092+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 43 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 44 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 45 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 46 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 47 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.093+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 48 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 49 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 50 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 51 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.094+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 52 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 53 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 54 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv6 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.095+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv3 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 55 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.096+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 56 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 57 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.097+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(180 gc.28 [call out=1702b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+1702 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d6d20 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 58 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d5d10 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 59 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d6d20 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 60 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.098+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d6d20 con 0x7f517c027020 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d5d10 con 0x7f517c027020 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d6d20 con 0x7f517c027020 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d6d20 con 0x560cf248e130 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.099+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d5d10 con 0x560cf248e130 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.100+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.100+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24d6d20 con 0x560cf248e130 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.100+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.101+0000 7f503b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.101+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94613604519120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a9c50 con 0x560cf2489bf0 2024-03-20T13:35:34.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.102+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94613604519120] v32'156 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.102+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94613604493360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.103+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94613604493360] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.103+0000 7f518dd2c800 20 remove_watcher() i=0 2024-03-20T13:35:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.103+0000 7f518dd2c800 2 removed watcher, disabling cache 2024-03-20T13:35:34.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.103+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94613604499344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.104+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94613604499344] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.104+0000 7f518dd2c800 20 remove_watcher() i=1 2024-03-20T13:35:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.104+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94613604502928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2492a40 2024-03-20T13:35:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.105+0000 7f51891f6640 1 -- 172.21.15.177:0/613202036 <== osd.3 v2:172.21.15.177:6809/1493521224 61 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94613604502928] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5174052bc0 con 0x560cf2492a40 2024-03-20T13:35:34.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.105+0000 7f518dd2c800 20 remove_watcher() i=2 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.105+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94613604497792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf248e130 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.106+0000 7f51899f7640 1 -- 172.21.15.177:0/613202036 <== osd.2 v2:172.21.15.177:6800/3663022842 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94613604497792] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f517c06c070 con 0x560cf248e130 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.106+0000 7f518dd2c800 20 remove_watcher() i=3 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.106+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94613604511152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x560cf2489bf0 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.107+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.1 v2:172.21.15.177:6808/2492741617 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94613604511152] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x560cf2489bf0 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.107+0000 7f518dd2c800 20 remove_watcher() i=4 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.107+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94613604512688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.108+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94613604512688] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.108+0000 7f518dd2c800 20 remove_watcher() i=5 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.108+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94613604514624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.109+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94613604514624] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.109+0000 7f518dd2c800 20 remove_watcher() i=6 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.109+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94613604518000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560cf24a8220 con 0x7f517c027020 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94613604518000] v32'161 uv159 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f51840083e0 con 0x7f517c027020 2024-03-20T13:35:34.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 20 remove_watcher() i=7 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f517c027020 msgr2=0x7f517c0341c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f517c027020 0x7f517c0341c0 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2489bf0 msgr2=0x560cf248c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2489bf0 0x560cf248c0b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf248e130 msgr2=0x560cf2490520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf248e130 0x560cf2490520 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x560cf2492a40 msgr2=0x560cf2494f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x560cf2492a40 0x560cf2494f00 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5054036790 msgr2=0x7f5054038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5054036790 0x7f5054038c50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x560cf245c6b0 tx=0x7f517404f000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 msgr2=0x560cf247e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 --2- 172.21.15.177:0/613202036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2477420 0x560cf247e390 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f517c049440 tx=0x7f517c00ff10 comp rx=0 tx=0).stop 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518a1f8640 1 -- 172.21.15.177:0/613202036 reap_dead start 2024-03-20T13:35:34.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.110+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 shutdown_connections 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 >> 172.21.15.177:0/613202036 conn(0x560cf24736f0 msgr2=0x560cf2471720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 shutdown_connections 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/613202036 wait complete. 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5064036790 msgr2=0x7f5064038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5064036790 0x7f5064038c50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x560cf2454240 tx=0x7f5174005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 msgr2=0x560cf246a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 0x560cf246a8c0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f517c04a6d0 tx=0x7f517c04adb0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 shutdown_connections 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5064036790 0x7f5064038c50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/1604961666 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf246a4a0 0x560cf246a8c0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 >> 172.21.15.177:0/1604961666 conn(0x560cf245e540 msgr2=0x560cf245e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 shutdown_connections 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/1604961666 wait complete. 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560cf2459790 msgr2=0x560cf245bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560cf2459790 0x560cf245bb80 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2357080 msgr2=0x560cf2453050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560cf2357080 0x560cf2453050 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf2455880 msgr2=0x560cf2457c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560cf2455880 0x560cf2457c70 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f50700367e0 msgr2=0x7f5070038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f50700367e0 0x7f5070038ca0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5174054000 tx=0x7f517404e000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 msgr2=0x560cf244c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 --2- 172.21.15.177:0/3910140858 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x560cf2353570 0x560cf244c320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f517c000f80 tx=0x7f517c001250 comp rx=0 tx=0).stop 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518a1f8640 1 -- 172.21.15.177:0/3910140858 reap_dead start 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 shutdown_connections 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.111+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 >> 172.21.15.177:0/3910140858 conn(0x560cf234d040 msgr2=0x560cf2351910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.112+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 shutdown_connections 2024-03-20T13:35:34.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.112+0000 7f518dd2c800 1 -- 172.21.15.177:0/3910140858 wait complete. 2024-03-20T13:35:34.121 INFO:teuthology.orchestra.run.smithi177.stdout:[{"tag":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.10631832624650970674\u0000","time":"2024-03-20T13:35:33.922103+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_7","key":"","instance":""}]}] 2024-03-20T13:35:34.122 DEBUG:tasks.util.rgw: json result: [{'tag': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.10631832624650970674\x00', 'time': '2024-03-20T13:35:33.922103+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_7', 'key': '', 'instance': ''}]}] 2024-03-20T13:35:34.122 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-03-20T13:35:34.122 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-03-20T13:35:34.122 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-03-20T13:35:34.164 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:34.164 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:34.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7549a31800 1 Processor -- start 2024-03-20T13:35:34.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7549a31800 1 -- start start 2024-03-20T13:35:34.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7549a31800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5629de96af50 0x5629de973a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7549a31800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5629de8b5cc0 con 0x5629de969410 2024-03-20T13:35:34.165 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7549a31800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5629de86c500 con 0x5629de96af50 2024-03-20T13:35:34.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f753ed2f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5629de96af50 0x5629de973a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7547530640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5629de969410 0x5629de969830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46300/0 (socket says 172.21.15.177:46300) 2024-03-20T13:35:34.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.164+0000 7f7547530640 1 -- 172.21.15.177:0/157640937 learned_addr learned my addr 172.21.15.177:0/157640937 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:34.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.165+0000 7f753ed2f640 1 -- 172.21.15.177:0/157640937 >> v1:172.21.15.28:6789/0 conn(0x5629de969410 legacy=0x5629de969830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.165+0000 7f7546d2f640 1 -- 172.21.15.177:0/157640937 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2166322809 0 0) 0x5629de8b5cc0 con 0x5629de969410 2024-03-20T13:35:34.166 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.165+0000 7f753ed2f640 1 -- 172.21.15.177:0/157640937 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629de8dded0 con 0x5629de96af50 2024-03-20T13:35:34.167 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.166+0000 7f753ed2f640 1 --2- 172.21.15.177:0/157640937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de96af50 0x5629de973a50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f753000a470 tx=0x7f753001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e22a64071197de5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.166+0000 7f7546d2f640 1 -- 172.21.15.177:0/157640937 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f753004ad40 con 0x5629de96af50 2024-03-20T13:35:34.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7546d2f640 1 -- 172.21.15.177:0/157640937 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7530052440 con 0x5629de96af50 2024-03-20T13:35:34.168 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7546d2f640 1 -- 172.21.15.177:0/157640937 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f753004aea0 con 0x5629de96af50 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 -- 172.21.15.177:0/157640937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de96af50 msgr2=0x5629de973a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 --2- 172.21.15.177:0/157640937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de96af50 0x5629de973a50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f753000a470 tx=0x7f753001cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 -- 172.21.15.177:0/157640937 shutdown_connections 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 --2- 172.21.15.177:0/157640937 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de96af50 0x5629de973a50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 -- 172.21.15.177:0/157640937 >> 172.21.15.177:0/157640937 conn(0x5629de965030 msgr2=0x5629de967450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 -- 172.21.15.177:0/157640937 shutdown_connections 2024-03-20T13:35:34.169 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.167+0000 7f7549a31800 1 -- 172.21.15.177:0/157640937 wait complete. 2024-03-20T13:35:34.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7549a31800 1 Processor -- start 2024-03-20T13:35:34.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7549a31800 1 -- start start 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7549a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea5cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7549a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629de869a30 con 0x5629de969410 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea5cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea5cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33014/0 (socket says 172.21.15.177:33014) 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7547530640 1 -- 172.21.15.177:0/365378770 learned_addr learned my addr 172.21.15.177:0/365378770 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.179+0000 7f7547530640 1 -- 172.21.15.177:0/365378770 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530005d20 con 0x5629de969410 2024-03-20T13:35:34.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.180+0000 7f7547530640 1 --2- 172.21.15.177:0/365378770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea5cb10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7538001630 tx=0x7f7538001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e918a1717bbf808b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.180+0000 7f743560a640 1 -- 172.21.15.177:0/365378770 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538003450 con 0x5629de969410 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.180+0000 7f743560a640 1 -- 172.21.15.177:0/365378770 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75380035b0 con 0x5629de969410 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.180+0000 7f743560a640 1 -- 172.21.15.177:0/365378770 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538003910 con 0x5629de969410 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- 172.21.15.177:0/365378770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 msgr2=0x5629dea5cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 --2- 172.21.15.177:0/365378770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea5cb10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7538001630 tx=0x7f7538001af0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- 172.21.15.177:0/365378770 shutdown_connections 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 --2- 172.21.15.177:0/365378770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea5cb10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- 172.21.15.177:0/365378770 >> 172.21.15.177:0/365378770 conn(0x5629de965030 msgr2=0x5629dea58430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- 172.21.15.177:0/365378770 shutdown_connections 2024-03-20T13:35:34.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- 172.21.15.177:0/365378770 wait complete. 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 Processor -- start 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- start start 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea64290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.181+0000 7f7549a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629de865210 con 0x5629de969410 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea64290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea64290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33026/0 (socket says 172.21.15.177:33026) 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7547530640 1 -- 172.21.15.177:0/3116102565 learned_addr learned my addr 172.21.15.177:0/3116102565 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7547530640 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7538006cb0 con 0x5629de969410 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7547530640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea64290 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7538006fa0 tx=0x7f7538001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7433e07640 1 -- 172.21.15.177:0/3116102565 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538013820 con 0x5629de969410 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7433e07640 1 -- 172.21.15.177:0/3116102565 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538013980 con 0x5629de969410 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629dea647d0 con 0x5629de969410 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7433e07640 1 -- 172.21.15.177:0/3116102565 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538013c20 con 0x5629de969410 2024-03-20T13:35:34.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.182+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629dea64cb0 con 0x5629de969410 2024-03-20T13:35:34.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.183+0000 7f7433e07640 1 -- 172.21.15.177:0/3116102565 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7538028460 con 0x5629de969410 2024-03-20T13:35:34.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.183+0000 7f7433e07640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f742c036790 0x7f742c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.183+0000 7f7433e07640 1 -- 172.21.15.177:0/3116102565 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f753804c4b0 con 0x5629de969410 2024-03-20T13:35:34.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.183+0000 7f753ed2f640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f742c036790 0x7f742c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.183+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629de96af50 0x5629dea6afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629dea6b570 con 0x5629de96af50 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7547d31640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629de96af50 0x5629dea6afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f753ed2f640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f742c036790 0x7f742c038c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7530054000 tx=0x7f753004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7547d31640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629de96af50 0x5629dea6afa0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7547d31640 1 -- 172.21.15.177:0/3116102565 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629de96af50 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629dea68670 con 0x5629de96af50 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7547d31640 1 -- 172.21.15.177:0/3116102565 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75400083e0 con 0x5629de96af50 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629dea6d7b0 0x5629dea6fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.184+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629dea702a0 con 0x5629dea6d7b0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7547530640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629dea6d7b0 0x5629dea6fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7547530640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629dea6d7b0 0x5629dea6fba0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7547530640 1 -- 172.21.15.177:0/3116102565 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7538024020 con 0x5629dea6d7b0 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629dea6c730 con 0x5629de96af50 2024-03-20T13:35:34.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7547d31640 1 -- 172.21.15.177:0/3116102565 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75400083e0 con 0x5629de96af50 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5629dea716c0 0x5629dea73ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.185+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629dea741f0 con 0x5629dea716c0 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.186+0000 7f753ed2f640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5629dea716c0 0x5629dea73ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.186+0000 7f753ed2f640 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5629dea716c0 0x5629dea73ab0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.186+0000 7f753ed2f640 1 -- 172.21.15.177:0/3116102565 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f75300525b0 con 0x5629dea716c0 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7549a31800 1 Processor -- start 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7549a31800 1 -- start start 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7549a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 0x5629dea82720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7549a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629de807c70 con 0x5629dea82300 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 0x5629dea82720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 0x5629dea82720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33038/0 (socket says 172.21.15.177:33038) 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.187+0000 7f7547530640 1 -- 172.21.15.177:0/2332086798 learned_addr learned my addr 172.21.15.177:0/2332086798 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7547530640 1 -- 172.21.15.177:0/2332086798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629dea82c60 con 0x5629dea82300 2024-03-20T13:35:34.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7547530640 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 0x5629dea82720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7538013e10 tx=0x7f7538012940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7431602640 1 -- 172.21.15.177:0/2332086798 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538010e90 con 0x5629dea82300 2024-03-20T13:35:34.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7431602640 1 -- 172.21.15.177:0/2332086798 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75380490c0 con 0x5629dea82300 2024-03-20T13:35:34.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629dea836d0 con 0x5629dea82300 2024-03-20T13:35:34.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7431602640 1 -- 172.21.15.177:0/2332086798 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538049360 con 0x5629dea82300 2024-03-20T13:35:34.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.188+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629dea836d0 con 0x5629dea82300 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7431602640 1 -- 172.21.15.177:0/2332086798 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7538012a80 con 0x5629dea82300 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7431602640 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7420036740 0x7f7420038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7431602640 1 -- 172.21.15.177:0/2332086798 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7538046160 con 0x5629dea82300 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f753ed2f640 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7420036740 0x7f7420038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7549a31800 1 Processor -- start 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7549a31800 1 -- start start 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f753ed2f640 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7420036740 0x7f7420038c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5629dea689f0 tx=0x7f7530005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7549a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea8f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7549a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629de7dd5d0 con 0x5629dea8f2c0 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea8f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea8f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33040/0 (socket says 172.21.15.177:33040) 2024-03-20T13:35:34.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.189+0000 7f7547530640 1 -- 172.21.15.177:0/3937454550 learned_addr learned my addr 172.21.15.177:0/3937454550 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f7547530640 1 -- 172.21.15.177:0/3937454550 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629dea8fc70 con 0x5629dea8f2c0 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f7547530640 1 --2- 172.21.15.177:0/3937454550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea8f6a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f753802a030 tx=0x7f753801e8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c225a48b623dfcd server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f742affd640 1 -- 172.21.15.177:0/3937454550 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538033470 con 0x5629dea8f2c0 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f742affd640 1 -- 172.21.15.177:0/3937454550 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7538033630 con 0x5629dea8f2c0 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f742affd640 1 -- 172.21.15.177:0/3937454550 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538012d30 con 0x5629dea8f2c0 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f7549a31800 1 -- 172.21.15.177:0/3937454550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 msgr2=0x5629dea8f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f7549a31800 1 --2- 172.21.15.177:0/3937454550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea8f6a0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f753802a030 tx=0x7f753801e8a0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f7549a31800 1 -- 172.21.15.177:0/3937454550 shutdown_connections 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.190+0000 7f7549a31800 1 --2- 172.21.15.177:0/3937454550 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea8f6a0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 -- 172.21.15.177:0/3937454550 >> 172.21.15.177:0/3937454550 conn(0x5629dea8b590 msgr2=0x5629dea895f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 -- 172.21.15.177:0/3937454550 shutdown_connections 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 -- 172.21.15.177:0/3937454550 wait complete. 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 Processor -- start 2024-03-20T13:35:34.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 -- start start 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea96280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7549a31800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5629dea967c0 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea96280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7547530640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea96280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33046/0 (socket says 172.21.15.177:33046) 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.191+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 learned_addr learned my addr 172.21.15.177:0/103009131 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5629dea82c60 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f7547530640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea96280 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7538010c10 tx=0x7f7538046050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f74297fa640 1 -- 172.21.15.177:0/103009131 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7538064040 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f74297fa640 1 -- 172.21.15.177:0/103009131 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75380441a0 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5629dea82c60 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f74297fa640 1 -- 172.21.15.177:0/103009131 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f753804ab20 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.192+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5629dea82c60 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.193+0000 7f74297fa640 1 -- 172.21.15.177:0/103009131 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7538059070 con 0x5629dea8f2c0 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.193+0000 7f74297fa640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7410036790 0x7f7410038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.193+0000 7f74297fa640 1 -- 172.21.15.177:0/103009131 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7538056070 con 0x5629dea8f2c0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.193+0000 7f753ed2f640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7410036790 0x7f7410038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.193+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629deaa1ae0 0x5629deaa3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa46f0 con 0x5629deaa1ae0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f753ed2f640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7410036790 0x7f7410038c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7530052fd0 tx=0x7f753004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7547d31640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629deaa1ae0 0x5629deaa3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7547d31640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629deaa1ae0 0x5629deaa3fa0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 20 realm 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa4ac0 con 0x5629deaa1ae0 2024-03-20T13:35:34.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.194+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa56a0 con 0x5629deaa1ae0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629deaa6050 0x5629deaa8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa8a50 con 0x5629deaa6050 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7547530640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629deaa6050 0x5629deaa8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.195+0000 7f7547530640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629deaa6050 0x5629deaa8440 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7538024020 con 0x5629deaa6050 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f7549a31800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f7549a31800 20 searching for the correct realm 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5629deaaad60 0x5629deaad220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaad8f0 con 0x5629deaaad60 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f753ed2f640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5629deaaad60 0x5629deaad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f753ed2f640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5629deaaad60 0x5629deaad220 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75300525b0 con 0x5629deaaad60 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.196+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaad8f0 con 0x5629deaa6050 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7538024020 con 0x5629deaa6050 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547530640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7538078040 0x7f7538046890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaad8f0 con 0x7f7538078040 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547d31640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7538078040 0x7f7538046890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547d31640 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7538078040 0x7f7538046890 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.197+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.198+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa6050 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7538024020 con 0x5629deaa6050 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.199+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa6050 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7538024020 con 0x5629deaa6050 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.200+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.201+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa6050 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7538024020 con 0x5629deaa6050 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.202+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa6050 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.203+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa6050 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaaad60 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x7f7538078040 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.204+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa1ae0 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa5340 con 0x5629deaa6050 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:34.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa9160 con 0x5629deaa1ae0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa9510 con 0x5629deaa1ae0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.205+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa9510 con 0x7f7538078040 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 zone default found 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 4 Realm: () 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 zonegroup default 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa9d90 con 0x7f7538078040 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaa9d90 con 0x5629deaaad60 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.206+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaaf7e0 con 0x5629deaaad60 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.207+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.207+0000 7f7549a31800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.207+0000 7f7549a31800 20 started sync module instance, tier type = 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.207+0000 7f7549a31800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.207+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaaeff0 con 0x5629deaa6050 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.208+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.208+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94737829391184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaaf3a0 con 0x5629deaa6050 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.208+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab06f0 con 0x5629deaa1ae0 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.209+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94737829391184] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.209+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.209+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94737829395456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab0aa0 con 0x5629deaa1ae0 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.209+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab14d0 con 0x5629deaaad60 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.210+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94737829395456] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.210+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.210+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94737829400528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab1880 con 0x5629deaaad60 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.210+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab2280 con 0x5629deaa6050 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.211+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94737829400528] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.211+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.211+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94737829397008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab2ad0 con 0x5629deaa6050 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.211+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab3440 con 0x5629deaa1ae0 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.212+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94737829397008] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.212+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.213+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94737829406736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab3440 con 0x5629deaa1ae0 2024-03-20T13:35:34.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.213+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab3e10 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.213+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94737829406736] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.214+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.214+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94737829411088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab3dd0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.214+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab4870 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.215+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.215+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94737829411088] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.215+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94737829413712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab4cd0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.215+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab2fe0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94737829413712] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'162 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94737829414960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab4c50 con 0x7f7538078040 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=0 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=1 2024-03-20T13:35:34.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=2 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=3 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=4 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=5 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.216+0000 7f7549a31800 20 add_watcher() i=6 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.217+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94737829414960] v32'163 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.217+0000 7f7549a31800 20 add_watcher() i=7 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.217+0000 7f7549a31800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.217+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab8750 con 0x5629deaa1ae0 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.217+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.217+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94737829417600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deab5be0 con 0x5629deaa1ae0 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.218+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94737829417600] v32'157 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.218+0000 7f73fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.218+0000 7f7549a31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:34.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.218+0000 7f7549a31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:34.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.218+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac1000 con 0x5629deaa1ae0 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.220+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.220+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac10b0 con 0x7f7538078040 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.221+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'19 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.221+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac19e0 con 0x5629deaaad60 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.222+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.222+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac21e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.223+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'158 uv15 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.223+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac2710 con 0x5629deaa6050 2024-03-20T13:35:34.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.223+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'48 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.224+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac2c40 con 0x5629deaaad60 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.224+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'31 uv10 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.224+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac3610 con 0x5629deaa1ae0 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.225+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'21 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.225+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac3610 con 0x7f7538078040 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.226+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'32 uv8 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.226+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac3610 con 0x5629deaa6050 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.227+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.227+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac3b40 con 0x5629deaaad60 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.228+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'25 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.228+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4070 con 0x5629deaa6050 2024-03-20T13:35:34.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.229+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'49 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.229+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac45a0 con 0x7f7538078040 2024-03-20T13:35:34.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.230+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'23 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.231+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac45a0 con 0x5629deaa6050 2024-03-20T13:35:34.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.231+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'19 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.231+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac3510 con 0x7f7538078040 2024-03-20T13:35:34.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.233+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'37 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.233+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaa1ae0 2024-03-20T13:35:34.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.233+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'159 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.233+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.235+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'41 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.235+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaa6050 2024-03-20T13:35:34.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.235+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'50 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.235+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.236+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'19 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.236+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaa1ae0 2024-03-20T13:35:34.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.238+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'27 uv4 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.238+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaa1ae0 2024-03-20T13:35:34.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.238+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'160 uv13 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.238+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.240+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'42 uv9 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.240+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaa6050 2024-03-20T13:35:34.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.240+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'29 uv7 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.240+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.241+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.241+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.242+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.243 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.242+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.243+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'15 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.243+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.244+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'32 uv6 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.244+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x7f7538078040 2024-03-20T13:35:34.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.245+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'21 uv3 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.245+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.246+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'19 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.246+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x7f7538078040 2024-03-20T13:35:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.247+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.247+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaaad60 2024-03-20T13:35:34.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.248+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'43 uv11 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.248+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x7f7538078040 2024-03-20T13:35:34.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.249+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'38 uv12 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.249+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deac4510 con 0x5629deaa6050 2024-03-20T13:35:34.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'25 uv5 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f73fcfe1640 20 reqs_thread_entry: start 2024-03-20T13:35:34.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f7549a31800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:34.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f7549a31800 20 Filter name: none 2024-03-20T13:35:34.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f73767fc640 20 reqs_thread_entry: start 2024-03-20T13:35:34.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-03-20T13:35:34.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.250+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:94 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.251+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(94 gc.31 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.251+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(95 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:96 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(96 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:97 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(97 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(98 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.252+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:99 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.253+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(99 gc.31 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.253+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-03-20T13:35:34.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.253+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(100 gc.0 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(101 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:102 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(102 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.255+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:103 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.256+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(103 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.256+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.256+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:104 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.256+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(104 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.256+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.256+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.257+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(105 gc.0 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.257+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-03-20T13:35:34.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.257+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:106 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.258+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(106 gc.1 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.258+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:107 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(107 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:108 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(108 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:109 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(109 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:110 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(110 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.259+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:111 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.261+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(111 gc.1 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.261+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-03-20T13:35:34.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.261+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:112 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(112 gc.2 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:113 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(113 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:114 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(114 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.262+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:115 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.263+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(115 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.263+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.263+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:116 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.263+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(116 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.263+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.263+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:117 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.264+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(117 gc.2 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.264+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-03-20T13:35:34.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.264+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:118 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(118 gc.3 [call] v32'161 uv161 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:119 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(119 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:120 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(120 gc.3 [call out=24b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:121 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 36 ==== osd_op_reply(121 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.265+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:122 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.266+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 37 ==== osd_op_reply(122 gc.3 [call out=15b] v0'0 uv161 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.266+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.266+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:123 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.266+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 38 ==== osd_op_reply(123 gc.3 [call] v32'162 uv162 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.266+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-03-20T13:35:34.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.266+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:124 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.267+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(124 gc.4 [call] v32'51 uv51 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.267+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:125 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(125 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.270 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:126 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(126 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:127 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(127 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:128 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== osd_op_reply(128 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.268+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:129 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.269+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(129 gc.4 [call] v32'52 uv52 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.269+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-03-20T13:35:34.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.269+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:130 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.270+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(130 gc.5 [call] v32'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.270+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:131 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== osd_op_reply(131 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:132 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(132 gc.5 [call out=24b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:133 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== osd_op_reply(133 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:134 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(134 gc.5 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.271+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:135 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.272+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(135 gc.5 [call] v32'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.272+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-03-20T13:35:34.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.272+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:136 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.273+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 39 ==== osd_op_reply(136 gc.6 [call] v32'22 uv22 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.273+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:137 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 40 ==== osd_op_reply(137 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:138 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 41 ==== osd_op_reply(138 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:139 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 42 ==== osd_op_reply(139 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:140 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 43 ==== osd_op_reply(140 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.274+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:141 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.275+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 44 ==== osd_op_reply(141 gc.6 [call] v32'23 uv23 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.275+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-03-20T13:35:34.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.275+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:142 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.276+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(142 gc.7 [call] v32'34 uv34 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.276+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:143 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.276+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(143 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.276+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.276+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:144 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(144 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:145 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(145 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:146 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(146 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.277+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:147 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.278+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(147 gc.7 [call] v32'35 uv35 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.278+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-03-20T13:35:34.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.278+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:148 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.279+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== osd_op_reply(148 gc.8 [call] v32'20 uv20 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.279+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:149 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.279+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(149 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.279+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.279+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:150 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== osd_op_reply(150 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:151 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(151 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:152 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(152 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.280+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:153 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.281+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== osd_op_reply(153 gc.8 [call] v32'21 uv21 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.281+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-03-20T13:35:34.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.281+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:154 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(154 gc.9 [call] v32'26 uv26 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:155 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 38 ==== osd_op_reply(155 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:156 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 39 ==== osd_op_reply(156 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.282+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:157 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.283+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 40 ==== osd_op_reply(157 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.283+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.283+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:158 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.283+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 41 ==== osd_op_reply(158 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.283+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.283+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:159 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.284+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 42 ==== osd_op_reply(159 gc.9 [call] v32'27 uv27 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.284+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-03-20T13:35:34.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.284+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:160 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.284+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 38 ==== osd_op_reply(160 gc.10 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.284+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:161 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 39 ==== osd_op_reply(161 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:162 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 40 ==== osd_op_reply(162 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:163 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 41 ==== osd_op_reply(163 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:164 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 42 ==== osd_op_reply(164 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.285+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:165 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.286+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 43 ==== osd_op_reply(165 gc.10 [call] v32'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.286+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-03-20T13:35:34.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.286+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:166 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(166 gc.11 [call] v32'24 uv24 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:167 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(167 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:168 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(168 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.288+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:169 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.289+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(169 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.289+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.289+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:170 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.289+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(170 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.289+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.289+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:171 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.290+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(171 gc.11 [call] v32'25 uv25 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.290+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-03-20T13:35:34.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.290+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:172 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.291+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 44 ==== osd_op_reply(172 gc.12 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.291+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:173 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.291+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 45 ==== osd_op_reply(173 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.291+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.291+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:174 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 46 ==== osd_op_reply(174 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:175 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 47 ==== osd_op_reply(175 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:176 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 48 ==== osd_op_reply(176 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.292+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:177 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.293+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 49 ==== osd_op_reply(177 gc.12 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.293+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-03-20T13:35:34.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.293+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:178 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.294+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(178 gc.13 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.294+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:179 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(179 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:180 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== osd_op_reply(180 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:181 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(181 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:182 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.295+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(182 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.296+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.296+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:183 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.297+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(183 gc.13 [call] v32'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.297+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-03-20T13:35:34.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.297+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:184 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 45 ==== osd_op_reply(184 gc.14 [call] v32'163 uv163 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:185 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 46 ==== osd_op_reply(185 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:186 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 47 ==== osd_op_reply(186 gc.14 [call out=24b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:187 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 48 ==== osd_op_reply(187 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.298+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:188 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.299+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 49 ==== osd_op_reply(188 gc.14 [call out=15b] v0'0 uv163 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.299+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.299+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:189 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.300+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 50 ==== osd_op_reply(189 gc.14 [call] v32'164 uv164 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.300+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-03-20T13:35:34.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.300+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:190 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.301+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 43 ==== osd_op_reply(190 gc.15 [call] v32'44 uv44 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.301+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:191 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.301+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 44 ==== osd_op_reply(191 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.301+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.301+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:192 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 45 ==== osd_op_reply(192 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:193 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 46 ==== osd_op_reply(193 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:194 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 47 ==== osd_op_reply(194 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.302+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:195 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.303+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 48 ==== osd_op_reply(195 gc.15 [call] v32'45 uv45 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.303+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-03-20T13:35:34.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.303+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:196 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.304+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 50 ==== osd_op_reply(196 gc.16 [call] v32'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.304+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:197 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 51 ==== osd_op_reply(197 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:198 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 52 ==== osd_op_reply(198 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:199 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 53 ==== osd_op_reply(199 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:200 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 54 ==== osd_op_reply(200 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.305+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:201 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.306+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 55 ==== osd_op_reply(201 gc.16 [call] v32'56 uv56 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.306+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-03-20T13:35:34.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.306+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:202 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.307+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 49 ==== osd_op_reply(202 gc.17 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.307+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:203 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.307+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 50 ==== osd_op_reply(203 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.307+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.307+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:204 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 51 ==== osd_op_reply(204 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:205 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 52 ==== osd_op_reply(205 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:206 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 53 ==== osd_op_reply(206 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.308+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:207 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.309+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 54 ==== osd_op_reply(207 gc.17 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.309+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-03-20T13:35:34.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.309+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:208 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 51 ==== osd_op_reply(208 gc.18 [call] v32'28 uv28 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:209 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 52 ==== osd_op_reply(209 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:210 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 53 ==== osd_op_reply(210 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:211 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 54 ==== osd_op_reply(211 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.311+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:212 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.313 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.312+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 55 ==== osd_op_reply(212 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.312+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.312+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:213 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.313+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 56 ==== osd_op_reply(213 gc.18 [call] v32'29 uv29 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.313+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-03-20T13:35:34.314 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.313+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:214 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 57 ==== osd_op_reply(214 gc.19 [call] v32'165 uv165 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:215 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 58 ==== osd_op_reply(215 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:216 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 59 ==== osd_op_reply(216 gc.19 [call out=24b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.316 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.314+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:217 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.315+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 60 ==== osd_op_reply(217 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.315+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.315+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:218 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.315+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 61 ==== osd_op_reply(218 gc.19 [call out=15b] v0'0 uv165 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.315+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.317 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.315+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:219 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa1ae0 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.316+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 62 ==== osd_op_reply(219 gc.19 [call] v32'166 uv166 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.316+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.316+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:220 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 55 ==== osd_op_reply(220 gc.20 [call] v32'46 uv46 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:221 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 56 ==== osd_op_reply(221 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.319 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:222 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 57 ==== osd_op_reply(222 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.317+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:223 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.318+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 58 ==== osd_op_reply(223 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.318+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.318+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:224 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.318+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 59 ==== osd_op_reply(224 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.318+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.320 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.318+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:225 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.319+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 60 ==== osd_op_reply(225 gc.20 [call] v32'47 uv47 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.319+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.319+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:226 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 56 ==== osd_op_reply(226 gc.21 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:227 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 57 ==== osd_op_reply(227 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:228 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 58 ==== osd_op_reply(228 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:229 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 59 ==== osd_op_reply(229 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.320+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:230 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.321+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 60 ==== osd_op_reply(230 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.321+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.321+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:231 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaa6050 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.322+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 61 ==== osd_op_reply(231 gc.21 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.322+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.322+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:232 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.322+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 61 ==== osd_op_reply(232 gc.22 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:233 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 62 ==== osd_op_reply(233 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:234 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 63 ==== osd_op_reply(234 gc.22 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:235 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 64 ==== osd_op_reply(235 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.323+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:236 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.324+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 65 ==== osd_op_reply(236 gc.22 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.324+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.324+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:237 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.324+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 66 ==== osd_op_reply(237 gc.22 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.324+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-03-20T13:35:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.324+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:238 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.325+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 67 ==== osd_op_reply(238 gc.23 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.325+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:239 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 68 ==== osd_op_reply(239 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:240 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 69 ==== osd_op_reply(240 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:241 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 70 ==== osd_op_reply(241 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:242 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 71 ==== osd_op_reply(242 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.326+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:243 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.327+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 72 ==== osd_op_reply(243 gc.23 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.327+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-03-20T13:35:34.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.327+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:244 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.328+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 73 ==== osd_op_reply(244 gc.24 [call] v32'16 uv16 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.328+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:245 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.328+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 74 ==== osd_op_reply(245 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.328+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.328+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:246 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 75 ==== osd_op_reply(246 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:247 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 76 ==== osd_op_reply(247 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:248 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 77 ==== osd_op_reply(248 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.329+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:249 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.330+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 78 ==== osd_op_reply(249 gc.24 [call] v32'17 uv17 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.330+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-03-20T13:35:34.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.330+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:250 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 79 ==== osd_op_reply(250 gc.25 [call] v32'35 uv35 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:251 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 80 ==== osd_op_reply(251 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:252 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 81 ==== osd_op_reply(252 gc.25 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:253 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.331+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 82 ==== osd_op_reply(253 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.332+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.332+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:254 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.332+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 83 ==== osd_op_reply(254 gc.25 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.332+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.332+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:255 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.333+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 84 ==== osd_op_reply(255 gc.25 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.333+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-03-20T13:35:34.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.333+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:256 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.335+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 49 ==== osd_op_reply(256 gc.26 [call] v32'22 uv22 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.335+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:257 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 50 ==== osd_op_reply(257 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:258 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 51 ==== osd_op_reply(258 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:259 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 52 ==== osd_op_reply(259 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.336+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:260 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.337+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 53 ==== osd_op_reply(260 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.337+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.337+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:261 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.338+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 54 ==== osd_op_reply(261 gc.26 [call] v32'23 uv23 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.338+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-03-20T13:35:34.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.338+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:262 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.339+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 85 ==== osd_op_reply(262 gc.27 [call] v32'20 uv20 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.339+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:263 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.339+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 86 ==== osd_op_reply(263 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.339+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.339+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:264 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.339+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 87 ==== osd_op_reply(264 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:265 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 88 ==== osd_op_reply(265 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:266 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 89 ==== osd_op_reply(266 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.340+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:267 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x5629deaaad60 2024-03-20T13:35:34.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.341+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 90 ==== osd_op_reply(267 gc.27 [call] v32'21 uv21 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.341+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-03-20T13:35:34.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.341+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:268 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.342+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 55 ==== osd_op_reply(268 gc.28 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.342+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:269 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.342+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 56 ==== osd_op_reply(269 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.342+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.342+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:270 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 57 ==== osd_op_reply(270 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:271 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 58 ==== osd_op_reply(271 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:272 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabebe0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 59 ==== osd_op_reply(272 gc.28 [call out=1702b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+1702 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 20 garbage collection: RGWGC::process iterating over entry tag='3852dce3-594b-4724-bee1-f3dae77b7611.4225.10631832624650970674', time=2024-03-20T13:35:33.922103+0000, chain.objs.size()=7 2024-03-20T13:35:34.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_1 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:273 3.3as0 3:5e23cc7f:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deabf430 con 0x5629deaa6050 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_2 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:274 3.37s0 3:ecd8473d:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf2470 con 0x5629deaa1ae0 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_3 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:275 3.2cs0 3:35af02ac:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf4e50 con 0x5629deaaad60 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_4 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:276 3.21s0 3:87a96088:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf7670 con 0x7f7538078040 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_5 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:277 3.15s0 3:ab45f27a:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaa6050 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_6 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:278 3.cs0 3:303d333c:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deafc810 con 0x5629deaaad60 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_7 2024-03-20T13:35:34.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.343+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:279 3.bs0 3:d3c62d03:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaff310 con 0x7f7538078040 2024-03-20T13:35:34.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.345+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 91 ==== osd_op_reply(275 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_3 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.346+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 62 ==== osd_op_reply(273 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_1 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.346+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 60 ==== osd_op_reply(279 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_7 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.347+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 92 ==== osd_op_reply(278 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_6 [call] v32'4 uv4 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.348 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.347+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 61 ==== osd_op_reply(276 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_4 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.349 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.347+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 63 ==== osd_op_reply(274 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_2 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.348+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 63 ==== osd_op_reply(277 3852dce3-594b-4724-bee1-f3dae77b7611.4225.1__shadow_.H4AYlPEAd9Gtrey1TPazhfhtdZgN6g4_5 [call] v32'2 uv2 ondisk = 0) v8 ==== 230+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.349+0000 7f7549a31800 5 garbage collection: RGWGC::process removing entries, marker: 2024-03-20T13:35:34.350 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.349+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:280 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.351+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 62 ==== osd_op_reply(280 gc.28 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.351+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:281 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.353+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 63 ==== osd_op_reply(281 gc.28 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.353+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-03-20T13:35:34.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.354+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:282 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.354+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 93 ==== osd_op_reply(282 gc.29 [call] v32'48 uv48 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.354+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:283 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 94 ==== osd_op_reply(283 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:284 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 95 ==== osd_op_reply(284 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:285 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 96 ==== osd_op_reply(285 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:286 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 97 ==== osd_op_reply(286 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.355+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:287 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.356+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 98 ==== osd_op_reply(287 gc.29 [call] v32'49 uv49 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.356+0000 7f7549a31800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.356+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:288 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.357+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 64 ==== osd_op_reply(288 gc.30 [call] v32'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.357+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:289 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 65 ==== osd_op_reply(289 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:290 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 66 ==== osd_op_reply(290 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:291 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 67 ==== osd_op_reply(291 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:35:34.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:292 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 68 ==== osd_op_reply(292 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.358+0000 7f7549a31800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:35:34.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.359+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:293 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.360+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 69 ==== osd_op_reply(293 gc.30 [call] v32'42 uv42 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.360+0000 7f73fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.360+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94737829417600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaa1ae0 2024-03-20T13:35:34.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.361+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 64 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94737829417600] v32'167 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.361+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94737829391184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaa6050 2024-03-20T13:35:34.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.362+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 64 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94737829391184] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.362+0000 7f7549a31800 20 remove_watcher() i=0 2024-03-20T13:35:34.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.362+0000 7f7549a31800 2 removed watcher, disabling cache 2024-03-20T13:35:34.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.362+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94737829395456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaa1ae0 2024-03-20T13:35:34.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.364+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 65 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94737829395456] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.364+0000 7f7549a31800 20 remove_watcher() i=1 2024-03-20T13:35:34.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.364+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94737829400528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaaad60 2024-03-20T13:35:34.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.366+0000 7f753ed2f640 1 -- 172.21.15.177:0/103009131 <== osd.3 v2:172.21.15.177:6809/1493521224 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94737829400528] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f753008b040 con 0x5629deaaad60 2024-03-20T13:35:34.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.366+0000 7f7549a31800 20 remove_watcher() i=2 2024-03-20T13:35:34.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.366+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94737829397008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaa6050 2024-03-20T13:35:34.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.366+0000 7f7547530640 1 -- 172.21.15.177:0/103009131 <== osd.2 v2:172.21.15.177:6800/3663022842 65 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94737829397008] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7538082040 con 0x5629deaa6050 2024-03-20T13:35:34.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.366+0000 7f7549a31800 20 remove_watcher() i=3 2024-03-20T13:35:34.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.366+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94737829406736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x5629deaa1ae0 2024-03-20T13:35:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.368+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.1 v2:172.21.15.177:6808/2492741617 66 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94737829406736] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x5629deaa1ae0 2024-03-20T13:35:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.368+0000 7f7549a31800 20 remove_watcher() i=4 2024-03-20T13:35:34.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.368+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94737829411088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.369+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 70 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94737829411088] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.369+0000 7f7549a31800 20 remove_watcher() i=5 2024-03-20T13:35:34.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.369+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94737829413712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.370+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 71 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94737829413712] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.370+0000 7f7549a31800 20 remove_watcher() i=6 2024-03-20T13:35:34.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.370+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94737829414960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5629deaf9f50 con 0x7f7538078040 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 <== osd.0 v2:172.21.15.28:6800/801909073 72 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94737829414960] v32'164 uv162 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f75400083e0 con 0x7f7538078040 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 20 remove_watcher() i=7 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7538078040 msgr2=0x7f7538046890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7538078040 0x7f7538046890 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629deaa1ae0 msgr2=0x5629deaa3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629deaa1ae0 0x5629deaa3fa0 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629deaa6050 msgr2=0x5629deaa8440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629deaa6050 0x5629deaa8440 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5629deaaad60 msgr2=0x5629deaad220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.371+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5629deaaad60 0x5629deaad220 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7410036790 msgr2=0x7f7410038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7410036790 0x7f7410038c50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7530052fd0 tx=0x7f753004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 msgr2=0x5629dea96280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7547d31640 1 -- 172.21.15.177:0/103009131 reap_dead start 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea96280 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f7538010c10 tx=0x7f7538046050 comp rx=0 tx=0).stop 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 shutdown_connections 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/103009131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea8f2c0 0x5629dea96280 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 >> 172.21.15.177:0/103009131 conn(0x5629dea8b590 msgr2=0x5629dea88bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 shutdown_connections 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/103009131 wait complete. 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7420036740 msgr2=0x7f7420038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7420036740 0x7f7420038c00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x5629dea689f0 tx=0x7f7530005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:34.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 msgr2=0x5629dea82720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 0x5629dea82720 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7538013e10 tx=0x7f7538012940 comp rx=0 tx=0).stop 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 shutdown_connections 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7420036740 0x7f7420038c00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/2332086798 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629dea82300 0x5629dea82720 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 >> 172.21.15.177:0/2332086798 conn(0x5629dea763a0 msgr2=0x5629dea767a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 shutdown_connections 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/2332086798 wait complete. 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5629dea716c0 msgr2=0x5629dea73ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5629dea716c0 0x5629dea73ab0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629de96af50 msgr2=0x5629dea6afa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5629de96af50 0x5629dea6afa0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629dea6d7b0 msgr2=0x5629dea6fba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5629dea6d7b0 0x5629dea6fba0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f742c036790 msgr2=0x7f742c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f742c036790 0x7f742c038c50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7530054000 tx=0x7f753004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 msgr2=0x5629dea64290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.372+0000 7f7549a31800 1 --2- 172.21.15.177:0/3116102565 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5629de969410 0x5629dea64290 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7538006fa0 tx=0x7f7538001250 comp rx=0 tx=0).stop 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.373+0000 7f7547d31640 1 -- 172.21.15.177:0/3116102565 reap_dead start 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.373+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 shutdown_connections 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.373+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 >> 172.21.15.177:0/3116102565 conn(0x5629de965030 msgr2=0x5629dea56cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.373+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 shutdown_connections 2024-03-20T13:35:34.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.373+0000 7f7549a31800 1 -- 172.21.15.177:0/3116102565 wait complete. 2024-03-20T13:35:34.381 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-03-20T13:35:34.381 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-03-20T13:35:34.382 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-03-20T13:35:34.463 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:34.464 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.463+0000 7fef743da800 1 Processor -- start 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.463+0000 7fef743da800 1 -- start start 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.463+0000 7fef743da800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5599d1e77f60 0x5599d1e80a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.463+0000 7fef743da800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5599d1dc2cd0 con 0x5599d1e76420 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.463+0000 7fef743da800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5599d1d79500 con 0x5599d1e77f60 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.464+0000 7fef716d8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5599d1e77f60 0x5599d1e80a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.465 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.464+0000 7fef716d8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5599d1e77f60 0x5599d1e80a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33048/0 (socket says 172.21.15.177:33048) 2024-03-20T13:35:34.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.464+0000 7fef716d8640 1 -- 172.21.15.177:0/2637969511 learned_addr learned my addr 172.21.15.177:0/2637969511 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.465+0000 7fef716d8640 1 -- 172.21.15.177:0/2637969511 >> v1:172.21.15.28:6789/0 conn(0x5599d1e76420 legacy=0x5599d1e76840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.466 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.465+0000 7fef716d8640 1 -- 172.21.15.177:0/2637969511 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599d1deaee0 con 0x5599d1e77f60 2024-03-20T13:35:34.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.467+0000 7fef716d8640 1 --2- 172.21.15.177:0/2637969511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1e80a60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fef6800a520 tx=0x7fef6801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59d76eab361ba7a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.467+0000 7fef70ed7640 1 -- 172.21.15.177:0/2637969511 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef68052570 con 0x5599d1e77f60 2024-03-20T13:35:34.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.467+0000 7fef70ed7640 1 -- 172.21.15.177:0/2637969511 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef680526d0 con 0x5599d1e77f60 2024-03-20T13:35:34.468 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.467+0000 7fef70ed7640 1 -- 172.21.15.177:0/2637969511 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef68052990 con 0x5599d1e77f60 2024-03-20T13:35:34.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 -- 172.21.15.177:0/2637969511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 msgr2=0x5599d1e80a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 --2- 172.21.15.177:0/2637969511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1e80a60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fef6800a520 tx=0x7fef6801cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 -- 172.21.15.177:0/2637969511 shutdown_connections 2024-03-20T13:35:34.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 --2- 172.21.15.177:0/2637969511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1e80a60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 -- 172.21.15.177:0/2637969511 >> 172.21.15.177:0/2637969511 conn(0x5599d1e72040 msgr2=0x5599d1e74460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.469 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 -- 172.21.15.177:0/2637969511 shutdown_connections 2024-03-20T13:35:34.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.468+0000 7fef743da800 1 -- 172.21.15.177:0/2637969511 wait complete. 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.479+0000 7fef743da800 1 Processor -- start 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.479+0000 7fef743da800 1 -- start start 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.479+0000 7fef743da800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 0x5599d1f69ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.479+0000 7fef743da800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d1d76a30 con 0x5599d1e76420 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 0x5599d1f69ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 0x5599d1f69ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33062/0 (socket says 172.21.15.177:33062) 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fef71ed9640 1 -- 172.21.15.177:0/3744730510 learned_addr learned my addr 172.21.15.177:0/3744730510 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.481 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fef71ed9640 1 -- 172.21.15.177:0/3744730510 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef68005de0 con 0x5599d1e76420 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3744730510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 0x5599d1f69ef0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fef64001d20 tx=0x7fef6400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35967f3180c2a66 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fee5fe07640 1 -- 172.21.15.177:0/3744730510 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64014070 con 0x5599d1e76420 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fee5fe07640 1 -- 172.21.15.177:0/3744730510 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64008030 con 0x5599d1e76420 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.480+0000 7fee5fe07640 1 -- 172.21.15.177:0/3744730510 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6400f570 con 0x5599d1e76420 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 -- 172.21.15.177:0/3744730510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 msgr2=0x5599d1f69ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 --2- 172.21.15.177:0/3744730510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 0x5599d1f69ef0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fef64001d20 tx=0x7fef6400b5b0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 -- 172.21.15.177:0/3744730510 shutdown_connections 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 --2- 172.21.15.177:0/3744730510 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e76420 0x5599d1f69ef0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 -- 172.21.15.177:0/3744730510 >> 172.21.15.177:0/3744730510 conn(0x5599d1e72040 msgr2=0x5599d1f65690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 -- 172.21.15.177:0/3744730510 shutdown_connections 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 -- 172.21.15.177:0/3744730510 wait complete. 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.481+0000 7fef743da800 1 Processor -- start 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef743da800 1 -- start start 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef743da800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1f71650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef743da800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d1d72210 con 0x5599d1e77f60 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1f71650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1f71650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33078/0 (socket says 172.21.15.177:33078) 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef71ed9640 1 -- 172.21.15.177:0/1067897501 learned_addr learned my addr 172.21.15.177:0/1067897501 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef71ed9640 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6400a040 con 0x5599d1e77f60 2024-03-20T13:35:34.487 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.482+0000 7fef71ed9640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1f71650 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x5599d1f6ab00 tx=0x7fef64000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.483+0000 7fee5e604640 1 -- 172.21.15.177:0/1067897501 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64014070 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.483+0000 7fee5e604640 1 -- 172.21.15.177:0/1067897501 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef64020070 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.483+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599d1f71b90 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.483+0000 7fee5e604640 1 -- 172.21.15.177:0/1067897501 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef640195c0 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.483+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599d1f720d0 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.483+0000 7fee5e604640 1 -- 172.21.15.177:0/1067897501 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fef640197f0 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fee5e604640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee58036790 0x7fee58038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fee5e604640 1 -- 172.21.15.177:0/1067897501 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fef6404bec0 con 0x5599d1e77f60 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef716d8640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee58036790 0x7fee58038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1f76460 0x5599d1f78850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f78dd0 con 0x5599d1f76460 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef726da640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1f76460 0x5599d1f78850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.488 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef716d8640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee58036790 0x7fee58038c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef68054000 tx=0x7fef6804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef726da640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1f76460 0x5599d1f78850 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef726da640 1 -- 172.21.15.177:0/1067897501 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1f76460 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.484+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f75a10 con 0x5599d1f76460 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef726da640 1 -- 172.21.15.177:0/1067897501 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1f76460 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1f7b030 0x5599d1f7d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f7db10 con 0x5599d1f7b030 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef71ed9640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1f7b030 0x5599d1f7d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef71ed9640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1f7b030 0x5599d1f7d420 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.504 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef71ed9640 1 -- 172.21.15.177:0/1067897501 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fef64048040 con 0x5599d1f7b030 2024-03-20T13:35:34.504 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.485+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f79fb0 con 0x5599d1f76460 2024-03-20T13:35:34.504 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.486+0000 7fef726da640 1 -- 172.21.15.177:0/1067897501 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1f76460 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.486+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5599d1f7ef30 0x5599d1f81320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.486+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f81a60 con 0x5599d1f7ef30 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.486+0000 7fef716d8640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5599d1f7ef30 0x5599d1f81320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.486+0000 7fef716d8640 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5599d1f7ef30 0x5599d1f81320 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef716d8640 1 -- 172.21.15.177:0/1067897501 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1f7ef30 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef743da800 1 Processor -- start 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef743da800 1 -- start start 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef743da800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 0x5599d1f90030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef743da800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d1d14c70 con 0x5599d1f8fc10 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 0x5599d1f90030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 0x5599d1f90030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33088/0 (socket says 172.21.15.177:33088) 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.487+0000 7fef71ed9640 1 -- 172.21.15.177:0/3727819678 learned_addr learned my addr 172.21.15.177:0/3727819678 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fef71ed9640 1 -- 172.21.15.177:0/3727819678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599d1f90570 con 0x5599d1f8fc10 2024-03-20T13:35:34.505 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 0x5599d1f90030 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fef6404a190 tx=0x7fef64019e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fee577fe640 1 -- 172.21.15.177:0/3727819678 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64035070 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fee577fe640 1 -- 172.21.15.177:0/3727819678 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6403f8b0 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599d1f90fe0 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fee577fe640 1 -- 172.21.15.177:0/3727819678 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6403fb70 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.488+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599d1f90fe0 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fee577fe640 1 -- 172.21.15.177:0/3727819678 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fef6403fcd0 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fee577fe640 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee4c036790 0x7fee4c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fee577fe640 1 -- 172.21.15.177:0/3727819678 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fef64045040 con 0x5599d1f8fc10 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fef716d8640 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee4c036790 0x7fee4c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fef743da800 1 Processor -- start 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fef743da800 1 -- start start 2024-03-20T13:35:34.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fef716d8640 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee4c036790 0x7fee4c038c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5599d1f75d90 tx=0x7fef68005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fef743da800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1f9cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.489+0000 7fef743da800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d1cea5d0 con 0x5599d1f9cb40 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1f9cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1f9cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33094/0 (socket says 172.21.15.177:33094) 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fef71ed9640 1 -- 172.21.15.177:0/3941346415 learned_addr learned my addr 172.21.15.177:0/3941346415 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fef71ed9640 1 -- 172.21.15.177:0/3941346415 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599d1f9d530 con 0x5599d1f9cb40 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3941346415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1f9cf60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fef64030e30 tx=0x7fef6400d770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67d995c1dc890133 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fee557fa640 1 -- 172.21.15.177:0/3941346415 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64055070 con 0x5599d1f9cb40 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fee557fa640 1 -- 172.21.15.177:0/3941346415 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6404abc0 con 0x5599d1f9cb40 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.490+0000 7fee557fa640 1 -- 172.21.15.177:0/3941346415 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6400da40 con 0x5599d1f9cb40 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- 172.21.15.177:0/3941346415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 msgr2=0x5599d1f9cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 --2- 172.21.15.177:0/3941346415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1f9cf60 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fef64030e30 tx=0x7fef6400d770 comp rx=0 tx=0).stop 2024-03-20T13:35:34.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- 172.21.15.177:0/3941346415 shutdown_connections 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 --2- 172.21.15.177:0/3941346415 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1f9cf60 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- 172.21.15.177:0/3941346415 >> 172.21.15.177:0/3941346415 conn(0x5599d1f98e60 msgr2=0x5599d1f96ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- 172.21.15.177:0/3941346415 shutdown_connections 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- 172.21.15.177:0/3941346415 wait complete. 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 Processor -- start 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- start start 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1fa3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef743da800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599d1fa4020 con 0x5599d1f9cb40 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1fa3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef71ed9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1fa3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33098/0 (socket says 172.21.15.177:33098) 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.491+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 learned_addr learned my addr 172.21.15.177:0/3695927336 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599d1f90570 con 0x5599d1f9cb40 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1fa3ae0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d7b0 tx=0x7fef6404eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fee437fe640 1 -- 172.21.15.177:0/3695927336 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef64006350 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fee437fe640 1 -- 172.21.15.177:0/3695927336 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef640064b0 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5599d1f90570 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fee437fe640 1 -- 172.21.15.177:0/3695927336 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fef6403e120 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.492+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5599d1f90570 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fee437fe640 1 -- 172.21.15.177:0/3695927336 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fef6403e280 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fee437fe640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee3c036790 0x7fee3c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fee437fe640 1 -- 172.21.15.177:0/3695927336 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fef64075d40 con 0x5599d1f9cb40 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fef716d8640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee3c036790 0x7fee3c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1faf2e0 0x5599d1fb17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb1ef0 con 0x5599d1faf2e0 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.493+0000 7fef726da640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1faf2e0 0x5599d1fb17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef716d8640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee3c036790 0x7fee3c038c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5599d1f81e20 tx=0x7fef6804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef726da640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1faf2e0 0x5599d1fb17a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 realm 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb22c0 con 0x5599d1faf2e0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2e70 con 0x5599d1faf2e0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1fb3820 0x5599d1fb5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.494+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb6190 con 0x5599d1fb3820 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1fb3820 0x5599d1fb5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1fb3820 0x5599d1fb5c10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef743da800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:34.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef743da800 20 searching for the correct realm 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5599d1fb8170 0x5599d1fba630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbad00 con 0x5599d1fb8170 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.495+0000 7fef716d8640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5599d1fb8170 0x5599d1fba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef716d8640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5599d1fb8170 0x5599d1fba630 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbad00 con 0x5599d1fb3820 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef71ed9640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fef6404a500 0x7fef6403b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbad00 con 0x7fef6404a500 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.496+0000 7fef726da640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fef6404a500 0x7fef6403b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fef6404a500 0x7fef6403b6b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.497+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb3820 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb8170 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.498+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb3820 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.499+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb8170 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb8170 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb8170 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.500+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb8170 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.501+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb8170 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb3820 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.502+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb3820 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x7fef6404a500 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1fb3820 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fef6408d040 con 0x5599d1fb8170 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.503+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fef6408d040 con 0x7fef6404a500 2024-03-20T13:35:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fef6408d040 con 0x5599d1faf2e0 2024-03-20T13:35:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fef6408d040 con 0x5599d1fb3820 2024-03-20T13:35:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.504+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb2b10 con 0x5599d1faf2e0 2024-03-20T13:35:34.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb6ab0 con 0x7fef6404a500 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 zone default found 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 4 Realm: () 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 zonegroup default 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb6ea0 con 0x7fef6404a500 2024-03-20T13:35:34.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.505+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb72a0 con 0x5599d1fb8170 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb76c0 con 0x5599d1fb8170 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 20 started sync module instance, tier type = 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.506+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fb6700 con 0x5599d1fb3820 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.507+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.507+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94119141293920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbc820 con 0x5599d1fb3820 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.507+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbd1f0 con 0x5599d1faf2e0 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.508+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94119141293920] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.508+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.508+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94119141297392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbc820 con 0x5599d1faf2e0 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.508+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbdd10 con 0x5599d1fb8170 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.509+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.509+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94119141300208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbe5a0 con 0x5599d1fb8170 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.509+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbf050 con 0x5599d1fb3820 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.509+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94119141297392] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.510+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94119141300208] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.511+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.511+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94119141305168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbe0c0 con 0x5599d1fb3820 2024-03-20T13:35:34.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.511+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbfa10 con 0x5599d1faf2e0 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.512+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.512+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94119141307760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fbfe30 con 0x5599d1faf2e0 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.512+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc0850 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.512+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94119141305168] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.513+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.513+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94119141307760] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.513+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94119141311280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc0810 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.513+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc10a0 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.514+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94119141311280] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.514+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.514+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94119141308816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc0cb0 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.514+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc16d0 con 0x7fef6404a500 2024-03-20T13:35:34.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94119141308816] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'165 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94119141314992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc18b0 con 0x7fef6404a500 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=0 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=1 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=2 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=3 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=4 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=5 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.515+0000 7fef743da800 20 add_watcher() i=6 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.516+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94119141314992] v32'166 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.516+0000 7fef743da800 20 add_watcher() i=7 2024-03-20T13:35:34.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.516+0000 7fef743da800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.516+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc4c70 con 0x5599d1faf2e0 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.516+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.516+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94119141316512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc2170 con 0x5599d1faf2e0 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.517+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94119141316512] v32'168 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.517+0000 7fee237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.518+0000 7fef743da800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.518+0000 7fef743da800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.518+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcd150 con 0x5599d1faf2e0 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.519+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.519+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcd150 con 0x7fef6404a500 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.520+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.520+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcd590 con 0x5599d1fb8170 2024-03-20T13:35:34.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.521+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.521+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc44e0 con 0x5599d1faf2e0 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.522+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'169 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.522+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc4040 con 0x5599d1fb3820 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.522+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'57 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.522+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fc4040 con 0x5599d1fb8170 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.523+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'37 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.523+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcf140 con 0x5599d1faf2e0 2024-03-20T13:35:34.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.525+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.535 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.525+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcb300 con 0x7fef6404a500 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.525+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'39 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.526+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcb300 con 0x5599d1fb3820 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.526+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.526+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcb300 con 0x5599d1fb8170 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.527+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.527+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcfe80 con 0x5599d1fb3820 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.528+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'58 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.528+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fd03b0 con 0x7fef6404a500 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.529+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'26 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.529+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fd0850 con 0x5599d1fb3820 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.530+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.530+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fd05e0 con 0x7fef6404a500 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.531+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'43 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.531+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fd0580 con 0x5599d1faf2e0 2024-03-20T13:35:34.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.532+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'170 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.532+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fd04f0 con 0x5599d1fb8170 2024-03-20T13:35:34.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.533+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'50 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.533+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fca440 con 0x5599d1fb3820 2024-03-20T13:35:34.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.534+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'59 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.534+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.535+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.535+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1faf2e0 2024-03-20T13:35:34.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.536+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'30 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.536+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1faf2e0 2024-03-20T13:35:34.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.537+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'171 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.537+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.538+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'51 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.538+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb3820 2024-03-20T13:35:34.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.539+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'32 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.539+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.540+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.540+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.541+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.541+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.542+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'18 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.542+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.543+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'38 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.543+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x7fef6404a500 2024-03-20T13:35:34.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.544+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'24 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.544+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.545+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'22 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.545+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x7fef6404a500 2024-03-20T13:35:34.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.546+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'40 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.546+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb8170 2024-03-20T13:35:34.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.547+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'52 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.547+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x7fef6404a500 2024-03-20T13:35:34.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.548+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'44 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.548+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1fcaa10 con 0x5599d1fb3820 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'28 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fee227fc640 20 reqs_thread_entry: start 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fef743da800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fef743da800 20 Filter name: none 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fed93fff640 20 reqs_thread_entry: start 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.549+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.552 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.550+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.551+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.552+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.552+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.552+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.552+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.552+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.552+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv162 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv52 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.553+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.554+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.555+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.555+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.555+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.555+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.555+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.555+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.556+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.557+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.558+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.558+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.558+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.558+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.558+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv54 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.558+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.559+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.559+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.559+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.559+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.559+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv25 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.559+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.560+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.560+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.560+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.560+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.560+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.560+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.561+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv164 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.562+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.568 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv56 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.563+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 38 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 39 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.564+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.565+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv166 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 40 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 41 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 42 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.566+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 43 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.567+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 44 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 45 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 46 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 47 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.568+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.569+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 48 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.569+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.569+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 49 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.569+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.569+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 50 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.569+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 51 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 52 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 53 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 54 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.570+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.571+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.571+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.571+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.571+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 55 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 56 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 57 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.572+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.573+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.573+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.573+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.573+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.573+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.573+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 58 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 59 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 60 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.574+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.575+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.575+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.575+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.575+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.576+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 38 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.576+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.576+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 39 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.576+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.576+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 40 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.577+0000 7fee237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.577+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94119141316512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.578+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94119141316512] v32'172 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.578+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94119141293920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.579+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 41 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94119141293920] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.579+0000 7fef743da800 20 remove_watcher() i=0 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.579+0000 7fef743da800 2 removed watcher, disabling cache 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.579+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94119141297392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.580+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94119141297392] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.580+0000 7fef743da800 20 remove_watcher() i=1 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.580+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94119141300208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb8170 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.581+0000 7fef716d8640 1 -- 172.21.15.177:0/3695927336 <== osd.3 v2:172.21.15.177:6809/1493521224 61 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94119141300208] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef68052bc0 con 0x5599d1fb8170 2024-03-20T13:35:34.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.581+0000 7fef743da800 20 remove_watcher() i=2 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.581+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94119141305168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1fb3820 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.582+0000 7fef71ed9640 1 -- 172.21.15.177:0/3695927336 <== osd.2 v2:172.21.15.177:6800/3663022842 42 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94119141305168] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef64064040 con 0x5599d1fb3820 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.582+0000 7fef743da800 20 remove_watcher() i=3 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.582+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94119141307760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x5599d1faf2e0 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.583+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.1 v2:172.21.15.177:6808/2492741617 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94119141307760] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x5599d1faf2e0 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.583+0000 7fef743da800 20 remove_watcher() i=4 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.583+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94119141311280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.584+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94119141311280] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.584+0000 7fef743da800 20 remove_watcher() i=5 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.584+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94119141308816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.585+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94119141308816] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.585+0000 7fef743da800 20 remove_watcher() i=6 2024-03-20T13:35:34.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.585+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94119141314992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5599d1f61d90 con 0x7fef6404a500 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94119141314992] v32'167 uv165 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fef6c00a4a0 con 0x7fef6404a500 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 20 remove_watcher() i=7 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fef6404a500 msgr2=0x7fef6403b6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fef6404a500 0x7fef6403b6b0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1faf2e0 msgr2=0x5599d1fb17a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1faf2e0 0x5599d1fb17a0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1fb3820 msgr2=0x5599d1fb5c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1fb3820 0x5599d1fb5c10 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.586+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5599d1fb8170 msgr2=0x5599d1fba630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5599d1fb8170 0x5599d1fba630 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee3c036790 msgr2=0x7fee3c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee3c036790 0x7fee3c038c50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x5599d1f81e20 tx=0x7fef6804f000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 msgr2=0x5599d1fa3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1fa3ae0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fef6400d7b0 tx=0x7fef6404eea0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef726da640 1 -- 172.21.15.177:0/3695927336 reap_dead start 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 shutdown_connections 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3695927336 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f9cb40 0x5599d1fa3ae0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 >> 172.21.15.177:0/3695927336 conn(0x5599d1f98e60 msgr2=0x5599d1f964c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 shutdown_connections 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3695927336 wait complete. 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee4c036790 msgr2=0x7fee4c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee4c036790 0x7fee4c038c50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x5599d1f75d90 tx=0x7fef68005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 msgr2=0x5599d1f90030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 0x5599d1f90030 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fef6404a190 tx=0x7fef64019e70 comp rx=0 tx=0).stop 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 shutdown_connections 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee4c036790 0x7fee4c038c50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/3727819678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1f8fc10 0x5599d1f90030 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 >> 172.21.15.177:0/3727819678 conn(0x5599d1f83cb0 msgr2=0x5599d1f840b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 shutdown_connections 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/3727819678 wait complete. 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5599d1f7ef30 msgr2=0x5599d1f81320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5599d1f7ef30 0x5599d1f81320 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1f76460 msgr2=0x5599d1f78850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5599d1f76460 0x5599d1f78850 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1f7b030 msgr2=0x5599d1f7d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.587+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5599d1f7b030 0x5599d1f7d420 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee58036790 msgr2=0x7fee58038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fee58036790 0x7fee58038c50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef68054000 tx=0x7fef6804e000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 msgr2=0x5599d1f71650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 --2- 172.21.15.177:0/1067897501 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5599d1e77f60 0x5599d1f71650 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x5599d1f6ab00 tx=0x7fef64000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef726da640 1 -- 172.21.15.177:0/1067897501 reap_dead start 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 shutdown_connections 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 >> 172.21.15.177:0/1067897501 conn(0x5599d1e72040 msgr2=0x5599d1f63f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 shutdown_connections 2024-03-20T13:35:34.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.588+0000 7fef743da800 1 -- 172.21.15.177:0/1067897501 wait complete. 2024-03-20T13:35:34.597 INFO:teuthology.orchestra.run.smithi177.stdout:[] 2024-03-20T13:35:34.597 DEBUG:tasks.util.rgw: json result: [] 2024-03-20T13:35:34.597 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-03-20T13:35:34.597 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-03-20T13:35:34.597 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-03-20T13:35:34.679 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:34.680 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.679+0000 7f60eb824800 1 Processor -- start 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.679+0000 7f60eb824800 1 -- start start 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.679+0000 7f60eb824800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5644f6210080 0x5644f6212470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.679+0000 7f60eb824800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5644f6156cd0 con 0x5644f620c570 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.679+0000 7f60eb824800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5644f610d500 con 0x5644f6210080 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.679+0000 7f60e8b22640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5644f6210080 0x5644f6212470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.680+0000 7f60e9323640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5644f620c570 0x5644f620e960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46318/0 (socket says 172.21.15.177:46318) 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.680+0000 7f60e8b22640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5644f6210080 0x5644f6212470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33108/0 (socket says 172.21.15.177:33108) 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.680+0000 7f60e9323640 1 -- 172.21.15.177:0/3838417399 learned_addr learned my addr 172.21.15.177:0/3838417399 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:34.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.680+0000 7f60e8b22640 1 -- 172.21.15.177:0/3838417399 >> v1:172.21.15.28:6789/0 conn(0x5644f620c570 legacy=0x5644f620e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.682 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.680+0000 7f60e8b22640 1 -- 172.21.15.177:0/3838417399 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f62139c0 con 0x5644f6210080 2024-03-20T13:35:34.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60e8b22640 1 --2- 172.21.15.177:0/3838417399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f6210080 0x5644f6212470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60e000a470 tx=0x7f60e001cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ac1079102b6854 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60dbfff640 1 -- 172.21.15.177:0/3838417399 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e0052570 con 0x5644f6210080 2024-03-20T13:35:34.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60dbfff640 1 -- 172.21.15.177:0/3838417399 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e00526d0 con 0x5644f6210080 2024-03-20T13:35:34.683 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60dbfff640 1 -- 172.21.15.177:0/3838417399 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60e0052990 con 0x5644f6210080 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 -- 172.21.15.177:0/3838417399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f6210080 msgr2=0x5644f6212470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 --2- 172.21.15.177:0/3838417399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f6210080 0x5644f6212470 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f60e000a470 tx=0x7f60e001cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 -- 172.21.15.177:0/3838417399 shutdown_connections 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 --2- 172.21.15.177:0/3838417399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f6210080 0x5644f6212470 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 -- 172.21.15.177:0/3838417399 >> 172.21.15.177:0/3838417399 conn(0x5644f6206040 msgr2=0x5644f6208460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 -- 172.21.15.177:0/3838417399 shutdown_connections 2024-03-20T13:35:34.684 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.682+0000 7f60eb824800 1 -- 172.21.15.177:0/3838417399 wait complete. 2024-03-20T13:35:34.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60eb824800 1 Processor -- start 2024-03-20T13:35:34.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60eb824800 1 -- start start 2024-03-20T13:35:34.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60eb824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f62fba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60eb824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f610aa30 con 0x5644f620c570 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f62fba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f62fba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33124/0 (socket says 172.21.15.177:33124) 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.694+0000 7f60e9323640 1 -- 172.21.15.177:0/3104346178 learned_addr learned my addr 172.21.15.177:0/3104346178 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.695+0000 7f60e9323640 1 -- 172.21.15.177:0/3104346178 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e0005d20 con 0x5644f620c570 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.695+0000 7f60e9323640 1 --2- 172.21.15.177:0/3104346178 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f62fba40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60dc001c50 tx=0x7f60dc00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba231faa475e32e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.695+0000 7f5fd7606640 1 -- 172.21.15.177:0/3104346178 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc00e470 con 0x5644f620c570 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.695+0000 7f5fd7606640 1 -- 172.21.15.177:0/3104346178 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc00e5d0 con 0x5644f620c570 2024-03-20T13:35:34.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.695+0000 7f5fd7606640 1 -- 172.21.15.177:0/3104346178 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc00e8d0 con 0x5644f620c570 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- 172.21.15.177:0/3104346178 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 msgr2=0x5644f62fba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 --2- 172.21.15.177:0/3104346178 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f62fba40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f60dc001c50 tx=0x7f60dc00b6c0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- 172.21.15.177:0/3104346178 shutdown_connections 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 --2- 172.21.15.177:0/3104346178 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f62fba40 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- 172.21.15.177:0/3104346178 >> 172.21.15.177:0/3104346178 conn(0x5644f6206040 msgr2=0x5644f62f7360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- 172.21.15.177:0/3104346178 shutdown_connections 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- 172.21.15.177:0/3104346178 wait complete. 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 Processor -- start 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- start start 2024-03-20T13:35:34.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f63030f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.696+0000 7f60eb824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f6106210 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f63030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f63030f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33138/0 (socket says 172.21.15.177:33138) 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60e9323640 1 -- 172.21.15.177:0/3695715059 learned_addr learned my addr 172.21.15.177:0/3695715059 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60e9323640 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f6156cd0 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60e9323640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f63030f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60dc001c50 tx=0x7f60dc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f5fd5e03640 1 -- 172.21.15.177:0/3695715059 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc01f070 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f5fd5e03640 1 -- 172.21.15.177:0/3695715059 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc018850 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5644f6303630 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f5fd5e03640 1 -- 172.21.15.177:0/3695715059 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc018b30 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.697+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644f6303b10 con 0x5644f620c570 2024-03-20T13:35:34.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.698+0000 7f5fd5e03640 1 -- 172.21.15.177:0/3695715059 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60dc018c90 con 0x5644f620c570 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.698+0000 7f5fd5e03640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fd00367e0 0x7f5fd0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.698+0000 7f5fd5e03640 1 -- 172.21.15.177:0/3695715059 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f60dc04c3a0 con 0x5644f620c570 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.698+0000 7f60e8b22640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fd00367e0 0x7f5fd0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.698+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f6210080 0x5644f6309dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.698+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f630a380 con 0x5644f6210080 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60e9b24640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f6210080 0x5644f6309dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60e8b22640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fd00367e0 0x7f5fd0038ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f60e0054000 tx=0x7f60e004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60e9b24640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f6210080 0x5644f6309dd0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60e9b24640 1 -- 172.21.15.177:0/3695715059 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f6210080 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63074a0 con 0x5644f6210080 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60e9b24640 1 -- 172.21.15.177:0/3695715059 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f6210080 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f630c5f0 0x5644f630e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f630f0b0 con 0x5644f630c5f0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.699+0000 7f60e9323640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f630c5f0 0x5644f630e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.700+0000 7f60e9323640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f630c5f0 0x5644f630e9e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.700+0000 7f60e9323640 1 -- 172.21.15.177:0/3695715059 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f60dc014070 con 0x5644f630c5f0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.700+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f630b570 con 0x5644f6210080 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.700+0000 7f60e9b24640 1 -- 172.21.15.177:0/3695715059 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f6210080 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.700+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5644f63104d0 0x5644f63128c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.700+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6313020 con 0x5644f63104d0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.701+0000 7f60e8b22640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5644f63104d0 0x5644f63128c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.701+0000 7f60e8b22640 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5644f63104d0 0x5644f63128c0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.701+0000 7f60e8b22640 1 -- 172.21.15.177:0/3695715059 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f60e0059040 con 0x5644f63104d0 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60eb824800 1 Processor -- start 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60eb824800 1 -- start start 2024-03-20T13:35:34.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60eb824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 0x5644f63215c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60eb824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f60a8c70 con 0x5644f63211a0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 0x5644f63215c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 0x5644f63215c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33152/0 (socket says 172.21.15.177:33152) 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60e9323640 1 -- 172.21.15.177:0/1733118264 learned_addr learned my addr 172.21.15.177:0/1733118264 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60e9323640 1 -- 172.21.15.177:0/1733118264 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f6321b00 con 0x5644f63211a0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.702+0000 7f60e9323640 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 0x5644f63215c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f60dc02efd0 tx=0x7f60dc0165e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.703+0000 7f5fceffd640 1 -- 172.21.15.177:0/1733118264 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc049040 con 0x5644f63211a0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.703+0000 7f5fceffd640 1 -- 172.21.15.177:0/1733118264 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc022db0 con 0x5644f63211a0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.703+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5644f6322570 con 0x5644f63211a0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.703+0000 7f5fceffd640 1 -- 172.21.15.177:0/1733118264 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc02d570 con 0x5644f63211a0 2024-03-20T13:35:34.708 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.703+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644f6322a30 con 0x5644f63211a0 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.703+0000 7f5fceffd640 1 -- 172.21.15.177:0/1733118264 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60dc02d6d0 con 0x5644f63211a0 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f5fceffd640 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fc00367e0 0x7f5fc0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f5fceffd640 1 -- 172.21.15.177:0/1733118264 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f60dc032070 con 0x5644f63211a0 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60e8b22640 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fc00367e0 0x7f5fc0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60eb824800 1 Processor -- start 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60eb824800 1 -- start start 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60e8b22640 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fc00367e0 0x7f5fc0038ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5644f63073f0 tx=0x7f60e0005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60eb824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f632e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60eb824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f607e5d0 con 0x5644f632e260 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f632e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f632e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33154/0 (socket says 172.21.15.177:33154) 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60e9323640 1 -- 172.21.15.177:0/1537090276 learned_addr learned my addr 172.21.15.177:0/1537090276 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.704+0000 7f60e9323640 1 -- 172.21.15.177:0/1537090276 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f632ec50 con 0x5644f632e260 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60e9323640 1 --2- 172.21.15.177:0/1537090276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f632e680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f60dc038ff0 tx=0x7f60dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4b310845d44a2e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f5fccff9640 1 -- 172.21.15.177:0/1537090276 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc043f90 con 0x5644f632e260 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f5fccff9640 1 -- 172.21.15.177:0/1537090276 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc0440f0 con 0x5644f632e260 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f5fccff9640 1 -- 172.21.15.177:0/1537090276 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc0124e0 con 0x5644f632e260 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 -- 172.21.15.177:0/1537090276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 msgr2=0x5644f632e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 --2- 172.21.15.177:0/1537090276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f632e680 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f60dc038ff0 tx=0x7f60dc00dab0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 -- 172.21.15.177:0/1537090276 shutdown_connections 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 --2- 172.21.15.177:0/1537090276 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f632e680 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 -- 172.21.15.177:0/1537090276 >> 172.21.15.177:0/1537090276 conn(0x5644f632a530 msgr2=0x5644f6328590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 -- 172.21.15.177:0/1537090276 shutdown_connections 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.705+0000 7f60eb824800 1 -- 172.21.15.177:0/1537090276 wait complete. 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60eb824800 1 Processor -- start 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60eb824800 1 -- start start 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60eb824800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f63351e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60eb824800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5644f6335720 con 0x5644f632e260 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f63351e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60e9323640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f63351e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33156/0 (socket says 172.21.15.177:33156) 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 learned_addr learned my addr 172.21.15.177:0/1720188722 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5644f6322570 con 0x5644f632e260 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.706+0000 7f60e9323640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f63351e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f60dc04dc10 tx=0x7f60dc016e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f5fbeffd640 1 -- 172.21.15.177:0/1720188722 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc016c90 con 0x5644f632e260 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f5fbeffd640 1 -- 172.21.15.177:0/1720188722 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60dc064040 con 0x5644f632e260 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5644f6322570 con 0x5644f632e260 2024-03-20T13:35:34.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f5fbeffd640 1 -- 172.21.15.177:0/1720188722 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f60dc042d40 con 0x5644f632e260 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5644f6322570 con 0x5644f632e260 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f5fbeffd640 1 -- 172.21.15.177:0/1720188722 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f60dc012780 con 0x5644f632e260 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.707+0000 7f5fbeffd640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fb4036790 0x7f5fb4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f5fbeffd640 1 -- 172.21.15.177:0/1720188722 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f60dc077a90 con 0x5644f632e260 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60e8b22640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fb4036790 0x7f5fb4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f63409d0 0x5644f6342e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63435e0 con 0x5644f63409d0 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60e8b22640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fb4036790 0x7f5fb4038c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60e0055040 tx=0x7f60e004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60e9b24640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f63409d0 0x5644f6342e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.708+0000 7f60e9b24640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f63409d0 0x5644f6342e90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 realm 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63439b0 con 0x5644f63409d0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344590 con 0x5644f63409d0 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f6344f40 0x5644f6347330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6347940 con 0x5644f6344f40 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.709+0000 7f60e9323640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f6344f40 0x5644f6347330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60e9323640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f6344f40 0x5644f6347330 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60eb824800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60eb824800 20 searching for the correct realm 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5644f6349bf0 0x5644f634c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634c730 con 0x5644f6349bf0 2024-03-20T13:35:34.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60e8b22640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5644f6349bf0 0x5644f634c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.710+0000 7f60e8b22640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5644f6349bf0 0x5644f634c0b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.711+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.711+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634c730 con 0x5644f6344f40 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.711+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.711+0000 7f60e9323640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f60dc0446f0 0x7f60dc05a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.711+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634c730 con 0x7f60dc0446f0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.711+0000 7f60e9b24640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f60dc0446f0 0x7f60dc05a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f60dc0446f0 0x7f60dc05a210 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.712+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6344f40 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.713+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6344f40 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.714+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.715+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.716+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6344f40 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.717+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6344f40 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6344f40 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6349bf0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.718+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x7f60dc0446f0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f63409d0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6344230 con 0x5644f6344f40 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.719+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6348030 con 0x5644f63409d0 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6348030 con 0x5644f63409d0 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63483e0 con 0x7f60dc0446f0 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 zone default found 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 4 Realm: () 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 zonegroup default 2024-03-20T13:35:34.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63487d0 con 0x7f60dc0446f0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.720+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6348bd0 con 0x5644f6349bf0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634e550 con 0x5644f6349bf0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 20 started sync module instance, tier type = 2024-03-20T13:35:34.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.721+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634d9e0 con 0x5644f6344f40 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.722+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.722+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94854188424512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634e160 con 0x5644f6344f40 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.722+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634f230 con 0x5644f63409d0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.723+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94854188424512] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.723+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.723+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94854188427440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634f5e0 con 0x5644f63409d0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.723+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634fff0 con 0x5644f6349bf0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.724+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94854188427440] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.725+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.725+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94854188428496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63503d0 con 0x5644f6349bf0 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.725+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6350db0 con 0x5644f6344f40 2024-03-20T13:35:34.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.726+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94854188428496] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.726+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.726+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94854188432144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6351630 con 0x5644f6344f40 2024-03-20T13:35:34.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.726+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6351fa0 con 0x5644f63409d0 2024-03-20T13:35:34.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.727+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.727+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94854188432144] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.727+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94854188440800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6351290 con 0x5644f63409d0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.727+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6352cf0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.728+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94854188440800] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.728+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.728+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94854188442048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6352cf0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.728+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63536f0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.729+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94854188442048] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.729+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.729+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94854188446192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63538d0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.729+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6354110 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94854188446192] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'168 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94854188443728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6353d70 con 0x7f60dc0446f0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=0 2024-03-20T13:35:34.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=1 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=2 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=3 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=4 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=5 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.730+0000 7f60eb824800 20 add_watcher() i=6 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.731+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94854188443728] v32'169 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.731+0000 7f60eb824800 20 add_watcher() i=7 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.731+0000 7f60eb824800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.731+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6357520 con 0x5644f63409d0 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.731+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.731+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94854188448416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6354a30 con 0x5644f63409d0 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.732+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94854188448416] v32'173 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.732+0000 7f5f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.733+0000 7f60eb824800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.733+0000 7f60eb824800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.733+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f635fec0 con 0x5644f63409d0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.734+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.734+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f635ff80 con 0x7f60dc0446f0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.735+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.735+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6360400 con 0x5644f6349bf0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.736+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.736+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6360dd0 con 0x5644f63409d0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.737+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'174 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.737+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6361300 con 0x5644f6344f40 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.738+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'60 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.738+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63617a0 con 0x5644f6349bf0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.738+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'39 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.738+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6362170 con 0x5644f63409d0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.740+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.740+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6362170 con 0x7f60dc0446f0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.741+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'41 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.741+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6362170 con 0x5644f6344f40 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.741+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.742+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63626f0 con 0x5644f6349bf0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.742+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.742+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6362c20 con 0x5644f6344f40 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.743+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'61 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.743+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363150 con 0x7f60dc0446f0 2024-03-20T13:35:34.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.744+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'27 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.745+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363150 con 0x5644f6344f40 2024-03-20T13:35:34.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.745+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.745+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363290 con 0x7f60dc0446f0 2024-03-20T13:35:34.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.746+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'45 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.746+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63630c0 con 0x5644f63409d0 2024-03-20T13:35:34.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.747+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'175 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.747+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63630c0 con 0x5644f6349bf0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.748+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'53 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.748+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363110 con 0x5644f6344f40 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.749+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'62 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.749+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363110 con 0x5644f6349bf0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.750+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.750+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63631f0 con 0x5644f63409d0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.751+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'31 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.752+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63631f0 con 0x5644f63409d0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.752+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'176 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.752+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63631f0 con 0x5644f6349bf0 2024-03-20T13:35:34.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.754+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'54 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.754+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f63631f0 con 0x5644f6344f40 2024-03-20T13:35:34.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.755+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'33 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.755+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6349bf0 2024-03-20T13:35:34.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.756+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.756+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6349bf0 2024-03-20T13:35:34.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.756+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.756+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6349bf0 2024-03-20T13:35:34.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.757+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'19 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.757+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6349bf0 2024-03-20T13:35:34.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.758+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'40 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.758+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x7f60dc0446f0 2024-03-20T13:35:34.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.759+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'25 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.759+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6349bf0 2024-03-20T13:35:34.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.760+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'23 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.760+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x7f60dc0446f0 2024-03-20T13:35:34.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.761+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'42 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.761+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6349bf0 2024-03-20T13:35:34.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.762+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'55 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.762+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x7f60dc0446f0 2024-03-20T13:35:34.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.763+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'46 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.763+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6363710 con 0x5644f6344f40 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.764+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'29 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.764+0000 7f5f9e7e4640 20 reqs_thread_entry: start 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.764+0000 7f60eb824800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 20 Filter name: none 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f5f0ffff640 20 reqs_thread_entry: start 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f635e440 con 0x5644f63409d0 2024-03-20T13:35:34.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:34.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.765+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f635e440 con 0x5644f6344f40 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.766+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.766+0000 7f5f9f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.766+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94854188448416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f635ed50 con 0x5644f63409d0 2024-03-20T13:35:34.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.767+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94854188448416] v32'177 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.767+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94854188424512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f6353a70 con 0x5644f6344f40 2024-03-20T13:35:34.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.768+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94854188424512] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.769 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.768+0000 7f60eb824800 20 remove_watcher() i=0 2024-03-20T13:35:34.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.768+0000 7f60eb824800 2 removed watcher, disabling cache 2024-03-20T13:35:34.770 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.768+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94854188427440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634dd40 con 0x5644f63409d0 2024-03-20T13:35:34.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.770+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94854188427440] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.770+0000 7f60eb824800 20 remove_watcher() i=1 2024-03-20T13:35:34.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.770+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94854188428496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634dd40 con 0x5644f6349bf0 2024-03-20T13:35:34.771 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.770+0000 7f60e8b22640 1 -- 172.21.15.177:0/1720188722 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94854188428496] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e0059040 con 0x5644f6349bf0 2024-03-20T13:35:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.771+0000 7f60eb824800 20 remove_watcher() i=2 2024-03-20T13:35:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.771+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94854188432144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634ed50 con 0x5644f6344f40 2024-03-20T13:35:34.772 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.771+0000 7f60e9323640 1 -- 172.21.15.177:0/1720188722 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94854188432144] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60dc06e020 con 0x5644f6344f40 2024-03-20T13:35:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.771+0000 7f60eb824800 20 remove_watcher() i=3 2024-03-20T13:35:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.771+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94854188440800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634ed50 con 0x5644f63409d0 2024-03-20T13:35:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.772+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94854188440800] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x5644f63409d0 2024-03-20T13:35:34.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.772+0000 7f60eb824800 20 remove_watcher() i=4 2024-03-20T13:35:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.772+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94854188442048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634ed50 con 0x7f60dc0446f0 2024-03-20T13:35:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.773+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94854188442048] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.773+0000 7f60eb824800 20 remove_watcher() i=5 2024-03-20T13:35:34.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.773+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94854188446192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634ed50 con 0x7f60dc0446f0 2024-03-20T13:35:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.774+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94854188446192] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.775+0000 7f60eb824800 20 remove_watcher() i=6 2024-03-20T13:35:34.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.775+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94854188443728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5644f634ed50 con 0x7f60dc0446f0 2024-03-20T13:35:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.775+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94854188443728] v32'170 uv168 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f60e400a4a0 con 0x7f60dc0446f0 2024-03-20T13:35:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.775+0000 7f60eb824800 20 remove_watcher() i=7 2024-03-20T13:35:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f60dc0446f0 msgr2=0x7f60dc05a210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f60dc0446f0 0x7f60dc05a210 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f63409d0 msgr2=0x5644f6342e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.779 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f63409d0 0x5644f6342e90 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f6344f40 msgr2=0x5644f6347330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f6344f40 0x5644f6347330 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5644f6349bf0 msgr2=0x5644f634c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5644f6349bf0 0x5644f634c0b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fb4036790 msgr2=0x7f5fb4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fb4036790 0x7f5fb4038c50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f60e0055040 tx=0x7f60e004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 msgr2=0x5644f63351e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60e9b24640 1 -- 172.21.15.177:0/1720188722 reap_dead start 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f63351e0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f60dc04dc10 tx=0x7f60dc016e70 comp rx=0 tx=0).stop 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 shutdown_connections 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1720188722 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f632e260 0x5644f63351e0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 >> 172.21.15.177:0/1720188722 conn(0x5644f632a530 msgr2=0x5644f6327b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 shutdown_connections 2024-03-20T13:35:34.780 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1720188722 wait complete. 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fc00367e0 msgr2=0x7f5fc0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fc00367e0 0x7f5fc0038ca0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x5644f63073f0 tx=0x7f60e0005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 msgr2=0x5644f63215c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 0x5644f63215c0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f60dc02efd0 tx=0x7f60dc0165e0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 shutdown_connections 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fc00367e0 0x7f5fc0038ca0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 --2- 172.21.15.177:0/1733118264 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f63211a0 0x5644f63215c0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 >> 172.21.15.177:0/1733118264 conn(0x5644f6315240 msgr2=0x5644f6315640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 shutdown_connections 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.776+0000 7f60eb824800 1 -- 172.21.15.177:0/1733118264 wait complete. 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5644f63104d0 msgr2=0x5644f63128c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5644f63104d0 0x5644f63128c0 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f6210080 msgr2=0x5644f6309dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5644f6210080 0x5644f6309dd0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.781 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f630c5f0 msgr2=0x5644f630e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5644f630c5f0 0x5644f630e9e0 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fd00367e0 msgr2=0x7f5fd0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5fd00367e0 0x7f5fd0038ca0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f60e0054000 tx=0x7f60e004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 msgr2=0x5644f63030f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 --2- 172.21.15.177:0/3695715059 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5644f620c570 0x5644f63030f0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f60dc001c50 tx=0x7f60dc000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60e9b24640 1 -- 172.21.15.177:0/3695715059 reap_dead start 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 shutdown_connections 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 >> 172.21.15.177:0/3695715059 conn(0x5644f6206040 msgr2=0x5644f62f5bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 shutdown_connections 2024-03-20T13:35:34.782 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.777+0000 7f60eb824800 1 -- 172.21.15.177:0/3695715059 wait complete. 2024-03-20T13:35:34.785 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:35:34.794 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-03-20T13:35:34.799 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:34.829 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:34.839 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:34.883 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-03-20T13:35:34.889 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:34.889 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:35:34.889 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:35:34.889 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:35:34.935 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:34.935 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:34.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.934+0000 7f9fa0b42800 1 Processor -- start 2024-03-20T13:35:34.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.934+0000 7f9fa0b42800 1 -- start start 2024-03-20T13:35:34.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.934+0000 7f9fa0b42800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564a24e8ce00 0x564a24e8f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.936 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.934+0000 7f9fa0b42800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564a24dd3cd0 con 0x564a24dfbea0 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.934+0000 7f9fa0b42800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x564a24d8a500 con 0x564a24e8ce00 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.935+0000 7f9f9c043640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564a24e8ce00 0x564a24e8f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.935+0000 7f9f9c043640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564a24e8ce00 0x564a24e8f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33160/0 (socket says 172.21.15.177:33160) 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.935+0000 7f9f9c043640 1 -- 172.21.15.177:0/3960345852 learned_addr learned my addr 172.21.15.177:0/3960345852 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.935+0000 7f9f9c844640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x564a24dfbea0 0x564a24e8b680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46330/0 (socket says 172.21.15.177:46330) 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.935+0000 7f9f9c043640 1 -- 172.21.15.177:0/3960345852 >> v1:172.21.15.28:6789/0 conn(0x564a24dfbea0 legacy=0x564a24e8b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.935+0000 7f9f9c043640 1 -- 172.21.15.177:0/3960345852 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a24e90980 con 0x564a24e8ce00 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.937+0000 7f9f9c043640 1 --2- 172.21.15.177:0/3960345852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24e8ce00 0x564a24e8f2a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00a520 tx=0x7f9f8c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25aeb02548a283a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.937+0000 7f9f9b842640 1 -- 172.21.15.177:0/3960345852 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f8c052570 con 0x564a24e8ce00 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.937+0000 7f9f9b842640 1 -- 172.21.15.177:0/3960345852 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c0526d0 con 0x564a24e8ce00 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.937+0000 7f9f9b842640 1 -- 172.21.15.177:0/3960345852 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f8c052990 con 0x564a24e8ce00 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.937+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3960345852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24e8ce00 msgr2=0x564a24e8f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.937+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/3960345852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24e8ce00 0x564a24e8f2a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c00a520 tx=0x7f9f8c01cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.938+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3960345852 shutdown_connections 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.938+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/3960345852 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24e8ce00 0x564a24e8f2a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.938+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3960345852 >> 172.21.15.177:0/3960345852 conn(0x564a24e83040 msgr2=0x564a24e85460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.938+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3960345852 shutdown_connections 2024-03-20T13:35:34.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.938+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3960345852 wait complete. 2024-03-20T13:35:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.949+0000 7f9fa0b42800 1 Processor -- start 2024-03-20T13:35:34.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.949+0000 7f9fa0b42800 1 -- start start 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.949+0000 7f9fa0b42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24e88fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.949+0000 7f9fa0b42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a24d87a30 con 0x564a24dfbea0 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24e88fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24e88fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33172/0 (socket says 172.21.15.177:33172) 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9f9c844640 1 -- 172.21.15.177:0/2512864131 learned_addr learned my addr 172.21.15.177:0/2512864131 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9f9c844640 1 -- 172.21.15.177:0/2512864131 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f8c005de0 con 0x564a24dfbea0 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9f9c844640 1 --2- 172.21.15.177:0/2512864131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24e88fb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9f90001c80 tx=0x7f9f9000b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bcc0677b04b0deb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9e8ae0d640 1 -- 172.21.15.177:0/2512864131 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f90014070 con 0x564a24dfbea0 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9e8ae0d640 1 -- 172.21.15.177:0/2512864131 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9000f450 con 0x564a24dfbea0 2024-03-20T13:35:34.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.950+0000 7f9e8ae0d640 1 -- 172.21.15.177:0/2512864131 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f9000f790 con 0x564a24dfbea0 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- 172.21.15.177:0/2512864131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 msgr2=0x564a24e88fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/2512864131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24e88fb0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f9f90001c80 tx=0x7f9f9000b600 comp rx=0 tx=0).stop 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- 172.21.15.177:0/2512864131 shutdown_connections 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/2512864131 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24e88fb0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- 172.21.15.177:0/2512864131 >> 172.21.15.177:0/2512864131 conn(0x564a24e83040 msgr2=0x564a24f74380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- 172.21.15.177:0/2512864131 shutdown_connections 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- 172.21.15.177:0/2512864131 wait complete. 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 Processor -- start 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- start start 2024-03-20T13:35:34.961 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24f82320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.951+0000 7f9fa0b42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a24d83210 con 0x564a24dfbea0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24f82320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24f82320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33186/0 (socket says 172.21.15.177:33186) 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9f9c844640 1 -- 172.21.15.177:0/671584449 learned_addr learned my addr 172.21.15.177:0/671584449 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9f9c844640 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a24dd3cd0 con 0x564a24dfbea0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9f9c844640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24f82320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9f90004000 tx=0x7f9f90000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9e8960a640 1 -- 172.21.15.177:0/671584449 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f90014050 con 0x564a24dfbea0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9e8960a640 1 -- 172.21.15.177:0/671584449 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9001b850 con 0x564a24dfbea0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a24f82860 con 0x564a24dfbea0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9e8960a640 1 -- 172.21.15.177:0/671584449 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f9001bb10 con 0x564a24dfbea0 2024-03-20T13:35:34.962 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.952+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a24f82d40 con 0x564a24dfbea0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.953+0000 7f9e8960a640 1 -- 172.21.15.177:0/671584449 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9f90022020 con 0x564a24dfbea0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.953+0000 7f9e8960a640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e84036790 0x7f9e84038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.953+0000 7f9e8960a640 1 -- 172.21.15.177:0/671584449 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9f90008030 con 0x564a24dfbea0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.953+0000 7f9f9c043640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e84036790 0x7f9e84038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24e8ce00 0x564a24f89070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24f89640 con 0x564a24e8ce00 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9f9d045640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24e8ce00 0x564a24f89070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9f9c043640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e84036790 0x7f9e84038c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c054000 tx=0x7f9f8c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9f9d045640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24e8ce00 0x564a24f89070 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9f9d045640 1 -- 172.21.15.177:0/671584449 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24e8ce00 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24f86720 con 0x564a24e8ce00 2024-03-20T13:35:34.963 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.954+0000 7f9f9d045640 1 -- 172.21.15.177:0/671584449 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24e8ce00 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24f8b8b0 0x564a24f8dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24f8e390 con 0x564a24f8b8b0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9f9c844640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24f8b8b0 0x564a24f8dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9f9c844640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24f8b8b0 0x564a24f8dca0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9f9c844640 1 -- 172.21.15.177:0/671584449 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9f90016070 con 0x564a24f8b8b0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24f8a830 con 0x564a24e8ce00 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9f9d045640 1 -- 172.21.15.177:0/671584449 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24e8ce00 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a24f8f7b0 0x564a24f91ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.955+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24f92300 con 0x564a24f8f7b0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.956+0000 7f9f9c043640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a24f8f7b0 0x564a24f91ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.956+0000 7f9f9c043640 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a24f8f7b0 0x564a24f91ba0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.956+0000 7f9f9c043640 1 -- 172.21.15.177:0/671584449 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24f8f7b0 2024-03-20T13:35:34.964 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9fa0b42800 1 Processor -- start 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9fa0b42800 1 -- start start 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9fa0b42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 0x564a24fa08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9fa0b42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a24d25c70 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 0x564a24fa08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 0x564a24fa08d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33192/0 (socket says 172.21.15.177:33192) 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9f9c844640 1 -- 172.21.15.177:0/359426414 learned_addr learned my addr 172.21.15.177:0/359426414 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9f9c844640 1 -- 172.21.15.177:0/359426414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a24fa0e10 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9f9c844640 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 0x564a24fa08d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f9004a5b0 tx=0x7f9f90018ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.957+0000 7f9e827fc640 1 -- 172.21.15.177:0/359426414 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f90043e20 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9e827fc640 1 -- 172.21.15.177:0/359426414 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90043f80 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a24fa1880 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9e827fc640 1 -- 172.21.15.177:0/359426414 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f9004a710 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a24fa1d40 con 0x564a24fa04b0 2024-03-20T13:35:34.965 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9e827fc640 1 -- 172.21.15.177:0/359426414 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9f9004a870 con 0x564a24fa04b0 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9e827fc640 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e74036790 0x7f9e74038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.958+0000 7f9e827fc640 1 -- 172.21.15.177:0/359426414 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9f90039d60 con 0x564a24fa04b0 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9f9c043640 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e74036790 0x7f9e74038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9fa0b42800 1 Processor -- start 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9fa0b42800 1 -- start start 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9f9c043640 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e74036790 0x7f9e74038c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x564a24f86640 tx=0x7f9f8c005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9fa0b42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fadb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9fa0b42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a24cfb5d0 con 0x564a24fad710 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fadb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fadb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33208/0 (socket says 172.21.15.177:33208) 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9f9c844640 1 -- 172.21.15.177:0/3292105777 learned_addr learned my addr 172.21.15.177:0/3292105777 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.959+0000 7f9f9c844640 1 -- 172.21.15.177:0/3292105777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a24fae100 con 0x564a24fad710 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9f9c844640 1 --2- 172.21.15.177:0/3292105777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fadb30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9f900186a0 tx=0x7f9f9003e380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac25e311a6285554 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.966 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9e73fff640 1 -- 172.21.15.177:0/3292105777 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f90057070 con 0x564a24fad710 2024-03-20T13:35:34.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9e73fff640 1 -- 172.21.15.177:0/3292105777 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f9002fd50 con 0x564a24fad710 2024-03-20T13:35:34.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9e73fff640 1 -- 172.21.15.177:0/3292105777 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f9004ab20 con 0x564a24fad710 2024-03-20T13:35:34.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3292105777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 msgr2=0x564a24fadb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:34.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/3292105777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fadb30 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9f900186a0 tx=0x7f9f9003e380 comp rx=0 tx=0).stop 2024-03-20T13:35:34.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3292105777 shutdown_connections 2024-03-20T13:35:34.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/3292105777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fadb30 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:34.982 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3292105777 >> 172.21.15.177:0/3292105777 conn(0x564a24fa9a30 msgr2=0x564a24fa7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3292105777 shutdown_connections 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 -- 172.21.15.177:0/3292105777 wait complete. 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.960+0000 7f9fa0b42800 1 Processor -- start 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9fa0b42800 1 -- start start 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9fa0b42800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fb46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9fa0b42800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a24fb4c00 con 0x564a24fad710 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fb46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9f9c844640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fb46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33212/0 (socket says 172.21.15.177:33212) 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 learned_addr learned my addr 172.21.15.177:0/660982410 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a24fa1d40 con 0x564a24fad710 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9f9c844640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fb46c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9f900247a0 tx=0x7f9f90030f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.983 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9e727fc640 1 -- 172.21.15.177:0/660982410 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f900248c0 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9e727fc640 1 -- 172.21.15.177:0/660982410 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f90032520 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9e727fc640 1 -- 172.21.15.177:0/660982410 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9f900328a0 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.961+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a24fa1d40 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.962+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a24fa1d40 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.962+0000 7f9e727fc640 1 -- 172.21.15.177:0/660982410 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9f90032a00 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.962+0000 7f9e727fc640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e68036790 0x7f9e68038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9e727fc640 1 -- 172.21.15.177:0/660982410 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9f90073db0 con 0x564a24fad710 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9f9c043640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e68036790 0x7f9e68038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9f9c043640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e68036790 0x7f9e68038c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c055040 tx=0x7f9f8c04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24fbff20 0x564a24fc23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc2b30 con 0x564a24fbff20 2024-03-20T13:35:34.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9f9d045640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24fbff20 0x564a24fc23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.963+0000 7f9f9d045640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24fbff20 0x564a24fc23e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 realm 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc2f00 con 0x564a24fbff20 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3ae0 con 0x564a24fbff20 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24fc4490 0x564a24fc6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc6e40 con 0x564a24fc4490 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.964+0000 7f9f9c844640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24fc4490 0x564a24fc6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9f9c844640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24fc4490 0x564a24fc6880 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9fa0b42800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9fa0b42800 20 searching for the correct realm 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a24fc9150 0x564a24fcb610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcbce0 con 0x564a24fc9150 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9f9c043640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a24fc9150 0x564a24fcb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.965+0000 7f9f9c043640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a24fc9150 0x564a24fcb610 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcbce0 con 0x564a24fc4490 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9c844640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9f90072060 0x7f9f9000d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:34.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcbce0 con 0x7f9f90072060 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9d045640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9f90072060 0x7f9f9000d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.966+0000 7f9f9d045640 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9f90072060 0x7f9f9000d730 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.967+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc4490 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.968+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.969+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.969+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.969+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.969+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc4490 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.969+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.969+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.970+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.990 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.971+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.972+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.972+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc4490 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.972+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.972+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.972+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.972+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.973+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.973+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc4490 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.973+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.973+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.973+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.973+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc4490 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.974+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.974+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc9150 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.974+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.974+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x7f9f90072060 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.974+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.974+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fbff20 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc3780 con 0x564a24fc4490 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:34.992 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc7550 con 0x564a24fbff20 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc7550 con 0x564a24fbff20 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.975+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc7500 con 0x7f9f90072060 2024-03-20T13:35:34.993 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 20 zone default found 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 4 Realm: () 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 20 zonegroup default 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc7da0 con 0x7f9f90072060 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.976+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fc81a0 con 0x564a24fc9150 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcdb00 con 0x564a24fc9150 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 20 started sync module instance, tier type = 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.977+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fccf90 con 0x564a24fc4490 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.978+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.978+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94876448117616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fccc00 con 0x564a24fc4490 2024-03-20T13:35:34.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.978+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fce800 con 0x564a24fbff20 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.979+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94876448117616] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.979+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.979+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94876448120416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcebb0 con 0x564a24fbff20 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.979+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcf5e0 con 0x564a24fc9150 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.981+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94876448120416] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.981+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.981+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94876448125152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcf9c0 con 0x564a24fc9150 2024-03-20T13:35:34.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.981+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd03e0 con 0x564a24fc4490 2024-03-20T13:35:35.007 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.982+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94876448125152] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.982+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.982+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94876448128704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd0790 con 0x564a24fc4490 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.982+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd1170 con 0x564a24fbff20 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.983+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94876448128704] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.983+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.983+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94876448132240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd1170 con 0x564a24fbff20 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.983+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd1bf0 con 0x7f9f90072060 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.984+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94876448132240] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.984+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.984+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94876448134896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd1bb0 con 0x7f9f90072060 2024-03-20T13:35:35.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.984+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd25b0 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.985+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94876448134896] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.985+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.985+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94876448121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd25b0 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.985+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2f80 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'171 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94876448139904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd3420 con 0x7f9f90072060 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 20 add_watcher() i=0 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 20 add_watcher() i=1 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 20 add_watcher() i=2 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 20 add_watcher() i=3 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 20 add_watcher() i=4 2024-03-20T13:35:35.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9fa0b42800 20 add_watcher() i=5 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.986+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94876448121472] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.987+0000 7f9fa0b42800 20 add_watcher() i=6 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.987+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94876448139904] v32'172 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.987+0000 7f9fa0b42800 20 add_watcher() i=7 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.987+0000 7f9fa0b42800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.987+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2110 con 0x564a24fbff20 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.988+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.988+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94876448141120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2110 con 0x564a24fbff20 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94876448141120] v32'178 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9e52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:35.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 5 note: GC not initialized 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9e51fe3640 20 reqs_thread_entry: start 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 20 Filter name: none 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9dc37fe640 20 reqs_thread_entry: start 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.989+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a25008780 con 0x564a24fc4490 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:35.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 : miss 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:63 8.16 8:6a944445:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a2500a050 con 0x564a24fc9150 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(63 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 info.flags=0x17 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 to cache LRU end 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.990+0000 7f9fa0b42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.991+0000 7f9fa0b42800 20 get_obj_state: octx=0x7f9f90045f40 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564a2500c6b8 s->prefetch_data=0 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.991+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 3.28s0 3:17a6c442:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a2500d7f0 con 0x564a24fc9150 2024-03-20T13:35:35.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.991+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) v8 ==== 262+0+865 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.991+0000 7f9fa0b42800 10 manifest: total_size = 5 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.991+0000 7f9fa0b42800 20 get_obj_state: setting s->obj_tag to _lOqX4sRaiafCQMYy1LL0YBlnE-bDuCi 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.992+0000 7f9e52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.992+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94876448141120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24ff2360 con 0x564a24fbff20 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.993+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94876448141120] v32'179 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.993+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94876448117616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2f40 con 0x564a24fc4490 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.993+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94876448117616] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.994+0000 7f9fa0b42800 20 remove_watcher() i=0 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.994+0000 7f9fa0b42800 2 removed watcher, disabling cache 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.994+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94876448120416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2f40 con 0x564a24fbff20 2024-03-20T13:35:35.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.995+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94876448120416] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.995+0000 7f9fa0b42800 20 remove_watcher() i=1 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.995+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94876448125152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcde60 con 0x564a24fc9150 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.996+0000 7f9f9c043640 1 -- 172.21.15.177:0/660982410 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94876448125152] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f8c052ba0 con 0x564a24fc9150 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.996+0000 7f9fa0b42800 20 remove_watcher() i=2 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.996+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94876448128704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2f40 con 0x564a24fc4490 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.997+0000 7f9f9c844640 1 -- 172.21.15.177:0/660982410 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94876448128704] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f90016070 con 0x564a24fc4490 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.997+0000 7f9fa0b42800 20 remove_watcher() i=3 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.997+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94876448132240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcf0e0 con 0x564a24fbff20 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.998+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94876448132240] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x564a24fbff20 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.998+0000 7f9fa0b42800 20 remove_watcher() i=4 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.998+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94876448134896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fcde60 con 0x7f9f90072060 2024-03-20T13:35:35.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.999+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94876448134896] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.999+0000 7f9fa0b42800 20 remove_watcher() i=5 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:34.999+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94876448121472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd2f40 con 0x7f9f90072060 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.000+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94876448121472] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.001+0000 7f9fa0b42800 20 remove_watcher() i=6 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.001+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94876448139904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a24fd0c90 con 0x7f9f90072060 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.001+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94876448139904] v32'173 uv171 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9f9400a4a0 con 0x7f9f90072060 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 20 remove_watcher() i=7 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9f90072060 msgr2=0x7f9f9000d730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9f90072060 0x7f9f9000d730 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24fbff20 msgr2=0x564a24fc23e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24fbff20 0x564a24fc23e0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24fc4490 msgr2=0x564a24fc6880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24fc4490 0x564a24fc6880 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a24fc9150 msgr2=0x564a24fcb610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a24fc9150 0x564a24fcb610 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e68036790 msgr2=0x7f9e68038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e68036790 0x7f9e68038c50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c055040 tx=0x7f9f8c04f000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 msgr2=0x564a24fb46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/660982410 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fad710 0x564a24fb46c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9f900247a0 tx=0x7f9f90030f90 comp rx=0 tx=0).stop 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 reap_dead start 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9f9d045640 1 -- 172.21.15.177:0/660982410 reap_dead start 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 shutdown_connections 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 >> 172.21.15.177:0/660982410 conn(0x564a24fa9a30 msgr2=0x564a24fa7090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 shutdown_connections 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/660982410 wait complete. 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e74036790 msgr2=0x7f9e74038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e74036790 0x7f9e74038c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x564a24f86640 tx=0x7f9f8c005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 msgr2=0x564a24fa08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 0x564a24fa08d0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f9004a5b0 tx=0x7f9f90018ae0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 shutdown_connections 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e74036790 0x7f9e74038c50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/359426414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24fa04b0 0x564a24fa08d0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 >> 172.21.15.177:0/359426414 conn(0x564a24f94550 msgr2=0x564a24f94950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.017 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 shutdown_connections 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.002+0000 7f9fa0b42800 1 -- 172.21.15.177:0/359426414 wait complete. 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a24f8f7b0 msgr2=0x564a24f91ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a24f8f7b0 0x564a24f91ba0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24e8ce00 msgr2=0x564a24f89070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a24e8ce00 0x564a24f89070 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24f8b8b0 msgr2=0x564a24f8dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a24f8b8b0 0x564a24f8dca0 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e84036790 msgr2=0x7f9e84038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9e84036790 0x7f9e84038c50 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c054000 tx=0x7f9f8c04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 msgr2=0x564a24f82320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.018 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 --2- 172.21.15.177:0/671584449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a24dfbea0 0x564a24f82320 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f9f90004000 tx=0x7f9f90000bc0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9f9d045640 1 -- 172.21.15.177:0/671584449 reap_dead start 2024-03-20T13:35:35.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 shutdown_connections 2024-03-20T13:35:35.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 >> 172.21.15.177:0/671584449 conn(0x564a24e83040 msgr2=0x564a24e87a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 shutdown_connections 2024-03-20T13:35:35.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.003+0000 7f9fa0b42800 1 -- 172.21.15.177:0/671584449 wait complete. 2024-03-20T13:35:35.020 INFO:teuthology.orchestra.run.smithi177.stdout:fooFoofooFooFULL_CONTROL 2024-03-20T13:35:35.020 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-03-20T13:35:35.023 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-03-20T13:35:35.028 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:35.028 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:35:35.028 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-03-20T13:35:35.028 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:35:35.071 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:35.072 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:35.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.071+0000 7f1c49975800 1 Processor -- start 2024-03-20T13:35:35.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.071+0000 7f1c49975800 1 -- start start 2024-03-20T13:35:35.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.071+0000 7f1c49975800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x555ce0cda570 0x555ce0cdc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.071+0000 7f1c49975800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x555ce0c24cd0 con 0x555ce0cdcea0 2024-03-20T13:35:35.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.071+0000 7f1c49975800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x555ce0bdb500 con 0x555ce0cda570 2024-03-20T13:35:35.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.072+0000 7f1c47474640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x555ce0cda570 0x555ce0cdc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.072+0000 7f1c3ec73640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x555ce0cdcea0 0x555ce0cdf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46346/0 (socket says 172.21.15.177:46346) 2024-03-20T13:35:35.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.072+0000 7f1c3ec73640 1 -- 172.21.15.177:0/2711302588 learned_addr learned my addr 172.21.15.177:0/2711302588 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:35.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.072+0000 7f1c47474640 1 -- 172.21.15.177:0/2711302588 >> v1:172.21.15.28:6789/0 conn(0x555ce0cdcea0 legacy=0x555ce0cdf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.074 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.072+0000 7f1c47474640 1 -- 172.21.15.177:0/2711302588 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0ce19c0 con 0x555ce0cda570 2024-03-20T13:35:35.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.074+0000 7f1c47474640 1 --2- 172.21.15.177:0/2711302588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cdc960 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800a470 tx=0x7f1c3801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e915c54d845e93b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.074+0000 7f1c46c73640 1 -- 172.21.15.177:0/2711302588 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38052570 con 0x555ce0cda570 2024-03-20T13:35:35.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.074+0000 7f1c46c73640 1 -- 172.21.15.177:0/2711302588 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c380526d0 con 0x555ce0cda570 2024-03-20T13:35:35.075 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.074+0000 7f1c46c73640 1 -- 172.21.15.177:0/2711302588 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38052990 con 0x555ce0cda570 2024-03-20T13:35:35.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.074+0000 7f1c49975800 1 -- 172.21.15.177:0/2711302588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 msgr2=0x555ce0cdc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.074+0000 7f1c49975800 1 --2- 172.21.15.177:0/2711302588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cdc960 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f1c3800a470 tx=0x7f1c3801cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:35.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.075+0000 7f1c49975800 1 -- 172.21.15.177:0/2711302588 shutdown_connections 2024-03-20T13:35:35.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.075+0000 7f1c49975800 1 --2- 172.21.15.177:0/2711302588 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cdc960 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.075+0000 7f1c49975800 1 -- 172.21.15.177:0/2711302588 >> 172.21.15.177:0/2711302588 conn(0x555ce0cd4040 msgr2=0x555ce0cd6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.076 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.075+0000 7f1c49975800 1 -- 172.21.15.177:0/2711302588 shutdown_connections 2024-03-20T13:35:35.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.075+0000 7f1c49975800 1 -- 172.21.15.177:0/2711302588 wait complete. 2024-03-20T13:35:35.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.086+0000 7f1c49975800 1 Processor -- start 2024-03-20T13:35:35.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.086+0000 7f1c49975800 1 -- start start 2024-03-20T13:35:35.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.086+0000 7f1c49975800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cd9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.086+0000 7f1c49975800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0bd8a30 con 0x555ce0cda570 2024-03-20T13:35:35.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cd9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cd9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33220/0 (socket says 172.21.15.177:33220) 2024-03-20T13:35:35.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1c47474640 1 -- 172.21.15.177:0/2185954130 learned_addr learned my addr 172.21.15.177:0/2185954130 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1c47474640 1 -- 172.21.15.177:0/2185954130 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c38005d20 con 0x555ce0cda570 2024-03-20T13:35:35.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1c47474640 1 --2- 172.21.15.177:0/2185954130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cd9eb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1c38055040 tx=0x7f1c3804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1acdb50c831c1842 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1b3560a640 1 -- 172.21.15.177:0/2185954130 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3800a180 con 0x555ce0cda570 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1b3560a640 1 -- 172.21.15.177:0/2185954130 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3800a2e0 con 0x555ce0cda570 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.087+0000 7f1b3560a640 1 -- 172.21.15.177:0/2185954130 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c380529b0 con 0x555ce0cda570 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- 172.21.15.177:0/2185954130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 msgr2=0x555ce0cd9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 --2- 172.21.15.177:0/2185954130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cd9eb0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f1c38055040 tx=0x7f1c3804c000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- 172.21.15.177:0/2185954130 shutdown_connections 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 --2- 172.21.15.177:0/2185954130 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0cd9eb0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- 172.21.15.177:0/2185954130 >> 172.21.15.177:0/2185954130 conn(0x555ce0cd4040 msgr2=0x555ce0dc53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- 172.21.15.177:0/2185954130 shutdown_connections 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- 172.21.15.177:0/2185954130 wait complete. 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 Processor -- start 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- start start 2024-03-20T13:35:35.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0dd3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.088+0000 7f1c49975800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0bd4210 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0dd3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0dd3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33234/0 (socket says 172.21.15.177:33234) 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c47474640 1 -- 172.21.15.177:0/790561139 learned_addr learned my addr 172.21.15.177:0/790561139 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c47474640 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0ce19c0 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c47474640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0dd3280 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005870 tx=0x7f1c38002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1b33e07640 1 -- 172.21.15.177:0/790561139 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3806a070 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1b33e07640 1 -- 172.21.15.177:0/790561139 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3805d550 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ce0dd37c0 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1b33e07640 1 -- 172.21.15.177:0/790561139 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3805d7f0 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.089+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ce0dd3ca0 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.090+0000 7f1b33e07640 1 -- 172.21.15.177:0/790561139 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1c3805d950 con 0x555ce0cda570 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.090+0000 7f1b33e07640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b2c0367e0 0x7f1b2c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.090+0000 7f1b33e07640 1 -- 172.21.15.177:0/790561139 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f1c3808dd00 con 0x555ce0cda570 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.090+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b2c0367e0 0x7f1b2c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0cdcea0 0x555ce0dd9f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0dda530 con 0x555ce0cdcea0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c47c75640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0cdcea0 0x555ce0dd9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b2c0367e0 0x7f1b2c038ca0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000f60 tx=0x7f1c300012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c47c75640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0cdcea0 0x555ce0dd9f30 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c47c75640 1 -- 172.21.15.177:0/790561139 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0cdcea0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0dd7640 con 0x555ce0cdcea0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.091+0000 7f1c47c75640 1 -- 172.21.15.177:0/790561139 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0cdcea0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0ddc770 0x555ce0ddeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0ddf200 con 0x555ce0ddc770 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c47474640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0ddc770 0x555ce0ddeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c47474640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0ddc770 0x555ce0ddeb60 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c47474640 1 -- 172.21.15.177:0/790561139 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f1c38059040 con 0x555ce0ddc770 2024-03-20T13:35:35.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0ddb6f0 con 0x555ce0cdcea0 2024-03-20T13:35:35.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c47c75640 1 -- 172.21.15.177:0/790561139 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0cdcea0 2024-03-20T13:35:35.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x555ce0de0620 0x555ce0de2a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.092+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0de3170 con 0x555ce0de0620 2024-03-20T13:35:35.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.093+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x555ce0de0620 0x555ce0de2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.093+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x555ce0de0620 0x555ce0de2a10 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.093+0000 7f1c3ec73640 1 -- 172.21.15.177:0/790561139 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0de0620 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c49975800 1 Processor -- start 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c49975800 1 -- start start 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c49975800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 0x555ce0df1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c49975800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0b76c70 con 0x555ce0df1300 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 0x555ce0df1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 0x555ce0df1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33246/0 (socket says 172.21.15.177:33246) 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c47474640 1 -- 172.21.15.177:0/796589383 learned_addr learned my addr 172.21.15.177:0/796589383 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c47474640 1 -- 172.21.15.177:0/796589383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0df1c60 con 0x555ce0df1300 2024-03-20T13:35:35.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.094+0000 7f1c47474640 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 0x555ce0df1720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c3808bf90 tx=0x7f1c3806e6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1b31602640 1 -- 172.21.15.177:0/796589383 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38065ce0 con 0x555ce0df1300 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1b31602640 1 -- 172.21.15.177:0/796589383 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3807a940 con 0x555ce0df1300 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ce0df26d0 con 0x555ce0df1300 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1b31602640 1 -- 172.21.15.177:0/796589383 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38065e40 con 0x555ce0df1300 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ce0df2b90 con 0x555ce0df1300 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1b31602640 1 -- 172.21.15.177:0/796589383 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1c3807ac20 con 0x555ce0df1300 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1b31602640 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b200367e0 0x7f1b20038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.095+0000 7f1b31602640 1 -- 172.21.15.177:0/796589383 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f1c3807f8c0 con 0x555ce0df1300 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b200367e0 0x7f1b20038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c49975800 1 Processor -- start 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c49975800 1 -- start start 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b200367e0 0x7f1b20038ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000bf50 tx=0x7f1c3000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c49975800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0dfe7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c49975800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0b4c5d0 con 0x555ce0dfe390 2024-03-20T13:35:35.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0dfe7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0dfe7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33256/0 (socket says 172.21.15.177:33256) 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.096+0000 7f1c47474640 1 -- 172.21.15.177:0/3528857677 learned_addr learned my addr 172.21.15.177:0/3528857677 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.097+0000 7f1c47474640 1 -- 172.21.15.177:0/3528857677 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0dfed80 con 0x555ce0dfe390 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.097+0000 7f1c47474640 1 --2- 172.21.15.177:0/3528857677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0dfe7b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1c38083fd0 tx=0x7f1c38083cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e52db902a7ae59 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1b2affd640 1 -- 172.21.15.177:0/3528857677 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c380a3070 con 0x555ce0dfe390 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1b2affd640 1 -- 172.21.15.177:0/3528857677 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c380a4040 con 0x555ce0dfe390 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1b2affd640 1 -- 172.21.15.177:0/3528857677 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38004ef0 con 0x555ce0dfe390 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 -- 172.21.15.177:0/3528857677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 msgr2=0x555ce0dfe7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 --2- 172.21.15.177:0/3528857677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0dfe7b0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f1c38083fd0 tx=0x7f1c38083cc0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 -- 172.21.15.177:0/3528857677 shutdown_connections 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 --2- 172.21.15.177:0/3528857677 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0dfe7b0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 -- 172.21.15.177:0/3528857677 >> 172.21.15.177:0/3528857677 conn(0x555ce0dfa6f0 msgr2=0x555ce0df8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 -- 172.21.15.177:0/3528857677 shutdown_connections 2024-03-20T13:35:35.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 -- 172.21.15.177:0/3528857677 wait complete. 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 Processor -- start 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.098+0000 7f1c49975800 1 -- start start 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c49975800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0e05200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c49975800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ce0e05740 con 0x555ce0dfe390 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0e05200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c47474640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0e05200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33272/0 (socket says 172.21.15.177:33272) 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 learned_addr learned my addr 172.21.15.177:0/4123847948 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ce0df26d0 con 0x555ce0dfe390 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.099+0000 7f1c47474640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0e05200 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1c38083fd0 tx=0x7f1c3807f560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.100+0000 7f1b297fa640 1 -- 172.21.15.177:0/4123847948 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c38083740 con 0x555ce0dfe390 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.100+0000 7f1b297fa640 1 -- 172.21.15.177:0/4123847948 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c380838a0 con 0x555ce0dfe390 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.100+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x555ce0df26d0 con 0x555ce0dfe390 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.100+0000 7f1b297fa640 1 -- 172.21.15.177:0/4123847948 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c3808d5c0 con 0x555ce0dfe390 2024-03-20T13:35:35.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.100+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555ce0df26d0 con 0x555ce0dfe390 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1b297fa640 1 -- 172.21.15.177:0/4123847948 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1c3808d720 con 0x555ce0dfe390 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1b297fa640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b10036790 0x7f1b10038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1b297fa640 1 -- 172.21.15.177:0/4123847948 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f1c380c5a90 con 0x555ce0dfe390 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b10036790 0x7f1b10038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0e108d0 0x555ce0e12d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e134c0 con 0x555ce0e108d0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.101+0000 7f1c47c75640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0e108d0 0x555ce0e12d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b10036790 0x7f1b10038c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1c30001b60 tx=0x7f1c30010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c47c75640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0e108d0 0x555ce0e12d70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 realm 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e13890 con 0x555ce0e108d0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.102+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e14440 con 0x555ce0e108d0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0e14df0 0x555ce0e171e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e17830 con 0x555ce0e14df0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c47474640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0e14df0 0x555ce0e171e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c47474640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0e14df0 0x555ce0e171e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 20 searching for the correct realm 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x555ce0e19ae0 0x555ce0e1bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1c670 con 0x555ce0e19ae0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.103+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x555ce0e19ae0 0x555ce0e1bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c3ec73640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x555ce0e19ae0 0x555ce0e1bfa0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1c670 con 0x555ce0e14df0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c47474640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1c38078060 0x7f1c38059290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1c670 con 0x7f1c38078060 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.104+0000 7f1c47c75640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1c38078060 0x7f1c38059290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.105+0000 7f1c47c75640 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1c38078060 0x7f1c38059290 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.105+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.105+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.105+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.105+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e14df0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.106+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e14df0 2024-03-20T13:35:35.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.107+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.137 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.108+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.109+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.110+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.110+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e14df0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.110+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.138 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.110+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.110+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.110+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e14df0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e14df0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e19ae0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.111+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x7f1c38078060 2024-03-20T13:35:35.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e108d0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e140e0 con 0x555ce0e14df0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.112+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e17ee0 con 0x555ce0e108d0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e17ee0 con 0x555ce0e108d0 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e17ee0 con 0x7f1c38078060 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 zone default found 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 4 Realm: () 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:35.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 zonegroup default 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e187c0 con 0x7f1c38078060 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.113+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e187c0 con 0x555ce0e19ae0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1e490 con 0x555ce0e19ae0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 20 started sync module instance, tier type = 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.114+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1dd70 con 0x555ce0e14df0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.115+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.115+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93857398249680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1e120 con 0x555ce0e14df0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.115+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1f2a0 con 0x555ce0e108d0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.116+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93857398249680] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.116+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.116+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93857398255104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1f6c0 con 0x555ce0e108d0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.116+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e20030 con 0x555ce0e19ae0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.117+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93857398255104] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.117+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.117+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93857398256160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e1f640 con 0x555ce0e19ae0 2024-03-20T13:35:35.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.117+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e20e40 con 0x555ce0e14df0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.118+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.118+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93857398264224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e21a60 con 0x555ce0e14df0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.118+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e22410 con 0x555ce0e108d0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.118+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 93857398256160] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.119+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.119+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93857398260624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e227c0 con 0x555ce0e108d0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.119+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e23190 con 0x7f1c38078060 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.119+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93857398264224] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.120+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93857398260624] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.120+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.120+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93857398267696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e23150 con 0x7f1c38078060 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.121+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e239e0 con 0x7f1c38078060 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.122+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93857398267696] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.122+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.122+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93857398271120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e23150 con 0x7f1c38078060 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.122+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e23ff0 con 0x7f1c38078060 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'174 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93857398271120] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93857398274896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e24410 con 0x7f1c38078060 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=0 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=1 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=2 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=3 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=4 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=5 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.123+0000 7f1c49975800 20 add_watcher() i=6 2024-03-20T13:35:35.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.124+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93857398274896] v32'175 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.124+0000 7f1c49975800 20 add_watcher() i=7 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.124+0000 7f1c49975800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.124+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e24410 con 0x555ce0e108d0 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.124+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.124+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93857398275952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e24c90 con 0x555ce0e108d0 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.125+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93857398275952] v32'180 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.125+0000 7f1afdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.125+0000 7f1c49975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.125+0000 7f1c49975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.125+0000 7f1c49975800 5 note: GC not initialized 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1afcfe1640 20 reqs_thread_entry: start 2024-03-20T13:35:35.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 20 Filter name: none 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1a767fc640 20 reqs_thread_entry: start 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e597b0 con 0x555ce0e14df0 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 : miss 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.126+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:63 8.16 8:6a944445:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5b400 con 0x555ce0e19ae0 2024-03-20T13:35:35.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(63 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 info.flags=0x17 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 to cache LRU end 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 20 get_obj_state: octx=0x7f1c38059b20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x555ce0e5da38 s->prefetch_data=0 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 3.28s0 3:17a6c442:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e19ae0 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(64 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 10 manifest: total_size = 5 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.127+0000 7f1c49975800 20 get_obj_state: setting s->obj_tag to _tgA-plWn-r3OtevjnG_tpPZ0Hc578ql 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.128+0000 7f1afdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.128+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93857398275952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e108d0 2024-03-20T13:35:35.148 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.129+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93857398275952] v32'181 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.129+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93857398249680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e14df0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.130+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93857398249680] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.130+0000 7f1c49975800 20 remove_watcher() i=0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.130+0000 7f1c49975800 2 removed watcher, disabling cache 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.130+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93857398255104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e108d0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.131+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93857398255104] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.131+0000 7f1c49975800 20 remove_watcher() i=1 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.131+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93857398256160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e19ae0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.132+0000 7f1c3ec73640 1 -- 172.21.15.177:0/4123847948 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93857398256160] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c30006070 con 0x555ce0e19ae0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.132+0000 7f1c49975800 20 remove_watcher() i=2 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.132+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93857398264224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e14df0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.133+0000 7f1c47474640 1 -- 172.21.15.177:0/4123847948 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93857398264224] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c380bc020 con 0x555ce0e14df0 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.133+0000 7f1c49975800 20 remove_watcher() i=3 2024-03-20T13:35:35.149 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.133+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93857398260624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x555ce0e108d0 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.134+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93857398260624] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x555ce0e108d0 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.134+0000 7f1c49975800 20 remove_watcher() i=4 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.134+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93857398267696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x7f1c38078060 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.135+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93857398267696] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.135+0000 7f1c49975800 20 remove_watcher() i=5 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.135+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93857398271120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x7f1c38078060 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.136+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93857398271120] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.136+0000 7f1c49975800 20 remove_watcher() i=6 2024-03-20T13:35:35.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.136+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93857398274896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x555ce0e5eb90 con 0x7f1c38078060 2024-03-20T13:35:35.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93857398274896] v32'176 uv174 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1c4000a4a0 con 0x7f1c38078060 2024-03-20T13:35:35.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 20 remove_watcher() i=7 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1c38078060 msgr2=0x7f1c38059290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1c38078060 0x7f1c38059290 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0e108d0 msgr2=0x555ce0e12d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0e108d0 0x555ce0e12d70 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0e14df0 msgr2=0x555ce0e171e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0e14df0 0x555ce0e171e0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x555ce0e19ae0 msgr2=0x555ce0e1bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x555ce0e19ae0 0x555ce0e1bfa0 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b10036790 msgr2=0x7f1b10038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b10036790 0x7f1b10038c50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1c30001b60 tx=0x7f1c30010000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 msgr2=0x555ce0e05200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 --2- 172.21.15.177:0/4123847948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0dfe390 0x555ce0e05200 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1c38083fd0 tx=0x7f1c3807f560 comp rx=0 tx=0).stop 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 reap_dead start 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c47c75640 1 -- 172.21.15.177:0/4123847948 reap_dead start 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 shutdown_connections 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 >> 172.21.15.177:0/4123847948 conn(0x555ce0dfa6f0 msgr2=0x555ce0df7d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 shutdown_connections 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.137+0000 7f1c49975800 1 -- 172.21.15.177:0/4123847948 wait complete. 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b200367e0 msgr2=0x7f1b20038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b200367e0 0x7f1b20038ca0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1c3000bf50 tx=0x7f1c3000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 msgr2=0x555ce0df1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 0x555ce0df1720 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f1c3808bf90 tx=0x7f1c3806e6e0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 shutdown_connections 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b200367e0 0x7f1b20038ca0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.155 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/796589383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0df1300 0x555ce0df1720 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 >> 172.21.15.177:0/796589383 conn(0x555ce0de53a0 msgr2=0x555ce0de57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 shutdown_connections 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/796589383 wait complete. 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x555ce0de0620 msgr2=0x555ce0de2a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x555ce0de0620 0x555ce0de2a10 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0cdcea0 msgr2=0x555ce0dd9f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x555ce0cdcea0 0x555ce0dd9f30 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0ddc770 msgr2=0x555ce0ddeb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x555ce0ddc770 0x555ce0ddeb60 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b2c0367e0 msgr2=0x7f1b2c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1b2c0367e0 0x7f1b2c038ca0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1c30000f60 tx=0x7f1c300012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.156 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 msgr2=0x555ce0dd3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 --2- 172.21.15.177:0/790561139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x555ce0cda570 0x555ce0dd3280 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f1c38005870 tx=0x7f1c38002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c47c75640 1 -- 172.21.15.177:0/790561139 reap_dead start 2024-03-20T13:35:35.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 shutdown_connections 2024-03-20T13:35:35.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 >> 172.21.15.177:0/790561139 conn(0x555ce0cd4040 msgr2=0x555ce0cd8850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 shutdown_connections 2024-03-20T13:35:35.157 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.138+0000 7f1c49975800 1 -- 172.21.15.177:0/790561139 wait complete. 2024-03-20T13:35:35.158 INFO:teuthology.orchestra.run.smithi177.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-03-20T13:35:35.158 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-03-20T13:35:35.160 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-03-20T13:35:35.173 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:35.271 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-03-20T13:35:35.271 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-03-20T13:35:35.271 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-03-20T13:35:35.271 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-03-20T13:35:35.271 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-03-20T13:35:35.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-03-20T13:35:35.272 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-03-20T13:35:35.320 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629dd4b800 1 Processor -- start 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629dd4b800 1 -- start start 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629dd4b800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561758bdde70 0x561758be0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629dd4b800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561758b25cd0 con 0x561758bd99e0 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629dd4b800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561758adc500 con 0x561758bdde70 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629b050640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561758bdde70 0x561758be0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629b050640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561758bdde70 0x561758be0260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33280/0 (socket says 172.21.15.177:33280) 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629b050640 1 -- 172.21.15.177:0/3783878103 learned_addr learned my addr 172.21.15.177:0/3783878103 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.315+0000 7f629b851640 1 --1- 172.21.15.177:0/3783878103 >> v1:172.21.15.28:6789/0 conn(0x561758bd99e0 0x561758bd9e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46354/0 (socket says 172.21.15.177:46354) 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.316+0000 7f629b050640 1 -- 172.21.15.177:0/3783878103 >> v1:172.21.15.28:6789/0 conn(0x561758bd99e0 legacy=0x561758bd9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.321 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.316+0000 7f629b050640 1 -- 172.21.15.177:0/3783878103 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561758be1890 con 0x561758bdde70 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.317+0000 7f629b050640 1 --2- 172.21.15.177:0/3783878103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bdde70 0x561758be0260 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f629000a520 tx=0x7f629001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db688355676e28c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629a84f640 1 -- 172.21.15.177:0/3783878103 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6290052570 con 0x561758bdde70 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629a84f640 1 -- 172.21.15.177:0/3783878103 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62900526d0 con 0x561758bdde70 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629a84f640 1 -- 172.21.15.177:0/3783878103 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6290052990 con 0x561758bdde70 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 -- 172.21.15.177:0/3783878103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bdde70 msgr2=0x561758be0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 --2- 172.21.15.177:0/3783878103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bdde70 0x561758be0260 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f629000a520 tx=0x7f629001cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 -- 172.21.15.177:0/3783878103 shutdown_connections 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 --2- 172.21.15.177:0/3783878103 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bdde70 0x561758be0260 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 -- 172.21.15.177:0/3783878103 >> 172.21.15.177:0/3783878103 conn(0x561758bd5040 msgr2=0x561758bd7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 -- 172.21.15.177:0/3783878103 shutdown_connections 2024-03-20T13:35:35.322 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.318+0000 7f629dd4b800 1 -- 172.21.15.177:0/3783878103 wait complete. 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629dd4b800 1 Processor -- start 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629dd4b800 1 -- start start 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629dd4b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758b4dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629dd4b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561758ad9a30 con 0x561758bd99e0 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758b4dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758b4dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33286/0 (socket says 172.21.15.177:33286) 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629b851640 1 -- 172.21.15.177:0/2307172618 learned_addr learned my addr 172.21.15.177:0/2307172618 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.330+0000 7f629b851640 1 -- 172.21.15.177:0/2307172618 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6290005de0 con 0x561758bd99e0 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f629b851640 1 --2- 172.21.15.177:0/2307172618 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758b4dcb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f628c001d30 tx=0x7f628c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2eeafc27d294d5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f6189e0b640 1 -- 172.21.15.177:0/2307172618 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c014070 con 0x561758bd99e0 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f6189e0b640 1 -- 172.21.15.177:0/2307172618 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c00f450 con 0x561758bd99e0 2024-03-20T13:35:35.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f6189e0b640 1 -- 172.21.15.177:0/2307172618 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c00f730 con 0x561758bd99e0 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f629dd4b800 1 -- 172.21.15.177:0/2307172618 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 msgr2=0x561758b4dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2307172618 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758b4dcb0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f628c001d30 tx=0x7f628c00b600 comp rx=0 tx=0).stop 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f629dd4b800 1 -- 172.21.15.177:0/2307172618 shutdown_connections 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2307172618 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758b4dcb0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.331+0000 7f629dd4b800 1 -- 172.21.15.177:0/2307172618 >> 172.21.15.177:0/2307172618 conn(0x561758bd5040 msgr2=0x561758cc5290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629dd4b800 1 -- 172.21.15.177:0/2307172618 shutdown_connections 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629dd4b800 1 -- 172.21.15.177:0/2307172618 wait complete. 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629dd4b800 1 Processor -- start 2024-03-20T13:35:35.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629dd4b800 1 -- start start 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629dd4b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758cd2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629dd4b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561758ad5210 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758cd2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758cd2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33294/0 (socket says 172.21.15.177:33294) 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.332+0000 7f629b851640 1 -- 172.21.15.177:0/2349800365 learned_addr learned my addr 172.21.15.177:0/2349800365 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f629b851640 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561758b25cd0 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f629b851640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758cd2100 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x561758b4d2e0 tx=0x7f628c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f6183fff640 1 -- 172.21.15.177:0/2349800365 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c014050 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f6183fff640 1 -- 172.21.15.177:0/2349800365 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c01b850 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561758cd2640 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f6183fff640 1 -- 172.21.15.177:0/2349800365 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c01bb30 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.333+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561758cd2b20 con 0x561758bd99e0 2024-03-20T13:35:35.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f6183fff640 1 -- 172.21.15.177:0/2349800365 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f628c022020 con 0x561758bd99e0 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f6183fff640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6184036790 0x7f6184038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f6183fff640 1 -- 172.21.15.177:0/2349800365 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f628c008030 con 0x561758bd99e0 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f629b050640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6184036790 0x7f6184038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758bdde70 0x561758cd8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758cd9400 con 0x561758bdde70 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.334+0000 7f629c052640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758bdde70 0x561758cd8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629b050640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6184036790 0x7f6184038c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6290054000 tx=0x7f629004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629c052640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758bdde70 0x561758cd8db0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629c052640 1 -- 172.21.15.177:0/2349800365 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758bdde70 2024-03-20T13:35:35.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758cd64c0 con 0x561758bdde70 2024-03-20T13:35:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629c052640 1 -- 172.21.15.177:0/2349800365 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f629400a4a0 con 0x561758bdde70 2024-03-20T13:35:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758cdb640 0x561758cdda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758cde0d0 con 0x561758cdb640 2024-03-20T13:35:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.335+0000 7f629b851640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758cdb640 0x561758cdda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.351 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.336+0000 7f629b851640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758cdb640 0x561758cdda30 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.336+0000 7f629b851640 1 -- 172.21.15.177:0/2349800365 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f628c016070 con 0x561758cdb640 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.336+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758cda5c0 con 0x561758bdde70 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.336+0000 7f629c052640 1 -- 172.21.15.177:0/2349800365 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f629400a4a0 con 0x561758bdde70 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.336+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561758cdf4f0 0x561758ce18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.336+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758ce2040 con 0x561758cdf4f0 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.337+0000 7f629b050640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561758cdf4f0 0x561758ce18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.337+0000 7f629b050640 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561758cdf4f0 0x561758ce18e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.337+0000 7f629b050640 1 -- 172.21.15.177:0/2349800365 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f6290052bc0 con 0x561758cdf4f0 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629dd4b800 1 Processor -- start 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629dd4b800 1 -- start start 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629dd4b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 0x561758cf0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629dd4b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561758a77c70 con 0x561758cf01f0 2024-03-20T13:35:35.352 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 0x561758cf0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 0x561758cf0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33298/0 (socket says 172.21.15.177:33298) 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629b851640 1 -- 172.21.15.177:0/1337916062 learned_addr learned my addr 172.21.15.177:0/1337916062 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629b851640 1 -- 172.21.15.177:0/1337916062 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561758cf0b50 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f629b851640 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 0x561758cf0610 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f628c04a410 tx=0x7f628c03eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.338+0000 7f61817fa640 1 -- 172.21.15.177:0/1337916062 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c02d790 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f61817fa640 1 -- 172.21.15.177:0/1337916062 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c02d8f0 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561758cf15c0 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f61817fa640 1 -- 172.21.15.177:0/1337916062 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c02dbb0 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561758cf1a80 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f61817fa640 1 -- 172.21.15.177:0/1337916062 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f628c02dd10 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f61817fa640 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f61740367e0 0x7f6174038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f61817fa640 1 -- 172.21.15.177:0/1337916062 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f628c039d60 con 0x561758cf01f0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.339+0000 7f629b050640 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f61740367e0 0x7f6174038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629dd4b800 1 Processor -- start 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629dd4b800 1 -- start start 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629b050640 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f61740367e0 0x7f6174038ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x561758cd6420 tx=0x7f6290005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629dd4b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758cfd910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629dd4b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561758a4d5d0 con 0x561758cfd4f0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758cfd910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758cfd910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33306/0 (socket says 172.21.15.177:33306) 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629b851640 1 -- 172.21.15.177:0/3105698119 learned_addr learned my addr 172.21.15.177:0/3105698119 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629b851640 1 -- 172.21.15.177:0/3105698119 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561758cfdee0 con 0x561758cfd4f0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.340+0000 7f629b851640 1 --2- 172.21.15.177:0/3105698119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758cfd910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f628c021ff0 tx=0x7f628c004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4c047e2c4610947 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f617affd640 1 -- 172.21.15.177:0/3105698119 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c017c20 con 0x561758cfd4f0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f617affd640 1 -- 172.21.15.177:0/3105698119 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c017960 con 0x561758cfd4f0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f617affd640 1 -- 172.21.15.177:0/3105698119 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c043140 con 0x561758cfd4f0 2024-03-20T13:35:35.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 -- 172.21.15.177:0/3105698119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 msgr2=0x561758cfd910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 --2- 172.21.15.177:0/3105698119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758cfd910 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f628c021ff0 tx=0x7f628c004f90 comp rx=0 tx=0).stop 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 -- 172.21.15.177:0/3105698119 shutdown_connections 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 --2- 172.21.15.177:0/3105698119 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758cfd910 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 -- 172.21.15.177:0/3105698119 >> 172.21.15.177:0/3105698119 conn(0x561758cf9810 msgr2=0x561758cf7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 -- 172.21.15.177:0/3105698119 shutdown_connections 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 -- 172.21.15.177:0/3105698119 wait complete. 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 Processor -- start 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.341+0000 7f629dd4b800 1 -- start start 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629dd4b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758d04510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629dd4b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561758d04a50 con 0x561758cfd4f0 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758d04510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629b851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758d04510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33312/0 (socket says 172.21.15.177:33312) 2024-03-20T13:35:35.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 learned_addr learned my addr 172.21.15.177:0/1102569247 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561758cf1a80 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629b851640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758d04510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f628c00ffb0 tx=0x7f628c010e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f61797fa640 1 -- 172.21.15.177:0/1102569247 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c03e250 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f61797fa640 1 -- 172.21.15.177:0/1102569247 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f628c03e3b0 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561758cf1a80 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f61797fa640 1 -- 172.21.15.177:0/1102569247 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f628c03e690 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.342+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561758cf1a80 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.343+0000 7f61797fa640 1 -- 172.21.15.177:0/1102569247 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f628c066040 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.343+0000 7f61797fa640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6164036740 0x7f6164038c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.343+0000 7f61797fa640 1 -- 172.21.15.177:0/1102569247 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f628c072d30 con 0x561758cfd4f0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.343+0000 7f629b050640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6164036740 0x7f6164038c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758d0fce0 0x561758d121a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629b050640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6164036740 0x7f6164038c00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x561758ce2400 tx=0x7f629004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d128f0 con 0x561758d0fce0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629c052640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758d0fce0 0x561758d121a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629c052640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758d0fce0 0x561758d121a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.344+0000 7f629dd4b800 20 realm 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d12cc0 con 0x561758d0fce0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d138a0 con 0x561758d0fce0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758d14250 0x561758d16640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d16c50 con 0x561758d14250 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.345+0000 7f629b851640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758d14250 0x561758d16640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629b851640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758d14250 0x561758d16640 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629dd4b800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629dd4b800 20 searching for the correct realm 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561758d18f00 0x561758d1b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1ba40 con 0x561758d18f00 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629b050640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561758d18f00 0x561758d1b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.346+0000 7f629b050640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561758d18f00 0x561758d1b3c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1ba40 con 0x561758d14250 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629b851640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f628c07c040 0x7f628c024940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1ba40 con 0x7f628c07c040 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629c052640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f628c07c040 0x7f628c024940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.347+0000 7f629c052640 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f628c07c040 0x7f628c024940 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.348+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d14250 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.349+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d14250 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.350+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.351+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d14250 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.352+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.353+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.353+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.353+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.353+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d14250 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.353+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.353+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.354+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.354+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d14250 2024-03-20T13:35:35.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.354+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.354+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d18f00 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.354+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.354+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x7f628c07c040 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d0fce0 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d13540 con 0x561758d14250 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:35.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d17340 con 0x561758d0fce0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.355+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d17340 con 0x561758d0fce0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d176f0 con 0x7f628c07c040 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 zone default found 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 4 Realm: () 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 zonegroup default 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d17ae0 con 0x7f628c07c040 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d17ee0 con 0x561758d18f00 2024-03-20T13:35:35.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.356+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.357+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1d860 con 0x561758d18f00 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.357+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.357+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.357+0000 7f629dd4b800 20 started sync module instance, tier type = 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.357+0000 7f629dd4b800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.357+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1ccf0 con 0x561758d14250 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.358+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.358+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94658274382032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1c960 con 0x561758d14250 2024-03-20T13:35:35.378 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.358+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1e670 con 0x561758d0fce0 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.359+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94658274382032] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.359+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.359+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94658274386384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1ea90 con 0x561758d0fce0 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.359+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1f400 con 0x561758d18f00 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.360+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.360+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94658274386384] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.360+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94658274389856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1f760 con 0x561758d18f00 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.360+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d201b0 con 0x561758d14250 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.361+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94658274389856] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.361+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.361+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94658274393232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d20560 con 0x561758d14250 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.361+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d20f50 con 0x561758d0fce0 2024-03-20T13:35:35.379 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.362+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.362+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94658274396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d217a0 con 0x561758d0fce0 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.362+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d21fa0 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.362+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94658274393232] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.363+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.363+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94658274396720] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.363+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94658274400160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22060 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.363+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d21300 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.365+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94658274400160] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.365+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.365+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94658274401216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d21fe0 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.365+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22e70 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'177 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94658274404816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d23290 con 0x7f628c07c040 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=0 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=1 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=2 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=3 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=4 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=5 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94658274401216] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629dd4b800 20 add_watcher() i=6 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.366+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94658274404816] v32'178 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.367+0000 7f629dd4b800 20 add_watcher() i=7 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.367+0000 7f629dd4b800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.367+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d23290 con 0x561758d0fce0 2024-03-20T13:35:35.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.367+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.367+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94658274405872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d23c00 con 0x561758d0fce0 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.368+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94658274405872] v32'182 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.368+0000 7f6151fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.368+0000 7f629dd4b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.368+0000 7f629dd4b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.368+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2eb30 con 0x561758d0fce0 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.369+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.369+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2ef30 con 0x7f628c07c040 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.370+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.370+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2ef30 con 0x561758d18f00 2024-03-20T13:35:35.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.371+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.371+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2f940 con 0x561758d0fce0 2024-03-20T13:35:35.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.372+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'183 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.372+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2fe70 con 0x561758d14250 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.373+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'63 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.373+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d303a0 con 0x561758d18f00 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.374+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'41 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.374+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2f820 con 0x561758d0fce0 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.375+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.375+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d30d70 con 0x7f628c07c040 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.376+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'43 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.376+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d30d70 con 0x561758d14250 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.377+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.386 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.377+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d312a0 con 0x561758d18f00 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.378+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.378+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d317d0 con 0x561758d14250 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.379+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'64 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.379+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31d00 con 0x7f628c07c040 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.380+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'28 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.380+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31d00 con 0x561758d14250 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.381+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.381+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d30c70 con 0x7f628c07c040 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.382+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'47 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.382+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d30c70 con 0x561758d0fce0 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.383+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'184 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.387 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.383+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d30c70 con 0x561758d18f00 2024-03-20T13:35:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.384+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'57 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.384+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d14250 2024-03-20T13:35:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.385+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'65 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.385+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.386+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.386+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d0fce0 2024-03-20T13:35:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.387+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'32 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.388+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d0fce0 2024-03-20T13:35:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.388+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'185 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.388+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.389+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'58 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.389+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d14250 2024-03-20T13:35:35.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.390+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'34 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.390+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.391+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.391+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.392+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.392+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.393+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'20 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.393+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.394+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'42 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.394+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x7f628c07c040 2024-03-20T13:35:35.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.395+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'26 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.395+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.396+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'24 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.396+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x7f628c07c040 2024-03-20T13:35:35.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.398+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'44 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.398+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d18f00 2024-03-20T13:35:35.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.398+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'59 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.398+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x7f628c07c040 2024-03-20T13:35:35.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.399+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'48 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.399+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d31ec0 con 0x561758d14250 2024-03-20T13:35:35.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.400+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'30 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.400+0000 7f6150fe1640 20 reqs_thread_entry: start 2024-03-20T13:35:35.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:35.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 20 Filter name: none 2024-03-20T13:35:35.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f60ca7fc640 20 reqs_thread_entry: start 2024-03-20T13:35:35.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2a660 con 0x561758d14250 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 : miss 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:95 8.16 8:6a944445:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2af30 con 0x561758d18f00 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(95 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 info.flags=0x17 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 to cache LRU end 2024-03-20T13:35:35.404 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:35.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.401+0000 7f629dd4b800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:35:35.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.402+0000 7f629dd4b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 2024-03-20T13:35:35.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.402+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:96 4.1c 4:3a9f2ae2:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda950 con 0x7f628c07c040 2024-03-20T13:35:35.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.402+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(96 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.405 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.402+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 4.25 4:a783c830:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda950 con 0x561758d18f00 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(97 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:98 4.29 4:95a48870:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda990 con 0x561758d18f00 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(98 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 [call out=425b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629dd4b800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 4.20 4:04d479af:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x561758d0fce0 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(99 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.403+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 4.f 4:f02bac02:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x561758d0fce0 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(100 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:101 4.34 4:2ecbdddf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x561758d14250 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(101 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:102 4.1f 4:f854f161:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x561758d18f00 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(102 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 [call out=425b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+425 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629dd4b800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.404+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 4.2d 4:b4d023be:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x7f628c07c040 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.405+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(103 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.405+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:104 4.1d 4:b9e5f009:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x561758d18f00 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.405+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(104 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 [call out=426b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.405+0000 7f629dd4b800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.405+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:105 4.1c 4:3805e64d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x7f628c07c040 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.405+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(105 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.406+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:106 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda9d0 con 0x7f628c07c040 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.406+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(106 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [call out=698b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+698 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.406+0000 7f629dd4b800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.406+0000 7f629dd4b800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.406+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.406+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:107 3.3cs0 3:3f6d1638:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_9c8454ddf7aa50116496bac348d7550d:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d5ddc0 con 0x561758d14250 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(107 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_9c8454ddf7aa50116496bac348d7550d [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629dd4b800 10 manifest: total_size = 6 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629dd4b800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.4159390603483729932 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629dd4b800 20 prepare_atomic_modification: state is not atomic. state=0x561758dd9e18 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629dd4b800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 2024-03-20T13:35:35.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.407+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:108 4.29 4:95a48870:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d62690 con 0x561758d18f00 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.408+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(108 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 [stat,call,call] v32'6 uv6 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.408+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:109 3.3cs0 3:3f6d1638:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d60670 con 0x561758d14250 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.409+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(109 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_9c8454ddf7aa50116496bac348d7550d [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.409+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:110 4.29 4:95a48870:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d62c30 con 0x561758d18f00 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.409+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.409+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:111 3.35s0 3:acc089ae:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d62c30 con 0x561758d0fce0 2024-03-20T13:35:35.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(111 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_b1b9a972ccd8c962a473909b97007eb4 [getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+893 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629dd4b800 10 manifest: total_size = 3 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629dd4b800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5638705868475418265 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629dd4b800 20 prepare_atomic_modification: state is not atomic. state=0x561758dd9e18 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629dd4b800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.410+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:112 4.1f 4:f854f161:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d678c0 con 0x561758d18f00 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.411+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(110 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.411+0000 7f617affd640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.411+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== osd_op_reply(112 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.411+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:113 3.35s0 3:acc089ae:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d5f1c0 con 0x561758d0fce0 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.412+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(113 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_b1b9a972ccd8c962a473909b97007eb4 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.412+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:114 4.1f 4:f854f161:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63880 con 0x561758d18f00 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.412+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.412+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:115 3.2fs0 3:f46622ab:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63f10 con 0x561758d18f00 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(115 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629dd4b800 10 manifest: total_size = 4 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629dd4b800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.16117344712189352070 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629dd4b800 20 prepare_atomic_modification: state is not atomic. state=0x561758dd9e18 2024-03-20T13:35:35.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629dd4b800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 2024-03-20T13:35:35.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:116 4.1d 4:b9e5f009:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63f50 con 0x561758d18f00 2024-03-20T13:35:35.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== osd_op_reply(114 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 [stat,call,call] v32'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.413+0000 7f617a7fc640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-03-20T13:35:35.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.414+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(116 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 [stat,call,call] v32'4 uv4 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.414+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:117 3.2fs0 3:f46622ab:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63f50 con 0x561758d18f00 2024-03-20T13:35:35.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(117 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:118 4.1d 4:b9e5f009:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63f50 con 0x561758d18f00 2024-03-20T13:35:35.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:119 3.es0 3:73530f60:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63f50 con 0x561758d14250 2024-03-20T13:35:35.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(119 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_24d27c169c2c881eb09a065116f2aa5c [getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 10 manifest: total_size = 5 2024-03-20T13:35:35.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.14632435689557364090 2024-03-20T13:35:35.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 20 prepare_atomic_modification: state is not atomic. state=0x561758dd9e18 2024-03-20T13:35:35.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.417+0000 7f629dd4b800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 2024-03-20T13:35:35.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.418+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:120 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d639e0 con 0x7f628c07c040 2024-03-20T13:35:35.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.419+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(120 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [stat,call,call] v32'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.419+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:121 3.es0 3:73530f60:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d639e0 con 0x561758d14250 2024-03-20T13:35:35.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.419+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(118 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 [stat,call,call] v32'5 uv5 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.419+0000 7f617affd640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-03-20T13:35:35.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(121 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_24d27c169c2c881eb09a065116f2aa5c [call] v32'2 uv2 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:122 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d639e0 con 0x7f628c07c040 2024-03-20T13:35:35.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:123 3.28s0 3:17a6c442:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d60dc0 con 0x561758d18f00 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 38 ==== osd_op_reply(123 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432 [getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+927 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 10 manifest: total_size = 5 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 20 get_obj_state: setting s->obj_tag to _tgA-plWn-r3OtevjnG_tpPZ0Hc578ql 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 20 get_obj_state: octx=0x7f628c050bc0 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x561758dd9e18 s->prefetch_data=0 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 20 prepare_atomic_modification: state is not atomic. state=0x561758dd9e18 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.420+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:124 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d60920 con 0x7f628c07c040 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.421+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(122 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [stat,call,call] v32'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.421+0000 7f617a7fc640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-03-20T13:35:35.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.422+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(124 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [stat,call,call] v32'12 uv12 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.422+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:125 3.28s0 3:17a6c442:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d5e1b0 con 0x561758d18f00 2024-03-20T13:35:35.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 39 ==== osd_op_reply(125 3852dce3-594b-4724-bee1-f3dae77b7611.4225.5_bb3aec0fdcdbc2974890f805c585d432 [call] v32'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:126 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63f10 con 0x7f628c07c040 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 20 list_objects_ordered: starting attempt 1 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:127 4.1c 4:3a9f2ae2:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63ee0 con 0x7f628c07c040 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:128 4.25 4:a783c830:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dda0d0 con 0x561758d18f00 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:129 4.29 4:95a48870:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63ee0 con 0x561758d18f00 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:130 4.20 4:04d479af:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63ee0 con 0x561758d0fce0 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:131 4.f 4:f02bac02:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d66ff0 con 0x561758d0fce0 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:132 4.34 4:2ecbdddf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d73b70 con 0x561758d14250 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:133 4.1f 4:f854f161:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d76410 con 0x561758d18f00 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:134 4.2d 4:b4d023be:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d78e20 con 0x7f628c07c040 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:135 4.1d 4:b9e5f009:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d7b680 con 0x561758d18f00 2024-03-20T13:35:35.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(127 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.423+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:136 4.1c 4:3805e64d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d78e20 con 0x7f628c07c040 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:137 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d7dcc0 con 0x7f628c07c040 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(132 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(131 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(134 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(130 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(136 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 40 ==== osd_op_reply(128 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 41 ==== osd_op_reply(133 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 42 ==== osd_op_reply(135 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 43 ==== osd_op_reply(129 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(126 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [stat,call,call] v32'13 uv13 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.424+0000 7f617a7fc640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-03-20T13:35:35.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(137 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.5])"; uploads.size()=0; is_truncated=0 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:138 4.1c 4:3a9f2ae2:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d7dcc0 con 0x7f628c07c040 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:139 4.25 4:a783c830:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dd9c30 con 0x561758d18f00 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:140 4.29 4:95a48870:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d18f00 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:141 4.20 4:04d479af:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d64210 con 0x561758d0fce0 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:142 4.f 4:f02bac02:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dd9c30 con 0x561758d0fce0 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:143 4.34 4:2ecbdddf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d14250 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:144 4.1f 4:f854f161:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d64210 con 0x561758d18f00 2024-03-20T13:35:35.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:145 4.2d 4:b4d023be:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758dd9c30 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:146 4.1d 4:b9e5f009:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d760d0 con 0x561758d18f00 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:147 4.1c 4:3805e64d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d6fa70 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:148 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d725b0 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(138 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(145 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(141 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(142 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(143 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(147 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(148 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [call out=124b] v0'0 uv13 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 44 ==== osd_op_reply(139 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 45 ==== osd_op_reply(140 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 [call out=124b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 46 ==== osd_op_reply(144 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 47 ==== osd_op_reply(146 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 [call out=124b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.425+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d14250 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.426+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(149 foo.buckets [call] v32'37 uv37 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.426+0000 7f629dd4b800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.426+0000 7f629dd4b800 10 removing default.rgw.meta+root+myfoo from cache 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.426+0000 7f629dd4b800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.426+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:150 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94658275149488 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x7f628c07c040 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== watch-notify(notify (1) cookie 94658274401216 notify 137438953493 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7f629405b040 con 0x7f628c07c040 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f617affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953493 cookie 94658274401216 notifier 4634 bl.length()=149 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(150 notify.6 [notify cookie 94658275149488 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f617affd640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6160003d50 con 0x7f628c07c040 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(151 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== watch-notify(notify_complete (2) cookie 94658275149488 notify 137438953493 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f629403d040 con 0x7f628c07c040 2024-03-20T13:35:35.439 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.427+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:152 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(152 myfoo [call,call,delete] v32'38 uv38 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f629dd4b800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 from cache 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f629dd4b800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5, ofs0, ns] 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:153 7.e 7:7759931f:::notify.3:head [notify cookie 94658275149488 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== watch-notify(notify (1) cookie 94658274393232 notify 137438953497 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x561758cfdee0 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f617affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953497 cookie 94658274393232 notifier 4634 bl.length()=206 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(153 notify.3 [notify cookie 94658275149488 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.428+0000 7f617affd640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:154 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6160003d50 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.429+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== watch-notify(notify_complete (2) cookie 94658275149488 notify 137438953497 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f628c09d040 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.429+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(154 notify.3 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.429+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:155 8.16 8:6a944445:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d18f00 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 48 ==== osd_op_reply(155 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 [call,call,delete] v32'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:156 4.1c 4:3a9f2ae2:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x7f628c07c040 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:157 4.25 4:a783c830:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d6fa70 con 0x561758d18f00 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:158 4.29 4:95a48870:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d61340 con 0x561758d18f00 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:159 4.20 4:04d479af:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d61bc0 con 0x561758d0fce0 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:160 4.f 4:f02bac02:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x561758d0fce0 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:161 4.34 4:2ecbdddf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d6fa70 con 0x561758d14250 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:162 4.1f 4:f854f161:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d61bc0 con 0x561758d18f00 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:163 4.2d 4:b4d023be:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d68b10 con 0x7f628c07c040 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:164 4.1d 4:b9e5f009:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d61340 con 0x561758d18f00 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.430+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:165 4.1c 4:3805e64d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d63e20 con 0x7f628c07c040 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.431+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:166 4.4 4:231da62c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d61340 con 0x7f628c07c040 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.431+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 49 ==== osd_op_reply(157 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.1 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.431+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(159 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.3 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.432+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== osd_op_reply(156 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.0 [delete] v32'3 uv3 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.432+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(165 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.9 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 50 ==== osd_op_reply(158 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 51 ==== osd_op_reply(162 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.6 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 52 ==== osd_op_reply(164 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.8 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== osd_op_reply(161 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.5 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 36 ==== osd_op_reply(160 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.4 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(166 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.10 [delete] v32'14 uv14 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(163 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.5.7 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629dd4b800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 : miss 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629dd4b800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:167 6.10 6:0df8bfd0:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d68b10 con 0x7f628c07c040 2024-03-20T13:35:35.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 49 ==== osd_op_reply(167 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629dd4b800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629dd4b800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 info.flags=0x0 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.434+0000 7f629dd4b800 10 adding default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 to cache LRU end 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629dd4b800 10 removing default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 from cache 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629dd4b800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5, ofs0, ns] 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [notify cookie 94658274664224 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d61bc0 con 0x561758d18f00 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 53 ==== watch-notify(notify (1) cookie 94658274389856 notify 137438953481 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x561758be1890 con 0x561758d18f00 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f617affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953481 cookie 94658274389856 notifier 4634 bl.length()=203 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 54 ==== osd_op_reply(168 notify.2 [notify cookie 94658274664224 out=8b] v0'0 uv177 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f617affd640 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:169 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f6160003d50 con 0x561758d18f00 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 55 ==== watch-notify(notify_complete (2) cookie 94658274664224 notify 137438953481 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f629004e070 con 0x561758d18f00 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 56 ==== osd_op_reply(169 notify.2 [notify-ack] v0'0 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.435+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:170 6.10 6:0df8bfd0:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d6fa70 con 0x7f628c07c040 2024-03-20T13:35:35.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.436+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 50 ==== osd_op_reply(170 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.5 [delete] v32'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.436+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:171 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2abe0 con 0x561758d14250 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.438+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(171 foo.buckets [call] v32'39 uv39 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.438+0000 7f6151fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.438+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:172 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94658274405872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d2abe0 con 0x561758d0fce0 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.439+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 37 ==== osd_op_reply(172 data_loggenerations_metadata [watch unwatch cookie 94658274405872] v32'186 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.439+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:173 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94658274382032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22df0 con 0x561758d14250 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.440+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(173 notify.0 [watch unwatch cookie 94658274382032] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.440+0000 7f629dd4b800 20 remove_watcher() i=0 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.440+0000 7f629dd4b800 2 removed watcher, disabling cache 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.440+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:174 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94658274386384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22df0 con 0x561758d0fce0 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.441+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 38 ==== osd_op_reply(174 notify.1 [watch unwatch cookie 94658274386384] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.441+0000 7f629dd4b800 20 remove_watcher() i=1 2024-03-20T13:35:35.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.441+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:175 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94658274389856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1e1d0 con 0x561758d18f00 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.442+0000 7f629b050640 1 -- 172.21.15.177:0/1102569247 <== osd.3 v2:172.21.15.177:6809/1493521224 57 ==== osd_op_reply(175 notify.2 [watch unwatch cookie 94658274389856] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6290052bc0 con 0x561758d18f00 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.442+0000 7f629dd4b800 20 remove_watcher() i=2 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.442+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:176 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94658274393232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22df0 con 0x561758d14250 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.443+0000 7f629b851640 1 -- 172.21.15.177:0/1102569247 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== osd_op_reply(176 notify.3 [watch unwatch cookie 94658274393232] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f628c06e070 con 0x561758d14250 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.443+0000 7f629dd4b800 20 remove_watcher() i=3 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.443+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:177 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94658274396720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1e1d0 con 0x561758d0fce0 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.445+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.1 v2:172.21.15.177:6808/2492741617 39 ==== osd_op_reply(177 notify.4 [watch unwatch cookie 94658274396720] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x561758d0fce0 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.445+0000 7f629dd4b800 20 remove_watcher() i=4 2024-03-20T13:35:35.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.445+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:178 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94658274400160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22df0 con 0x7f628c07c040 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.446+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 51 ==== osd_op_reply(178 notify.5 [watch unwatch cookie 94658274400160] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.446+0000 7f629dd4b800 20 remove_watcher() i=5 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.446+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:179 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94658274401216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d1e1d0 con 0x7f628c07c040 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.447+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 52 ==== osd_op_reply(179 notify.6 [watch unwatch cookie 94658274401216] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.447+0000 7f629dd4b800 20 remove_watcher() i=6 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.447+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:180 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94658274404816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561758d22df0 con 0x7f628c07c040 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 <== osd.0 v2:172.21.15.28:6800/801909073 53 ==== osd_op_reply(180 notify.7 [watch unwatch cookie 94658274404816] v32'179 uv177 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f629400a4a0 con 0x7f628c07c040 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 20 remove_watcher() i=7 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f628c07c040 msgr2=0x7f628c024940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f628c07c040 0x7f628c024940 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758d0fce0 msgr2=0x561758d121a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.453 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758d0fce0 0x561758d121a0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758d14250 msgr2=0x561758d16640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758d14250 0x561758d16640 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561758d18f00 msgr2=0x561758d1b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561758d18f00 0x561758d1b3c0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6164036740 msgr2=0x7f6164038c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6164036740 0x7f6164038c00 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x561758ce2400 tx=0x7f629004f000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 msgr2=0x561758d04510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629c052640 1 -- 172.21.15.177:0/1102569247 reap_dead start 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758d04510 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f628c00ffb0 tx=0x7f628c010e90 comp rx=0 tx=0).stop 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 shutdown_connections 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1102569247 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cfd4f0 0x561758d04510 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 >> 172.21.15.177:0/1102569247 conn(0x561758cf9810 msgr2=0x561758cf6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 shutdown_connections 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.448+0000 7f629dd4b800 1 -- 172.21.15.177:0/1102569247 wait complete. 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f61740367e0 msgr2=0x7f6174038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f61740367e0 0x7f6174038ca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x561758cd6420 tx=0x7f6290005ac0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 msgr2=0x561758cf0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 0x561758cf0610 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f628c04a410 tx=0x7f628c03eec0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 shutdown_connections 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f61740367e0 0x7f6174038ca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/1337916062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758cf01f0 0x561758cf0610 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 >> 172.21.15.177:0/1337916062 conn(0x561758ce4290 msgr2=0x561758ce4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 shutdown_connections 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/1337916062 wait complete. 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561758cdf4f0 msgr2=0x561758ce18e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561758cdf4f0 0x561758ce18e0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758bdde70 msgr2=0x561758cd8db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561758bdde70 0x561758cd8db0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758cdb640 msgr2=0x561758cdda30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561758cdb640 0x561758cdda30 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6184036790 msgr2=0x7f6184038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6184036790 0x7f6184038c50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6290054000 tx=0x7f629004e000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 msgr2=0x561758cd2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 --2- 172.21.15.177:0/2349800365 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561758bd99e0 0x561758cd2100 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x561758b4d2e0 tx=0x7f628c000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629c052640 1 -- 172.21.15.177:0/2349800365 reap_dead start 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 shutdown_connections 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 >> 172.21.15.177:0/2349800365 conn(0x561758bd5040 msgr2=0x561758cc3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 shutdown_connections 2024-03-20T13:35:35.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.449+0000 7f629dd4b800 1 -- 172.21.15.177:0/2349800365 wait complete. 2024-03-20T13:35:35.458 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:35:35.458 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:35:35.459 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-03-20T13:35:35.544 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:35.544 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:35.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.543+0000 7fcb0f11f800 1 Processor -- start 2024-03-20T13:35:35.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.543+0000 7fcb0f11f800 1 -- start start 2024-03-20T13:35:35.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb0f11f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5603528935f0 0x5603528959e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb0f11f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5603527ddcd0 con 0x560352895f20 2024-03-20T13:35:35.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb0f11f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x560352794500 con 0x5603528935f0 2024-03-20T13:35:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb0adf3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5603528935f0 0x5603528959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb025f2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x560352895f20 0x560352898310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46356/0 (socket says 172.21.15.177:46356) 2024-03-20T13:35:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb025f2640 1 -- 172.21.15.177:0/166309364 learned_addr learned my addr 172.21.15.177:0/166309364 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb0adf3640 1 -- 172.21.15.177:0/166309364 >> v1:172.21.15.28:6789/0 conn(0x560352895f20 legacy=0x560352898310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.544+0000 7fcb0adf3640 1 -- 172.21.15.177:0/166309364 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56035289aa40 con 0x5603528935f0 2024-03-20T13:35:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.546+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/166309364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603528959e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00a470 tx=0x7fcafc01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4338bbcb76b85ca server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.546+0000 7fcb0a5f2640 1 -- 172.21.15.177:0/166309364 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc052570 con 0x5603528935f0 2024-03-20T13:35:35.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.546+0000 7fcb0a5f2640 1 -- 172.21.15.177:0/166309364 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc0526d0 con 0x5603528935f0 2024-03-20T13:35:35.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.546+0000 7fcb0a5f2640 1 -- 172.21.15.177:0/166309364 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc052990 con 0x5603528935f0 2024-03-20T13:35:35.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 -- 172.21.15.177:0/166309364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 msgr2=0x5603528959e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/166309364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603528959e0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fcafc00a470 tx=0x7fcafc01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:35.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 -- 172.21.15.177:0/166309364 shutdown_connections 2024-03-20T13:35:35.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/166309364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603528959e0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 -- 172.21.15.177:0/166309364 >> 172.21.15.177:0/166309364 conn(0x56035288d040 msgr2=0x56035288f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 -- 172.21.15.177:0/166309364 shutdown_connections 2024-03-20T13:35:35.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.547+0000 7fcb0f11f800 1 -- 172.21.15.177:0/166309364 wait complete. 2024-03-20T13:35:35.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.558+0000 7fcb0f11f800 1 Processor -- start 2024-03-20T13:35:35.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.558+0000 7fcb0f11f800 1 -- start start 2024-03-20T13:35:35.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0f11f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603529829e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0f11f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x560352791a30 con 0x5603528935f0 2024-03-20T13:35:35.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603529829e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603529829e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33318/0 (socket says 172.21.15.177:33318) 2024-03-20T13:35:35.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0adf3640 1 -- 172.21.15.177:0/1699184517 learned_addr learned my addr 172.21.15.177:0/1699184517 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0adf3640 1 -- 172.21.15.177:0/1699184517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcafc005d20 con 0x5603528935f0 2024-03-20T13:35:35.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/1699184517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603529829e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcafc055040 tx=0x7fcafc04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a4b073dfe663523 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.559+0000 7fc9f8e09640 1 -- 172.21.15.177:0/1699184517 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc00a180 con 0x5603528935f0 2024-03-20T13:35:35.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fc9f8e09640 1 -- 172.21.15.177:0/1699184517 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc00a300 con 0x5603528935f0 2024-03-20T13:35:35.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fc9f8e09640 1 -- 172.21.15.177:0/1699184517 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc0529b0 con 0x5603528935f0 2024-03-20T13:35:35.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1699184517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 msgr2=0x5603529829e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.563 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1699184517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603529829e0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcafc055040 tx=0x7fcafc04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1699184517 shutdown_connections 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1699184517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x5603529829e0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1699184517 >> 172.21.15.177:0/1699184517 conn(0x56035288d040 msgr2=0x56035297e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1699184517 shutdown_connections 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.560+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1699184517 wait complete. 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0f11f800 1 Processor -- start 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0f11f800 1 -- start start 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0f11f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x560352892f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0f11f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56035278d210 con 0x5603528935f0 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x560352892f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x560352892f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33322/0 (socket says 172.21.15.177:33322) 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0adf3640 1 -- 172.21.15.177:0/1987251884 learned_addr learned my addr 172.21.15.177:0/1987251884 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.561+0000 7fcb0adf3640 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56035289aa40 con 0x5603528935f0 2024-03-20T13:35:35.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.562+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x560352892f30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcafc05f040 tx=0x7fcafc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.562+0000 7fc9f7606640 1 -- 172.21.15.177:0/1987251884 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc06a070 con 0x5603528935f0 2024-03-20T13:35:35.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.562+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560352891620 con 0x5603528935f0 2024-03-20T13:35:35.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.562+0000 7fc9f7606640 1 -- 172.21.15.177:0/1987251884 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc05d420 con 0x5603528935f0 2024-03-20T13:35:35.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.562+0000 7fc9f7606640 1 -- 172.21.15.177:0/1987251884 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc05d6c0 con 0x5603528935f0 2024-03-20T13:35:35.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.562+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560352891b00 con 0x5603528935f0 2024-03-20T13:35:35.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fc9f7606640 1 -- 172.21.15.177:0/1987251884 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcafc05d820 con 0x5603528935f0 2024-03-20T13:35:35.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fc9f7606640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9f0036790 0x7fc9f0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fc9f7606640 1 -- 172.21.15.177:0/1987251884 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fcafc08d920 con 0x5603528935f0 2024-03-20T13:35:35.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fcb025f2640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9f0036790 0x7fc9f0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560352895f20 0x560352993370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352892310 con 0x560352895f20 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fcb0b5f4640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560352895f20 0x560352993370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fcb025f2640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9f0036790 0x7fc9f0038c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4000f60 tx=0x7fcaf40012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.563+0000 7fcb0b5f4640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560352895f20 0x560352993370 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/1987251884 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x560352895f20 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352891e10 con 0x560352895f20 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/1987251884 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcb0400a4a0 con 0x560352895f20 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560352995790 0x560352997b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352998220 con 0x560352995790 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560352995790 0x560352997b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.564+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560352995790 0x560352997b80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb0adf3640 1 -- 172.21.15.177:0/1987251884 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fcafc059040 con 0x560352995790 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352994710 con 0x560352895f20 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/1987251884 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcb0400a4a0 con 0x560352895f20 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560352999640 0x56035299ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56035299c190 con 0x560352999640 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb025f2640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560352999640 0x56035299ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.565+0000 7fcb025f2640 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560352999640 0x56035299ba30 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb025f2640 1 -- 172.21.15.177:0/1987251884 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fcaf4006070 con 0x560352999640 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0f11f800 1 Processor -- start 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0f11f800 1 -- start start 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0f11f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 0x5603529aa740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0f11f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56035272fc70 con 0x5603529aa320 2024-03-20T13:35:35.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 0x5603529aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 0x5603529aa740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33336/0 (socket says 172.21.15.177:33336) 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.566+0000 7fcb0adf3640 1 -- 172.21.15.177:0/3920641203 learned_addr learned my addr 172.21.15.177:0/3920641203 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fcb0adf3640 1 -- 172.21.15.177:0/3920641203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603529aac80 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 0x5603529aa740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcafc08bbb0 tx=0x7fcafc04be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fc9f4e01640 1 -- 172.21.15.177:0/3920641203 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc065620 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fc9f4e01640 1 -- 172.21.15.177:0/3920641203 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc088040 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5603529ab6f0 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fc9f4e01640 1 -- 172.21.15.177:0/3920641203 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc05cca0 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.567+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603529abbb0 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.568+0000 7fc9f4e01640 1 -- 172.21.15.177:0/3920641203 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcafc08a2d0 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.568+0000 7fc9f4e01640 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9e4036830 0x7fc9e4038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.568+0000 7fc9f4e01640 1 -- 172.21.15.177:0/3920641203 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fcafc097d80 con 0x5603529aa320 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.568+0000 7fcb025f2640 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9e4036830 0x7fc9e4038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0f11f800 1 Processor -- start 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0f11f800 1 -- start start 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb025f2640 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9e4036830 0x7fc9e4038cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400bf50 tx=0x7fcaf400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0f11f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529b7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0f11f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603527055d0 con 0x5603529b7410 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529b7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33348/0 (socket says 172.21.15.177:33348) 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0adf3640 1 -- 172.21.15.177:0/4064600345 learned_addr learned my addr 172.21.15.177:0/4064600345 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0adf3640 1 -- 172.21.15.177:0/4064600345 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603529b7e00 con 0x5603529b7410 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/4064600345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529b7830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0657a0 tx=0x7fcafc067f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=778f492061d887c7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fc9ee7fc640 1 -- 172.21.15.177:0/4064600345 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc0773f0 con 0x5603529b7410 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fc9ee7fc640 1 -- 172.21.15.177:0/4064600345 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc077e90 con 0x5603529b7410 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.569+0000 7fc9ee7fc640 1 -- 172.21.15.177:0/4064600345 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc07a120 con 0x5603529b7410 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- 172.21.15.177:0/4064600345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 msgr2=0x5603529b7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/4064600345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529b7830 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fcafc0657a0 tx=0x7fcafc067f60 comp rx=0 tx=0).stop 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- 172.21.15.177:0/4064600345 shutdown_connections 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/4064600345 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529b7830 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- 172.21.15.177:0/4064600345 >> 172.21.15.177:0/4064600345 conn(0x5603529b36e0 msgr2=0x5603529b1740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- 172.21.15.177:0/4064600345 shutdown_connections 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- 172.21.15.177:0/4064600345 wait complete. 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 Processor -- start 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- start start 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529be180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.570+0000 7fcb0f11f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5603529be6c0 con 0x5603529b7410 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529be180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0adf3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529be180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33356/0 (socket says 172.21.15.177:33356) 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 learned_addr learned my addr 172.21.15.177:0/2695836996 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5603529ab6f0 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529be180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcafc08d850 tx=0x7fcafc085210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fc9ecff9640 1 -- 172.21.15.177:0/2695836996 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc0b7070 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fc9ecff9640 1 -- 172.21.15.177:0/2695836996 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcafc0097d0 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5603529ab6f0 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fc9ecff9640 1 -- 172.21.15.177:0/2695836996 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcafc009a70 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.571+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5603529ab6f0 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.572+0000 7fc9ecff9640 1 -- 172.21.15.177:0/2695836996 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcafc009bd0 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.572+0000 7fc9ecff9640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9d4036790 0x7fc9d4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.572+0000 7fc9ecff9640 1 -- 172.21.15.177:0/2695836996 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fcafc0c0a40 con 0x5603529b7410 2024-03-20T13:35:35.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.572+0000 7fcb025f2640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9d4036790 0x7fc9d4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb025f2640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9d4036790 0x7fc9d4038c50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4001b60 tx=0x7fcaf4010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5603529c9900 0x5603529cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cc510 con 0x5603529c9900 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0b5f4640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5603529c9900 0x5603529cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0b5f4640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5603529c9900 0x5603529cbdc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 20 realm 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.573+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cc8e0 con 0x5603529c9900 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd4c0 con 0x5603529c9900 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5603529cde70 0x5603529d0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d0870 con 0x5603529cde70 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5603529cde70 0x5603529d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.574+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5603529cde70 0x5603529d0260 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb0f11f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb0f11f800 20 searching for the correct realm 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5603529d2b20 0x5603529d4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d5660 con 0x5603529d2b20 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb025f2640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5603529d2b20 0x5603529d4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb025f2640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5603529d2b20 0x5603529d4fe0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.575+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d5660 con 0x5603529cde70 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0adf3640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fcafc096070 0x7fcafc087140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d5660 con 0x7fcafc096070 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0b5f4640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fcafc096070 0x7fcafc087140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0b5f4640 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fcafc096070 0x7fcafc087140 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.576+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.577+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529cde70 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.578+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.578+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.578+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.578+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.578+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.578+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.597 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529cde70 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.579+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.580+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529cde70 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.581+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529cde70 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.582+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529cde70 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.583+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.583+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529d2b20 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.583+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.583+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x7fcafc096070 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.583+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.583+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529c9900 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529cd160 con 0x5603529cde70 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d0f60 con 0x5603529c9900 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d0f60 con 0x5603529c9900 2024-03-20T13:35:35.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.584+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d0f60 con 0x7fcafc096070 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 zone default found 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 4 Realm: () 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 zonegroup default 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d17b0 con 0x7fcafc096070 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d1bb0 con 0x5603529d2b20 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.585+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d7480 con 0x5603529d2b20 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.586+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.586+0000 7fcb0f11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.586+0000 7fcb0f11f800 20 started sync module instance, tier type = 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.586+0000 7fcb0f11f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.586+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d6910 con 0x5603529cde70 2024-03-20T13:35:35.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.587+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.587+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94572270939328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d70e0 con 0x5603529cde70 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.587+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d8120 con 0x5603529c9900 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.588+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94572270939328] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.588+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.588+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94572270942656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d84d0 con 0x5603529c9900 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.588+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d8f20 con 0x5603529d2b20 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.589+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94572270942656] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.589+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.589+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94572270946816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d92d0 con 0x5603529d2b20 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.589+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d9cf0 con 0x5603529cde70 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.590+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94572270946816] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.590+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.590+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94572270943872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529da540 con 0x5603529cde70 2024-03-20T13:35:35.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.590+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529daeb0 con 0x5603529c9900 2024-03-20T13:35:35.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.591+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.591+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94572270955504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529db690 con 0x5603529c9900 2024-03-20T13:35:35.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.591+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dc160 con 0x7fcafc096070 2024-03-20T13:35:35.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.592+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94572270943872] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.593+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94572270955504] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.593+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.593+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94572270959680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dc120 con 0x7fcafc096070 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.593+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529db260 con 0x7fcafc096070 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.594+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94572270959680] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.594+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.594+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94572270952608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dc9b0 con 0x7fcafc096070 2024-03-20T13:35:35.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.594+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dd360 con 0x7fcafc096070 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'180 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94572270964352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dd7c0 con 0x7fcafc096070 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=0 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=1 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=2 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=3 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=4 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=5 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94572270952608] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.595+0000 7fcb0f11f800 20 add_watcher() i=6 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.596+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94572270964352] v32'181 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.596+0000 7fcb0f11f800 20 add_watcher() i=7 2024-03-20T13:35:35.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.596+0000 7fcb0f11f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.596+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dc510 con 0x5603529c9900 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.596+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.596+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94572270965408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dc510 con 0x5603529c9900 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94572270965408] v32'187 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fc9c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fcb0f11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fcb0f11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fcb0f11f800 5 note: GC not initialized 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fc93bfff640 20 reqs_thread_entry: start 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fcb0f11f800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.597+0000 7fcb0f11f800 20 Filter name: none 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fc939ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352a12700 con 0x5603529c9900 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv13 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.598+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~369 in=369b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352a183a0 con 0x5603529c9900 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~369] v32'14 uv14 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0f11f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0f11f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0f11f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94572271206464 in=557b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352a150c0 con 0x5603529c9900 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94572270955504 notify 137438953488 ret 0) v3 ==== 587+0+0 (crc 0 0 0) 0x7fcb0403d040 con 0x5603529c9900 2024-03-20T13:35:35.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fc9ee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953488 cookie 94572270955504 notifier 4641 bl.length()=545 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fc9ee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fc9ee7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fc9ee7fc640 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fc9d0003e90 con 0x5603529c9900 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.599+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 94572271206464 out=8b] v0'0 uv180 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.600+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.600+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94572271206464 notify 137438953488 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fcb04018dd0 con 0x5603529c9900 2024-03-20T13:35:35.614 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.601+0000 7fc9c17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.601+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94572270965408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x560352a11480 con 0x5603529c9900 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.602+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94572270965408] v32'188 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.602+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94572270939328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dd2a0 con 0x5603529cde70 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.603+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94572270939328] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.603+0000 7fcb0f11f800 20 remove_watcher() i=0 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.603+0000 7fcb0f11f800 2 removed watcher, disabling cache 2024-03-20T13:35:35.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.603+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94572270942656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dd2a0 con 0x5603529c9900 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.604+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94572270942656] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.604+0000 7fcb0f11f800 20 remove_watcher() i=1 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.604+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94572270946816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d79c0 con 0x5603529d2b20 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.605+0000 7fcb025f2640 1 -- 172.21.15.177:0/2695836996 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94572270946816] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcaf4006070 con 0x5603529d2b20 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.605+0000 7fcb0f11f800 20 remove_watcher() i=2 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.605+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94572270943872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dd2a0 con 0x5603529cde70 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.606+0000 7fcb0adf3640 1 -- 172.21.15.177:0/2695836996 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94572270943872] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcafc0a8020 con 0x5603529cde70 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.606+0000 7fcb0f11f800 20 remove_watcher() i=3 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.606+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94572270955504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d8a00 con 0x5603529c9900 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.607+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94572270955504] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x5603529c9900 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.607+0000 7fcb0f11f800 20 remove_watcher() i=4 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.607+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94572270959680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d79c0 con 0x7fcafc096070 2024-03-20T13:35:35.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.608+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94572270959680] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.608+0000 7fcb0f11f800 20 remove_watcher() i=5 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.608+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94572270952608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529dd2a0 con 0x7fcafc096070 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.609+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94572270952608] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.609+0000 7fcb0f11f800 20 remove_watcher() i=6 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.609+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94572270964352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5603529d8a00 con 0x7fcafc096070 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94572270964352] v32'182 uv180 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fcb0400a4a0 con 0x7fcafc096070 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 20 remove_watcher() i=7 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fcafc096070 msgr2=0x7fcafc087140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fcafc096070 0x7fcafc087140 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5603529c9900 msgr2=0x5603529cbdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5603529c9900 0x5603529cbdc0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5603529cde70 msgr2=0x5603529d0260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5603529cde70 0x5603529d0260 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5603529d2b20 msgr2=0x5603529d4fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5603529d2b20 0x5603529d4fe0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9d4036790 msgr2=0x7fc9d4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9d4036790 0x7fc9d4038c50 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4001b60 tx=0x7fcaf4010000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/2695836996 reap_dead start 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 msgr2=0x5603529be180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529be180 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fcafc08d850 tx=0x7fcafc085210 comp rx=0 tx=0).stop 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 shutdown_connections 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/2695836996 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529b7410 0x5603529be180 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 >> 172.21.15.177:0/2695836996 conn(0x5603529b36e0 msgr2=0x5603529b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 shutdown_connections 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/2695836996 wait complete. 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9e4036830 msgr2=0x7fc9e4038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9e4036830 0x7fc9e4038cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaf400bf50 tx=0x7fcaf400f000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 msgr2=0x5603529aa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 0x5603529aa740 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fcafc08bbb0 tx=0x7fcafc04be40 comp rx=0 tx=0).stop 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 shutdown_connections 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9e4036830 0x7fc9e4038cf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/3920641203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603529aa320 0x5603529aa740 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 >> 172.21.15.177:0/3920641203 conn(0x56035299e3c0 msgr2=0x56035299e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 shutdown_connections 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.610+0000 7fcb0f11f800 1 -- 172.21.15.177:0/3920641203 wait complete. 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560352999640 msgr2=0x56035299ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x560352999640 0x56035299ba30 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560352895f20 msgr2=0x560352993370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x560352895f20 0x560352993370 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560352995790 msgr2=0x560352997b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x560352995790 0x560352997b80 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9f0036790 msgr2=0x7fc9f0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc9f0036790 0x7fc9f0038c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4000f60 tx=0x7fcaf40012b0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 msgr2=0x560352892f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 --2- 172.21.15.177:0/1987251884 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5603528935f0 0x560352892f30 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcafc05f040 tx=0x7fcafc002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0b5f4640 1 -- 172.21.15.177:0/1987251884 reap_dead start 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 shutdown_connections 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 >> 172.21.15.177:0/1987251884 conn(0x56035288d040 msgr2=0x5603529813d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 shutdown_connections 2024-03-20T13:35:35.625 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.611+0000 7fcb0f11f800 1 -- 172.21.15.177:0/1987251884 wait complete. 2024-03-20T13:35:35.625 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:35.625 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:35:35.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-03-20T13:35:35.626 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-03-20T13:35:35.670 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:35.670 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:35.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.670+0000 7f4ce7c30800 1 Processor -- start 2024-03-20T13:35:35.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.670+0000 7f4ce7c30800 1 -- start start 2024-03-20T13:35:35.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.670+0000 7f4ce7c30800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b932d9ff40 0x55b932da8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.670+0000 7f4ce7c30800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b932ceacd0 con 0x55b932d9e400 2024-03-20T13:35:35.671 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.670+0000 7f4ce7c30800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b932ca1500 con 0x55b932d9ff40 2024-03-20T13:35:35.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.671+0000 7f4cda659640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b932d9ff40 0x55b932da8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.671+0000 7f4ce2e5a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55b932d9e400 0x55b932d9e820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46372/0 (socket says 172.21.15.177:46372) 2024-03-20T13:35:35.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.671+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/553419803 learned_addr learned my addr 172.21.15.177:0/553419803 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:35:35.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.671+0000 7f4cda659640 1 -- 172.21.15.177:0/553419803 >> v1:172.21.15.28:6789/0 conn(0x55b932d9e400 legacy=0x55b932d9e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.671+0000 7f4ce2659640 1 -- 172.21.15.177:0/553419803 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562648973 0 0) 0x55b932ceacd0 con 0x55b932d9e400 2024-03-20T13:35:35.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.671+0000 7f4cda659640 1 -- 172.21.15.177:0/553419803 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b932d12f00 con 0x55b932d9ff40 2024-03-20T13:35:35.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4cda659640 1 --2- 172.21.15.177:0/553419803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9ff40 0x55b932da8a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e8a7d84d27cb6d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce2659640 1 -- 172.21.15.177:0/553419803 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc04ad40 con 0x55b932d9ff40 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce2659640 1 -- 172.21.15.177:0/553419803 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ccc052440 con 0x55b932d9ff40 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce2659640 1 -- 172.21.15.177:0/553419803 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc04aea0 con 0x55b932d9ff40 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 -- 172.21.15.177:0/553419803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9ff40 msgr2=0x55b932da8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/553419803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9ff40 0x55b932da8a40 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc01cd60 comp rx=0 tx=0).stop 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 -- 172.21.15.177:0/553419803 shutdown_connections 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/553419803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9ff40 0x55b932da8a40 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 -- 172.21.15.177:0/553419803 >> 172.21.15.177:0/553419803 conn(0x55b932d9a040 msgr2=0x55b932d9c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 -- 172.21.15.177:0/553419803 shutdown_connections 2024-03-20T13:35:35.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.673+0000 7f4ce7c30800 1 -- 172.21.15.177:0/553419803 wait complete. 2024-03-20T13:35:35.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce7c30800 1 Processor -- start 2024-03-20T13:35:35.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce7c30800 1 -- start start 2024-03-20T13:35:35.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce7c30800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e91b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce7c30800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b932c9ea30 con 0x55b932d9e400 2024-03-20T13:35:35.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e91b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e91b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33378/0 (socket says 172.21.15.177:33378) 2024-03-20T13:35:35.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.685+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/2241363414 learned_addr learned my addr 172.21.15.177:0/2241363414 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.686+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/2241363414 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ccc005d20 con 0x55b932d9e400 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.686+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/2241363414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e91b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b210 tx=0x7f4cd400b6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d3b964251376ad server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.686+0000 7f4bd0e09640 1 -- 172.21.15.177:0/2241363414 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4014070 con 0x55b932d9e400 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.686+0000 7f4bd0e09640 1 -- 172.21.15.177:0/2241363414 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd400d500 con 0x55b932d9e400 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.686+0000 7f4bd0e09640 1 -- 172.21.15.177:0/2241363414 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd400d800 con 0x55b932d9e400 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 -- 172.21.15.177:0/2241363414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 msgr2=0x55b932e91b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/2241363414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e91b20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b210 tx=0x7f4cd400b6d0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 -- 172.21.15.177:0/2241363414 shutdown_connections 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/2241363414 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e91b20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 -- 172.21.15.177:0/2241363414 >> 172.21.15.177:0/2241363414 conn(0x55b932d9a040 msgr2=0x55b932e8d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 -- 172.21.15.177:0/2241363414 shutdown_connections 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 -- 172.21.15.177:0/2241363414 wait complete. 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 Processor -- start 2024-03-20T13:35:35.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.687+0000 7f4ce7c30800 1 -- start start 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce7c30800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce7c30800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b932c9a210 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33384/0 (socket says 172.21.15.177:33384) 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/697532071 learned_addr learned my addr 172.21.15.177:0/697532071 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4001b70 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e992a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b210 tx=0x7f4cd4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4bcf606640 1 -- 172.21.15.177:0/697532071 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd400f950 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4bcf606640 1 -- 172.21.15.177:0/697532071 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4020070 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4bcf606640 1 -- 172.21.15.177:0/697532071 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd400fc20 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b932e997e0 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.688+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b932e99cc0 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.689+0000 7f4bcf606640 1 -- 172.21.15.177:0/697532071 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd400d040 con 0x55b932d9e400 2024-03-20T13:35:35.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.689+0000 7f4bcf606640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bc80367e0 0x7f4bc8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.689+0000 7f4bcf606640 1 -- 172.21.15.177:0/697532071 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f4cd400a040 con 0x55b932d9e400 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.689+0000 7f4cda659640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bc80367e0 0x7f4bc8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.689+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932d9ff40 0x55b932e9ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.689+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ea0540 con 0x55b932d9ff40 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce365b640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932d9ff40 0x55b932e9ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4cda659640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bc80367e0 0x7f4bc8038ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc054000 tx=0x7f4ccc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce365b640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932d9ff40 0x55b932e9ff70 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce365b640 1 -- 172.21.15.177:0/697532071 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932d9ff40 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932e9d6a0 con 0x55b932d9ff40 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce365b640 1 -- 172.21.15.177:0/697532071 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932d9ff40 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932ea27b0 0x55b932ea4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ea5290 con 0x55b932ea27b0 2024-03-20T13:35:35.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.690+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932ea27b0 0x55b932ea4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.691+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932ea27b0 0x55b932ea4ba0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.691+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/697532071 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932ea27b0 2024-03-20T13:35:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.691+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ea1730 con 0x55b932d9ff40 2024-03-20T13:35:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.691+0000 7f4ce365b640 1 -- 172.21.15.177:0/697532071 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932d9ff40 2024-03-20T13:35:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.691+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b932ea66b0 0x55b932ea8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.691+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ea91e0 con 0x55b932ea66b0 2024-03-20T13:35:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.693+0000 7f4cda659640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b932ea66b0 0x55b932ea8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.695+0000 7f4cda659640 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b932ea66b0 0x55b932ea8aa0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.695+0000 7f4cda659640 1 -- 172.21.15.177:0/697532071 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f4ccc0525b0 con 0x55b932ea66b0 2024-03-20T13:35:35.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.695+0000 7f4ce7c30800 1 Processor -- start 2024-03-20T13:35:35.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.695+0000 7f4ce7c30800 1 -- start start 2024-03-20T13:35:35.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.695+0000 7f4ce7c30800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 0x55b932eb7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.695+0000 7f4ce7c30800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b932c3cc70 con 0x55b932eb7310 2024-03-20T13:35:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.696+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 0x55b932eb7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.696+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 0x55b932eb7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33392/0 (socket says 172.21.15.177:33392) 2024-03-20T13:35:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.696+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1585085931 learned_addr learned my addr 172.21.15.177:0/1585085931 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.696+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1585085931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b932eb7c70 con 0x55b932eb7310 2024-03-20T13:35:35.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 0x55b932eb7730 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4cd404c010 tx=0x7f4cd4044eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4bcce01640 1 -- 172.21.15.177:0/1585085931 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4036070 con 0x55b932eb7310 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4bcce01640 1 -- 172.21.15.177:0/1585085931 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd401a3c0 con 0x55b932eb7310 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4bcce01640 1 -- 172.21.15.177:0/1585085931 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd4044750 con 0x55b932eb7310 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b932eb86e0 con 0x55b932eb7310 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b932eb8ba0 con 0x55b932eb7310 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.697+0000 7f4bcce01640 1 -- 172.21.15.177:0/1585085931 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd401bc60 con 0x55b932eb7310 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4bcce01640 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bbc036790 0x7f4bbc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4bcce01640 1 -- 172.21.15.177:0/1585085931 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f4cd403cd90 con 0x55b932eb7310 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4cda659640 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bbc036790 0x7f4bbc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce7c30800 1 Processor -- start 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce7c30800 1 -- start start 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4cda659640 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bbc036790 0x7f4bbc038c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55b932e9d5c0 tx=0x7f4ccc005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce7c30800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ec47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce7c30800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b932c125d0 con 0x55b932ec43e0 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ec47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ec47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33402/0 (socket says 172.21.15.177:33402) 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/571207840 learned_addr learned my addr 172.21.15.177:0/571207840 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.698+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/571207840 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b932ec4d90 con 0x55b932ec43e0 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/571207840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ec47c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4018fd0 tx=0x7f4cd4029e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded97f1f36ef52af server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4bc67fc640 1 -- 172.21.15.177:0/571207840 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd40448b0 con 0x55b932ec43e0 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4bc67fc640 1 -- 172.21.15.177:0/571207840 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd404c8f0 con 0x55b932ec43e0 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4bc67fc640 1 -- 172.21.15.177:0/571207840 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd404cd40 con 0x55b932ec43e0 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 -- 172.21.15.177:0/571207840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 msgr2=0x55b932ec47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/571207840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ec47c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4018fd0 tx=0x7f4cd4029e60 comp rx=0 tx=0).stop 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 -- 172.21.15.177:0/571207840 shutdown_connections 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/571207840 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ec47c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 -- 172.21.15.177:0/571207840 >> 172.21.15.177:0/571207840 conn(0x55b932ec06b0 msgr2=0x55b932ebe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 -- 172.21.15.177:0/571207840 shutdown_connections 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.699+0000 7f4ce7c30800 1 -- 172.21.15.177:0/571207840 wait complete. 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce7c30800 1 Processor -- start 2024-03-20T13:35:35.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce7c30800 1 -- start start 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce7c30800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ecb320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce7c30800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b932ecb860 con 0x55b932ec43e0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ecb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce2e5a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ecb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33418/0 (socket says 172.21.15.177:33418) 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 learned_addr learned my addr 172.21.15.177:0/1239742303 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.700+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cd4050020 con 0x55b932ec43e0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.701+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ecb320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4038000 tx=0x7f4cd4037f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.701+0000 7f4bc4ff9640 1 -- 172.21.15.177:0/1239742303 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd40448b0 con 0x55b932ec43e0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.701+0000 7f4bc4ff9640 1 -- 172.21.15.177:0/1239742303 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd4034580 con 0x55b932ec43e0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.701+0000 7f4bc4ff9640 1 -- 172.21.15.177:0/1239742303 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4cd40308e0 con 0x55b932ec43e0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.701+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b932ecba60 con 0x55b932ec43e0 2024-03-20T13:35:35.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.701+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b932ecba60 con 0x55b932ec43e0 2024-03-20T13:35:35.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4bc4ff9640 1 -- 172.21.15.177:0/1239742303 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f4cd4030a40 con 0x55b932ec43e0 2024-03-20T13:35:35.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4bc4ff9640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bac036790 0x7f4bac038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4bc4ff9640 1 -- 172.21.15.177:0/1239742303 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f4cd4078d90 con 0x55b932ec43e0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4cda659640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bac036790 0x7f4bac038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932ed6d60 0x55b932ed9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ed9970 con 0x55b932ed6d60 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4cda659640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bac036790 0x7f4bac038c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc052fd0 tx=0x7f4ccc04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.702+0000 7f4ce365b640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932ed6d60 0x55b932ed9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce365b640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932ed6d60 0x55b932ed9220 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 realm 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ed9d40 con 0x55b932ed6d60 2024-03-20T13:35:35.712 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda920 con 0x55b932ed6d60 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.703+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932edb2d0 0x55b932edd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eddc80 con 0x55b932edb2d0 2024-03-20T13:35:35.713 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932edb2d0 0x55b932edd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932edb2d0 0x55b932edd6c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 20 searching for the correct realm 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b932edff90 0x55b932ee2450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee2b20 con 0x55b932edff90 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.704+0000 7f4cda659640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b932edff90 0x55b932ee2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.705+0000 7f4cda659640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b932edff90 0x55b932ee2450 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.705+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc0525b0 con 0x55b932edff90 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.705+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee2b20 con 0x55b932edb2d0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.705+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.705+0000 7f4ce2e5a640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4cd4077060 0x7f4cd400e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.705+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee2b20 con 0x7f4cd4077060 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.706+0000 7f4ce365b640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4cd4077060 0x7f4cd400e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.708+0000 7f4ce365b640 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4cd4077060 0x7f4cd400e780 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.708+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.708+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.709+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edb2d0 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.710+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edb2d0 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.711+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.712+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.713+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.713+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.713+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.713+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edb2d0 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.713+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.713+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.714+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.714+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.714+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.714+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edb2d0 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.714+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.714+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edb2d0 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edff90 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x7f4cd4077060 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.715+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932ed6d60 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eda5c0 con 0x55b932edb2d0 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ede390 con 0x55b932ed6d60 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ede390 con 0x55b932ed6d60 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.716+0000 7f4ce7c30800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ede340 con 0x7f4cd4077060 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 20 zone default found 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 4 Realm: () 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:35.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 20 zonegroup default 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.717+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932edec30 con 0x7f4cd4077060 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.718+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.718+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.718+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.718+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932edec30 con 0x55b932edff90 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee4940 con 0x55b932edff90 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 20 started sync module instance, tier type = 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.719+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee4220 con 0x55b932edb2d0 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.720+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.720+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94253911784832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee5140 con 0x55b932edb2d0 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.720+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee5940 con 0x55b932ed6d60 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.721+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94253911784832] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.721+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.721+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94253911790752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee4db0 con 0x55b932ed6d60 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.721+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee64a0 con 0x55b932edff90 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.722+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.722+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94253911793536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee6d30 con 0x55b932edff90 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.722+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee77d0 con 0x55b932edb2d0 2024-03-20T13:35:35.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.722+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94253911790752] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.723+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.723+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94253911793536] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.723+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94253911791808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee8020 con 0x55b932edb2d0 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.723+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee6850 con 0x55b932ed6d60 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.724+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.724+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94253911803120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee6850 con 0x55b932ed6d60 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.724+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee93c0 con 0x7f4cd4077060 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.724+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94253911791808] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.725+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.725+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94253911800704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee93c0 con 0x7f4cd4077060 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.725+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94253911803120] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.725+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee8910 con 0x7f4cd4077060 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.726+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94253911800704] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.726+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.726+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94253911805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee9340 con 0x7f4cd4077060 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.726+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eea1d0 con 0x7f4cd4077060 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94253911805728] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'183 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94253911808144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eea150 con 0x7f4cd4077060 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=0 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=1 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=2 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=3 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=4 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=5 2024-03-20T13:35:35.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.728+0000 7f4ce7c30800 20 add_watcher() i=6 2024-03-20T13:35:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.729+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94253911808144] v32'184 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.729+0000 7f4ce7c30800 20 add_watcher() i=7 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.729+0000 7f4ce7c30800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.729+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eed5e0 con 0x55b932ed6d60 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.730+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.730+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94253911809664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eeaaf0 con 0x55b932ed6d60 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94253911809664] v32'189 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4b997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4ce7c30800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4ce7c30800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4ce7c30800 5 note: GC not initialized 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4b13fff640 20 reqs_thread_entry: start 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.731+0000 7f4ce7c30800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 20 Filter name: none 2024-03-20T13:35:35.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4b11ffb640 20 reqs_thread_entry: start 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932f1f5a0 con 0x55b932ed6d60 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~369 out=369b,getxattrs out=75b] v0'0 uv14 ondisk = 0) v8 ==== 231+0+492 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 20 rados_obj.operate() r=0 bl.length=369 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.732+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~357 in=357b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932f25160 con 0x55b932ed6d60 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.733+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~357] v32'15 uv15 ondisk = 0) v8 ==== 315+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.733+0000 7f4ce7c30800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:35.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.733+0000 7f4ce7c30800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.733+0000 7f4ce7c30800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.733+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94253912050688 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932f21f60 con 0x55b932ed6d60 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== watch-notify(notify (1) cookie 94253911803120 notify 137438953489 ret 0) v3 ==== 575+0+0 (crc 0 0 0) 0x7f4cdc03d040 con 0x55b932ed6d60 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4bc67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953489 cookie 94253911803120 notifier 4648 bl.length()=533 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(64 notify.4 [notify cookie 94253912050688 out=8b] v0'0 uv183 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4bc67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4bc67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4bc67fc640 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f4ba8003e90 con 0x55b932ed6d60 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.734+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== watch-notify(notify_complete (2) cookie 94253912050688 notify 137438953489 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f4cdc018d90 con 0x55b932ed6d60 2024-03-20T13:35:35.744 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.735+0000 7f4b997e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.735+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94253911809664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eed140 con 0x55b932ed6d60 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.736+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94253911809664] v32'190 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.736+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94253911784832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932eecca0 con 0x55b932edb2d0 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.737+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94253911784832] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.737+0000 7f4ce7c30800 20 remove_watcher() i=0 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.737+0000 7f4ce7c30800 2 removed watcher, disabling cache 2024-03-20T13:35:35.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.737+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94253911790752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee3d80 con 0x55b932ed6d60 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.738+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94253911790752] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.738+0000 7f4ce7c30800 20 remove_watcher() i=1 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.738+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94253911793536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee3d80 con 0x55b932edff90 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.739+0000 7f4cda659640 1 -- 172.21.15.177:0/1239742303 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94253911793536] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4ccc08b040 con 0x55b932edff90 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.739+0000 7f4ce7c30800 20 remove_watcher() i=2 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.739+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94253911791808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee5f80 con 0x55b932edb2d0 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.740+0000 7f4ce2e5a640 1 -- 172.21.15.177:0/1239742303 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94253911791808] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cd4016070 con 0x55b932edb2d0 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.740+0000 7f4ce7c30800 20 remove_watcher() i=3 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.740+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94253911803120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee5f80 con 0x55b932ed6d60 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.741+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94253911803120] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x55b932ed6d60 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.741+0000 7f4ce7c30800 20 remove_watcher() i=4 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.741+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94253911800704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee5f80 con 0x7f4cd4077060 2024-03-20T13:35:35.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.743+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94253911800704] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.743+0000 7f4ce7c30800 20 remove_watcher() i=5 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.743+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94253911805728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee5f80 con 0x7f4cd4077060 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.744+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94253911805728] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.744+0000 7f4ce7c30800 20 remove_watcher() i=6 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.744+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94253911808144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b932ee8f20 con 0x7f4cd4077060 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94253911808144] v32'185 uv183 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f4cdc00a4a0 con 0x7f4cd4077060 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 20 remove_watcher() i=7 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4cd4077060 msgr2=0x7f4cd400e780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f4cd4077060 0x7f4cd400e780 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932ed6d60 msgr2=0x55b932ed9220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932ed6d60 0x55b932ed9220 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932edb2d0 msgr2=0x55b932edd6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932edb2d0 0x55b932edd6c0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b932edff90 msgr2=0x55b932ee2450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.745+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b932edff90 0x55b932ee2450 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bac036790 msgr2=0x7f4bac038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bac036790 0x7f4bac038c50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc052fd0 tx=0x7f4ccc04f000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 msgr2=0x55b932ecb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ecb320 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f4cd4038000 tx=0x7f4cd4037f50 comp rx=0 tx=0).stop 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce365b640 1 -- 172.21.15.177:0/1239742303 reap_dead start 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 shutdown_connections 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1239742303 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932ec43e0 0x55b932ecb320 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 >> 172.21.15.177:0/1239742303 conn(0x55b932ec06b0 msgr2=0x55b932ebdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 shutdown_connections 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1239742303 wait complete. 2024-03-20T13:35:35.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bbc036790 msgr2=0x7f4bbc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bbc036790 0x7f4bbc038c50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x55b932e9d5c0 tx=0x7f4ccc005a00 comp rx=0 tx=0).stop 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 msgr2=0x55b932eb7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 0x55b932eb7730 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f4cd404c010 tx=0x7f4cd4044eb0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 shutdown_connections 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bbc036790 0x7f4bbc038c50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/1585085931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932eb7310 0x55b932eb7730 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 >> 172.21.15.177:0/1585085931 conn(0x55b932eab3b0 msgr2=0x55b932eab7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 shutdown_connections 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/1585085931 wait complete. 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b932ea66b0 msgr2=0x55b932ea8aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b932ea66b0 0x55b932ea8aa0 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932d9ff40 msgr2=0x55b932e9ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b932d9ff40 0x55b932e9ff70 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932ea27b0 msgr2=0x55b932ea4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b932ea27b0 0x55b932ea4ba0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bc80367e0 msgr2=0x7f4bc8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4bc80367e0 0x7f4bc8038ca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc054000 tx=0x7f4ccc04e000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 msgr2=0x55b932e992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.746+0000 7f4ce7c30800 1 --2- 172.21.15.177:0/697532071 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b932d9e400 0x55b932e992a0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f4cd400b210 tx=0x7f4cd4000ed0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.747+0000 7f4ce365b640 1 -- 172.21.15.177:0/697532071 reap_dead start 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.747+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 shutdown_connections 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.747+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 >> 172.21.15.177:0/697532071 conn(0x55b932d9a040 msgr2=0x55b932e8bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.747+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 shutdown_connections 2024-03-20T13:35:35.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.747+0000 7f4ce7c30800 1 -- 172.21.15.177:0/697532071 wait complete. 2024-03-20T13:35:35.755 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:35:35.767 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:35.767 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-03-20T13:35:35.767 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-03-20T13:35:35.767 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-03-20T13:35:35.810 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:35:35.810 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:35:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.809+0000 7f647e6c0800 1 Processor -- start 2024-03-20T13:35:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.809+0000 7f647e6c0800 1 -- start start 2024-03-20T13:35:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647e6c0800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564b2fe14570 0x564b2fe16960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647e6c0800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564b2fd5ecd0 con 0x564b2fe16ea0 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647e6c0800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x564b2fd15500 con 0x564b2fe14570 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647c1c6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564b2fe14570 0x564b2fe16960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647c1c6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564b2fe14570 0x564b2fe16960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33422/0 (socket says 172.21.15.177:33422) 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647b9c5640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x564b2fe16ea0 0x564b2fe19290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:46376/0 (socket says 172.21.15.177:46376) 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647c1c6640 1 -- 172.21.15.177:0/1928817636 learned_addr learned my addr 172.21.15.177:0/1928817636 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647c1c6640 1 -- 172.21.15.177:0/1928817636 >> v1:172.21.15.28:6789/0 conn(0x564b2fe16ea0 legacy=0x564b2fe19290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.810+0000 7f647c1c6640 1 -- 172.21.15.177:0/1928817636 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2fe1b9c0 con 0x564b2fe14570 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.812+0000 7f647c1c6640 1 --2- 172.21.15.177:0/1928817636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2fe16960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f646c00a520 tx=0x7f646c01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ce6cd57d5d091b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.812+0000 7f647b1c4640 1 -- 172.21.15.177:0/1928817636 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c052570 con 0x564b2fe14570 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.812+0000 7f647b1c4640 1 -- 172.21.15.177:0/1928817636 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0526d0 con 0x564b2fe14570 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.812+0000 7f647b1c4640 1 -- 172.21.15.177:0/1928817636 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c052990 con 0x564b2fe14570 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 -- 172.21.15.177:0/1928817636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 msgr2=0x564b2fe16960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1928817636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2fe16960 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f646c00a520 tx=0x7f646c01cee0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 -- 172.21.15.177:0/1928817636 shutdown_connections 2024-03-20T13:35:35.814 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1928817636 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2fe16960 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 -- 172.21.15.177:0/1928817636 >> 172.21.15.177:0/1928817636 conn(0x564b2fe0e040 msgr2=0x564b2fe10460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 -- 172.21.15.177:0/1928817636 shutdown_connections 2024-03-20T13:35:35.815 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.813+0000 7f647e6c0800 1 -- 172.21.15.177:0/1928817636 wait complete. 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.824+0000 7f647e6c0800 1 Processor -- start 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.824+0000 7f647e6c0800 1 -- start start 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.824+0000 7f647e6c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff03a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f647e6c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd12a30 con 0x564b2fe14570 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff03a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff03a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33426/0 (socket says 172.21.15.177:33426) 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f647c1c6640 1 -- 172.21.15.177:0/4281188561 learned_addr learned my addr 172.21.15.177:0/4281188561 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.826 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f647c1c6640 1 -- 172.21.15.177:0/4281188561 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f646c005de0 con 0x564b2fe14570 2024-03-20T13:35:35.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f647c1c6640 1 --2- 172.21.15.177:0/4281188561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff03a50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f646c055040 tx=0x7f646c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797a460eaf33b230 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f636a60c640 1 -- 172.21.15.177:0/4281188561 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c052840 con 0x564b2fe14570 2024-03-20T13:35:35.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f636a60c640 1 -- 172.21.15.177:0/4281188561 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c0529c0 con 0x564b2fe14570 2024-03-20T13:35:35.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.825+0000 7f636a60c640 1 -- 172.21.15.177:0/4281188561 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c052ca0 con 0x564b2fe14570 2024-03-20T13:35:35.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 -- 172.21.15.177:0/4281188561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 msgr2=0x564b2ff03a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 --2- 172.21.15.177:0/4281188561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff03a50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f646c055040 tx=0x7f646c04c000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 -- 172.21.15.177:0/4281188561 shutdown_connections 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 --2- 172.21.15.177:0/4281188561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff03a50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 -- 172.21.15.177:0/4281188561 >> 172.21.15.177:0/4281188561 conn(0x564b2fe0e040 msgr2=0x564b2feff370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 -- 172.21.15.177:0/4281188561 shutdown_connections 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.826+0000 7f647e6c0800 1 -- 172.21.15.177:0/4281188561 wait complete. 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647e6c0800 1 Processor -- start 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647e6c0800 1 -- start start 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647e6c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff0b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647e6c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fd0e210 con 0x564b2fe14570 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff0b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff0b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33434/0 (socket says 172.21.15.177:33434) 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647c1c6640 1 -- 172.21.15.177:0/1600475974 learned_addr learned my addr 172.21.15.177:0/1600475974 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647c1c6640 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2fe1b9c0 con 0x564b2fe14570 2024-03-20T13:35:35.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f647c1c6640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff0b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f646c01ceb0 tx=0x7f646c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.827+0000 7f6368e09640 1 -- 172.21.15.177:0/1600475974 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c06c070 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f6368e09640 1 -- 172.21.15.177:0/1600475974 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c05d690 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564b2ff0b5e0 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f6368e09640 1 -- 172.21.15.177:0/1600475974 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c05d970 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b2ff0bb20 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f6368e09640 1 -- 172.21.15.177:0/1600475974 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f646c059040 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f6368e09640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63640367e0 0x7f6364038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.828+0000 7f6368e09640 1 -- 172.21.15.177:0/1600475974 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f646c08d890 con 0x564b2fe14570 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647b9c5640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63640367e0 0x7f6364038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2fe16ea0 0x564b2ff11ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff12400 con 0x564b2fe16ea0 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647c9c7640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2fe16ea0 0x564b2ff11ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647b9c5640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63640367e0 0x7f6364038ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6470000f60 tx=0x7f6470001370 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647c9c7640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2fe16ea0 0x564b2ff11ec0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647c9c7640 1 -- 172.21.15.177:0/1600475974 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2fe16ea0 2024-03-20T13:35:35.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.829+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff0f480 con 0x564b2fe16ea0 2024-03-20T13:35:35.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647c9c7640 1 -- 172.21.15.177:0/1600475974 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2fe16ea0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff14610 0x564b2ff16a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff17100 con 0x564b2ff14610 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647c1c6640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff14610 0x564b2ff16a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647c1c6640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff14610 0x564b2ff16a00 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647c1c6640 1 -- 172.21.15.177:0/1600475974 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f646c078360 con 0x564b2ff14610 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.830+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff13590 con 0x564b2fe16ea0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.831+0000 7f647c9c7640 1 -- 172.21.15.177:0/1600475974 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2fe16ea0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.831+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564b2ff18520 0x564b2ff1a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.831+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff1b070 con 0x564b2ff18520 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.831+0000 7f647b9c5640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564b2ff18520 0x564b2ff1a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.832+0000 7f647b9c5640 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564b2ff18520 0x564b2ff1a910 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.832+0000 7f647b9c5640 1 -- 172.21.15.177:0/1600475974 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f647000f690 con 0x564b2ff18520 2024-03-20T13:35:35.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.832+0000 7f647e6c0800 1 Processor -- start 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647e6c0800 1 -- start start 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647e6c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 0x564b2ff29620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647e6c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fcb0c70 con 0x564b2ff29200 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 0x564b2ff29620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 0x564b2ff29620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33438/0 (socket says 172.21.15.177:33438) 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647c1c6640 1 -- 172.21.15.177:0/2527181176 learned_addr learned my addr 172.21.15.177:0/2527181176 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.833+0000 7f647c1c6640 1 -- 172.21.15.177:0/2527181176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2ff29b60 con 0x564b2ff29200 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.834+0000 7f647c1c6640 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 0x564b2ff29620 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f646c08bc80 tx=0x7f646c054da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.834+0000 7f6361ffb640 1 -- 172.21.15.177:0/2527181176 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c05dc30 con 0x564b2ff29200 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.834+0000 7f6361ffb640 1 -- 172.21.15.177:0/2527181176 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c06fa70 con 0x564b2ff29200 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.834+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564b2ff2a5d0 con 0x564b2ff29200 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.834+0000 7f6361ffb640 1 -- 172.21.15.177:0/2527181176 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c08dd00 con 0x564b2ff29200 2024-03-20T13:35:35.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.834+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b2ff2aa90 con 0x564b2ff29200 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.835+0000 7f6361ffb640 1 -- 172.21.15.177:0/2527181176 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f646c0795c0 con 0x564b2ff29200 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.835+0000 7f6361ffb640 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63540367e0 0x7f6354038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.835+0000 7f6361ffb640 1 -- 172.21.15.177:0/2527181176 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f646c07cd80 con 0x564b2ff29200 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.835+0000 7f647b9c5640 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63540367e0 0x7f6354038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647e6c0800 1 Processor -- start 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647e6c0800 1 -- start start 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647b9c5640 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63540367e0 0x7f6354038ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x564b2ff0f800 tx=0x7f647000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647e6c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff36700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647e6c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2fc865d0 con 0x564b2ff362e0 2024-03-20T13:35:35.848 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff36700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff36700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33450/0 (socket says 172.21.15.177:33450) 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647c1c6640 1 -- 172.21.15.177:0/339793043 learned_addr learned my addr 172.21.15.177:0/339793043 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.836+0000 7f647c1c6640 1 -- 172.21.15.177:0/339793043 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2ff36cd0 con 0x564b2ff362e0 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f647c1c6640 1 --2- 172.21.15.177:0/339793043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff36700 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f646c052d80 tx=0x7f646c070700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b177f5f72f8d41a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f635b7fe640 1 -- 172.21.15.177:0/339793043 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c09b040 con 0x564b2ff362e0 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f635b7fe640 1 -- 172.21.15.177:0/339793043 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c087420 con 0x564b2ff362e0 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f635b7fe640 1 -- 172.21.15.177:0/339793043 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c088e80 con 0x564b2ff362e0 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f647e6c0800 1 -- 172.21.15.177:0/339793043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 msgr2=0x564b2ff36700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f647e6c0800 1 --2- 172.21.15.177:0/339793043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff36700 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f646c052d80 tx=0x7f646c070700 comp rx=0 tx=0).stop 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f647e6c0800 1 -- 172.21.15.177:0/339793043 shutdown_connections 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f647e6c0800 1 --2- 172.21.15.177:0/339793043 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff36700 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.837+0000 7f647e6c0800 1 -- 172.21.15.177:0/339793043 >> 172.21.15.177:0/339793043 conn(0x564b2ff325b0 msgr2=0x564b2ff30610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647e6c0800 1 -- 172.21.15.177:0/339793043 shutdown_connections 2024-03-20T13:35:35.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647e6c0800 1 -- 172.21.15.177:0/339793043 wait complete. 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647e6c0800 1 Processor -- start 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647e6c0800 1 -- start start 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647e6c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff3d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647e6c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b2ff3d6e0 con 0x564b2ff362e0 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff3d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647c1c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff3d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:33452/0 (socket says 172.21.15.177:33452) 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 learned_addr learned my addr 172.21.15.177:0/2008322156 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.838+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b2ff2a5d0 con 0x564b2ff362e0 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f647c1c6640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff3d1a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f646c08d840 tx=0x7f646c081f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f6359ffb640 1 -- 172.21.15.177:0/2008322156 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c087590 con 0x564b2ff362e0 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f6359ffb640 1 -- 172.21.15.177:0/2008322156 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f646c070870 con 0x564b2ff362e0 2024-03-20T13:35:35.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564b2ff2a5d0 con 0x564b2ff362e0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f6359ffb640 1 -- 172.21.15.177:0/2008322156 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f646c070b10 con 0x564b2ff362e0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b2ff2a5d0 con 0x564b2ff362e0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.839+0000 7f6359ffb640 1 -- 172.21.15.177:0/2008322156 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f646c096d50 con 0x564b2ff362e0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f6359ffb640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f634c036790 0x7f634c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f6359ffb640 1 -- 172.21.15.177:0/2008322156 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f646c0b4d90 con 0x564b2ff362e0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f647b9c5640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f634c036790 0x7f634c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f647b9c5640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f634c036790 0x7f634c038c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x564b2ff1b430 tx=0x7f6470010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2ff48950 0x564b2ff4ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4b560 con 0x564b2ff48950 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.840+0000 7f647c9c7640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2ff48950 0x564b2ff4ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647c9c7640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2ff48950 0x564b2ff4ae10 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 realm 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4b930 con 0x564b2ff48950 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.841+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c510 con 0x564b2ff48950 2024-03-20T13:35:35.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff4cec0 0x564b2ff4f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4f870 con 0x564b2ff4cec0 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647c1c6640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff4cec0 0x564b2ff4f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647c1c6640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff4cec0 0x564b2ff4f2b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f646c0c4040 con 0x564b2ff4cec0 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 20 searching for the correct realm 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564b2ff51b70 0x564b2ff54030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff54700 con 0x564b2ff51b70 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.842+0000 7f647b9c5640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564b2ff51b70 0x564b2ff54030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.843+0000 7f647b9c5640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564b2ff51b70 0x564b2ff54030 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.843+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.843+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff54700 con 0x564b2ff4cec0 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.843+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f646c0c4040 con 0x564b2ff4cec0 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.843+0000 7f647c1c6640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f646c0aa040 0x7f646c0bc870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.843+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff54700 con 0x7f646c0aa040 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.844+0000 7f647c9c7640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f646c0aa040 0x7f646c0bc870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.844+0000 7f647c9c7640 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f646c0aa040 0x7f646c0bc870 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.844+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.844+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.844+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.844+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x7f646c0aa040 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x7f646c0aa040 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff4cec0 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f646c0c4040 con 0x564b2ff4cec0 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.845+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff51b70 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x7f646c0aa040 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff4cec0 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.846+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff51b70 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff51b70 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x7f646c0aa040 2024-03-20T13:35:35.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff51b70 2024-03-20T13:35:35.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.847+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff51b70 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.848+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.848+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.848+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.848+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.848+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.848+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x7f646c0aa040 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff51b70 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff4cec0 2024-03-20T13:35:35.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff48950 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.849+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x7f646c0aa040 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.850+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.850+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4c1b0 con 0x564b2ff4cec0 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.850+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.850+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f646c0d0040 con 0x7f646c0aa040 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.850+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.850+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f646c0d0040 con 0x564b2ff4cec0 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.851+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.851+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f646c0d0040 con 0x564b2ff51b70 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.851+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.851+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f646c0d0040 con 0x7f646c0aa040 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.851+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.851+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f646c0d0040 con 0x564b2ff48950 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f646c0d0040 con 0x564b2ff4cec0 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4ff30 con 0x564b2ff48950 2024-03-20T13:35:35.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4ff30 con 0x564b2ff48950 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.852+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff4ff30 con 0x7f646c0aa040 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 20 zone default found 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 4 Realm: () 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:35:35.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 20 zonegroup default 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff50810 con 0x7f646c0aa040 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff50c10 con 0x564b2ff51b70 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.853+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff56520 con 0x564b2ff51b70 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 20 started sync module instance, tier type = 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.854+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff55e00 con 0x564b2ff4cec0 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.855+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.855+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94880927144288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff561b0 con 0x564b2ff4cec0 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.855+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff57330 con 0x564b2ff48950 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.856+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94880927144288] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.856+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.856+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94880927149712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff57750 con 0x564b2ff48950 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.856+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff580c0 con 0x564b2ff51b70 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.857+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94880927149712] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.858+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.858+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94880927150768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff576d0 con 0x564b2ff51b70 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.858+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff58f20 con 0x564b2ff4cec0 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.859+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.859+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94880927157344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff59680 con 0x564b2ff4cec0 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.859+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5a150 con 0x564b2ff48950 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.859+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94880927150768] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.860+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.860+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94880927161392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5a110 con 0x564b2ff48950 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.860+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5ab90 con 0x7f646c0aa040 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.861+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.861+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94880927157344] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.861+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94880927158560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5ab90 con 0x7f646c0aa040 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.861+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5b5c0 con 0x7f646c0aa040 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.861+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94880927161392] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.862+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94880927158560] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.862+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.862+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94880927164112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5b0e0 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.862+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5ba50 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'186 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94880927167920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5b9d0 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=0 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=1 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=2 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=3 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=4 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=5 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94880927164112] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.863+0000 7f647e6c0800 20 add_watcher() i=6 2024-03-20T13:35:35.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.864+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94880927167920] v32'187 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.864+0000 7f647e6c0800 20 add_watcher() i=7 2024-03-20T13:35:35.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.864+0000 7f647e6c0800 2 all 8 watchers are set, enabling cache 2024-03-20T13:35:35.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.864+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff58470 con 0x564b2ff48950 2024-03-20T13:35:35.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.864+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.864+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94880927169968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff58470 con 0x564b2ff48950 2024-03-20T13:35:35.876 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.865+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94880927169968] v32'191 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.866+0000 7f63327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.866+0000 7f647e6c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.866+0000 7f647e6c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.866+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff67800 con 0x564b2ff48950 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.867+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.867+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff67c40 con 0x7f646c0aa040 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.868+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.868+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff67c40 con 0x564b2ff51b70 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.869+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.869+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff68610 con 0x564b2ff48950 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.870+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'192 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.877 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.870+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff689b0 con 0x564b2ff4cec0 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.871+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'66 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.871+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff68f00 con 0x564b2ff51b70 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.872+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'43 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.872+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff698d0 con 0x564b2ff48950 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.874+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.874+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff698d0 con 0x7f646c0aa040 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.875+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'45 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.875+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff699c0 con 0x564b2ff4cec0 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.876+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.878 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.876+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff69ff0 con 0x564b2ff51b70 2024-03-20T13:35:35.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.876+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.876+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a490 con 0x564b2ff4cec0 2024-03-20T13:35:35.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.877+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'67 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.877+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a490 con 0x7f646c0aa040 2024-03-20T13:35:35.879 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.878+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'29 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.878+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a490 con 0x564b2ff4cec0 2024-03-20T13:35:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.879+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.880 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.879+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a490 con 0x7f646c0aa040 2024-03-20T13:35:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.880+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'49 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.880+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a490 con 0x564b2ff48950 2024-03-20T13:35:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.881+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'193 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.881+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a490 con 0x564b2ff51b70 2024-03-20T13:35:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.882+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'60 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.882+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a660 con 0x564b2ff4cec0 2024-03-20T13:35:35.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.883+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'68 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.883+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a660 con 0x564b2ff51b70 2024-03-20T13:35:35.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.884+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.884+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a660 con 0x564b2ff48950 2024-03-20T13:35:35.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.885+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'33 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.885+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a660 con 0x564b2ff48950 2024-03-20T13:35:35.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.886+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'194 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.886+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6a660 con 0x564b2ff51b70 2024-03-20T13:35:35.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.887+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'61 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.887+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff4cec0 2024-03-20T13:35:35.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.888+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'35 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.888+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff51b70 2024-03-20T13:35:35.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.890+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.890+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff51b70 2024-03-20T13:35:35.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.890+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.890+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff51b70 2024-03-20T13:35:35.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.891+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'21 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.891+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff51b70 2024-03-20T13:35:35.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.892+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'44 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.892+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x7f646c0aa040 2024-03-20T13:35:35.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.894+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'27 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.894+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff51b70 2024-03-20T13:35:35.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.895+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'25 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.895+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x7f646c0aa040 2024-03-20T13:35:35.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.896+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'46 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.896+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff51b70 2024-03-20T13:35:35.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.897+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'62 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.898 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.897+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x7f646c0aa040 2024-03-20T13:35:35.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.898+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'50 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.899 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.898+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff6abf0 con 0x564b2ff4cec0 2024-03-20T13:35:35.900 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'31 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f63317e2640 20 reqs_thread_entry: start 2024-03-20T13:35:35.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f647e6c0800 20 init_complete bucket index max shards: 11 2024-03-20T13:35:35.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f647e6c0800 20 Filter name: none 2024-03-20T13:35:35.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f62a2ffd640 20 reqs_thread_entry: start 2024-03-20T13:35:35.901 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f647e6c0800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f647e6c0800 20 rados->read ofs=0 len=0 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.899+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff944a0 con 0x564b2ff48950 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647e6c0800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647e6c0800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647e6c0800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647e6c0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff96780 con 0x564b2ff4cec0 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.900+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.902 INFO:teuthology.orchestra.run.smithi177.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-03-20T13:35:35.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.901+0000 7f63327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:35:35.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.901+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94880927169968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff666b0 con 0x564b2ff48950 2024-03-20T13:35:35.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.902+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94880927169968] v32'195 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.903 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.902+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94880927144288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff5bd60 con 0x564b2ff4cec0 2024-03-20T13:35:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.903+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94880927144288] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.903+0000 7f647e6c0800 20 remove_watcher() i=0 2024-03-20T13:35:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.903+0000 7f647e6c0800 2 removed watcher, disabling cache 2024-03-20T13:35:35.904 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.903+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94880927149712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff55960 con 0x564b2ff48950 2024-03-20T13:35:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.904+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94880927149712] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.904+0000 7f647e6c0800 20 remove_watcher() i=1 2024-03-20T13:35:35.905 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.904+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94880927150768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff55960 con 0x564b2ff51b70 2024-03-20T13:35:35.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.905+0000 7f647b9c5640 1 -- 172.21.15.177:0/2008322156 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94880927150768] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f6470033040 con 0x564b2ff51b70 2024-03-20T13:35:35.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.905+0000 7f647e6c0800 20 remove_watcher() i=2 2024-03-20T13:35:35.906 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.905+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94880927157344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff55960 con 0x564b2ff4cec0 2024-03-20T13:35:35.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.906+0000 7f647c1c6640 1 -- 172.21.15.177:0/2008322156 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94880927157344] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f646c0bcdb0 con 0x564b2ff4cec0 2024-03-20T13:35:35.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.906+0000 7f647e6c0800 20 remove_watcher() i=3 2024-03-20T13:35:35.907 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.906+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94880927161392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff55960 con 0x564b2ff48950 2024-03-20T13:35:35.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.907+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94880927161392] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x564b2ff48950 2024-03-20T13:35:35.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.907+0000 7f647e6c0800 20 remove_watcher() i=4 2024-03-20T13:35:35.908 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.907+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94880927158560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff59c30 con 0x7f646c0aa040 2024-03-20T13:35:35.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.908+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94880927158560] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.908+0000 7f647e6c0800 20 remove_watcher() i=5 2024-03-20T13:35:35.909 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.908+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94880927164112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff55960 con 0x7f646c0aa040 2024-03-20T13:35:35.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.910+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94880927164112] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.910+0000 7f647e6c0800 20 remove_watcher() i=6 2024-03-20T13:35:35.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.910+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94880927167920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564b2ff59c30 con 0x7f646c0aa040 2024-03-20T13:35:35.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94880927167920] v32'188 uv186 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f647400a4a0 con 0x7f646c0aa040 2024-03-20T13:35:35.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 20 remove_watcher() i=7 2024-03-20T13:35:35.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f646c0aa040 msgr2=0x7f646c0bc870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f646c0aa040 0x7f646c0bc870 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2ff48950 msgr2=0x564b2ff4ae10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2ff48950 0x564b2ff4ae10 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff4cec0 msgr2=0x564b2ff4f2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff4cec0 0x564b2ff4f2b0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564b2ff51b70 msgr2=0x564b2ff54030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564b2ff51b70 0x564b2ff54030 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f634c036790 msgr2=0x7f634c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f634c036790 0x7f634c038c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x564b2ff1b430 tx=0x7f6470010000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 msgr2=0x564b2ff3d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2008322156 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff362e0 0x564b2ff3d1a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f646c08d840 tx=0x7f646c081f90 comp rx=0 tx=0).stop 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 reap_dead start 2024-03-20T13:35:35.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647c9c7640 1 -- 172.21.15.177:0/2008322156 reap_dead start 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 shutdown_connections 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 >> 172.21.15.177:0/2008322156 conn(0x564b2ff325b0 msgr2=0x564b2ff2fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 shutdown_connections 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2008322156 wait complete. 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63540367e0 msgr2=0x7f6354038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63540367e0 0x7f6354038ca0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x564b2ff0f800 tx=0x7f647000f000 comp rx=0 tx=0).stop 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 msgr2=0x564b2ff29620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 0x564b2ff29620 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f646c08bc80 tx=0x7f646c054da0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 shutdown_connections 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63540367e0 0x7f6354038ca0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 --2- 172.21.15.177:0/2527181176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2ff29200 0x564b2ff29620 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 >> 172.21.15.177:0/2527181176 conn(0x564b2ff1d2a0 msgr2=0x564b2ff1d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 shutdown_connections 2024-03-20T13:35:35.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.911+0000 7f647e6c0800 1 -- 172.21.15.177:0/2527181176 wait complete. 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564b2ff18520 msgr2=0x564b2ff1a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564b2ff18520 0x564b2ff1a910 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2fe16ea0 msgr2=0x564b2ff11ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564b2fe16ea0 0x564b2ff11ec0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff14610 msgr2=0x564b2ff16a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564b2ff14610 0x564b2ff16a00 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63640367e0 msgr2=0x7f6364038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f63640367e0 0x7f6364038ca0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f6470000f60 tx=0x7f6470001370 comp rx=0 tx=0).stop 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 msgr2=0x564b2ff0b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 --2- 172.21.15.177:0/1600475974 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564b2fe14570 0x564b2ff0b0a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f646c01ceb0 tx=0x7f646c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647c9c7640 1 -- 172.21.15.177:0/1600475974 reap_dead start 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 shutdown_connections 2024-03-20T13:35:35.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 >> 172.21.15.177:0/1600475974 conn(0x564b2fe0e040 msgr2=0x564b2fefdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:35:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 shutdown_connections 2024-03-20T13:35:35.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:35:35.912+0000 7f647e6c0800 1 -- 172.21.15.177:0/1600475974 wait complete. 2024-03-20T13:35:35.920 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:35:35.943 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:35:35.948 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-03-20T13:36:10.948 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-03-20T13:36:10.949 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-03-20T13:36:10.949 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-03-20T13:36:11.000 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.000 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:10.999+0000 7f2e9640f800 1 Processor -- start 2024-03-20T13:36:11.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:10.999+0000 7f2e9640f800 1 -- start start 2024-03-20T13:36:11.001 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9640f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563529b3a100 0x563529b3c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9640f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563529a80cd0 con 0x563529b365f0 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9640f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x563529a37500 con 0x563529b3a100 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9134b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563529b3a100 0x563529b3c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9134b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563529b3a100 0x563529b3c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42648/0 (socket says 172.21.15.177:42648) 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9134b640 1 -- 172.21.15.177:0/3202601898 learned_addr learned my addr 172.21.15.177:0/3202601898 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9134b640 1 -- 172.21.15.177:0/3202601898 >> v1:172.21.15.28:6789/0 conn(0x563529b365f0 legacy=0x563529b389e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-20T13:36:11.002 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.000+0000 7f2e9134b640 1 -- 172.21.15.177:0/3202601898 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563529b3da40 con 0x563529b3a100 2024-03-20T13:36:11.003 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.002+0000 7f2e9134b640 1 --2- 172.21.15.177:0/3202601898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b3a100 0x563529b3c4f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800a520 tx=0x7f2e8801ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1ca519a4c4017a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.004+0000 7f2e90b4a640 1 -- 172.21.15.177:0/3202601898 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e88052570 con 0x563529b3a100 2024-03-20T13:36:11.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.004+0000 7f2e90b4a640 1 -- 172.21.15.177:0/3202601898 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e880526d0 con 0x563529b3a100 2024-03-20T13:36:11.005 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.004+0000 7f2e90b4a640 1 -- 172.21.15.177:0/3202601898 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e88052990 con 0x563529b3a100 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.004+0000 7f2e9640f800 1 -- 172.21.15.177:0/3202601898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b3a100 msgr2=0x563529b3c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.004+0000 7f2e9640f800 1 --2- 172.21.15.177:0/3202601898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b3a100 0x563529b3c4f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2e8800a520 tx=0x7f2e8801ce40 comp rx=0 tx=0).stop 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.005+0000 7f2e9640f800 1 -- 172.21.15.177:0/3202601898 shutdown_connections 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.005+0000 7f2e9640f800 1 --2- 172.21.15.177:0/3202601898 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b3a100 0x563529b3c4f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.005+0000 7f2e9640f800 1 -- 172.21.15.177:0/3202601898 >> 172.21.15.177:0/3202601898 conn(0x563529b30040 msgr2=0x563529b32460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.005+0000 7f2e9640f800 1 -- 172.21.15.177:0/3202601898 shutdown_connections 2024-03-20T13:36:11.006 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.005+0000 7f2e9640f800 1 -- 172.21.15.177:0/3202601898 wait complete. 2024-03-20T13:36:11.019 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.018+0000 7f2e9640f800 1 Processor -- start 2024-03-20T13:36:11.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e9640f800 1 -- start start 2024-03-20T13:36:11.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e9640f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c25b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e9640f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563529a34a30 con 0x563529b365f0 2024-03-20T13:36:11.021 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c25b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c25b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42664/0 (socket says 172.21.15.177:42664) 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1527886698 learned_addr learned my addr 172.21.15.177:0/1527886698 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.019+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1527886698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88005de0 con 0x563529b365f0 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.020+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/1527886698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c25b30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400a480 tx=0x7f2e8400a940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41fd4c59b14b28a8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.020+0000 7f2d7fe07640 1 -- 172.21.15.177:0/1527886698 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e84008860 con 0x563529b365f0 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.020+0000 7f2d7fe07640 1 -- 172.21.15.177:0/1527886698 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e840089c0 con 0x563529b365f0 2024-03-20T13:36:11.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.020+0000 7f2d7fe07640 1 -- 172.21.15.177:0/1527886698 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e84008c80 con 0x563529b365f0 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- 172.21.15.177:0/1527886698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 msgr2=0x563529c25b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1527886698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c25b30 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400a480 tx=0x7f2e8400a940 comp rx=0 tx=0).stop 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- 172.21.15.177:0/1527886698 shutdown_connections 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1527886698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c25b30 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- 172.21.15.177:0/1527886698 >> 172.21.15.177:0/1527886698 conn(0x563529b30040 msgr2=0x563529c21450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- 172.21.15.177:0/1527886698 shutdown_connections 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- 172.21.15.177:0/1527886698 wait complete. 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 Processor -- start 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- start start 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c2d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e9640f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563529a30210 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c2d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.021+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c2d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42672/0 (socket says 172.21.15.177:42672) 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2e91b4c640 1 -- 172.21.15.177:0/2547266713 learned_addr learned my addr 172.21.15.177:0/2547266713 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2e91b4c640 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e84005d30 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c2d2a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400a420 tx=0x7f2e84002fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2d7e604640 1 -- 172.21.15.177:0/2547266713 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e84013800 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2d7e604640 1 -- 172.21.15.177:0/2547266713 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84013960 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2d7e604640 1 -- 172.21.15.177:0/2547266713 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e84013c00 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563529c2d7e0 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.022+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563529c2dcc0 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.023+0000 7f2d7e604640 1 -- 172.21.15.177:0/2547266713 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2e8401e420 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.023+0000 7f2d7e604640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d78036790 0x7f2d78038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.023+0000 7f2d7e604640 1 -- 172.21.15.177:0/2547266713 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f2e8404c230 con 0x563529b365f0 2024-03-20T13:36:11.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.023+0000 7f2e9134b640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d78036790 0x7f2d78038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529b3a100 0x563529c33f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c34540 con 0x563529b3a100 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9234d640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529b3a100 0x563529c33f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9134b640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d78036790 0x7f2d78038c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2e88054000 tx=0x7f2e8804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9234d640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529b3a100 0x563529c33f70 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9234d640 1 -- 172.21.15.177:0/2547266713 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529b3a100 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.024+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c316a0 con 0x563529b3a100 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e9234d640 1 -- 172.21.15.177:0/2547266713 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529b3a100 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c367b0 0x563529c38ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c39290 con 0x563529c367b0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c367b0 0x563529c38ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c367b0 0x563529c38ba0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.029 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e91b4c640 1 -- 172.21.15.177:0/2547266713 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2e84024070 con 0x563529c367b0 2024-03-20T13:36:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.025+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c35730 con 0x563529b3a100 2024-03-20T13:36:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.026+0000 7f2e9234d640 1 -- 172.21.15.177:0/2547266713 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529b3a100 2024-03-20T13:36:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.026+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563529c3a6b0 0x563529c3caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.026+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c3d1e0 con 0x563529c3a6b0 2024-03-20T13:36:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.027+0000 7f2e9134b640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563529c3a6b0 0x563529c3caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.030 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.029+0000 7f2e9134b640 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563529c3a6b0 0x563529c3caa0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.031 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.030+0000 7f2e9134b640 1 -- 172.21.15.177:0/2547266713 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c3a6b0 2024-03-20T13:36:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e9640f800 1 Processor -- start 2024-03-20T13:36:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e9640f800 1 -- start start 2024-03-20T13:36:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e9640f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 0x563529c4b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e9640f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635299d2c70 con 0x563529c4b310 2024-03-20T13:36:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 0x563529c4b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.033 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 0x563529c4b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42688/0 (socket says 172.21.15.177:42688) 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.031+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1893731804 learned_addr learned my addr 172.21.15.177:0/1893731804 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1893731804 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563529c4bc70 con 0x563529c4b310 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 0x563529c4b730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2e8404a4c0 tx=0x7f2e84044130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2d777fe640 1 -- 172.21.15.177:0/1893731804 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e840067c0 con 0x563529c4b310 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2d777fe640 1 -- 172.21.15.177:0/1893731804 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e84006920 con 0x563529c4b310 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563529c4c6e0 con 0x563529c4b310 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2d777fe640 1 -- 172.21.15.177:0/1893731804 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e84006be0 con 0x563529c4b310 2024-03-20T13:36:11.034 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.032+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563529c4cba0 con 0x563529c4b310 2024-03-20T13:36:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2d777fe640 1 -- 172.21.15.177:0/1893731804 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2e84006d40 con 0x563529c4b310 2024-03-20T13:36:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2d777fe640 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d6c0367e0 0x7f2d6c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2d777fe640 1 -- 172.21.15.177:0/1893731804 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f2e8403bd70 con 0x563529c4b310 2024-03-20T13:36:11.037 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2e9134b640 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d6c0367e0 0x7f2d6c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2e9640f800 1 Processor -- start 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2e9640f800 1 -- start start 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.033+0000 7f2e9134b640 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d6c0367e0 0x7f2d6c038ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x563529c315c0 tx=0x7f2e88005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e9640f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c588a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e9640f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635299a85d0 con 0x563529c58480 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c588a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42692/0 (socket says 172.21.15.177:42692) 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e91b4c640 1 -- 172.21.15.177:0/861550832 learned_addr learned my addr 172.21.15.177:0/861550832 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e91b4c640 1 -- 172.21.15.177:0/861550832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563529c58e70 con 0x563529c58480 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/861550832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c588a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400a980 tx=0x7f2e84045ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c98743c078d0ecc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2d757fa640 1 -- 172.21.15.177:0/861550832 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e84014e60 con 0x563529c58480 2024-03-20T13:36:11.038 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.034+0000 7f2d757fa640 1 -- 172.21.15.177:0/861550832 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8404ce10 con 0x563529c58480 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2d757fa640 1 -- 172.21.15.177:0/861550832 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e8403f9a0 con 0x563529c58480 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 -- 172.21.15.177:0/861550832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 msgr2=0x563529c588a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 --2- 172.21.15.177:0/861550832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c588a0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400a980 tx=0x7f2e84045ec0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 -- 172.21.15.177:0/861550832 shutdown_connections 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 --2- 172.21.15.177:0/861550832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c588a0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 -- 172.21.15.177:0/861550832 >> 172.21.15.177:0/861550832 conn(0x563529c54700 msgr2=0x563529c52760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 -- 172.21.15.177:0/861550832 shutdown_connections 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 -- 172.21.15.177:0/861550832 wait complete. 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 Processor -- start 2024-03-20T13:36:11.039 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.035+0000 7f2e9640f800 1 -- start start 2024-03-20T13:36:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.036+0000 7f2e9640f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c5f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.036+0000 7f2e9640f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563529c5f880 con 0x563529c58480 2024-03-20T13:36:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.037+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c5f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.040 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.037+0000 7f2e91b4c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c5f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42700/0 (socket says 172.21.15.177:42700) 2024-03-20T13:36:11.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.037+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 learned_addr learned my addr 172.21.15.177:0/1051296981 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.038+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563529c4c6e0 con 0x563529c58480 2024-03-20T13:36:11.041 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.040+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c5f340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2e84008ff0 tx=0x7f2e8402ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.041+0000 7f2d637fe640 1 -- 172.21.15.177:0/1051296981 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e8404c510 con 0x563529c58480 2024-03-20T13:36:11.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.041+0000 7f2d637fe640 1 -- 172.21.15.177:0/1051296981 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e8404c670 con 0x563529c58480 2024-03-20T13:36:11.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.041+0000 7f2d637fe640 1 -- 172.21.15.177:0/1051296981 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2e8404c910 con 0x563529c58480 2024-03-20T13:36:11.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.041+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563529c4c6e0 con 0x563529c58480 2024-03-20T13:36:11.042 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.041+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563529c4c6e0 con 0x563529c58480 2024-03-20T13:36:11.043 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.042+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.044+0000 7f2d637fe640 1 -- 172.21.15.177:0/1051296981 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2e84055070 con 0x563529c58480 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2d637fe640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d5c0367e0 0x7f2d5c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2d637fe640 1 -- 172.21.15.177:0/1051296981 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f2e84052040 con 0x563529c58480 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9134b640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d5c0367e0 0x7f2d5c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529c6ab90 0x563529c6d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6d780 con 0x563529c6ab90 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9234d640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529c6ab90 0x563529c6d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.046 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9134b640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d5c0367e0 0x7f2d5c038ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e88052fd0 tx=0x7f2e8804f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.047 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9234d640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529c6ab90 0x563529c6d030 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.050 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9640f800 20 realm 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.045+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6db50 con 0x563529c6ab90 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.051 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e700 con 0x563529c6ab90 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c6f0b0 0x563529c714a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c71a20 con 0x563529c6f0b0 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.046+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c6f0b0 0x563529c714a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c6f0b0 0x563529c714a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e9640f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e9640f800 20 searching for the correct realm 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563529c739c0 0x563529c75e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c76550 con 0x563529c739c0 2024-03-20T13:36:11.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e9134b640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563529c739c0 0x563529c75e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.047+0000 7f2e9134b640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563529c739c0 0x563529c75e80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.048+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.048+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c76550 con 0x563529c6f0b0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.048+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.048+0000 7f2e91b4c640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2e8406b070 0x7f2e84065170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.048+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c76550 con 0x7f2e8406b070 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.048+0000 7f2e9234d640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2e8406b070 0x7f2e84065170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.049+0000 7f2e9234d640 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2e8406b070 0x7f2e84065170 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.049+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.049+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.049+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.049+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.050+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.050+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.050+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.050+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.050+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.050+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6f0b0 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.064 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.051+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6f0b0 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.065 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.052+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.053+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.053+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.053+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.053+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.053+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.053+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.054+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6f0b0 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6f0b0 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.055+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.056+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.056+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6f0b0 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.056+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.056+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c739c0 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.056+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.056+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x7f2e8406b070 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6ab90 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c6e3a0 con 0x563529c6f0b0 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.068 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.057+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c722f0 con 0x563529c6ab90 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c722f0 con 0x563529c6ab90 2024-03-20T13:36:11.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c722f0 con 0x7f2e8406b070 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 zone default found 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 4 Realm: () 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 zonegroup default 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.058+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c72b90 con 0x7f2e8406b070 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c72f70 con 0x563529c739c0 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c78370 con 0x563529c739c0 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 started sync module instance, tier type = 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.059+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c77800 con 0x563529c6f0b0 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.060+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.060+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94786334194608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c77fd0 con 0x563529c6f0b0 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.060+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c79180 con 0x563529c6ab90 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.061+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94786334194608] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.063+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.063+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94786334199008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c795a0 con 0x563529c6ab90 2024-03-20T13:36:11.073 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.063+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c79f10 con 0x563529c739c0 2024-03-20T13:36:11.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.064+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.082 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.064+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94786334202480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7a710 con 0x563529c739c0 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.064+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7b180 con 0x563529c6f0b0 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.065+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94786334199008] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.065+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94786334202480] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.065+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.065+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94786334207168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7b560 con 0x563529c6f0b0 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.065+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7bd60 con 0x563529c6ab90 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.066+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94786334207168] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.067+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.067+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94786334210240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7bce0 con 0x563529c6ab90 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.067+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7cad0 con 0x7f2e8406b070 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.069+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94786334210240] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.083 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.070+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.070+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94786334212288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7ca90 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.070+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7d4d0 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.071+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94786334212288] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.072+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.072+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94786334213344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7d490 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.072+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7de90 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'189 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94786334218736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7e2f0 con 0x7f2e8406b070 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=0 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=1 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=2 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=3 2024-03-20T13:36:11.084 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=4 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=5 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94786334213344] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.073+0000 7f2e9640f800 20 add_watcher() i=6 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.074+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94786334218736] v32'190 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.074+0000 7f2e9640f800 20 add_watcher() i=7 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.074+0000 7f2e9640f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.074+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7cff0 con 0x563529c6ab90 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.075+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.075+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94786334219792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7cff0 con 0x563529c6ab90 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94786334219792] v32'196 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2d437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.085 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9640f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9640f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9640f800 5 note: GC not initialized 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2d427fc640 20 reqs_thread_entry: start 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9640f800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9640f800 20 Filter name: none 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2cb3fff640 20 reqs_thread_entry: start 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.076+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb3750 con 0x563529c6ab90 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb3750 con 0x563529c6f0b0 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb3b10 con 0x563529c6ab90 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.086 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb3b10 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.077+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb3e70 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb41d0 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb41d0 con 0x563529c6ab90 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb41d0 con 0x563529c6ab90 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.078+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb41d0 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.079+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.087 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.079+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb41d0 con 0x563529c739c0 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.079+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.079+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb41d0 con 0x7f2e8406b070 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.079+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6ab90 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6f0b0 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.080+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x7f2e8406b070 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.081+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.081+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x7f2e8406b070 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.081+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.088 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.081+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.081+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.089 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.081+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x7f2e8406b070 2024-03-20T13:36:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.082+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.082+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6ab90 2024-03-20T13:36:11.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.082+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.082+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.082+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.082+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x7f2e8406b070 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6f0b0 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x7f2e8406b070 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6ab90 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.083+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6ab90 2024-03-20T13:36:11.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6ab90 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c6ab90 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.084+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb5900 con 0x7f2e8406b070 2024-03-20T13:36:11.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.085+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.086+0000 7f2d437fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.086+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94786334219792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529cb14a0 con 0x563529c6ab90 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.087+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94786334219792] v32'197 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.087+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94786334194608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7de10 con 0x563529c6f0b0 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.088+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94786334194608] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.088+0000 7f2e9640f800 20 remove_watcher() i=0 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.088+0000 7f2e9640f800 2 removed watcher, disabling cache 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.088+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94786334199008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7de10 con 0x563529c6ab90 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.090+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94786334199008] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.090+0000 7f2e9640f800 20 remove_watcher() i=1 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.090+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94786334202480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c78ce0 con 0x563529c739c0 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.091+0000 7f2e9134b640 1 -- 172.21.15.177:0/1051296981 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94786334202480] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e88052b40 con 0x563529c739c0 2024-03-20T13:36:11.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.091+0000 7f2e9640f800 20 remove_watcher() i=2 2024-03-20T13:36:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.091+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94786334207168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7de10 con 0x563529c6f0b0 2024-03-20T13:36:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.092+0000 7f2e91b4c640 1 -- 172.21.15.177:0/1051296981 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94786334207168] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8405e040 con 0x563529c6f0b0 2024-03-20T13:36:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.092+0000 7f2e9640f800 20 remove_watcher() i=3 2024-03-20T13:36:11.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.092+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94786334210240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c79a70 con 0x563529c6ab90 2024-03-20T13:36:11.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.094+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94786334210240] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x563529c6ab90 2024-03-20T13:36:11.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.094+0000 7f2e9640f800 20 remove_watcher() i=4 2024-03-20T13:36:11.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.094+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94786334212288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c78ce0 con 0x7f2e8406b070 2024-03-20T13:36:11.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.095+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94786334212288] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.095+0000 7f2e9640f800 20 remove_watcher() i=5 2024-03-20T13:36:11.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.095+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94786334213344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7acc0 con 0x7f2e8406b070 2024-03-20T13:36:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.097+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94786334213344] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.097+0000 7f2e9640f800 20 remove_watcher() i=6 2024-03-20T13:36:11.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.097+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94786334218736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563529c7c560 con 0x7f2e8406b070 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94786334218736] v32'191 uv189 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2e8c00a4a0 con 0x7f2e8406b070 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 20 remove_watcher() i=7 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2e8406b070 msgr2=0x7f2e84065170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2e8406b070 0x7f2e84065170 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529c6ab90 msgr2=0x563529c6d030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529c6ab90 0x563529c6d030 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c6f0b0 msgr2=0x563529c714a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c6f0b0 0x563529c714a0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563529c739c0 msgr2=0x563529c75e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.098+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563529c739c0 0x563529c75e80 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d5c0367e0 msgr2=0x7f2d5c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d5c0367e0 0x7f2d5c038ca0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2e88052fd0 tx=0x7f2e8804f000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 msgr2=0x563529c5f340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9234d640 1 -- 172.21.15.177:0/1051296981 reap_dead start 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c5f340 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f2e84008ff0 tx=0x7f2e8402ef30 comp rx=0 tx=0).stop 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 shutdown_connections 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1051296981 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c58480 0x563529c5f340 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 >> 172.21.15.177:0/1051296981 conn(0x563529c54700 msgr2=0x563529c51d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 shutdown_connections 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1051296981 wait complete. 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d6c0367e0 msgr2=0x7f2d6c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d6c0367e0 0x7f2d6c038ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x563529c315c0 tx=0x7f2e88005ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 msgr2=0x563529c4b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 0x563529c4b730 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f2e8404a4c0 tx=0x7f2e84044130 comp rx=0 tx=0).stop 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 shutdown_connections 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d6c0367e0 0x7f2d6c038ca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/1893731804 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529c4b310 0x563529c4b730 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 >> 172.21.15.177:0/1893731804 conn(0x563529c3f3b0 msgr2=0x563529c3f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 shutdown_connections 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/1893731804 wait complete. 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563529c3a6b0 msgr2=0x563529c3caa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563529c3a6b0 0x563529c3caa0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529b3a100 msgr2=0x563529c33f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.099+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563529b3a100 0x563529c33f70 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c367b0 msgr2=0x563529c38ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563529c367b0 0x563529c38ba0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d78036790 msgr2=0x7f2d78038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d78036790 0x7f2d78038c50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2e88054000 tx=0x7f2e8804e000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 msgr2=0x563529c2d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 --2- 172.21.15.177:0/2547266713 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563529b365f0 0x563529c2d2a0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2e8400a420 tx=0x7f2e84002fd0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9234d640 1 -- 172.21.15.177:0/2547266713 reap_dead start 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 shutdown_connections 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 >> 172.21.15.177:0/2547266713 conn(0x563529b30040 msgr2=0x563529c1fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 shutdown_connections 2024-03-20T13:36:11.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.100+0000 7f2e9640f800 1 -- 172.21.15.177:0/2547266713 wait complete. 2024-03-20T13:36:11.109 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"anonymous","categories":[]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-03-20T13:36:11.109 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'anonymous', 'categories': []}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-03-20T13:36:11.109 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-03-20T13:36:11.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-03-20T13:36:11.109 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-03-20T13:36:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.150 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.150+0000 7fb86d410800 1 Processor -- start 2024-03-20T13:36:11.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.150+0000 7fb86d410800 1 -- start start 2024-03-20T13:36:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.150+0000 7fb86d410800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561a538d4f30 0x561a538dda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.150+0000 7fb86d410800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561a5381fcc0 con 0x561a538d33f0 2024-03-20T13:36:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.150+0000 7fb86d410800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561a537d6500 con 0x561a538d4f30 2024-03-20T13:36:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.151+0000 7fb863fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561a538d4f30 0x561a538dda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.151+0000 7fb863fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561a538d4f30 0x561a538dda30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42714/0 (socket says 172.21.15.177:42714) 2024-03-20T13:36:11.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.151+0000 7fb863fff640 1 -- 172.21.15.177:0/1444434690 learned_addr learned my addr 172.21.15.177:0/1444434690 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.153 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.151+0000 7fb868ac2640 1 --1- 172.21.15.177:0/1444434690 >> v1:172.21.15.28:6789/0 conn(0x561a538d33f0 0x561a538d3810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34784/0 (socket says 172.21.15.177:34784) 2024-03-20T13:36:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.153+0000 7fb863fff640 1 -- 172.21.15.177:0/1444434690 >> v1:172.21.15.28:6789/0 conn(0x561a538d33f0 legacy=0x561a538d3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.154 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.153+0000 7fb863fff640 1 -- 172.21.15.177:0/1444434690 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a53847ef0 con 0x561a538d4f30 2024-03-20T13:36:11.158 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.157+0000 7fb863fff640 1 --2- 172.21.15.177:0/1444434690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d4f30 0x561a538dda30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb85400a520 tx=0x7fb85401cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9d197891724481b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.158+0000 7fb8637fe640 1 -- 172.21.15.177:0/1444434690 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb854052570 con 0x561a538d4f30 2024-03-20T13:36:11.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.158+0000 7fb8637fe640 1 -- 172.21.15.177:0/1444434690 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8540526d0 con 0x561a538d4f30 2024-03-20T13:36:11.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.158+0000 7fb8637fe640 1 -- 172.21.15.177:0/1444434690 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb854052990 con 0x561a538d4f30 2024-03-20T13:36:11.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 -- 172.21.15.177:0/1444434690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d4f30 msgr2=0x561a538dda30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 --2- 172.21.15.177:0/1444434690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d4f30 0x561a538dda30 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fb85400a520 tx=0x7fb85401cee0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 -- 172.21.15.177:0/1444434690 shutdown_connections 2024-03-20T13:36:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 --2- 172.21.15.177:0/1444434690 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d4f30 0x561a538dda30 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 -- 172.21.15.177:0/1444434690 >> 172.21.15.177:0/1444434690 conn(0x561a538cf030 msgr2=0x561a538d1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 -- 172.21.15.177:0/1444434690 shutdown_connections 2024-03-20T13:36:11.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.159+0000 7fb86d410800 1 -- 172.21.15.177:0/1444434690 wait complete. 2024-03-20T13:36:11.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.171+0000 7fb86d410800 1 Processor -- start 2024-03-20T13:36:11.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.171+0000 7fb86d410800 1 -- start start 2024-03-20T13:36:11.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.171+0000 7fb86d410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.171+0000 7fb86d410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a537d3a30 con 0x561a538d33f0 2024-03-20T13:36:11.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.172+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.173+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539c6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42730/0 (socket says 172.21.15.177:42730) 2024-03-20T13:36:11.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.173+0000 7fb868ac2640 1 -- 172.21.15.177:0/81380367 learned_addr learned my addr 172.21.15.177:0/81380367 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.175+0000 7fb868ac2640 1 -- 172.21.15.177:0/81380367 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854005de0 con 0x561a538d33f0 2024-03-20T13:36:11.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.176+0000 7fb868ac2640 1 --2- 172.21.15.177:0/81380367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539c6ed0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb85c001c80 tx=0x7fb85c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbdbd7dc6d059cd6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.177+0000 7fb756e05640 1 -- 172.21.15.177:0/81380367 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c014070 con 0x561a538d33f0 2024-03-20T13:36:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.177+0000 7fb756e05640 1 -- 172.21.15.177:0/81380367 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c00f450 con 0x561a538d33f0 2024-03-20T13:36:11.178 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.177+0000 7fb756e05640 1 -- 172.21.15.177:0/81380367 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c00f790 con 0x561a538d33f0 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 -- 172.21.15.177:0/81380367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 msgr2=0x561a539c6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 --2- 172.21.15.177:0/81380367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539c6ed0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fb85c001c80 tx=0x7fb85c00b600 comp rx=0 tx=0).stop 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 -- 172.21.15.177:0/81380367 shutdown_connections 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 --2- 172.21.15.177:0/81380367 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539c6ed0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 -- 172.21.15.177:0/81380367 >> 172.21.15.177:0/81380367 conn(0x561a538cf030 msgr2=0x561a539c2670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 -- 172.21.15.177:0/81380367 shutdown_connections 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 -- 172.21.15.177:0/81380367 wait complete. 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.178+0000 7fb86d410800 1 Processor -- start 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.179+0000 7fb86d410800 1 -- start start 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.179+0000 7fb86d410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.179+0000 7fb86d410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a537cf210 con 0x561a538d33f0 2024-03-20T13:36:11.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.180+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.180+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42734/0 (socket says 172.21.15.177:42734) 2024-03-20T13:36:11.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.180+0000 7fb868ac2640 1 -- 172.21.15.177:0/1826738361 learned_addr learned my addr 172.21.15.177:0/1826738361 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.181+0000 7fb868ac2640 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a5381fcc0 con 0x561a538d33f0 2024-03-20T13:36:11.183 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.182+0000 7fb868ac2640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539ce3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x561a539c7ae0 tx=0x7fb85c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.184 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.183+0000 7fb755602640 1 -- 172.21.15.177:0/1826738361 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c014070 con 0x561a538d33f0 2024-03-20T13:36:11.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.183+0000 7fb755602640 1 -- 172.21.15.177:0/1826738361 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c020070 con 0x561a538d33f0 2024-03-20T13:36:11.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.183+0000 7fb755602640 1 -- 172.21.15.177:0/1826738361 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c0198e0 con 0x561a538d33f0 2024-03-20T13:36:11.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.183+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a539ce930 con 0x561a538d33f0 2024-03-20T13:36:11.185 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.183+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a539cee10 con 0x561a538d33f0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb755602640 1 -- 172.21.15.177:0/1826738361 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb85c019a40 con 0x561a538d33f0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb755602640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb750036830 0x7fb750038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb755602640 1 -- 172.21.15.177:0/1826738361 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb85c008030 con 0x561a538d33f0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb863fff640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb750036830 0x7fb750038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a538d4f30 0x561a539d5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a539d5740 con 0x561a538d4f30 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb8692c3640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a538d4f30 0x561a539d5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.187+0000 7fb863fff640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb750036830 0x7fb750038cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb854054000 tx=0x7fb85404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb8692c3640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a538d4f30 0x561a539d5170 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb8692c3640 1 -- 172.21.15.177:0/1826738361 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a538d4f30 2024-03-20T13:36:11.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a539d27f0 con 0x561a538d4f30 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb8692c3640 1 -- 172.21.15.177:0/1826738361 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a538d4f30 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a539d79b0 0x561a539d9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a539da490 con 0x561a539d79b0 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.188+0000 7fb868ac2640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a539d79b0 0x561a539d9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.189+0000 7fb868ac2640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a539d79b0 0x561a539d9da0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.189+0000 7fb868ac2640 1 -- 172.21.15.177:0/1826738361 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb85c016070 con 0x561a539d79b0 2024-03-20T13:36:11.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.189+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a539d6930 con 0x561a538d4f30 2024-03-20T13:36:11.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.189+0000 7fb8692c3640 1 -- 172.21.15.177:0/1826738361 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a538d4f30 2024-03-20T13:36:11.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.189+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561a539db8b0 0x561a539ddca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.189+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a539de3e0 con 0x561a539db8b0 2024-03-20T13:36:11.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.192+0000 7fb863fff640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561a539db8b0 0x561a539ddca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.196 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.196+0000 7fb863fff640 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561a539db8b0 0x561a539ddca0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.198 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.197+0000 7fb863fff640 1 -- 172.21.15.177:0/1826738361 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb854052b80 con 0x561a539db8b0 2024-03-20T13:36:11.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.198+0000 7fb86d410800 1 Processor -- start 2024-03-20T13:36:11.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.198+0000 7fb86d410800 1 -- start start 2024-03-20T13:36:11.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.198+0000 7fb86d410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 0x561a539eca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.199 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.198+0000 7fb86d410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a53771c70 con 0x561a539ec5e0 2024-03-20T13:36:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.200+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 0x561a539eca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.200+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 0x561a539eca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42750/0 (socket says 172.21.15.177:42750) 2024-03-20T13:36:11.201 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.200+0000 7fb868ac2640 1 -- 172.21.15.177:0/2782709284 learned_addr learned my addr 172.21.15.177:0/2782709284 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.202+0000 7fb868ac2640 1 -- 172.21.15.177:0/2782709284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a539ecf40 con 0x561a539ec5e0 2024-03-20T13:36:11.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.204+0000 7fb868ac2640 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 0x561a539eca00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb85c04c010 tx=0x7fb85c04c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.206+0000 7fb74e7fc640 1 -- 172.21.15.177:0/2782709284 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c043030 con 0x561a539ec5e0 2024-03-20T13:36:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.206+0000 7fb74e7fc640 1 -- 172.21.15.177:0/2782709284 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c01b580 con 0x561a539ec5e0 2024-03-20T13:36:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.206+0000 7fb74e7fc640 1 -- 172.21.15.177:0/2782709284 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c035070 con 0x561a539ec5e0 2024-03-20T13:36:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.206+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a539ed9b0 con 0x561a539ec5e0 2024-03-20T13:36:11.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.206+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a539ede70 con 0x561a539ec5e0 2024-03-20T13:36:11.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb74e7fc640 1 -- 172.21.15.177:0/2782709284 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb85c0442b0 con 0x561a539ec5e0 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb74e7fc640 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7400367e0 0x7fb740038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb74e7fc640 1 -- 172.21.15.177:0/2782709284 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb85c03bd90 con 0x561a539ec5e0 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb863fff640 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7400367e0 0x7fb740038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb86d410800 1 Processor -- start 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb86d410800 1 -- start start 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb863fff640 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7400367e0 0x7fb740038ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x561a539d2710 tx=0x7fb854005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb86d410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a539f9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.209+0000 7fb86d410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a537475d0 con 0x561a539f9720 2024-03-20T13:36:11.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.211+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a539f9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.211+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a539f9b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42756/0 (socket says 172.21.15.177:42756) 2024-03-20T13:36:11.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.211+0000 7fb868ac2640 1 -- 172.21.15.177:0/3962352693 learned_addr learned my addr 172.21.15.177:0/3962352693 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.212+0000 7fb868ac2640 1 -- 172.21.15.177:0/3962352693 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a539fa0f0 con 0x561a539f9720 2024-03-20T13:36:11.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.213+0000 7fb868ac2640 1 --2- 172.21.15.177:0/3962352693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a539f9b20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00bba0 tx=0x7fb85c0448c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b4c03d7aa067c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.214+0000 7fb73ffff640 1 -- 172.21.15.177:0/3962352693 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c044ba0 con 0x561a539f9720 2024-03-20T13:36:11.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.214+0000 7fb73ffff640 1 -- 172.21.15.177:0/3962352693 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c044d00 con 0x561a539f9720 2024-03-20T13:36:11.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.214+0000 7fb73ffff640 1 -- 172.21.15.177:0/3962352693 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c00d440 con 0x561a539f9720 2024-03-20T13:36:11.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.214+0000 7fb86d410800 1 -- 172.21.15.177:0/3962352693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 msgr2=0x561a539f9b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.214+0000 7fb86d410800 1 --2- 172.21.15.177:0/3962352693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a539f9b20 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fb85c00bba0 tx=0x7fb85c0448c0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 -- 172.21.15.177:0/3962352693 shutdown_connections 2024-03-20T13:36:11.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 --2- 172.21.15.177:0/3962352693 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a539f9b20 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 -- 172.21.15.177:0/3962352693 >> 172.21.15.177:0/3962352693 conn(0x561a539f59f0 msgr2=0x561a539f3a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 -- 172.21.15.177:0/3962352693 shutdown_connections 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 -- 172.21.15.177:0/3962352693 wait complete. 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 Processor -- start 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 -- start start 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a53a00600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb86d410800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a53a00b40 con 0x561a539f9720 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a53a00600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb868ac2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a53a00600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42760/0 (socket says 172.21.15.177:42760) 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.215+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 learned_addr learned my addr 172.21.15.177:0/4199158014 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c050020 con 0x561a539f9720 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb868ac2640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a53a00600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb85c044eb0 tx=0x7fb85c003f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb73e7fc640 1 -- 172.21.15.177:0/4199158014 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c030890 con 0x561a539f9720 2024-03-20T13:36:11.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb73e7fc640 1 -- 172.21.15.177:0/4199158014 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85c0309f0 con 0x561a539f9720 2024-03-20T13:36:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561a53a00d40 con 0x561a539f9720 2024-03-20T13:36:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb73e7fc640 1 -- 172.21.15.177:0/4199158014 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb85c030c90 con 0x561a539f9720 2024-03-20T13:36:11.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.216+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a53a00d40 con 0x561a539f9720 2024-03-20T13:36:11.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.217+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.217+0000 7fb73e7fc640 1 -- 172.21.15.177:0/4199158014 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb85c04d870 con 0x561a539f9720 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.217+0000 7fb73e7fc640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb734036790 0x7fb734038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.217+0000 7fb73e7fc640 1 -- 172.21.15.177:0/4199158014 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb85c078d70 con 0x561a539f9720 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb863fff640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb734036790 0x7fb734038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a53a0c0b0 0x561a53a0e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0eca0 con 0x561a53a0c0b0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb8692c3640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a53a0c0b0 0x561a53a0e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb863fff640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb734036790 0x7fb734038c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x561a539de7a0 tx=0x7fb85404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb8692c3640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a53a0c0b0 0x561a53a0e550 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 20 realm 2024-03-20T13:36:11.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f070 con 0x561a53a0c0b0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.218+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0fc50 con 0x561a53a0c0b0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a53a10600 0x561a53a129f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a12f30 con 0x561a53a10600 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb868ac2640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a53a10600 0x561a53a129f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.219+0000 7fb868ac2640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a53a10600 0x561a53a129f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb86d410800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb86d410800 20 searching for the correct realm 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561a53a14ed0 0x561a53a17390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a17a60 con 0x561a53a14ed0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb863fff640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561a53a14ed0 0x561a53a17390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb863fff640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561a53a14ed0 0x561a53a17390 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.220+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a17a60 con 0x561a53a10600 2024-03-20T13:36:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.221+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.221+0000 7fb868ac2640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb85c077060 0x7fb85c0351d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.221+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a17a60 con 0x7fb85c077060 2024-03-20T13:36:11.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.222+0000 7fb8692c3640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb85c077060 0x7fb85c0351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.224+0000 7fb8692c3640 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb85c077060 0x7fb85c0351d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.225+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.225+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.226+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.226+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.226+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.226+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.227+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.227+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.227+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.227+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a10600 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.228+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.228+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.228+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.228+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.228+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.228+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.229+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.229+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.229+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.229+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a10600 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.230+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.230+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.230+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.230+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.230+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.230+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.231+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.231+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.231+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.231+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.232+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.232+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.232+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.232+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.232+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.232+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.233+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.233+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.233+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.234+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a10600 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.234+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.234+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.234+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.234+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.235+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.235+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a10600 2024-03-20T13:36:11.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.235+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.235+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.237+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.237+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a10600 2024-03-20T13:36:11.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.237+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.237+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a14ed0 2024-03-20T13:36:11.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.237+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.237+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x7fb85c077060 2024-03-20T13:36:11.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.238+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.238+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a0f8f0 con 0x561a53a10600 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a137f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a137f0 con 0x561a53a0c0b0 2024-03-20T13:36:11.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.239+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a137f0 con 0x7fb85c077060 2024-03-20T13:36:11.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 20 zone default found 2024-03-20T13:36:11.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 4 Realm: () 2024-03-20T13:36:11.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 20 zonegroup default 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.241+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a14090 con 0x7fb85c077060 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a14490 con 0x561a53a14ed0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a19880 con 0x561a53a14ed0 2024-03-20T13:36:11.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 started sync module instance, tier type = 2024-03-20T13:36:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.242+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a18d10 con 0x561a53a10600 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.244+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.244+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671072235712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a194e0 con 0x561a53a10600 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.244+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1a690 con 0x561a53a0c0b0 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.245+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671072235712] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.245+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.245+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671072240112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1aab0 con 0x561a53a0c0b0 2024-03-20T13:36:11.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.245+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1b420 con 0x561a53a14ed0 2024-03-20T13:36:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.247+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.247+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671072243584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1bc20 con 0x561a53a14ed0 2024-03-20T13:36:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.247+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1c6b0 con 0x561a53a10600 2024-03-20T13:36:11.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.247+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671072240112] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.248+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671072243584] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.248+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.248+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671072245632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1c1d0 con 0x561a53a10600 2024-03-20T13:36:11.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.248+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1d0a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.249+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671072245632] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.250+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.250+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671072241168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1d0a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.250+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1da10 con 0x7fb85c077060 2024-03-20T13:36:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.251+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671072241168] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.251+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.251+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671072251360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1da10 con 0x7fb85c077060 2024-03-20T13:36:11.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.251+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1e380 con 0x7fb85c077060 2024-03-20T13:36:11.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.253+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671072251360] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.253+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.253+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671072253296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1e380 con 0x7fb85c077060 2024-03-20T13:36:11.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.253+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1ed50 con 0x7fb85c077060 2024-03-20T13:36:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'192 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671072258128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1f1b0 con 0x7fb85c077060 2024-03-20T13:36:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=0 2024-03-20T13:36:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=1 2024-03-20T13:36:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=2 2024-03-20T13:36:11.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=3 2024-03-20T13:36:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=4 2024-03-20T13:36:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=5 2024-03-20T13:36:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671072253296] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.255+0000 7fb86d410800 20 add_watcher() i=6 2024-03-20T13:36:11.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.256+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671072258128] v32'193 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.256+0000 7fb86d410800 20 add_watcher() i=7 2024-03-20T13:36:11.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.256+0000 7fb86d410800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.256+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1dee0 con 0x561a53a0c0b0 2024-03-20T13:36:11.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.257+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.257+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671072259344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1dee0 con 0x561a53a0c0b0 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671072259344] v32'198 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb71efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb86d410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb86d410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb86d410800 5 note: GC not initialized 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb71dfe3640 20 reqs_thread_entry: start 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb86d410800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.258+0000 7fb86d410800 20 Filter name: none 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb68f7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a54620 con 0x561a53a0c0b0 2024-03-20T13:36:11.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a54620 con 0x561a53a10600 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a549e0 con 0x561a53a0c0b0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a549e0 con 0x561a53a14ed0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.259+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a54d40 con 0x561a53a14ed0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a550a0 con 0x561a53a14ed0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a55400 con 0x561a53a0c0b0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a55400 con 0x561a53a0c0b0 2024-03-20T13:36:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.260+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a55400 con 0x561a53a14ed0 2024-03-20T13:36:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.261+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.261+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a55400 con 0x561a53a14ed0 2024-03-20T13:36:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.261+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 151+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.261+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a55400 con 0x7fb85c077060 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.262+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(72 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.262+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a0c0b0 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.262+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.262+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a10600 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.262+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.262+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.263+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.263+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x7fb85c077060 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.264+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.264+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x7fb85c077060 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.264+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.265+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.265+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.265+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x7fb85c077060 2024-03-20T13:36:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.266+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(79 usage.17 [call out=163b] v0'0 uv6 ondisk = 0) v8 ==== 152+0+163 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.266+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a0c0b0 2024-03-20T13:36:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.266+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.266+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.266+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.266+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x7fb85c077060 2024-03-20T13:36:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.267+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.267+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a10600 2024-03-20T13:36:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.268+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.268+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x7fb85c077060 2024-03-20T13:36:11.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.269+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.269+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.269+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.269+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.269+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.269+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x561a53a14ed0 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.270+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.271+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a56b30 con 0x7fb85c077060 2024-03-20T13:36:11.273 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.271+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.272+0000 7fb71efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.272+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671072259344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a530b0 con 0x561a53a0c0b0 2024-03-20T13:36:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.273+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94671072259344] v32'199 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.274 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.273+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671072235712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1ed10 con 0x561a53a10600 2024-03-20T13:36:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.274+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94671072235712] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.274+0000 7fb86d410800 20 remove_watcher() i=0 2024-03-20T13:36:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.274+0000 7fb86d410800 2 removed watcher, disabling cache 2024-03-20T13:36:11.275 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.274+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671072240112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1ed10 con 0x561a53a0c0b0 2024-03-20T13:36:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.276+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94671072240112] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.276+0000 7fb86d410800 20 remove_watcher() i=1 2024-03-20T13:36:11.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.276+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671072243584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1a1f0 con 0x561a53a14ed0 2024-03-20T13:36:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.278+0000 7fb863fff640 1 -- 172.21.15.177:0/4199158014 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94671072243584] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb854052b80 con 0x561a53a14ed0 2024-03-20T13:36:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.278+0000 7fb86d410800 20 remove_watcher() i=2 2024-03-20T13:36:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.278+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671072245632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1ed10 con 0x561a53a10600 2024-03-20T13:36:11.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.278+0000 7fb868ac2640 1 -- 172.21.15.177:0/4199158014 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94671072245632] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb85c016070 con 0x561a53a10600 2024-03-20T13:36:11.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.278+0000 7fb86d410800 20 remove_watcher() i=3 2024-03-20T13:36:11.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.278+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671072241168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1af80 con 0x561a53a0c0b0 2024-03-20T13:36:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.280+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94671072241168] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x561a53a0c0b0 2024-03-20T13:36:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.280+0000 7fb86d410800 20 remove_watcher() i=4 2024-03-20T13:36:11.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.280+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671072251360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1a690 con 0x7fb85c077060 2024-03-20T13:36:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.282+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94671072251360] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.282+0000 7fb86d410800 20 remove_watcher() i=5 2024-03-20T13:36:11.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.282+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671072253296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1a690 con 0x7fb85c077060 2024-03-20T13:36:11.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.283+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94671072253296] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.284+0000 7fb86d410800 20 remove_watcher() i=6 2024-03-20T13:36:11.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.284+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671072258128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x561a53a1a690 con 0x7fb85c077060 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94671072258128] v32'194 uv192 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb86400a4a0 con 0x7fb85c077060 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 20 remove_watcher() i=7 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb85c077060 msgr2=0x7fb85c0351d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb85c077060 0x7fb85c0351d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a53a0c0b0 msgr2=0x561a53a0e550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a53a0c0b0 0x561a53a0e550 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a53a10600 msgr2=0x561a53a129f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a53a10600 0x561a53a129f0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561a53a14ed0 msgr2=0x561a53a17390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x561a53a14ed0 0x561a53a17390 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb734036790 msgr2=0x7fb734038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb734036790 0x7fb734038c50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x561a539de7a0 tx=0x7fb85404f000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 msgr2=0x561a53a00600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 --2- 172.21.15.177:0/4199158014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539f9720 0x561a53a00600 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fb85c044eb0 tx=0x7fb85c003f50 comp rx=0 tx=0).stop 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 reap_dead start 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb8692c3640 1 -- 172.21.15.177:0/4199158014 reap_dead start 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 shutdown_connections 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 >> 172.21.15.177:0/4199158014 conn(0x561a539f59f0 msgr2=0x561a539f3050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 shutdown_connections 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.285+0000 7fb86d410800 1 -- 172.21.15.177:0/4199158014 wait complete. 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7400367e0 msgr2=0x7fb740038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7400367e0 0x7fb740038ca0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x561a539d2710 tx=0x7fb854005ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 msgr2=0x561a539eca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 0x561a539eca00 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fb85c04c010 tx=0x7fb85c04c480 comp rx=0 tx=0).stop 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 shutdown_connections 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7400367e0 0x7fb740038ca0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/2782709284 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a539ec5e0 0x561a539eca00 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 >> 172.21.15.177:0/2782709284 conn(0x561a539e0680 msgr2=0x561a539e0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 shutdown_connections 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/2782709284 wait complete. 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561a539db8b0 msgr2=0x561a539ddca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x561a539db8b0 0x561a539ddca0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a538d4f30 msgr2=0x561a539d5170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561a538d4f30 0x561a539d5170 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a539d79b0 msgr2=0x561a539d9da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561a539d79b0 0x561a539d9da0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb750036830 msgr2=0x7fb750038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb750036830 0x7fb750038cf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb854054000 tx=0x7fb85404e000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 msgr2=0x561a539ce3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 --2- 172.21.15.177:0/1826738361 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561a538d33f0 0x561a539ce3f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x561a539c7ae0 tx=0x7fb85c000bc0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb8692c3640 1 -- 172.21.15.177:0/1826738361 reap_dead start 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 shutdown_connections 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 >> 172.21.15.177:0/1826738361 conn(0x561a538cf030 msgr2=0x561a539c0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 shutdown_connections 2024-03-20T13:36:11.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.286+0000 7fb86d410800 1 -- 172.21.15.177:0/1826738361 wait complete. 2024-03-20T13:36:11.295 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}]}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":237,"bytes_received":0,"ops":1,"successful_ops":1}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-03-20T13:36:11.295 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 237, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-03-20T13:36:11.296 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-03-20T13:36:11.296 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-03-20T13:36:11.296 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-03-20T13:36:11.377 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.378 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.377+0000 7f507389d800 1 Processor -- start 2024-03-20T13:36:11.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.377+0000 7f507389d800 1 -- start start 2024-03-20T13:36:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.377+0000 7f507389d800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x5606ac693630 0x5606ac695a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.377+0000 7f507389d800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x5606ac5ddcd0 con 0x5606ac695f60 2024-03-20T13:36:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.377+0000 7f507389d800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x5606ac594500 con 0x5606ac693630 2024-03-20T13:36:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f5070b9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x5606ac695f60 0x5606ac698350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34788/0 (socket says 172.21.15.177:34788) 2024-03-20T13:36:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f5070b9b640 1 -- 172.21.15.177:0/3662420006 learned_addr learned my addr 172.21.15.177:0/3662420006 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:11.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f507139c640 1 --2- 172.21.15.177:0/3662420006 >> v2:172.21.15.28:3300/0 conn(0x5606ac693630 0x5606ac695a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f5063fff640 1 -- 172.21.15.177:0/3662420006 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3903593637 0 0) 0x5606ac5ddcd0 con 0x5606ac695f60 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f5063fff640 1 -- 172.21.15.177:0/3662420006 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c001e10 con 0x5606ac695f60 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f507139c640 1 -- 172.21.15.177:0/3662420006 >> v1:172.21.15.28:6789/0 conn(0x5606ac695f60 legacy=0x5606ac698350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.378+0000 7f507139c640 1 -- 172.21.15.177:0/3662420006 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ac69aa80 con 0x5606ac693630 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.380+0000 7f507139c640 1 --2- 172.21.15.177:0/3662420006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac695a20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f506400a470 tx=0x7f506401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77030df47707e87f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.380+0000 7f5063fff640 1 -- 172.21.15.177:0/3662420006 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506404ad60 con 0x5606ac693630 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.380+0000 7f5063fff640 1 -- 172.21.15.177:0/3662420006 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064052440 con 0x5606ac693630 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.380+0000 7f5063fff640 1 -- 172.21.15.177:0/3662420006 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5064052700 con 0x5606ac693630 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 -- 172.21.15.177:0/3662420006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 msgr2=0x5606ac695a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 --2- 172.21.15.177:0/3662420006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac695a20 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f506400a470 tx=0x7f506401cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 -- 172.21.15.177:0/3662420006 shutdown_connections 2024-03-20T13:36:11.384 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 --2- 172.21.15.177:0/3662420006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac695a20 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 -- 172.21.15.177:0/3662420006 >> 172.21.15.177:0/3662420006 conn(0x5606ac68d040 msgr2=0x5606ac68f460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 -- 172.21.15.177:0/3662420006 shutdown_connections 2024-03-20T13:36:11.385 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.381+0000 7f507389d800 1 -- 172.21.15.177:0/3662420006 wait complete. 2024-03-20T13:36:11.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.392+0000 7f507389d800 1 Processor -- start 2024-03-20T13:36:11.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507389d800 1 -- start start 2024-03-20T13:36:11.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507389d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac782820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507389d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ac591a30 con 0x5606ac693630 2024-03-20T13:36:11.394 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac782820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac782820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42772/0 (socket says 172.21.15.177:42772) 2024-03-20T13:36:11.395 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507139c640 1 -- 172.21.15.177:0/1197179989 learned_addr learned my addr 172.21.15.177:0/1197179989 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.393+0000 7f507139c640 1 -- 172.21.15.177:0/1197179989 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064005d20 con 0x5606ac693630 2024-03-20T13:36:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.394+0000 7f507139c640 1 --2- 172.21.15.177:0/1197179989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac782820 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f506401ccc0 tx=0x7f506404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86204991cafd0dae server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.394+0000 7f4f5f606640 1 -- 172.21.15.177:0/1197179989 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506400a040 con 0x5606ac693630 2024-03-20T13:36:11.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.394+0000 7f4f5f606640 1 -- 172.21.15.177:0/1197179989 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506400a1a0 con 0x5606ac693630 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.394+0000 7f4f5f606640 1 -- 172.21.15.177:0/1197179989 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50640525b0 con 0x5606ac693630 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- 172.21.15.177:0/1197179989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 msgr2=0x5606ac782820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 --2- 172.21.15.177:0/1197179989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac782820 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f506401ccc0 tx=0x7f506404c000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- 172.21.15.177:0/1197179989 shutdown_connections 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 --2- 172.21.15.177:0/1197179989 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac782820 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- 172.21.15.177:0/1197179989 >> 172.21.15.177:0/1197179989 conn(0x5606ac68d040 msgr2=0x5606ac77e140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- 172.21.15.177:0/1197179989 shutdown_connections 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- 172.21.15.177:0/1197179989 wait complete. 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 Processor -- start 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- start start 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac789db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507389d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ac58d210 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac789db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac789db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42786/0 (socket says 172.21.15.177:42786) 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.395+0000 7f507139c640 1 -- 172.21.15.177:0/2152063795 learned_addr learned my addr 172.21.15.177:0/2152063795 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f507139c640 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ac69aa80 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f507139c640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac789db0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f506401d3b0 tx=0x7f5064002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f4f5de03640 1 -- 172.21.15.177:0/2152063795 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506406b070 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f4f5de03640 1 -- 172.21.15.177:0/2152063795 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064052cb0 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f4f5de03640 1 -- 172.21.15.177:0/2152063795 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506406f410 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ac78a2f0 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.396+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ac78a830 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f4f5de03640 1 -- 172.21.15.177:0/2152063795 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5064059050 con 0x5606ac693630 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f4f5de03640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f58036790 0x7f4f58038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f4f5de03640 1 -- 172.21.15.177:0/2152063795 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f506408d4d0 con 0x5606ac693630 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f5070b9b640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f58036790 0x7f4f58038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac695f60 0x5606ac790bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac791150 con 0x5606ac695f60 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f5071b9d640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac695f60 0x5606ac790bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.397+0000 7f5070b9b640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f58036790 0x7f4f58038c50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5068000f60 tx=0x7f50680010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f5071b9d640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac695f60 0x5606ac790bd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f5071b9d640 1 -- 172.21.15.177:0/2152063795 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac695f60 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac78e190 con 0x5606ac695f60 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f5071b9d640 1 -- 172.21.15.177:0/2152063795 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac695f60 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac793360 0x5606ac795750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac795e20 con 0x5606ac793360 2024-03-20T13:36:11.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.398+0000 7f507139c640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac793360 0x5606ac795750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.403 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f507139c640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac793360 0x5606ac795750 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f507139c640 1 -- 172.21.15.177:0/2152063795 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f506407f040 con 0x5606ac793360 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7922e0 con 0x5606ac695f60 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f5071b9d640 1 -- 172.21.15.177:0/2152063795 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac695f60 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5606ac797220 0x5606ac799610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac799d70 con 0x5606ac797220 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.399+0000 7f5070b9b640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5606ac797220 0x5606ac799610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.418 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.400+0000 7f5070b9b640 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5606ac797220 0x5606ac799610 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.400+0000 7f5070b9b640 1 -- 172.21.15.177:0/2152063795 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5068006070 con 0x5606ac797220 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.400+0000 7f507389d800 1 Processor -- start 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507389d800 1 -- start start 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507389d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 0x5606ac7a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507389d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ac52fc70 con 0x5606ac7a7f00 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 0x5606ac7a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 0x5606ac7a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42798/0 (socket says 172.21.15.177:42798) 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507139c640 1 -- 172.21.15.177:0/1870804238 learned_addr learned my addr 172.21.15.177:0/1870804238 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.401+0000 7f507139c640 1 -- 172.21.15.177:0/1870804238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ac7a8860 con 0x5606ac7a7f00 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.402+0000 7f507139c640 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 0x5606ac7a8320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f506405cfd0 tx=0x7f506405ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.402+0000 7f4f56ffd640 1 -- 172.21.15.177:0/1870804238 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506405b6f0 con 0x5606ac7a7f00 2024-03-20T13:36:11.419 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.402+0000 7f4f56ffd640 1 -- 172.21.15.177:0/1870804238 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506405b850 con 0x5606ac7a7f00 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.402+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ac7a92d0 con 0x5606ac7a7f00 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.402+0000 7f4f56ffd640 1 -- 172.21.15.177:0/1870804238 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f506408bb60 con 0x5606ac7a7f00 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.402+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ac7a9790 con 0x5606ac7a7f00 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f4f56ffd640 1 -- 172.21.15.177:0/1870804238 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f506408bcc0 con 0x5606ac7a7f00 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f4f56ffd640 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f4c0367e0 0x7f4f4c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f4f56ffd640 1 -- 172.21.15.177:0/1870804238 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f5064067050 con 0x5606ac7a7f00 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f5070b9b640 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f4c0367e0 0x7f4f4c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f507389d800 1 Processor -- start 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f507389d800 1 -- start start 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f5070b9b640 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f4c0367e0 0x7f4f4c038ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f506800bf90 tx=0x7f506800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f507389d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac693040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.403+0000 7f507389d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ac5055d0 con 0x5606ac692c20 2024-03-20T13:36:11.420 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac693040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac693040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42814/0 (socket says 172.21.15.177:42814) 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f507139c640 1 -- 172.21.15.177:0/2566145120 learned_addr learned my addr 172.21.15.177:0/2566145120 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f507139c640 1 -- 172.21.15.177:0/2566145120 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ac691420 con 0x5606ac692c20 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f507139c640 1 --2- 172.21.15.177:0/2566145120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac693040 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f506404c040 tx=0x7f5064077ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55205b772a29b350 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f4f54ff9640 1 -- 172.21.15.177:0/2566145120 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50640690c0 con 0x5606ac692c20 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f4f54ff9640 1 -- 172.21.15.177:0/2566145120 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506409c040 con 0x5606ac692c20 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.404+0000 7f4f54ff9640 1 -- 172.21.15.177:0/2566145120 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5064077cc0 con 0x5606ac692c20 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- 172.21.15.177:0/2566145120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 msgr2=0x5606ac693040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 --2- 172.21.15.177:0/2566145120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac693040 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f506404c040 tx=0x7f5064077ba0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- 172.21.15.177:0/2566145120 shutdown_connections 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 --2- 172.21.15.177:0/2566145120 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac693040 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.421 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- 172.21.15.177:0/2566145120 >> 172.21.15.177:0/2566145120 conn(0x5606ac7b1310 msgr2=0x5606ac7af370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- 172.21.15.177:0/2566145120 shutdown_connections 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- 172.21.15.177:0/2566145120 wait complete. 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 Processor -- start 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- start start 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac7be090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.405+0000 7f507389d800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5606ac7be5d0 con 0x5606ac692c20 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac7be090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507139c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac7be090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42826/0 (socket says 172.21.15.177:42826) 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 learned_addr learned my addr 172.21.15.177:0/1900853021 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5606ac7a92d0 con 0x5606ac692c20 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507139c640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac7be090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5064079010 tx=0x7f5064073f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.422 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f4f42ffd640 1 -- 172.21.15.177:0/1900853021 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50640b4070 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f4f42ffd640 1 -- 172.21.15.177:0/1900853021 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064096d20 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5606ac7a92d0 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f4f42ffd640 1 -- 172.21.15.177:0/1900853021 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5064096450 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.406+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5606ac7a92d0 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.407+0000 7f4f42ffd640 1 -- 172.21.15.177:0/1900853021 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f50640965b0 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.407+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.407+0000 7f4f42ffd640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f3c036790 0x7f4f3c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.407+0000 7f4f42ffd640 1 -- 172.21.15.177:0/1900853021 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f50640bea90 con 0x5606ac692c20 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.407+0000 7f5070b9b640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f3c036790 0x7f4f3c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac7c97f0 0x5606ac7cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cc400 con 0x5606ac7c97f0 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f5071b9d640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac7c97f0 0x5606ac7cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.423 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f5070b9b640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f3c036790 0x7f4f3c038c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5606ac78e0d0 tx=0x7f5068010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f5071b9d640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac7c97f0 0x5606ac7cbcb0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 20 realm 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cc7d0 con 0x5606ac7c97f0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.408+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.424 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd380 con 0x5606ac7c97f0 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac7cdd30 0x5606ac7d0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d0660 con 0x5606ac7cdd30 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507139c640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac7cdd30 0x5606ac7d0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507139c640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac7cdd30 0x5606ac7d0120 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 20 searching for the correct realm 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5606ac7d2660 0x5606ac7d4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.425 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.409+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d51f0 con 0x5606ac7d2660 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f5070b9b640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5606ac7d2660 0x5606ac7d4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f5070b9b640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5606ac7d2660 0x5606ac7d4b20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d51f0 con 0x5606ac7cdd30 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f507139c640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5064070000 0x7f506406c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.410+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d51f0 con 0x7f5064070000 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.411+0000 7f5071b9d640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5064070000 0x7f506406c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.411+0000 7f5071b9d640 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5064070000 0x7f506406c270 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.426 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.412+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7cdd30 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.413+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.427 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7cdd30 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.414+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.415+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7cdd30 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.416+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.417+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.417+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.417+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.417+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7cdd30 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.417+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.417+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.418+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.418+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7cdd30 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.418+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.418+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7d2660 2024-03-20T13:36:11.440 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.418+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.418+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x7f5064070000 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7c97f0 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7cd020 con 0x5606ac7cdd30 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.441 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d0f60 con 0x5606ac7c97f0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d0f60 con 0x5606ac7c97f0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.419+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d0f60 con 0x7f5064070000 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 zone default found 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 4 Realm: () 2024-03-20T13:36:11.442 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 zonegroup default 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d17b0 con 0x7f5064070000 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.420+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d17b0 con 0x5606ac7d2660 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d7010 con 0x5606ac7d2660 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 20 started sync module instance, tier type = 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.421+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d64a0 con 0x5606ac7cdd30 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.422+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.422+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94586663692368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d6c70 con 0x5606ac7cdd30 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.422+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d7e20 con 0x5606ac7c97f0 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.423+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94586663692368] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.423+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.423+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94586663696768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d8240 con 0x5606ac7c97f0 2024-03-20T13:36:11.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.423+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d8bb0 con 0x5606ac7d2660 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.424+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.424+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94586663700240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d93b0 con 0x5606ac7d2660 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.424+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d9e60 con 0x5606ac7cdd30 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.425+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94586663696768] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.425+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.425+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94586663697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7da6b0 con 0x5606ac7cdd30 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.425+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7db020 con 0x5606ac7c97f0 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.426+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94586663700240] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.426+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94586663697824] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.427+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.427+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94586663707152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7da630 con 0x5606ac7c97f0 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.427+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7db4c0 con 0x7f5064070000 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.429+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.429+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94586663710752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7db440 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.429+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94586663707152] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.429+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7daba0 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.431+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.431+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94586663709600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7dc380 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.431+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7dce20 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.431+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94586663710752] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'195 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94586663717120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7dcde0 con 0x7f5064070000 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=0 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=1 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=2 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=3 2024-03-20T13:36:11.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=4 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=5 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94586663709600] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.432+0000 7f507389d800 20 add_watcher() i=6 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.433+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94586663717120] v32'196 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.433+0000 7f507389d800 20 add_watcher() i=7 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.433+0000 7f507389d800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.433+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7dbee0 con 0x5606ac7c97f0 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.433+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.433+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94586663712720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7dbee0 con 0x5606ac7c97f0 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.434+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94586663712720] v32'200 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.434+0000 7f4f277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.434+0000 7f507389d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.434+0000 7f507389d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.434+0000 7f507389d800 5 note: GC not initialized 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f4f267e4640 20 reqs_thread_entry: start 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f507389d800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f507389d800 20 Filter name: none 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f4e97fff640 20 reqs_thread_entry: start 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f507389d800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac8117c0 con 0x5606ac7c97f0 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f507389d800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.435+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac8117c0 con 0x7f5064070000 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.436+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.437+0000 7f4f277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.437+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94586663712720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac8117c0 con 0x5606ac7c97f0 2024-03-20T13:36:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.438+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94586663712720] v32'201 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.438+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94586663692368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac8117c0 con 0x5606ac7cdd30 2024-03-20T13:36:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.439+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94586663692368] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.439+0000 7f507389d800 20 remove_watcher() i=0 2024-03-20T13:36:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.439+0000 7f507389d800 2 removed watcher, disabling cache 2024-03-20T13:36:11.449 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.439+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94586663696768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac8117c0 con 0x5606ac7c97f0 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.441+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94586663696768] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.441+0000 7f507389d800 20 remove_watcher() i=1 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.441+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94586663700240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac8117c0 con 0x5606ac7d2660 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.442+0000 7f5070b9b640 1 -- 172.21.15.177:0/1900853021 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94586663700240] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5068006070 con 0x5606ac7d2660 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.442+0000 7f507389d800 20 remove_watcher() i=2 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.442+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94586663697824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d6850 con 0x5606ac7cdd30 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.442+0000 7f507139c640 1 -- 172.21.15.177:0/1900853021 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94586663697824] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f50640b6070 con 0x5606ac7cdd30 2024-03-20T13:36:11.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.443+0000 7f507389d800 20 remove_watcher() i=3 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.443+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94586663707152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d6850 con 0x5606ac7c97f0 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.444+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94586663707152] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x5606ac7c97f0 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.444+0000 7f507389d800 20 remove_watcher() i=4 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.444+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94586663710752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7da210 con 0x7f5064070000 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.446+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94586663710752] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.446+0000 7f507389d800 20 remove_watcher() i=5 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.446+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94586663709600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7d6850 con 0x7f5064070000 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.448+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94586663709600] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.448+0000 7f507389d800 20 remove_watcher() i=6 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.448+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94586663717120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5606ac7da210 con 0x7f5064070000 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94586663717120] v32'197 uv195 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f506c00a4a0 con 0x7f5064070000 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 20 remove_watcher() i=7 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5064070000 msgr2=0x7f506406c270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5064070000 0x7f506406c270 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac7c97f0 msgr2=0x5606ac7cbcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac7c97f0 0x5606ac7cbcb0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac7cdd30 msgr2=0x5606ac7d0120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac7cdd30 0x5606ac7d0120 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5606ac7d2660 msgr2=0x5606ac7d4b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x5606ac7d2660 0x5606ac7d4b20 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f3c036790 msgr2=0x7f4f3c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f3c036790 0x7f4f3c038c50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x5606ac78e0d0 tx=0x7f5068010000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 msgr2=0x5606ac7be090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 --2- 172.21.15.177:0/1900853021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac692c20 0x5606ac7be090 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5064079010 tx=0x7f5064073f50 comp rx=0 tx=0).stop 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 reap_dead start 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f5071b9d640 1 -- 172.21.15.177:0/1900853021 reap_dead start 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 shutdown_connections 2024-03-20T13:36:11.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 >> 172.21.15.177:0/1900853021 conn(0x5606ac7b1310 msgr2=0x5606ac7ae970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 shutdown_connections 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.449+0000 7f507389d800 1 -- 172.21.15.177:0/1900853021 wait complete. 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f4c0367e0 msgr2=0x7f4f4c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f4c0367e0 0x7f4f4c038ca0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f506800bf90 tx=0x7f506800f000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 msgr2=0x5606ac7a8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 0x5606ac7a8320 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f506405cfd0 tx=0x7f506405ca90 comp rx=0 tx=0).stop 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 shutdown_connections 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f4c0367e0 0x7f4f4c038ca0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/1870804238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac7a7f00 0x5606ac7a8320 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 >> 172.21.15.177:0/1870804238 conn(0x5606ac79bfa0 msgr2=0x5606ac79c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 shutdown_connections 2024-03-20T13:36:11.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/1870804238 wait complete. 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5606ac797220 msgr2=0x5606ac799610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x5606ac797220 0x5606ac799610 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac695f60 msgr2=0x5606ac790bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x5606ac695f60 0x5606ac790bd0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac793360 msgr2=0x5606ac795750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x5606ac793360 0x5606ac795750 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f58036790 msgr2=0x7f4f58038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f4f58036790 0x7f4f58038c50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f5068000f60 tx=0x7f50680010a0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 msgr2=0x5606ac789db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 --2- 172.21.15.177:0/2152063795 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5606ac693630 0x5606ac789db0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f506401d3b0 tx=0x7f5064002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f5071b9d640 1 -- 172.21.15.177:0/2152063795 reap_dead start 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 shutdown_connections 2024-03-20T13:36:11.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 >> 172.21.15.177:0/2152063795 conn(0x5606ac68d040 msgr2=0x5606ac781210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 shutdown_connections 2024-03-20T13:36:11.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.450+0000 7f507389d800 1 -- 172.21.15.177:0/2152063795 wait complete. 2024-03-20T13:36:11.460 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34}}]} 2024-03-20T13:36:11.460 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34}}]} 2024-03-20T13:36:11.460 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-03-20T13:36:11.460 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-03-20T13:36:11.460 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-03-20T13:36:11.544 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.545 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.544+0000 7f7be2731800 1 Processor -- start 2024-03-20T13:36:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.544+0000 7f7be2731800 1 -- start start 2024-03-20T13:36:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.544+0000 7f7be2731800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c4f2331e70 0x55c4f2334260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.544+0000 7f7be2731800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55c4f2279cd0 con 0x55c4f232d9e0 2024-03-20T13:36:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.544+0000 7f7be2731800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55c4f2230500 con 0x55c4f2331e70 2024-03-20T13:36:11.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.545+0000 7f7bd7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c4f2331e70 0x55c4f2334260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.545+0000 7f7bd7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55c4f2331e70 0x55c4f2334260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42838/0 (socket says 172.21.15.177:42838) 2024-03-20T13:36:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.545+0000 7f7bde434640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55c4f232d9e0 0x55c4f232de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34804/0 (socket says 172.21.15.177:34804) 2024-03-20T13:36:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.545+0000 7f7bd7fff640 1 -- 172.21.15.177:0/226819925 learned_addr learned my addr 172.21.15.177:0/226819925 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.545+0000 7f7bd7fff640 1 -- 172.21.15.177:0/226819925 >> v1:172.21.15.28:6789/0 conn(0x55c4f232d9e0 legacy=0x55c4f232de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.545+0000 7f7bd7fff640 1 -- 172.21.15.177:0/226819925 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f2335890 con 0x55c4f2331e70 2024-03-20T13:36:11.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.547+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/226819925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2334260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800a520 tx=0x7f7bc801cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe22fbdb5d01f6c4 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.547+0000 7f7bddc33640 1 -- 172.21.15.177:0/226819925 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc8052570 con 0x55c4f2331e70 2024-03-20T13:36:11.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.547+0000 7f7bddc33640 1 -- 172.21.15.177:0/226819925 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc80526d0 con 0x55c4f2331e70 2024-03-20T13:36:11.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.547+0000 7f7bddc33640 1 -- 172.21.15.177:0/226819925 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc8052990 con 0x55c4f2331e70 2024-03-20T13:36:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.547+0000 7f7be2731800 1 -- 172.21.15.177:0/226819925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 msgr2=0x55c4f2334260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.547+0000 7f7be2731800 1 --2- 172.21.15.177:0/226819925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2334260 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f7bc800a520 tx=0x7f7bc801cee0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.548+0000 7f7be2731800 1 -- 172.21.15.177:0/226819925 shutdown_connections 2024-03-20T13:36:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.548+0000 7f7be2731800 1 --2- 172.21.15.177:0/226819925 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2334260 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.548+0000 7f7be2731800 1 -- 172.21.15.177:0/226819925 >> 172.21.15.177:0/226819925 conn(0x55c4f2329040 msgr2=0x55c4f232b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.548+0000 7f7be2731800 1 -- 172.21.15.177:0/226819925 shutdown_connections 2024-03-20T13:36:11.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.548+0000 7f7be2731800 1 -- 172.21.15.177:0/226819925 wait complete. 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.559+0000 7f7be2731800 1 Processor -- start 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.559+0000 7f7be2731800 1 -- start start 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.559+0000 7f7be2731800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 0x55c4f241d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.559+0000 7f7be2731800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f222da30 con 0x55c4f232d9e0 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.560+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 0x55c4f241d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.560+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 0x55c4f241d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42840/0 (socket says 172.21.15.177:42840) 2024-03-20T13:36:11.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.560+0000 7f7bde434640 1 -- 172.21.15.177:0/2048323708 learned_addr learned my addr 172.21.15.177:0/2048323708 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.560+0000 7f7bde434640 1 -- 172.21.15.177:0/2048323708 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc8005de0 con 0x55c4f232d9e0 2024-03-20T13:36:11.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.560+0000 7f7bde434640 1 --2- 172.21.15.177:0/2048323708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 0x55c4f241d940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0001cb0 tx=0x7f7bd000d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d92afa75c49a375c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.560+0000 7f7acc608640 1 -- 172.21.15.177:0/2048323708 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd000a610 con 0x55c4f232d9e0 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7acc608640 1 -- 172.21.15.177:0/2048323708 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000a790 con 0x55c4f232d9e0 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7acc608640 1 -- 172.21.15.177:0/2048323708 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd000aab0 con 0x55c4f232d9e0 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 -- 172.21.15.177:0/2048323708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 msgr2=0x55c4f241d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 --2- 172.21.15.177:0/2048323708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 0x55c4f241d940 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0001cb0 tx=0x7f7bd000d810 comp rx=0 tx=0).stop 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 -- 172.21.15.177:0/2048323708 shutdown_connections 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 --2- 172.21.15.177:0/2048323708 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f232d9e0 0x55c4f241d940 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.564 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 -- 172.21.15.177:0/2048323708 >> 172.21.15.177:0/2048323708 conn(0x55c4f2329040 msgr2=0x55c4f2419260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 -- 172.21.15.177:0/2048323708 shutdown_connections 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.561+0000 7f7be2731800 1 -- 172.21.15.177:0/2048323708 wait complete. 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7be2731800 1 Processor -- start 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7be2731800 1 -- start start 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7be2731800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2424190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7be2731800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f2229210 con 0x55c4f2331e70 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2424190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2424190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42846/0 (socket says 172.21.15.177:42846) 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7bde434640 1 -- 172.21.15.177:0/67445202 learned_addr learned my addr 172.21.15.177:0/67445202 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7bde434640 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f2279cd0 con 0x55c4f2331e70 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.562+0000 7f7bde434640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2424190 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000d850 tx=0x7f7bd0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.563+0000 7f7acae05640 1 -- 172.21.15.177:0/67445202 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd001d040 con 0x55c4f2331e70 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.563+0000 7f7acae05640 1 -- 172.21.15.177:0/67445202 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd000ae50 con 0x55c4f2331e70 2024-03-20T13:36:11.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.563+0000 7f7acae05640 1 -- 172.21.15.177:0/67445202 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd0016c30 con 0x55c4f2331e70 2024-03-20T13:36:11.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.563+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4f24246d0 con 0x55c4f2331e70 2024-03-20T13:36:11.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.563+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4f2424bb0 con 0x55c4f2331e70 2024-03-20T13:36:11.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7acae05640 1 -- 172.21.15.177:0/67445202 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bd002b3b0 con 0x55c4f2331e70 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7acae05640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ac4036790 0x7f7ac4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7acae05640 1 -- 172.21.15.177:0/67445202 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7bd004d620 con 0x55c4f2331e70 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ac4036790 0x7f7ac4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2428e30 0x55c4f242b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f242b8c0 con 0x55c4f2428e30 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7bdec35640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2428e30 0x55c4f242b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ac4036790 0x7f7ac4038c50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8054000 tx=0x7f7bc804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.564+0000 7f7bdec35640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2428e30 0x55c4f242b2f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7bdec35640 1 -- 172.21.15.177:0/67445202 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2428e30 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2428570 con 0x55c4f2428e30 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7bdec35640 1 -- 172.21.15.177:0/67445202 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2428e30 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f242d900 0x55c4f242fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2430550 con 0x55c4f242d900 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7bde434640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f242d900 0x55c4f242fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.565+0000 7f7bde434640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f242d900 0x55c4f242fdc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.566+0000 7f7bde434640 1 -- 172.21.15.177:0/67445202 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f242d900 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.566+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f242c0f0 con 0x55c4f2428e30 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.566+0000 7f7bdec35640 1 -- 172.21.15.177:0/67445202 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2428e30 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.566+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4f2431970 0x55c4f2433d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.566+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24344c0 con 0x55c4f2431970 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.566+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4f2431970 0x55c4f2433d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.567+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4f2431970 0x55c4f2433d60 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.567+0000 7f7bd7fff640 1 -- 172.21.15.177:0/67445202 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f2431970 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.567+0000 7f7be2731800 1 Processor -- start 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.567+0000 7f7be2731800 1 -- start start 2024-03-20T13:36:11.571 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.567+0000 7f7be2731800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 0x55c4f2446ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.567+0000 7f7be2731800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f21cbc70 con 0x55c4f2446ad0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 0x55c4f2446ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 0x55c4f2446ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42856/0 (socket says 172.21.15.177:42856) 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7bde434640 1 -- 172.21.15.177:0/2215485607 learned_addr learned my addr 172.21.15.177:0/2215485607 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7bde434640 1 -- 172.21.15.177:0/2215485607 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f2447430 con 0x55c4f2446ad0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7bde434640 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 0x55c4f2446ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7bd002e040 tx=0x7f7bd004d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7ac3fff640 1 -- 172.21.15.177:0/2215485607 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd004a1a0 con 0x55c4f2446ad0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7ac3fff640 1 -- 172.21.15.177:0/2215485607 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd004a320 con 0x55c4f2446ad0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7ac3fff640 1 -- 172.21.15.177:0/2215485607 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd0046980 con 0x55c4f2446ad0 2024-03-20T13:36:11.572 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4f2447ea0 con 0x55c4f2446ad0 2024-03-20T13:36:11.573 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.568+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4f2448360 con 0x55c4f2446ad0 2024-03-20T13:36:11.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.569+0000 7f7ac3fff640 1 -- 172.21.15.177:0/2215485607 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bd0046ae0 con 0x55c4f2446ad0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.569+0000 7f7ac3fff640 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.569+0000 7f7ac3fff640 1 -- 172.21.15.177:0/2215485607 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7bd0008030 con 0x55c4f2446ad0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.569+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7be2731800 1 Processor -- start 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7be2731800 1 -- start start 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c4f24284b0 tx=0x7f7bc8005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7be2731800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f24541d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7be2731800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f21a15d0 con 0x55c4f2453db0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f24541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f24541d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42868/0 (socket says 172.21.15.177:42868) 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7bde434640 1 -- 172.21.15.177:0/2925005514 learned_addr learned my addr 172.21.15.177:0/2925005514 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7bde434640 1 -- 172.21.15.177:0/2925005514 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f24547a0 con 0x55c4f2453db0 2024-03-20T13:36:11.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.570+0000 7f7bde434640 1 --2- 172.21.15.177:0/2925005514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f24541d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7bd002c030 tx=0x7f7bd00452d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85aeff9331882db server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7ac1ffb640 1 -- 172.21.15.177:0/2925005514 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd0035cd0 con 0x55c4f2453db0 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7ac1ffb640 1 -- 172.21.15.177:0/2925005514 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd0046d90 con 0x55c4f2453db0 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7ac1ffb640 1 -- 172.21.15.177:0/2925005514 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd004dd40 con 0x55c4f2453db0 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 -- 172.21.15.177:0/2925005514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 msgr2=0x55c4f24541d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 --2- 172.21.15.177:0/2925005514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f24541d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f7bd002c030 tx=0x7f7bd00452d0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 -- 172.21.15.177:0/2925005514 shutdown_connections 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 --2- 172.21.15.177:0/2925005514 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f24541d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 -- 172.21.15.177:0/2925005514 >> 172.21.15.177:0/2925005514 conn(0x55c4f2450030 msgr2=0x55c4f244e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 -- 172.21.15.177:0/2925005514 shutdown_connections 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.571+0000 7f7be2731800 1 -- 172.21.15.177:0/2925005514 wait complete. 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7be2731800 1 Processor -- start 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7be2731800 1 -- start start 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7be2731800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f245ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7be2731800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c4f245b090 con 0x55c4f2453db0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f245ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7bde434640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f245ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42878/0 (socket says 172.21.15.177:42878) 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 learned_addr learned my addr 172.21.15.177:0/534084453 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.572+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c4f2448360 con 0x55c4f2453db0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.573+0000 7f7bde434640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f245ab50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7bd004a7c0 tx=0x7f7bd0025f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.573+0000 7f7aaffff640 1 -- 172.21.15.177:0/534084453 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd0035cd0 con 0x55c4f2453db0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.573+0000 7f7aaffff640 1 -- 172.21.15.177:0/534084453 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd002abc0 con 0x55c4f2453db0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.573+0000 7f7aaffff640 1 -- 172.21.15.177:0/534084453 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bd002c8a0 con 0x55c4f2453db0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.573+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55c4f2448360 con 0x55c4f2453db0 2024-03-20T13:36:11.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.573+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c4f2448360 con 0x55c4f2453db0 2024-03-20T13:36:11.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7aaffff640 1 -- 172.21.15.177:0/534084453 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bd002ca00 con 0x55c4f2453db0 2024-03-20T13:36:11.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7aaffff640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa8036790 0x7f7aa8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7aaffff640 1 -- 172.21.15.177:0/534084453 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7bd006dd80 con 0x55c4f2453db0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa8036790 0x7f7aa8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2466410 0x55c4f24688b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469000 con 0x55c4f2466410 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7bdec35640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2466410 0x55c4f24688b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.574+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa8036790 0x7f7aa8038c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8052fd0 tx=0x7f7bc805f040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7bdec35640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2466410 0x55c4f24688b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 realm 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24693d0 con 0x55c4f2466410 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469f80 con 0x55c4f2466410 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.575+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f246a930 0x55c4f246cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f246d260 con 0x55c4f246a930 2024-03-20T13:36:11.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7bde434640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f246a930 0x55c4f246cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7bde434640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f246a930 0x55c4f246cd20 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7be2731800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7be2731800 20 searching for the correct realm 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4f246f260 0x55c4f2471720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2471df0 con 0x55c4f246f260 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.576+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4f246f260 0x55c4f2471720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bd7fff640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4f246f260 0x55c4f2471720 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2471df0 con 0x55c4f246a930 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bde434640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bd006c070 0x7f7bd002d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2471df0 con 0x7f7bd006c070 2024-03-20T13:36:11.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.577+0000 7f7bdec35640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bd006c070 0x7f7bd002d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.578+0000 7f7bdec35640 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bd006c070 0x7f7bd002d5e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.578+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.578+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.578+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.578+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246a930 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.579+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.580+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246a930 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.581+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.581+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.581+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.581+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.581+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.581+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.582+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246a930 2024-03-20T13:36:11.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.583+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.584+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.584+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.584+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.584+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246a930 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.584+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.584+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246a930 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246f260 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x7f7bd006c070 2024-03-20T13:36:11.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.585+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f2466410 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2469c20 con 0x55c4f246a930 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f246db60 con 0x55c4f2466410 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f246db60 con 0x55c4f2466410 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.586+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f246db60 con 0x7f7bd006c070 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 20 zone default found 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 4 Realm: () 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 20 zonegroup default 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f246e400 con 0x7f7bd006c070 2024-03-20T13:36:11.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.587+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f246e400 con 0x55c4f246f260 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2473c10 con 0x55c4f246f260 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 20 started sync module instance, tier type = 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.588+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24730a0 con 0x55c4f246a930 2024-03-20T13:36:11.610 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.589+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.589+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94304366703616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2473820 con 0x55c4f246a930 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.589+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24748b0 con 0x55c4f2466410 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.590+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94304366703616] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.591+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.591+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94304366707024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2474c60 con 0x55c4f2466410 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.591+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24756b0 con 0x55c4f246f260 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.592+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94304366707024] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.592+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.592+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94304366711184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2475a60 con 0x55c4f246f260 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.592+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2476500 con 0x55c4f246a930 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.593+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94304366711184] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.593+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.593+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94304366708208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2476d50 con 0x55c4f246a930 2024-03-20T13:36:11.611 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.593+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24776c0 con 0x55c4f2466410 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.594+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.594+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94304366708208] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.594+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94304366720000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2476970 con 0x55c4f2466410 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.594+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2478370 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.595+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94304366720000] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.595+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.595+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94304366721056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2478330 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.595+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2478d40 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.597+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.597+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94304366725216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24791c0 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.597+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2479c70 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.597+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94304366721056] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.612 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94304366725216] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'198 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94304366726272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2477e90 con 0x7f7bd006c070 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=0 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=1 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=2 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=3 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=4 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=5 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.598+0000 7f7be2731800 20 add_watcher() i=6 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.599+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94304366726272] v32'199 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.599+0000 7f7be2731800 20 add_watcher() i=7 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.599+0000 7f7be2731800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.599+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f247cc60 con 0x55c4f2466410 2024-03-20T13:36:11.613 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.599+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.599+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94304366729072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f247a0d0 con 0x55c4f2466410 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.600+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94304366729072] v32'202 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.600+0000 7f7a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.600+0000 7f7be2731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.600+0000 7f7be2731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.600+0000 7f7be2731800 5 note: GC not initialized 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.600+0000 7f7a0f7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7be2731800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7be2731800 20 Filter name: none 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7a0d7fa640 20 reqs_thread_entry: start 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7be2731800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24ae5e0 con 0x55c4f2466410 2024-03-20T13:36:11.614 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7be2731800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.601+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24ae5e0 con 0x7f7bd006c070 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.602+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.602+0000 7f7a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.602+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94304366729072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24ae5e0 con 0x55c4f2466410 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.603+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94304366729072] v32'203 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.603+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94304366703616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24ae5e0 con 0x55c4f246a930 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.605+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94304366703616] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.605+0000 7f7be2731800 20 remove_watcher() i=0 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.605+0000 7f7be2731800 2 removed watcher, disabling cache 2024-03-20T13:36:11.615 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.605+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94304366707024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24ae5e0 con 0x55c4f2466410 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.606+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94304366707024] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.606+0000 7f7be2731800 20 remove_watcher() i=1 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.606+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94304366711184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f24ae5e0 con 0x55c4f246f260 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.607+0000 7f7bd7fff640 1 -- 172.21.15.177:0/534084453 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94304366711184] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc8066040 con 0x55c4f246f260 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.607+0000 7f7be2731800 20 remove_watcher() i=2 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.607+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94304366708208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2474150 con 0x55c4f246a930 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.608+0000 7f7bde434640 1 -- 172.21.15.177:0/534084453 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94304366708208] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd002b660 con 0x55c4f246a930 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.608+0000 7f7be2731800 20 remove_watcher() i=3 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.608+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94304366720000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2474150 con 0x55c4f2466410 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.609+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94304366720000] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x55c4f2466410 2024-03-20T13:36:11.620 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.609+0000 7f7be2731800 20 remove_watcher() i=4 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.609+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94304366721056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2477400 con 0x7f7bd006c070 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.610+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94304366721056] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.610+0000 7f7be2731800 20 remove_watcher() i=5 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.610+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94304366725216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2474150 con 0x7f7bd006c070 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.611+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94304366725216] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.611+0000 7f7be2731800 20 remove_watcher() i=6 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.611+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94304366726272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55c4f2478860 con 0x7f7bd006c070 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94304366726272] v32'200 uv198 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bd800a4a0 con 0x7f7bd006c070 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 20 remove_watcher() i=7 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bd006c070 msgr2=0x7f7bd002d5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bd006c070 0x7f7bd002d5e0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2466410 msgr2=0x55c4f24688b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2466410 0x55c4f24688b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.621 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f246a930 msgr2=0x55c4f246cd20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f246a930 0x55c4f246cd20 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4f246f260 msgr2=0x55c4f2471720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55c4f246f260 0x55c4f2471720 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa8036790 msgr2=0x7f7aa8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa8036790 0x7f7aa8038c50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8052fd0 tx=0x7f7bc805f040 comp rx=0 tx=0).stop 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 msgr2=0x55c4f245ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7bdec35640 1 -- 172.21.15.177:0/534084453 reap_dead start 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.612+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f245ab50 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f7bd004a7c0 tx=0x7f7bd0025f60 comp rx=0 tx=0).stop 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 shutdown_connections 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/534084453 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2453db0 0x55c4f245ab50 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 >> 172.21.15.177:0/534084453 conn(0x55c4f2450030 msgr2=0x55c4f244d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 shutdown_connections 2024-03-20T13:36:11.622 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/534084453 wait complete. 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 msgr2=0x7f7ab8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x55c4f24284b0 tx=0x7f7bc8005ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 msgr2=0x55c4f2446ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 0x55c4f2446ef0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f7bd002e040 tx=0x7f7bd004d280 comp rx=0 tx=0).stop 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 shutdown_connections 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/2215485607 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2446ad0 0x55c4f2446ef0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 >> 172.21.15.177:0/2215485607 conn(0x55c4f2436760 msgr2=0x55c4f2436b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 shutdown_connections 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/2215485607 wait complete. 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4f2431970 msgr2=0x55c4f2433d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55c4f2431970 0x55c4f2433d60 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2428e30 msgr2=0x55c4f242b2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.623 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55c4f2428e30 0x55c4f242b2f0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f242d900 msgr2=0x55c4f242fdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55c4f242d900 0x55c4f242fdc0 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ac4036790 msgr2=0x7f7ac4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ac4036790 0x7f7ac4038c50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8054000 tx=0x7f7bc804e000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 msgr2=0x55c4f2424190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 --2- 172.21.15.177:0/67445202 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55c4f2331e70 0x55c4f2424190 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f7bd000d850 tx=0x7f7bd0000bc0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7bdec35640 1 -- 172.21.15.177:0/67445202 reap_dead start 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 shutdown_connections 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 >> 172.21.15.177:0/67445202 conn(0x55c4f2329040 msgr2=0x55c4f2417aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.613+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 shutdown_connections 2024-03-20T13:36:11.624 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.614+0000 7f7be2731800 1 -- 172.21.15.177:0/67445202 wait complete. 2024-03-20T13:36:11.625 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}}]} 2024-03-20T13:36:11.625 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}}]} 2024-03-20T13:36:11.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-03-20T13:36:11.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-03-20T13:36:11.626 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-03-20T13:36:11.670 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.671 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.670+0000 7fbe3e4c0800 1 Processor -- start 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.670+0000 7fbe3e4c0800 1 -- start start 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.670+0000 7fbe3e4c0800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55eb30296e70 0x55eb30299260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.670+0000 7fbe3e4c0800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55eb301decd0 con 0x55eb302929e0 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.670+0000 7fbe3e4c0800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55eb30195500 con 0x55eb30296e70 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.671+0000 7fbe3b7c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55eb30296e70 0x55eb30299260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.672 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.671+0000 7fbe3b7c5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55eb30296e70 0x55eb30299260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42884/0 (socket says 172.21.15.177:42884) 2024-03-20T13:36:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.671+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/1690476045 learned_addr learned my addr 172.21.15.177:0/1690476045 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.671+0000 7fbe3bfc6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55eb302929e0 0x55eb30292e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34810/0 (socket says 172.21.15.177:34810) 2024-03-20T13:36:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.671+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/1690476045 >> v1:172.21.15.28:6789/0 conn(0x55eb302929e0 legacy=0x55eb30292e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.673 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.671+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/1690476045 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb3029a890 con 0x55eb30296e70 2024-03-20T13:36:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.673+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/1690476045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb30296e70 0x55eb30299260 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000a6b0 tx=0x7fbe3001eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c1bf84250345b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.673+0000 7fbe3afc4640 1 -- 172.21.15.177:0/1690476045 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe3000a200 con 0x55eb30296e70 2024-03-20T13:36:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.673+0000 7fbe3afc4640 1 -- 172.21.15.177:0/1690476045 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3000a360 con 0x55eb30296e70 2024-03-20T13:36:11.674 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.673+0000 7fbe3afc4640 1 -- 172.21.15.177:0/1690476045 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe300086e0 con 0x55eb30296e70 2024-03-20T13:36:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/1690476045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb30296e70 msgr2=0x55eb30299260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/1690476045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb30296e70 0x55eb30299260 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbe3000a6b0 tx=0x7fbe3001eda0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.675 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/1690476045 shutdown_connections 2024-03-20T13:36:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/1690476045 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb30296e70 0x55eb30299260 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/1690476045 >> 172.21.15.177:0/1690476045 conn(0x55eb3028e040 msgr2=0x55eb30290460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/1690476045 shutdown_connections 2024-03-20T13:36:11.676 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.674+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/1690476045 wait complete. 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.685+0000 7fbe3e4c0800 1 Processor -- start 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.685+0000 7fbe3e4c0800 1 -- start start 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.685+0000 7fbe3e4c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb303817d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.685+0000 7fbe3e4c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb30192a30 con 0x55eb302929e0 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.686+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb303817d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.686+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb303817d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42896/0 (socket says 172.21.15.177:42896) 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.686+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/168421750 learned_addr learned my addr 172.21.15.177:0/168421750 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.686+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/168421750 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe30005de0 con 0x55eb302929e0 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.686+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/168421750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb303817d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c001cb0 tx=0x7fbe2c00b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefbb614a2f2843a server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbd29e0b640 1 -- 172.21.15.177:0/168421750 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c014070 con 0x55eb302929e0 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbd29e0b640 1 -- 172.21.15.177:0/168421750 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c00f450 con 0x55eb302929e0 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbd29e0b640 1 -- 172.21.15.177:0/168421750 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c00f750 con 0x55eb302929e0 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/168421750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 msgr2=0x55eb303817d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/168421750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb303817d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c001cb0 tx=0x7fbe2c00b600 comp rx=0 tx=0).stop 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/168421750 shutdown_connections 2024-03-20T13:36:11.690 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/168421750 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb303817d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/168421750 >> 172.21.15.177:0/168421750 conn(0x55eb3028e040 msgr2=0x55eb3037d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/168421750 shutdown_connections 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.687+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/168421750 wait complete. 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3e4c0800 1 Processor -- start 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3e4c0800 1 -- start start 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3e4c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb30388ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3e4c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb3018e210 con 0x55eb302929e0 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb30388ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb30388ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42910/0 (socket says 172.21.15.177:42910) 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/4022136890 learned_addr learned my addr 172.21.15.177:0/4022136890 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.688+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb301decd0 con 0x55eb302929e0 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.689+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb30388ee0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004000 tx=0x7fbe2c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.691 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.689+0000 7fbd23fff640 1 -- 172.21.15.177:0/4022136890 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c014050 con 0x55eb302929e0 2024-03-20T13:36:11.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.689+0000 7fbd23fff640 1 -- 172.21.15.177:0/4022136890 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c01b850 con 0x55eb302929e0 2024-03-20T13:36:11.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.689+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eb30389420 con 0x55eb302929e0 2024-03-20T13:36:11.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.689+0000 7fbd23fff640 1 -- 172.21.15.177:0/4022136890 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c01baf0 con 0x55eb302929e0 2024-03-20T13:36:11.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.689+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb30389900 con 0x55eb302929e0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbd23fff640 1 -- 172.21.15.177:0/4022136890 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbe2c022020 con 0x55eb302929e0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbd23fff640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd24036790 0x7fbd24038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbd23fff640 1 -- 172.21.15.177:0/4022136890 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fbe2c008030 con 0x55eb302929e0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd24036790 0x7fbd24038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb30296e70 0x55eb3038fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30390150 con 0x55eb30296e70 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbe3c7c7640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb30296e70 0x55eb3038fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd24036790 0x7fbd24038c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbe30056000 tx=0x7fbe3000a000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.690+0000 7fbe3c7c7640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb30296e70 0x55eb3038fb80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/4022136890 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb30296e70 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb3038d290 con 0x55eb30296e70 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/4022136890 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb30296e70 2024-03-20T13:36:11.696 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303923c0 0x55eb303947b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30394ea0 con 0x55eb303923c0 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303923c0 0x55eb303947b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.691+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303923c0 0x55eb303947b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.692+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/4022136890 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303923c0 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.692+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30391340 con 0x55eb30296e70 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.692+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/4022136890 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb30296e70 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.692+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55eb303962c0 0x55eb303986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.692+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30398df0 con 0x55eb303962c0 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.692+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55eb303962c0 0x55eb303986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.697 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.693+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55eb303962c0 0x55eb303986b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.693+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/4022136890 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303962c0 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.693+0000 7fbe3e4c0800 1 Processor -- start 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.693+0000 7fbe3e4c0800 1 -- start start 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3e4c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 0x55eb303ab800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3e4c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb30130c70 con 0x55eb303ab3e0 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 0x55eb303ab800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 0x55eb303ab800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42916/0 (socket says 172.21.15.177:42916) 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/793109466 learned_addr learned my addr 172.21.15.177:0/793109466 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/793109466 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb303abd40 con 0x55eb303ab3e0 2024-03-20T13:36:11.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 0x55eb303ab800 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c04a3c0 tx=0x7fbe2c018570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbd217fa640 1 -- 172.21.15.177:0/793109466 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c043e40 con 0x55eb303ab3e0 2024-03-20T13:36:11.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbd217fa640 1 -- 172.21.15.177:0/793109466 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c043fa0 con 0x55eb303ab3e0 2024-03-20T13:36:11.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eb303ac7b0 con 0x55eb303ab3e0 2024-03-20T13:36:11.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.694+0000 7fbd217fa640 1 -- 172.21.15.177:0/793109466 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c04a7b0 con 0x55eb303ab3e0 2024-03-20T13:36:11.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.695+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb303acc70 con 0x55eb303ab3e0 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.695+0000 7fbd217fa640 1 -- 172.21.15.177:0/793109466 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbe2c04a910 con 0x55eb303ab3e0 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.695+0000 7fbd217fa640 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd140367e0 0x7fbd14038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.695+0000 7fbd217fa640 1 -- 172.21.15.177:0/793109466 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fbe2c039d20 con 0x55eb303ab3e0 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd140367e0 0x7fbd14038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3e4c0800 1 Processor -- start 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3e4c0800 1 -- start start 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd140367e0 0x7fbd14038ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55eb3038d1b0 tx=0x7fbe30005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3e4c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3e4c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb301065d0 con 0x55eb303b86f0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303b8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42932/0 (socket says 172.21.15.177:42932) 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/2847659495 learned_addr learned my addr 172.21.15.177:0/2847659495 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.696+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/2847659495 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb303b90e0 con 0x55eb303b86f0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/2847659495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303b8b10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c003f40 tx=0x7fbe2c00d310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=287e1568396714e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbd1affd640 1 -- 172.21.15.177:0/2847659495 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c055070 con 0x55eb303b86f0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbd1affd640 1 -- 172.21.15.177:0/2847659495 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c03e770 con 0x55eb303b86f0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbd1affd640 1 -- 172.21.15.177:0/2847659495 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c03e250 con 0x55eb303b86f0 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/2847659495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 msgr2=0x55eb303b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/2847659495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303b8b10 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c003f40 tx=0x7fbe2c00d310 comp rx=0 tx=0).stop 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/2847659495 shutdown_connections 2024-03-20T13:36:11.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/2847659495 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303b8b10 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/2847659495 >> 172.21.15.177:0/2847659495 conn(0x55eb303b4a00 msgr2=0x55eb303b2a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/2847659495 shutdown_connections 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.697+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/2847659495 wait complete. 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3e4c0800 1 Processor -- start 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3e4c0800 1 -- start start 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3e4c0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303bf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3e4c0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb303bfb20 con 0x55eb303b86f0 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303bf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3bfc6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303bf5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42942/0 (socket says 172.21.15.177:42942) 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 learned_addr learned my addr 172.21.15.177:0/3624069095 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb303acc70 con 0x55eb303b86f0 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.698+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303bf5e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00ff10 tx=0x7fbe2c037ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.699+0000 7fbd197fa640 1 -- 172.21.15.177:0/3624069095 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c061070 con 0x55eb303b86f0 2024-03-20T13:36:11.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.699+0000 7fbd197fa640 1 -- 172.21.15.177:0/3624069095 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe2c02f660 con 0x55eb303b86f0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.699+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55eb303acc70 con 0x55eb303b86f0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.699+0000 7fbd197fa640 1 -- 172.21.15.177:0/3624069095 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2c02f920 con 0x55eb303b86f0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.699+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb303acc70 con 0x55eb303b86f0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbd197fa640 1 -- 172.21.15.177:0/3624069095 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbe2c043140 con 0x55eb303b86f0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbd197fa640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04036790 0x7fbd04038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbd197fa640 1 -- 172.21.15.177:0/3624069095 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fbe2c067d50 con 0x55eb303b86f0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04036790 0x7fbd04038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb303cae80 0x55eb303cd340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303cda90 con 0x55eb303cae80 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3c7c7640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb303cae80 0x55eb303cd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04036790 0x7fbd04038c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe30008fd0 tx=0x7fbe30052000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.700+0000 7fbe3c7c7640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb303cae80 0x55eb303cd340 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 realm 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303cde60 con 0x55eb303cae80 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303cea10 con 0x55eb303cae80 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303cf3c0 0x55eb303d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.701+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d1d30 con 0x55eb303cf3c0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303cf3c0 0x55eb303d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303cf3c0 0x55eb303d17b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3e4c0800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3e4c0800 20 searching for the correct realm 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55eb303d3cd0 0x55eb303d6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d6860 con 0x55eb303d3cd0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.702+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55eb303d3cd0 0x55eb303d6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.703+0000 7fbe3b7c5640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55eb303d3cd0 0x55eb303d6190 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.703+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.703+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d6860 con 0x55eb303cf3c0 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.703+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.703+0000 7fbe3bfc6640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fbe2c047040 0x7fbe2c051920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.703+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d6860 con 0x7fbe2c047040 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.704+0000 7fbe3c7c7640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fbe2c047040 0x7fbe2c051920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.704+0000 7fbe3c7c7640 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fbe2c047040 0x7fbe2c051920 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.704+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.704+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.705+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cf3c0 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.706+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cf3c0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.707+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.708+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cf3c0 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.709+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.710+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.710+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.710+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.710+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cf3c0 2024-03-20T13:36:11.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cf3c0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.711+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x7fbe2c047040 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cae80 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ce6b0 con 0x55eb303cf3c0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d2600 con 0x55eb303cae80 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.712+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d2600 con 0x55eb303cae80 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.727 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d2600 con 0x7fbe2c047040 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 zone default found 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 4 Realm: () 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 zonegroup default 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d2e50 con 0x7fbe2c047040 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.728 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.713+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d2e50 con 0x55eb303d3cd0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d8680 con 0x55eb303d3cd0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 20 started sync module instance, tier type = 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.714+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d7b10 con 0x55eb303cf3c0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.715+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.715+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94468615011952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d8290 con 0x55eb303cf3c0 2024-03-20T13:36:11.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.715+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d9320 con 0x55eb303cae80 2024-03-20T13:36:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.716+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94468615011952] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.716+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.716+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94468615015360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d95e0 con 0x55eb303cae80 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.716+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303da0b0 con 0x55eb303d3cd0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.717+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94468615015360] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.717+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.718+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94468615019408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303da460 con 0x55eb303d3cd0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.718+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dae80 con 0x55eb303cf3c0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.718+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94468615019408] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.719+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.719+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94468615022944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303db230 con 0x55eb303cf3c0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.719+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dbc20 con 0x55eb303cae80 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.720+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94468615022944] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.720+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.720+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94468615026432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dbbe0 con 0x55eb303cae80 2024-03-20T13:36:11.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.720+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dc640 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.721+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94468615026432] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.721+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.721+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94468615016512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dc640 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.721+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dd030 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.722+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.722+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94468615031696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dd4b0 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.722+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ddf70 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.722+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94468615016512] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94468615031696] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'201 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94468615032752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303ddf30 con 0x7fbe2c047040 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=0 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=1 2024-03-20T13:36:11.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=2 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=3 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=4 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=5 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.723+0000 7fbe3e4c0800 20 add_watcher() i=6 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.724+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94468615032752] v32'202 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.724+0000 7fbe3e4c0800 20 add_watcher() i=7 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.724+0000 7fbe3e4c0800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.724+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dda30 con 0x55eb303cae80 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.724+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.724+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94468615029152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303dda30 con 0x55eb303cae80 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.725+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94468615029152] v32'204 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.725+0000 7fbcf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.725+0000 7fbe3e4c0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.725+0000 7fbe3e4c0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.725+0000 7fbe3e4c0800 5 note: GC not initialized 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbcf0fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3e4c0800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3e4c0800 20 Filter name: none 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbc6a7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3e4c0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30412920 con 0x55eb303cae80 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3e4c0800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.726+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30412920 con 0x7fbe2c047040 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.727+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.728+0000 7fbcf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.728+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94468615029152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30412920 con 0x55eb303cae80 2024-03-20T13:36:11.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.729+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94468615029152] v32'205 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.729+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94468615011952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30412920 con 0x55eb303cf3c0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.730+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94468615011952] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.730+0000 7fbe3e4c0800 20 remove_watcher() i=0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.730+0000 7fbe3e4c0800 2 removed watcher, disabling cache 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.730+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94468615015360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30412920 con 0x55eb303cae80 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.731+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94468615015360] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.731+0000 7fbe3e4c0800 20 remove_watcher() i=1 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.731+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94468615019408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb30412920 con 0x55eb303d3cd0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.732+0000 7fbe3b7c5640 1 -- 172.21.15.177:0/3624069095 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94468615019408] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe300088d0 con 0x55eb303d3cd0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.732+0000 7fbe3e4c0800 20 remove_watcher() i=2 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.732+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94468615022944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d8bc0 con 0x55eb303cf3c0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.733+0000 7fbe3bfc6640 1 -- 172.21.15.177:0/3624069095 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94468615022944] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe2c016070 con 0x55eb303cf3c0 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.733+0000 7fbe3e4c0800 20 remove_watcher() i=3 2024-03-20T13:36:11.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.733+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94468615026432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d9b90 con 0x55eb303cae80 2024-03-20T13:36:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.734+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94468615026432] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x55eb303cae80 2024-03-20T13:36:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.734+0000 7fbe3e4c0800 20 remove_watcher() i=4 2024-03-20T13:36:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.734+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94468615016512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d8bc0 con 0x7fbe2c047040 2024-03-20T13:36:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.735+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94468615016512] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.735+0000 7fbe3e4c0800 20 remove_watcher() i=5 2024-03-20T13:36:11.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.735+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94468615031696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303db700 con 0x7fbe2c047040 2024-03-20T13:36:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.736+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94468615031696] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.736+0000 7fbe3e4c0800 20 remove_watcher() i=6 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.736+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94468615032752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55eb303d9b90 con 0x7fbe2c047040 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94468615032752] v32'203 uv201 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fbe3400a4a0 con 0x7fbe2c047040 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 20 remove_watcher() i=7 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fbe2c047040 msgr2=0x7fbe2c051920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fbe2c047040 0x7fbe2c051920 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb303cae80 msgr2=0x55eb303cd340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb303cae80 0x55eb303cd340 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303cf3c0 msgr2=0x55eb303d17b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303cf3c0 0x55eb303d17b0 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55eb303d3cd0 msgr2=0x55eb303d6190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55eb303d3cd0 0x55eb303d6190 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04036790 msgr2=0x7fbd04038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd04036790 0x7fbd04038c50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fbe30008fd0 tx=0x7fbe30052000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 msgr2=0x55eb303bf5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/3624069095 reap_dead start 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303bf5e0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c00ff10 tx=0x7fbe2c037ef0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 shutdown_connections 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/3624069095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303b86f0 0x55eb303bf5e0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 >> 172.21.15.177:0/3624069095 conn(0x55eb303b4a00 msgr2=0x55eb303b2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 shutdown_connections 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/3624069095 wait complete. 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd140367e0 msgr2=0x7fbd14038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd140367e0 0x7fbd14038ca0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x55eb3038d1b0 tx=0x7fbe30005ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 msgr2=0x55eb303ab800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 0x55eb303ab800 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c04a3c0 tx=0x7fbe2c018570 comp rx=0 tx=0).stop 2024-03-20T13:36:11.747 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 shutdown_connections 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd140367e0 0x7fbd14038ca0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/793109466 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb303ab3e0 0x55eb303ab800 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 >> 172.21.15.177:0/793109466 conn(0x55eb3039b070 msgr2=0x55eb3039b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 shutdown_connections 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.738+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/793109466 wait complete. 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55eb303962c0 msgr2=0x55eb303986b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55eb303962c0 0x55eb303986b0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb30296e70 msgr2=0x55eb3038fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55eb30296e70 0x55eb3038fb80 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303923c0 msgr2=0x55eb303947b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55eb303923c0 0x55eb303947b0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd24036790 msgr2=0x7fbd24038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbd24036790 0x7fbd24038c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fbe30056000 tx=0x7fbe3000a000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 msgr2=0x55eb30388ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 --2- 172.21.15.177:0/4022136890 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55eb302929e0 0x55eb30388ee0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbe2c004000 tx=0x7fbe2c000bc0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3c7c7640 1 -- 172.21.15.177:0/4022136890 reap_dead start 2024-03-20T13:36:11.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 shutdown_connections 2024-03-20T13:36:11.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 >> 172.21.15.177:0/4022136890 conn(0x55eb3028e040 msgr2=0x55eb3037b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 shutdown_connections 2024-03-20T13:36:11.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.739+0000 7fbe3e4c0800 1 -- 172.21.15.177:0/4022136890 wait complete. 2024-03-20T13:36:11.750 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}}]} 2024-03-20T13:36:11.750 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}}]} 2024-03-20T13:36:11.750 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-03-20T13:36:11.750 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-03-20T13:36:11.750 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-03-20T13:36:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.795 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea9328800 1 Processor -- start 2024-03-20T13:36:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea9328800 1 -- start start 2024-03-20T13:36:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea9328800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55dd6ced5100 0x55dd6ced74f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.796 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea9328800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55dd6ce1bcd0 con 0x55dd6ced15f0 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea9328800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55dd6cdd2500 con 0x55dd6ced5100 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea4fcf640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55dd6ced15f0 0x55dd6ced39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34826/0 (socket says 172.21.15.177:34826) 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/2856012384 learned_addr learned my addr 172.21.15.177:0/2856012384 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/2856012384 >> v2:172.21.15.28:3300/0 conn(0x55dd6ced5100 0x55dd6ced74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5e9ffff640 1 -- 172.21.15.177:0/2856012384 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1246799071 0 0) 0x55dd6ce1bcd0 con 0x55dd6ced15f0 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5e9ffff640 1 -- 172.21.15.177:0/2856012384 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e90001e10 con 0x55dd6ced15f0 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/2856012384 >> v1:172.21.15.28:6789/0 conn(0x55dd6ced15f0 legacy=0x55dd6ced39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.797 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.795+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/2856012384 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6ced8a40 con 0x55dd6ced5100 2024-03-20T13:36:11.798 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.797+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/2856012384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced5100 0x55dd6ced74f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00a470 tx=0x7f5e8c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb0252b6bf3c912 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.797+0000 7f5e9ffff640 1 -- 172.21.15.177:0/2856012384 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c04ad60 con 0x55dd6ced5100 2024-03-20T13:36:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.797+0000 7f5e9ffff640 1 -- 172.21.15.177:0/2856012384 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c052440 con 0x55dd6ced5100 2024-03-20T13:36:11.799 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5e9ffff640 1 -- 172.21.15.177:0/2856012384 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e8c052700 con 0x55dd6ced5100 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 -- 172.21.15.177:0/2856012384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced5100 msgr2=0x55dd6ced74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2856012384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced5100 0x55dd6ced74f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00a470 tx=0x7f5e8c01cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 -- 172.21.15.177:0/2856012384 shutdown_connections 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2856012384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced5100 0x55dd6ced74f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 -- 172.21.15.177:0/2856012384 >> 172.21.15.177:0/2856012384 conn(0x55dd6cecb040 msgr2=0x55dd6cecd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 -- 172.21.15.177:0/2856012384 shutdown_connections 2024-03-20T13:36:11.800 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.798+0000 7f5ea9328800 1 -- 172.21.15.177:0/2856012384 wait complete. 2024-03-20T13:36:11.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea9328800 1 Processor -- start 2024-03-20T13:36:11.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea9328800 1 -- start start 2024-03-20T13:36:11.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea9328800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.811 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea9328800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6cdcfa30 con 0x55dd6ced15f0 2024-03-20T13:36:11.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42954/0 (socket says 172.21.15.177:42954) 2024-03-20T13:36:11.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.810+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/3302961055 learned_addr learned my addr 172.21.15.177:0/3302961055 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.812 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.811+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/3302961055 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c005d20 con 0x55dd6ced15f0 2024-03-20T13:36:11.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.811+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/3302961055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc0900 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5e94001c50 tx=0x7f5e9400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff657b15c155ae78 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.811+0000 7f5d92e0d640 1 -- 172.21.15.177:0/3302961055 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e9400e470 con 0x55dd6ced15f0 2024-03-20T13:36:11.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.811+0000 7f5d92e0d640 1 -- 172.21.15.177:0/3302961055 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400e5d0 con 0x55dd6ced15f0 2024-03-20T13:36:11.813 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.811+0000 7f5d92e0d640 1 -- 172.21.15.177:0/3302961055 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e9400e8b0 con 0x55dd6ced15f0 2024-03-20T13:36:11.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- 172.21.15.177:0/3302961055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 msgr2=0x55dd6cfc0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.816 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 --2- 172.21.15.177:0/3302961055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc0900 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f5e94001c50 tx=0x7f5e9400b6c0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- 172.21.15.177:0/3302961055 shutdown_connections 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 --2- 172.21.15.177:0/3302961055 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc0900 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- 172.21.15.177:0/3302961055 >> 172.21.15.177:0/3302961055 conn(0x55dd6cecb040 msgr2=0x55dd6cfbc220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- 172.21.15.177:0/3302961055 shutdown_connections 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- 172.21.15.177:0/3302961055 wait complete. 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 Processor -- start 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- start start 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea9328800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6cdcb210 con 0x55dd6ced15f0 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42956/0 (socket says 172.21.15.177:42956) 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.812+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/249278383 learned_addr learned my addr 172.21.15.177:0/249278383 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.817 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e90001e10 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc7f90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5e94000c00 tx=0x7f5e94000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5d9160a640 1 -- 172.21.15.177:0/249278383 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e9401f070 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5d9160a640 1 -- 172.21.15.177:0/249278383 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94018830 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd6cfc84d0 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5d9160a640 1 -- 172.21.15.177:0/249278383 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94018ad0 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.813+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6cfc89b0 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5d9160a640 1 -- 172.21.15.177:0/249278383 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e94018c30 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5d9160a640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d8c0367e0 0x7f5d8c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5d9160a640 1 -- 172.21.15.177:0/249278383 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f5e9404c3a0 con 0x55dd6ced15f0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d8c0367e0 0x7f5d8c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6ced5100 0x55dd6cfcec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6cfcf1e0 con 0x55dd6ced5100 2024-03-20T13:36:11.818 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.814+0000 7f5ea57d0640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6ced5100 0x55dd6cfcec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d8c0367e0 0x7f5d8c038ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c054000 tx=0x7f5e8c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea57d0640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6ced5100 0x55dd6cfcec30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea57d0640 1 -- 172.21.15.177:0/249278383 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6ced5100 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6cfcc340 con 0x55dd6ced5100 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea57d0640 1 -- 172.21.15.177:0/249278383 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6ced5100 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6cfd1450 0x55dd6cfd3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6cfd3f10 con 0x55dd6cfd1450 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.815+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6cfd1450 0x55dd6cfd3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.819 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6cfd1450 0x55dd6cfd3840 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/249278383 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6cfd1450 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6cfd03d0 con 0x55dd6ced5100 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5ea57d0640 1 -- 172.21.15.177:0/249278383 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6ced5100 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dd6cfd5330 0x55dd6cfd7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6cfd7e80 con 0x55dd6cfd5330 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.816+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dd6cfd5330 0x55dd6cfd7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.817+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dd6cfd5330 0x55dd6cfd7720 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.817+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/249278383 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6cfd5330 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.817+0000 7f5ea9328800 1 Processor -- start 2024-03-20T13:36:11.830 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.817+0000 7f5ea9328800 1 -- start start 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea9328800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 0x55dd6cfe64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea9328800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6cd6dc70 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 0x55dd6cfe64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 0x55dd6cfe64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42962/0 (socket says 172.21.15.177:42962) 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/2144780675 learned_addr learned my addr 172.21.15.177:0/2144780675 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/2144780675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6cfe69e0 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 0x55dd6cfe64a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5e9404a780 tx=0x7f5e94022ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5d8a7fc640 1 -- 172.21.15.177:0/2144780675 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94043f90 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5d8a7fc640 1 -- 172.21.15.177:0/2144780675 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e940440f0 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd6cfe7450 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.818+0000 7f5d8a7fc640 1 -- 172.21.15.177:0/2144780675 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94044390 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.819+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6cfe7450 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.819+0000 7f5d8a7fc640 1 -- 172.21.15.177:0/2144780675 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e9404a800 con 0x55dd6cfe6080 2024-03-20T13:36:11.831 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.819+0000 7f5d8a7fc640 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d7c0367e0 0x7f5d7c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.819+0000 7f5d8a7fc640 1 -- 172.21.15.177:0/2144780675 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f5e94032070 con 0x55dd6cfe6080 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.819+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d7c0367e0 0x7f5d7c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea9328800 1 Processor -- start 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea9328800 1 -- start start 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d7c0367e0 0x7f5d7c038ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55dd6cfcc290 tx=0x7f5e8c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea9328800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cecf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea9328800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6cd435d0 con 0x55dd6ced0cb0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cecf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cecf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42978/0 (socket says 172.21.15.177:42978) 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/2990545656 learned_addr learned my addr 172.21.15.177:0/2990545656 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/2990545656 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dd6ced1160 con 0x55dd6ced0cb0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.820+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/2990545656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cecf3e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5e940224b0 tx=0x7f5e94035840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92868848b2a2e04c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5d7bfff640 1 -- 172.21.15.177:0/2990545656 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94045d80 con 0x55dd6ced0cb0 2024-03-20T13:36:11.832 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5d7bfff640 1 -- 172.21.15.177:0/2990545656 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9402ed60 con 0x55dd6ced0cb0 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5d7bfff640 1 -- 172.21.15.177:0/2990545656 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e94024d20 con 0x55dd6ced0cb0 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 -- 172.21.15.177:0/2990545656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 msgr2=0x55dd6cecf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2990545656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cecf3e0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f5e940224b0 tx=0x7f5e94035840 comp rx=0 tx=0).stop 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 -- 172.21.15.177:0/2990545656 shutdown_connections 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2990545656 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cecf3e0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 -- 172.21.15.177:0/2990545656 >> 172.21.15.177:0/2990545656 conn(0x55dd6cfef2b0 msgr2=0x55dd6cfed310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 -- 172.21.15.177:0/2990545656 shutdown_connections 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 -- 172.21.15.177:0/2990545656 wait complete. 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.821+0000 7f5ea9328800 1 Processor -- start 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea9328800 1 -- start start 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea9328800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cffc120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea9328800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dd6cffc660 con 0x55dd6ced0cb0 2024-03-20T13:36:11.833 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cffc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea4fcf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cffc120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42984/0 (socket says 172.21.15.177:42984) 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 learned_addr learned my addr 172.21.15.177:0/826316889 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9403a030 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cffc120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5e9405b040 tx=0x7f5e9400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5d7a7fc640 1 -- 172.21.15.177:0/826316889 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e9404abe0 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.822+0000 7f5d7a7fc640 1 -- 172.21.15.177:0/826316889 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e94034370 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.823+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55dd6cffc860 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.823+0000 7f5d7a7fc640 1 -- 172.21.15.177:0/826316889 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5e9400d9d0 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.823+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dd6cffc860 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.823+0000 7f5d7a7fc640 1 -- 172.21.15.177:0/826316889 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5e9405f070 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.823+0000 7f5d7a7fc640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5d7a7fc640 1 -- 172.21.15.177:0/826316889 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f5e9406cd30 con 0x55dd6ced0cb0 2024-03-20T13:36:11.834 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6d007bc0 0x55dd6d00a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00a7a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea57d0640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6d007bc0 0x55dd6d00a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55dd6cfd8240 tx=0x7f5e8c05e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea57d0640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6d007bc0 0x55dd6d00a050 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 20 realm 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.824+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00ab70 con 0x55dd6d007bc0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.835 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b750 con 0x55dd6d007bc0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6d00bea0 0x55dd6d00e290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00ea00 con 0x55dd6d00bea0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6d00bea0 0x55dd6d00e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.825+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6d00bea0 0x55dd6d00e290 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.836 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5ea9328800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5ea9328800 20 searching for the correct realm 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dd6d010990 0x55dd6d012e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d013520 con 0x55dd6d010990 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dd6d010990 0x55dd6d012e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5e9c7ce640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dd6d010990 0x55dd6d012e50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.826+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d013520 con 0x55dd6d00bea0 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.827+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.827+0000 7f5ea4fcf640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e94017050 0x7f5e9404c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.827+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d013520 con 0x7f5e94017050 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.827+0000 7f5ea57d0640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e94017050 0x7f5e9404c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.827+0000 7f5ea57d0640 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e94017050 0x7f5e9404c6c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.837 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.827+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.828+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d00bea0 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.838 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.829+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d00bea0 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.849 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.830+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.831+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.850 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d00bea0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.832+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d00bea0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.851 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.833+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d00bea0 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.834+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.834+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d010990 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.834+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.834+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x7f5e94017050 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.834+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.834+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d007bc0 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00b3f0 con 0x55dd6d00bea0 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00f300 con 0x55dd6d007bc0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00f300 con 0x55dd6d007bc0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.835+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00f300 con 0x7f5e94017050 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 20 zone default found 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 4 Realm: () 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 20 zonegroup default 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00fbe0 con 0x7f5e94017050 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.836+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d00fbe0 con 0x55dd6d010990 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d015340 con 0x55dd6d010990 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 20 started sync module instance, tier type = 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.837+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d0147d0 con 0x55dd6d00bea0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.838+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.838+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94409504934784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d014fa0 con 0x55dd6d00bea0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.838+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d016150 con 0x55dd6d007bc0 2024-03-20T13:36:11.855 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.839+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94409504934784] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.839+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.839+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94409504939184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d016570 con 0x55dd6d007bc0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.839+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d016ee0 con 0x55dd6d010990 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.840+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94409504939184] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.841+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.841+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94409504940240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d0164f0 con 0x55dd6d010990 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.841+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d017bc0 con 0x55dd6d00bea0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.842+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.842+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94409504940240] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.842+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94409504945184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d018440 con 0x55dd6d00bea0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.842+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d018db0 con 0x55dd6d007bc0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.843+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.856 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.843+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94409504951024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d019510 con 0x55dd6d007bc0 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.843+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d019fc0 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.843+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94409504945184] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.844+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94409504951024] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.844+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.844+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94409504955072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d018f70 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.844+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d01a590 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.845+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94409504955072] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.845+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.845+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94409504948128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d01a590 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.845+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d01af00 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94409504948128] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'204 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94409504957136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d01af00 con 0x7f5e94017050 2024-03-20T13:36:11.857 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=0 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=1 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=2 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=3 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=4 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=5 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.846+0000 7f5ea9328800 20 add_watcher() i=6 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.847+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94409504957136] v32'205 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.847+0000 7f5ea9328800 20 add_watcher() i=7 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.847+0000 7f5ea9328800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.847+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d01e240 con 0x55dd6d007bc0 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.848+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.848+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94409504971888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d01b070 con 0x55dd6d007bc0 2024-03-20T13:36:11.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94409504971888] v32'206 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.865 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5d5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 5 note: GC not initialized 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5d59fe3640 20 reqs_thread_entry: start 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 20 Filter name: none 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ccb7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.849+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d04fd30 con 0x55dd6d007bc0 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.850+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.850+0000 7f5ea9328800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.850+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d04fd30 con 0x7f5e94017050 2024-03-20T13:36:11.866 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.850+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.851+0000 7f5d5afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.851+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94409504971888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d04fd30 con 0x55dd6d007bc0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.852+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94409504971888] v32'207 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.852+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94409504934784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d04fd30 con 0x55dd6d00bea0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.853+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94409504934784] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.853+0000 7f5ea9328800 20 remove_watcher() i=0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.853+0000 7f5ea9328800 2 removed watcher, disabling cache 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.853+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94409504939184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d04fd30 con 0x55dd6d007bc0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.854+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94409504939184] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.854+0000 7f5ea9328800 20 remove_watcher() i=1 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.854+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94409504940240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d04fd30 con 0x55dd6d010990 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.855+0000 7f5e9c7ce640 1 -- 172.21.15.177:0/826316889 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94409504940240] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e8c065040 con 0x55dd6d010990 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.855+0000 7f5ea9328800 20 remove_watcher() i=2 2024-03-20T13:36:11.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.855+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94409504945184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d039f00 con 0x55dd6d00bea0 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.856+0000 7f5ea4fcf640 1 -- 172.21.15.177:0/826316889 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94409504945184] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5e94014070 con 0x55dd6d00bea0 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.856+0000 7f5ea9328800 20 remove_watcher() i=3 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.856+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94409504951024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d014b80 con 0x55dd6d007bc0 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.857+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94409504951024] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x55dd6d007bc0 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.857+0000 7f5ea9328800 20 remove_watcher() i=4 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.857+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94409504955072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d014b80 con 0x7f5e94017050 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.858+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94409504955072] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.858+0000 7f5ea9328800 20 remove_watcher() i=5 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.859+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94409504948128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d019ac0 con 0x7f5e94017050 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.859+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94409504948128] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.859+0000 7f5ea9328800 20 remove_watcher() i=6 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.859+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94409504957136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55dd6d014b80 con 0x7f5e94017050 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94409504957136] v32'206 uv204 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f5ea000a4a0 con 0x7f5e94017050 2024-03-20T13:36:11.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 20 remove_watcher() i=7 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e94017050 msgr2=0x7f5e9404c6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5e94017050 0x7f5e9404c6c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6d007bc0 msgr2=0x55dd6d00a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6d007bc0 0x55dd6d00a050 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6d00bea0 msgr2=0x55dd6d00e290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.860+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6d00bea0 0x55dd6d00e290 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dd6d010990 msgr2=0x55dd6d012e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55dd6d010990 0x55dd6d012e50 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 msgr2=0x7f5d70038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d70036790 0x7f5d70038c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x55dd6cfd8240 tx=0x7f5e8c05e040 comp rx=0 tx=0).stop 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 msgr2=0x55dd6cffc120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cffc120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5e9405b040 tx=0x7f5e9400a5c0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea57d0640 1 -- 172.21.15.177:0/826316889 reap_dead start 2024-03-20T13:36:11.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 shutdown_connections 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/826316889 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced0cb0 0x55dd6cffc120 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 >> 172.21.15.177:0/826316889 conn(0x55dd6cfef2b0 msgr2=0x55dd6cfec910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 shutdown_connections 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/826316889 wait complete. 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d7c0367e0 msgr2=0x7f5d7c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d7c0367e0 0x7f5d7c038ca0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55dd6cfcc290 tx=0x7f5e8c005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 msgr2=0x55dd6cfe64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 0x55dd6cfe64a0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5e9404a780 tx=0x7f5e94022ca0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 shutdown_connections 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d7c0367e0 0x7f5d7c038ca0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/2144780675 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6cfe6080 0x55dd6cfe64a0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 >> 172.21.15.177:0/2144780675 conn(0x55dd6cfda120 msgr2=0x55dd6cfda520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 shutdown_connections 2024-03-20T13:36:11.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/2144780675 wait complete. 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dd6cfd5330 msgr2=0x55dd6cfd7720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55dd6cfd5330 0x55dd6cfd7720 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6ced5100 msgr2=0x55dd6cfcec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55dd6ced5100 0x55dd6cfcec30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6cfd1450 msgr2=0x55dd6cfd3840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.861+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55dd6cfd1450 0x55dd6cfd3840 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d8c0367e0 msgr2=0x7f5d8c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5d8c0367e0 0x7f5d8c038ca0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c054000 tx=0x7f5e8c04e000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 msgr2=0x55dd6cfc7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 --2- 172.21.15.177:0/249278383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55dd6ced15f0 0x55dd6cfc7f90 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5e94000c00 tx=0x7f5e94000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea57d0640 1 -- 172.21.15.177:0/249278383 reap_dead start 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 shutdown_connections 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 >> 172.21.15.177:0/249278383 conn(0x55dd6cecb040 msgr2=0x55dd6cfbaa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 shutdown_connections 2024-03-20T13:36:11.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.862+0000 7f5ea9328800 1 -- 172.21.15.177:0/249278383 wait complete. 2024-03-20T13:36:11.872 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}}]} 2024-03-20T13:36:11.873 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}}]} 2024-03-20T13:36:11.873 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-03-20T13:36:11.873 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-03-20T13:36:11.873 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-03-20T13:36:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:11.918 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:11.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.917+0000 7fca40631800 1 Processor -- start 2024-03-20T13:36:11.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.917+0000 7fca40631800 1 -- start start 2024-03-20T13:36:11.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca40631800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55a78920ce70 0x55a78920f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca40631800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55a789154cd0 con 0x55a7892089e0 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca40631800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55a78910b500 con 0x55a78920ce70 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca37fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55a78920ce70 0x55a78920f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca3e130640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55a7892089e0 0x55a789208e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34842/0 (socket says 172.21.15.177:34842) 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca3e130640 1 -- 172.21.15.177:0/862592542 learned_addr learned my addr 172.21.15.177:0/862592542 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca37fff640 1 -- 172.21.15.177:0/862592542 >> v1:172.21.15.28:6789/0 conn(0x55a7892089e0 legacy=0x55a789208e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca3d92f640 1 -- 172.21.15.177:0/862592542 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2583566292 0 0) 0x55a789154cd0 con 0x55a7892089e0 2024-03-20T13:36:11.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.918+0000 7fca37fff640 1 -- 172.21.15.177:0/862592542 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a789210890 con 0x55a78920ce70 2024-03-20T13:36:11.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.920+0000 7fca37fff640 1 --2- 172.21.15.177:0/862592542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78920ce70 0x55a78920f260 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca2800a470 tx=0x7fca2801ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fce6904b16802de0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca3d92f640 1 -- 172.21.15.177:0/862592542 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca28054570 con 0x55a78920ce70 2024-03-20T13:36:11.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca3d92f640 1 -- 172.21.15.177:0/862592542 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca2804ce90 con 0x55a78920ce70 2024-03-20T13:36:11.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca3d92f640 1 -- 172.21.15.177:0/862592542 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca28054820 con 0x55a78920ce70 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 -- 172.21.15.177:0/862592542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78920ce70 msgr2=0x55a78920f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 --2- 172.21.15.177:0/862592542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78920ce70 0x55a78920f260 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca2800a470 tx=0x7fca2801ef70 comp rx=0 tx=0).stop 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 -- 172.21.15.177:0/862592542 shutdown_connections 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 --2- 172.21.15.177:0/862592542 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78920ce70 0x55a78920f260 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 -- 172.21.15.177:0/862592542 >> 172.21.15.177:0/862592542 conn(0x55a789204040 msgr2=0x55a789206460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 -- 172.21.15.177:0/862592542 shutdown_connections 2024-03-20T13:36:11.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.921+0000 7fca40631800 1 -- 172.21.15.177:0/862592542 wait complete. 2024-03-20T13:36:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca40631800 1 Processor -- start 2024-03-20T13:36:11.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca40631800 1 -- start start 2024-03-20T13:36:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca40631800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7892f7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca40631800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a789108a30 con 0x55a7892089e0 2024-03-20T13:36:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7892f7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7892f7660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42998/0 (socket says 172.21.15.177:42998) 2024-03-20T13:36:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.933+0000 7fca3e130640 1 -- 172.21.15.177:0/4005781590 learned_addr learned my addr 172.21.15.177:0/4005781590 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.935 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.934+0000 7fca3e130640 1 -- 172.21.15.177:0/4005781590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca28005d20 con 0x55a7892089e0 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.934+0000 7fca3e130640 1 --2- 172.21.15.177:0/4005781590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7892f7660 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fca3000b240 tx=0x7fca3000b700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=809c5a9aaf918fa0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.934+0000 7fc92c608640 1 -- 172.21.15.177:0/4005781590 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30014070 con 0x55a7892089e0 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.934+0000 7fc92c608640 1 -- 172.21.15.177:0/4005781590 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000d500 con 0x55a7892089e0 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.934+0000 7fc92c608640 1 -- 172.21.15.177:0/4005781590 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3000d820 con 0x55a7892089e0 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- 172.21.15.177:0/4005781590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 msgr2=0x55a7892f7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 --2- 172.21.15.177:0/4005781590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7892f7660 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fca3000b240 tx=0x7fca3000b700 comp rx=0 tx=0).stop 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- 172.21.15.177:0/4005781590 shutdown_connections 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 --2- 172.21.15.177:0/4005781590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7892f7660 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- 172.21.15.177:0/4005781590 >> 172.21.15.177:0/4005781590 conn(0x55a789204040 msgr2=0x55a7892f2f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- 172.21.15.177:0/4005781590 shutdown_connections 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- 172.21.15.177:0/4005781590 wait complete. 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 Processor -- start 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- start start 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7893031e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.935+0000 7fca40631800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a789104210 con 0x55a7892089e0 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7893031e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7893031e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43006/0 (socket says 172.21.15.177:43006) 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca3e130640 1 -- 172.21.15.177:0/254882282 learned_addr learned my addr 172.21.15.177:0/254882282 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca3e130640 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30001ba0 con 0x55a7892089e0 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca3e130640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7893031e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fca30000f60 tx=0x7fca30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fc92ae05640 1 -- 172.21.15.177:0/254882282 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30019870 con 0x55a7892089e0 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fc92ae05640 1 -- 172.21.15.177:0/254882282 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca30020070 con 0x55a7892089e0 2024-03-20T13:36:11.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a789303720 con 0x55a7892089e0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fc92ae05640 1 -- 172.21.15.177:0/254882282 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30019b20 con 0x55a7892089e0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.936+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a789303c00 con 0x55a7892089e0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.937+0000 7fc92ae05640 1 -- 172.21.15.177:0/254882282 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fca3000d040 con 0x55a7892089e0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.937+0000 7fc92ae05640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc924036790 0x7fc924038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.937+0000 7fc92ae05640 1 -- 172.21.15.177:0/254882282 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fca3000a040 con 0x55a7892089e0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca37fff640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc924036790 0x7fc924038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a78920ce70 0x55a789309e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78930a420 con 0x55a78920ce70 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca3e931640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a78920ce70 0x55a789309e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca37fff640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc924036790 0x7fc924038c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fca28056000 tx=0x7fca28050000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca3e931640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a78920ce70 0x55a789309e80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca3e931640 1 -- 172.21.15.177:0/254882282 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a78920ce70 2024-03-20T13:36:11.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.938+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789307590 con 0x55a78920ce70 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca3e931640 1 -- 172.21.15.177:0/254882282 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a78920ce70 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78930c660 0x55a78930ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78930f140 con 0x55a78930c660 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca3e130640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78930c660 0x55a78930ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca3e130640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78930c660 0x55a78930ea50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca3e130640 1 -- 172.21.15.177:0/254882282 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fca30016070 con 0x55a78930c660 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78930b5e0 con 0x55a78920ce70 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.939+0000 7fca3e931640 1 -- 172.21.15.177:0/254882282 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a78920ce70 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.940+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a789310560 0x55a789312950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.940+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789313090 con 0x55a789310560 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.940+0000 7fca37fff640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a789310560 0x55a789312950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.940+0000 7fca37fff640 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a789310560 0x55a789312950 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.940+0000 7fca37fff640 1 -- 172.21.15.177:0/254882282 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fca2805b040 con 0x55a789310560 2024-03-20T13:36:11.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca40631800 1 Processor -- start 2024-03-20T13:36:11.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca40631800 1 -- start start 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca40631800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 0x55a7893216b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca40631800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7890a6c70 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 0x55a7893216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 0x55a7893216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43016/0 (socket says 172.21.15.177:43016) 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca3e130640 1 -- 172.21.15.177:0/2976433506 learned_addr learned my addr 172.21.15.177:0/2976433506 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.941+0000 7fca3e130640 1 -- 172.21.15.177:0/2976433506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a789321bf0 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.942+0000 7fca3e130640 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 0x55a7893216b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ffd0 tx=0x7fca30019f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.942+0000 7fc923fff640 1 -- 172.21.15.177:0/2976433506 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3001a540 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.942+0000 7fc923fff640 1 -- 172.21.15.177:0/2976433506 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3004c0c0 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.942+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a789322660 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.942+0000 7fc923fff640 1 -- 172.21.15.177:0/2976433506 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3004c360 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.942+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a789322b20 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.943+0000 7fc923fff640 1 -- 172.21.15.177:0/2976433506 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fca3004c910 con 0x55a789321290 2024-03-20T13:36:11.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.943+0000 7fc923fff640 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc918036830 0x7fc918038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.943+0000 7fc923fff640 1 -- 172.21.15.177:0/2976433506 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fca30040040 con 0x55a789321290 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.943+0000 7fca37fff640 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc918036830 0x7fc918038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca40631800 1 Processor -- start 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca40631800 1 -- start start 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca40631800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a78932e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca40631800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a78907c5d0 con 0x55a78932e2e0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca37fff640 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc918036830 0x7fc918038cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55a7893074b0 tx=0x7fca28005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a78932e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a78932e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43026/0 (socket says 172.21.15.177:43026) 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca3e130640 1 -- 172.21.15.177:0/10661893 learned_addr learned my addr 172.21.15.177:0/10661893 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.944+0000 7fca3e130640 1 -- 172.21.15.177:0/10661893 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a78932ecd0 con 0x55a78932e2e0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca3e130640 1 --2- 172.21.15.177:0/10661893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a78932e700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fca30031fd0 tx=0x7fca3000c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc7c913eba590e56 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fc921ffb640 1 -- 172.21.15.177:0/10661893 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3000cac0 con 0x55a78932e2e0 2024-03-20T13:36:11.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fc921ffb640 1 -- 172.21.15.177:0/10661893 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca30031070 con 0x55a78932e2e0 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fc921ffb640 1 -- 172.21.15.177:0/10661893 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca3004de00 con 0x55a78932e2e0 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 -- 172.21.15.177:0/10661893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 msgr2=0x55a78932e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 --2- 172.21.15.177:0/10661893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a78932e700 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fca30031fd0 tx=0x7fca3000c9d0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 -- 172.21.15.177:0/10661893 shutdown_connections 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 --2- 172.21.15.177:0/10661893 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a78932e700 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 -- 172.21.15.177:0/10661893 >> 172.21.15.177:0/10661893 conn(0x55a78932a5b0 msgr2=0x55a789328610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 -- 172.21.15.177:0/10661893 shutdown_connections 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.945+0000 7fca40631800 1 -- 172.21.15.177:0/10661893 wait complete. 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca40631800 1 Processor -- start 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca40631800 1 -- start start 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca40631800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a789177d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca40631800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7891748b0 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a789177d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca3e130640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a789177d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43030/0 (socket says 172.21.15.177:43030) 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.946+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 learned_addr learned my addr 172.21.15.177:0/1158397244 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca30050020 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fca3e130640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a789177d30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fca3005a040 tx=0x7fca30010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fc90ffff640 1 -- 172.21.15.177:0/1158397244 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30030660 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fc90ffff640 1 -- 172.21.15.177:0/1158397244 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3000cac0 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a789174ab0 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fc90ffff640 1 -- 172.21.15.177:0/1158397244 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fca30030450 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.947+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a789174ab0 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.948+0000 7fc90ffff640 1 -- 172.21.15.177:0/1158397244 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fca30030890 con 0x55a78932e2e0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fc90ffff640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc908036790 0x7fc908038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fc90ffff640 1 -- 172.21.15.177:0/1158397244 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fca3006ed70 con 0x55a78932e2e0 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca37fff640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc908036790 0x7fc908038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a789349400 0x55a78934b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934bff0 con 0x55a789349400 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca3e931640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a789349400 0x55a78934b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca37fff640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc908036790 0x7fc908038c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fca2801efb0 tx=0x7fca28051000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.955 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.949+0000 7fca3e931640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a789349400 0x55a78934b8a0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 realm 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934c3c0 con 0x55a789349400 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.967 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cf70 con 0x55a789349400 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78934d920 0x55a78934fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.950+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789350290 con 0x55a78934d920 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca3e130640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78934d920 0x55a78934fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca3e130640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78934d920 0x55a78934fd10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fca3005e020 con 0x55a78934d920 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca40631800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:11.968 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca40631800 20 searching for the correct realm 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a789352250 0x55a789354710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789354de0 con 0x55a789352250 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca37fff640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a789352250 0x55a789354710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.951+0000 7fca37fff640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a789352250 0x55a789354710 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.952+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.952+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789354de0 con 0x55a78934d920 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.952+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3005e020 con 0x55a78934d920 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.952+0000 7fca3e130640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fca3003a020 0x7fca30026890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.952+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789354de0 con 0x7fca3003a020 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.952+0000 7fca3e931640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fca3003a020 0x7fca30026890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.953+0000 7fca3e931640 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fca3003a020 0x7fca30026890 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.953+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.969 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.953+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.953+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.953+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a78934d920 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3005e020 con 0x55a78934d920 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.954+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.970 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.955+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.955+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.955+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.955+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.955+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.955+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a78934d920 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fca3005e020 con 0x55a78934d920 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.956+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.971 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.957+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a78934d920 2024-03-20T13:36:11.972 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.958+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.959+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.959+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.959+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.959+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a78934d920 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.959+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.959+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a78934d920 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789352250 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.973 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x7fca3003a020 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.960+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a789349400 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78934cc10 con 0x55a78934d920 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.974 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789350b60 con 0x55a789349400 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789350b60 con 0x55a789349400 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.961+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789350b60 con 0x7fca3003a020 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 20 zone default found 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 4 Realm: () 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:11.975 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 20 zonegroup default 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789351400 con 0x7fca3003a020 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789351800 con 0x55a789352250 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.962+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789356c00 con 0x55a789352250 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 20 started sync module instance, tier type = 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.963+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789356090 con 0x55a78934d920 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.964+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.964+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94178049876976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789356810 con 0x55a78934d920 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.964+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789357900 con 0x55a789349400 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.965+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94178049876976] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.965+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.965+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94178049879904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789357cb0 con 0x55a789349400 2024-03-20T13:36:11.977 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.965+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789358700 con 0x55a789352250 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.966+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94178049879904] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.966+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.966+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94178049884640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789358ab0 con 0x55a789352250 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.966+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789359530 con 0x55a78934d920 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.967+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94178049884640] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.967+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.967+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94178049880960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789359db0 con 0x55a78934d920 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.967+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935a720 con 0x55a789349400 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.969+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94178049880960] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.984 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.969+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.969+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94178049891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935a720 con 0x55a789349400 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.969+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935b0d0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.970+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94178049891056] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.970+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.970+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94178049895408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935a720 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.970+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935bad0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.971+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.971+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94178049897968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935bf30 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.971+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935c9d0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.971+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94178049895408] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'207 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94178049897968] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.985 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94178049901744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935c990 con 0x7fca3003a020 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=0 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=1 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=2 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=3 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=4 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=5 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.972+0000 7fca40631800 20 add_watcher() i=6 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.973+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94178049901744] v32'208 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.973+0000 7fca40631800 20 add_watcher() i=7 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.973+0000 7fca40631800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:11.986 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.973+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935f9c0 con 0x55a789349400 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.974+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.974+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94178049892992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a78935ce30 con 0x55a789349400 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94178049892992] v32'208 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fc8f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fca40631800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fca40631800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fca40631800 5 note: GC not initialized 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fc86f7fe640 20 reqs_thread_entry: start 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fca40631800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.975+0000 7fca40631800 20 Filter name: none 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fc86d7fa640 20 reqs_thread_entry: start 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fca40631800 20 rados->read ofs=0 len=0 2024-03-20T13:36:11.987 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789391350 con 0x55a789349400 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fca40631800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789391350 con 0x7fca3003a020 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.976+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call out=1268b] v0'0 uv30 ondisk = 0) v8 ==== 152+0+1268 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.977+0000 7fc8f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.977+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94178049892992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789391350 con 0x55a789349400 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.978+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94178049892992] v32'209 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.978+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94178049876976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789391350 con 0x55a78934d920 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.979+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94178049876976] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.979+0000 7fca40631800 20 remove_watcher() i=0 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.979+0000 7fca40631800 2 removed watcher, disabling cache 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.979+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94178049879904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789391350 con 0x55a789349400 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.981+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94178049879904] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.988 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.981+0000 7fca40631800 20 remove_watcher() i=1 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.981+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94178049884640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789391350 con 0x55a789352250 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.981+0000 7fca37fff640 1 -- 172.21.15.177:0/1158397244 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94178049884640] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca2805b040 con 0x55a789352250 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.981+0000 7fca40631800 20 remove_watcher() i=2 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.981+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94178049880960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a7893563f0 con 0x55a78934d920 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.982+0000 7fca3e130640 1 -- 172.21.15.177:0/1158397244 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94178049880960] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca30085080 con 0x55a78934d920 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.982+0000 7fca40631800 20 remove_watcher() i=3 2024-03-20T13:36:11.989 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.983+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94178049891056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789357400 con 0x55a789349400 2024-03-20T13:36:11.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.984+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94178049891056] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x55a789349400 2024-03-20T13:36:11.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.984+0000 7fca40631800 20 remove_watcher() i=4 2024-03-20T13:36:11.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.984+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94178049895408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789357400 con 0x7fca3003a020 2024-03-20T13:36:11.994 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.985+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94178049895408] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.985+0000 7fca40631800 20 remove_watcher() i=5 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.985+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94178049897968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a789357400 con 0x7fca3003a020 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.986+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94178049897968] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.986+0000 7fca40631800 20 remove_watcher() i=6 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.986+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94178049901744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55a7893581e0 con 0x7fca3003a020 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94178049901744] v32'209 uv207 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fca3800a4a0 con 0x7fca3003a020 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 20 remove_watcher() i=7 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fca3003a020 msgr2=0x7fca30026890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fca3003a020 0x7fca30026890 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a789349400 msgr2=0x55a78934b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a789349400 0x55a78934b8a0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78934d920 msgr2=0x55a78934fd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78934d920 0x55a78934fd10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a789352250 msgr2=0x55a789354710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55a789352250 0x55a789354710 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc908036790 msgr2=0x7fc908038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc908036790 0x7fc908038c50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fca2801efb0 tx=0x7fca28051000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 msgr2=0x55a789177d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca3e931640 1 -- 172.21.15.177:0/1158397244 reap_dead start 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a789177d30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fca3005a040 tx=0x7fca30010ee0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 shutdown_connections 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 --2- 172.21.15.177:0/1158397244 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a78932e2e0 0x55a789177d30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 >> 172.21.15.177:0/1158397244 conn(0x55a78932a5b0 msgr2=0x55a789327c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 shutdown_connections 2024-03-20T13:36:11.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.987+0000 7fca40631800 1 -- 172.21.15.177:0/1158397244 wait complete. 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc918036830 msgr2=0x7fc918038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc918036830 0x7fc918038cf0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x55a7893074b0 tx=0x7fca28005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 msgr2=0x55a7893216b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 0x55a7893216b0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fca3000ffd0 tx=0x7fca30019f30 comp rx=0 tx=0).stop 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 shutdown_connections 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc918036830 0x7fc918038cf0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/2976433506 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a789321290 0x55a7893216b0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 >> 172.21.15.177:0/2976433506 conn(0x55a789315330 msgr2=0x55a789315730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 shutdown_connections 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/2976433506 wait complete. 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a789310560 msgr2=0x55a789312950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55a789310560 0x55a789312950 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a78920ce70 msgr2=0x55a789309e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55a78920ce70 0x55a789309e80 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78930c660 msgr2=0x55a78930ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55a78930c660 0x55a78930ea50 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc924036790 msgr2=0x7fc924038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc924036790 0x7fc924038c50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fca28056000 tx=0x7fca28050000 comp rx=0 tx=0).stop 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 msgr2=0x55a7893031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 --2- 172.21.15.177:0/254882282 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55a7892089e0 0x55a7893031e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fca30000f60 tx=0x7fca30000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca3e931640 1 -- 172.21.15.177:0/254882282 reap_dead start 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 shutdown_connections 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 >> 172.21.15.177:0/254882282 conn(0x55a789204040 msgr2=0x55a7892f17e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 shutdown_connections 2024-03-20T13:36:11.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:11.988+0000 7fca40631800 1 -- 172.21.15.177:0/254882282 wait complete. 2024-03-20T13:36:11.999 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[]},{"bucket":"myfoo","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}]},{"bucket":"myfoo2","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo3","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]},{"bucket":"myfoo4","time":"2024-03-20T13:00:00.000000Z","epoch":1710939600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}]}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}}]} 2024-03-20T13:36:12.000 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': []}, {'bucket': 'myfoo', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}]}, {'bucket': 'myfoo2', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo3', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}, {'bucket': 'myfoo4', 'time': '2024-03-20T13:00:00.000000Z', 'epoch': 1710939600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}]}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}}]} 2024-03-20T13:36:12.000 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-03-20T13:36:12.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-03-20T13:36:12.000 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-03-20T13:36:12.050 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:12.051 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76e3cc0800 1 Processor -- start 2024-03-20T13:36:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76e3cc0800 1 -- start start 2024-03-20T13:36:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76e3cc0800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55ccdd369050 0x55ccdd36b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76e3cc0800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ccdd2afd00 con 0x55ccdd364bc0 2024-03-20T13:36:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76e3cc0800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ccdd266500 con 0x55ccdd369050 2024-03-20T13:36:12.052 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76d8fc5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55ccdd369050 0x55ccdd36b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76d8fc5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55ccdd369050 0x55ccdd36b440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43036/0 (socket says 172.21.15.177:43036) 2024-03-20T13:36:12.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76d8fc5640 1 -- 172.21.15.177:0/769136168 learned_addr learned my addr 172.21.15.177:0/769136168 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.050+0000 7f76e17c6640 1 --1- 172.21.15.177:0/769136168 >> v1:172.21.15.28:6789/0 conn(0x55ccdd364bc0 0x55ccdd364fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:34852/0 (socket says 172.21.15.177:34852) 2024-03-20T13:36:12.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.051+0000 7f76d8fc5640 1 -- 172.21.15.177:0/769136168 >> v1:172.21.15.28:6789/0 conn(0x55ccdd364bc0 legacy=0x55ccdd364fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.053 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.051+0000 7f76d8fc5640 1 -- 172.21.15.177:0/769136168 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccdd36ca70 con 0x55ccdd369050 2024-03-20T13:36:12.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/769136168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd369050 0x55ccdd36b440 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00a520 tx=0x7f76cc01cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17562ce157e0b746 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e0fc5640 1 -- 172.21.15.177:0/769136168 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76cc052570 con 0x55ccdd369050 2024-03-20T13:36:12.054 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e0fc5640 1 -- 172.21.15.177:0/769136168 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc0526d0 con 0x55ccdd369050 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e0fc5640 1 -- 172.21.15.177:0/769136168 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76cc052990 con 0x55ccdd369050 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 -- 172.21.15.177:0/769136168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd369050 msgr2=0x55ccdd36b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/769136168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd369050 0x55ccdd36b440 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f76cc00a520 tx=0x7f76cc01cee0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 -- 172.21.15.177:0/769136168 shutdown_connections 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/769136168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd369050 0x55ccdd36b440 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 -- 172.21.15.177:0/769136168 >> 172.21.15.177:0/769136168 conn(0x55ccdd3601c0 msgr2=0x55ccdd3625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 -- 172.21.15.177:0/769136168 shutdown_connections 2024-03-20T13:36:12.055 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.053+0000 7f76e3cc0800 1 -- 172.21.15.177:0/769136168 wait complete. 2024-03-20T13:36:12.066 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e3cc0800 1 Processor -- start 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e3cc0800 1 -- start start 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e3cc0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd454b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e3cc0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccdd263a30 con 0x55ccdd364bc0 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd454b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd454b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43046/0 (socket says 172.21.15.177:43046) 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.065+0000 7f76e17c6640 1 -- 172.21.15.177:0/3124628863 learned_addr learned my addr 172.21.15.177:0/3124628863 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.067 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.066+0000 7f76e17c6640 1 -- 172.21.15.177:0/3124628863 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc005de0 con 0x55ccdd364bc0 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.066+0000 7f76e17c6640 1 --2- 172.21.15.177:0/3124628863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd454b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f76d4001d30 tx=0x7f76d400b600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7caf8419db59114 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.066+0000 7f75cf606640 1 -- 172.21.15.177:0/3124628863 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d4014070 con 0x55ccdd364bc0 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.066+0000 7f75cf606640 1 -- 172.21.15.177:0/3124628863 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d400f450 con 0x55ccdd364bc0 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.066+0000 7f75cf606640 1 -- 172.21.15.177:0/3124628863 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d400f730 con 0x55ccdd364bc0 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3124628863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 msgr2=0x55ccdd454b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3124628863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd454b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f76d4001d30 tx=0x7f76d400b600 comp rx=0 tx=0).stop 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3124628863 shutdown_connections 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3124628863 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd454b80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.070 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3124628863 >> 172.21.15.177:0/3124628863 conn(0x55ccdd3601c0 msgr2=0x55ccdd4504a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3124628863 shutdown_connections 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3124628863 wait complete. 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.067+0000 7f76e3cc0800 1 Processor -- start 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e3cc0800 1 -- start start 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e3cc0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd45c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e3cc0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccdd25f210 con 0x55ccdd364bc0 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd45c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd45c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43058/0 (socket says 172.21.15.177:43058) 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e17c6640 1 -- 172.21.15.177:0/332968134 learned_addr learned my addr 172.21.15.177:0/332968134 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e17c6640 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccdd2afd00 con 0x55ccdd364bc0 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.068+0000 7f76e17c6640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd45c2a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x55ccdd455910 tx=0x7f76d4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f75cde03640 1 -- 172.21.15.177:0/332968134 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d4014050 con 0x55ccdd364bc0 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f75cde03640 1 -- 172.21.15.177:0/332968134 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d401b850 con 0x55ccdd364bc0 2024-03-20T13:36:12.071 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccdd45c7e0 con 0x55ccdd364bc0 2024-03-20T13:36:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f75cde03640 1 -- 172.21.15.177:0/332968134 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d401bb30 con 0x55ccdd364bc0 2024-03-20T13:36:12.072 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccdd45ccc0 con 0x55ccdd364bc0 2024-03-20T13:36:12.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f75cde03640 1 -- 172.21.15.177:0/332968134 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f76d4022020 con 0x55ccdd364bc0 2024-03-20T13:36:12.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.069+0000 7f75cde03640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75c80367e0 0x7f75c8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.077 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f75cde03640 1 -- 172.21.15.177:0/332968134 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f76d4008030 con 0x55ccdd364bc0 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75c80367e0 0x7f75c8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd369050 0x55ccdd462ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd463540 con 0x55ccdd369050 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76e1fc7640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd369050 0x55ccdd462ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75c80367e0 0x7f75c8038ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76cc054000 tx=0x7f76cc04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76e1fc7640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd369050 0x55ccdd462ed0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76e1fc7640 1 -- 172.21.15.177:0/332968134 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd369050 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.070+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4605e0 con 0x55ccdd369050 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e1fc7640 1 -- 172.21.15.177:0/332968134 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd369050 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd465780 0x55ccdd467b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd468240 con 0x55ccdd465780 2024-03-20T13:36:12.078 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e17c6640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd465780 0x55ccdd467b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e17c6640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd465780 0x55ccdd467b70 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e17c6640 1 -- 172.21.15.177:0/332968134 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f76d4016070 con 0x55ccdd465780 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.071+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd464700 con 0x55ccdd369050 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.072+0000 7f76e1fc7640 1 -- 172.21.15.177:0/332968134 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd369050 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.072+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ccdd469640 0x55ccdd46ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.072+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd46c190 con 0x55ccdd469640 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.072+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ccdd469640 0x55ccdd46ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.072+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ccdd469640 0x55ccdd46ba30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.073+0000 7f76d8fc5640 1 -- 172.21.15.177:0/332968134 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd469640 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.073+0000 7f76e3cc0800 1 Processor -- start 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.073+0000 7f76e3cc0800 1 -- start start 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.073+0000 7f76e3cc0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 0x55ccdd47a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.079 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.073+0000 7f76e3cc0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccdd201c70 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 0x55ccdd47a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 0x55ccdd47a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43062/0 (socket says 172.21.15.177:43062) 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e17c6640 1 -- 172.21.15.177:0/3041145399 learned_addr learned my addr 172.21.15.177:0/3041145399 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e17c6640 1 -- 172.21.15.177:0/3041145399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccdd47aca0 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e17c6640 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 0x55ccdd47a760 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f76d404a3a0 tx=0x7f76d401c700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f75c6ffd640 1 -- 172.21.15.177:0/3041145399 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d4010070 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f75c6ffd640 1 -- 172.21.15.177:0/3041145399 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d40101d0 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccdd47b710 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f75c6ffd640 1 -- 172.21.15.177:0/3041145399 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d4010470 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.074+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccdd47bbd0 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.075+0000 7f75c6ffd640 1 -- 172.21.15.177:0/3041145399 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f76d4043c10 con 0x55ccdd47a340 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.075+0000 7f75c6ffd640 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75b8036790 0x7f75b8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.080 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.075+0000 7f75c6ffd640 1 -- 172.21.15.177:0/3041145399 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f76d4039dc0 con 0x55ccdd47a340 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.075+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75b8036790 0x7f75b8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.075+0000 7f76e3cc0800 1 Processor -- start 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.075+0000 7f76e3cc0800 1 -- start start 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75b8036790 0x7f75b8038c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55ccdd460520 tx=0x7f76cc005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e3cc0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd487980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e3cc0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccdd1d75d0 con 0x55ccdd487560 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd487980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd487980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43066/0 (socket says 172.21.15.177:43066) 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e17c6640 1 -- 172.21.15.177:0/3167244977 learned_addr learned my addr 172.21.15.177:0/3167244977 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e17c6640 1 -- 172.21.15.177:0/3167244977 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccdd487f70 con 0x55ccdd487560 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f76e17c6640 1 --2- 172.21.15.177:0/3167244977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd487980 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f76d404a4a0 tx=0x7f76d4043440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ac98a80a0368ae server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f75c4ff9640 1 -- 172.21.15.177:0/3167244977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d404ad90 con 0x55ccdd487560 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f75c4ff9640 1 -- 172.21.15.177:0/3167244977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d4058070 con 0x55ccdd487560 2024-03-20T13:36:12.081 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.076+0000 7f75c4ff9640 1 -- 172.21.15.177:0/3167244977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d403e380 con 0x55ccdd487560 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3167244977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 msgr2=0x55ccdd487980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3167244977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd487980 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f76d404a4a0 tx=0x7f76d4043440 comp rx=0 tx=0).stop 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3167244977 shutdown_connections 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3167244977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd487980 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3167244977 >> 172.21.15.177:0/3167244977 conn(0x55ccdd4838a0 msgr2=0x55ccdd481900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3167244977 shutdown_connections 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3167244977 wait complete. 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 Processor -- start 2024-03-20T13:36:12.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- start start 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd48e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.077+0000 7f76e3cc0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ccdd48ea40 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd48e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e17c6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd48e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43078/0 (socket says 172.21.15.177:43078) 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 learned_addr learned my addr 172.21.15.177:0/2158279181 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ccdd47bbd0 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e17c6640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd48e500 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f76d402ada0 tx=0x7f76d402a9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f75b6ffd640 1 -- 172.21.15.177:0/2158279181 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d403e250 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f75b6ffd640 1 -- 172.21.15.177:0/2158279181 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d403e3b0 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ccdd47bbd0 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f75b6ffd640 1 -- 172.21.15.177:0/2158279181 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f76d4013260 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.078+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ccdd47bbd0 con 0x55ccdd487560 2024-03-20T13:36:12.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.079+0000 7f75b6ffd640 1 -- 172.21.15.177:0/2158279181 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f76d400d900 con 0x55ccdd487560 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.079+0000 7f75b6ffd640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75ac036790 0x7f75ac038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.079+0000 7f75b6ffd640 1 -- 172.21.15.177:0/2158279181 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f76d4074d70 con 0x55ccdd487560 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.079+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75ac036790 0x7f75ac038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75ac036790 0x7f75ac038c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55ccdd46c550 tx=0x7f76cc04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd499dd0 0x55ccdd49c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49c9e0 con 0x55ccdd499dd0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e1fc7640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd499dd0 0x55ccdd49c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e1fc7640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd499dd0 0x55ccdd49c290 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 20 realm 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49cdb0 con 0x55ccdd499dd0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.080+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d990 con 0x55ccdd499dd0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd49e340 0x55ccdd4a0730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a0d40 con 0x55ccdd49e340 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e17c6640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd49e340 0x55ccdd4a0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e17c6640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd49e340 0x55ccdd4a0730 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 20 searching for the correct realm 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55ccdd4a2ff0 0x55ccdd4a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.081+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a5b30 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55ccdd4a2ff0 0x55ccdd4a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76d8fc5640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55ccdd4a2ff0 0x55ccdd4a54b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a5b30 con 0x55ccdd49e340 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76e17c6640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f76d4073060 0x7f76d400e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.082+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a5b30 con 0x7f76d4073060 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.083+0000 7f76e1fc7640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f76d4073060 0x7f76d400e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.083+0000 7f76e1fc7640 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f76d4073060 0x7f76d400e5d0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.083+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.083+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.084+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd49e340 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.085+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd49e340 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.086+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.087+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd49e340 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.088+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd49e340 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.089+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.090+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd49e340 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.090+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.090+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.090+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.090+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x7f76d4073060 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd499dd0 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd49d630 con 0x55ccdd49e340 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:12.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a1430 con 0x55ccdd499dd0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.091+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a1430 con 0x55ccdd499dd0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a17e0 con 0x7f76d4073060 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 zone default found 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 4 Realm: () 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 zonegroup default 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a1bd0 con 0x7f76d4073060 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a1fd0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.092+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a7950 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.093+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.093+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.093+0000 7f76e3cc0800 20 started sync module instance, tier type = 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.093+0000 7f76e3cc0800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.093+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a7230 con 0x55ccdd49e340 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.094+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.094+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94338374331792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a75e0 con 0x55ccdd49e340 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.094+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a8760 con 0x55ccdd499dd0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.095+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94338374331792] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.095+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.095+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94338374337216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a8b80 con 0x55ccdd499dd0 2024-03-20T13:36:12.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.095+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a94f0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.096+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94338374337216] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.096+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.096+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94338374338272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a8b00 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.096+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4aa350 con 0x55ccdd49e340 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.097+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94338374338272] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.097+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.097+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94338374344368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4aa770 con 0x55ccdd49e340 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.097+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4ab0e0 con 0x55ccdd499dd0 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.098+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.098+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94338374347840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4ab0c0 con 0x55ccdd499dd0 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.098+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4ac060 con 0x7f76d4073060 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.098+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94338374344368] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.099+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94338374347840] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.099+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.099+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94338374345424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4abb80 con 0x7f76d4073060 2024-03-20T13:36:12.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.099+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4ac8e0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.100+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94338374345424] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.101+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.101+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94338374349888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4abb80 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.101+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4acef0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94338374349888] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'210 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94338374353984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4acef0 con 0x7f76d4073060 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=0 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=1 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=2 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=3 2024-03-20T13:36:12.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=4 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=5 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.102+0000 7f76e3cc0800 20 add_watcher() i=6 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.103+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94338374353984] v32'211 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.103+0000 7f76e3cc0800 20 add_watcher() i=7 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.103+0000 7f76e3cc0800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.103+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4b02e0 con 0x55ccdd499dd0 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.103+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.103+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94338374356000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4ad780 con 0x55ccdd499dd0 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.104+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94338374356000] v32'210 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.104+0000 7f75977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.104+0000 7f76e3cc0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.104+0000 7f76e3cc0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.104+0000 7f76e3cc0800 5 note: GC not initialized 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.104+0000 7f75967e4640 20 reqs_thread_entry: start 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 20 Filter name: none 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f7507fff640 20 reqs_thread_entry: start 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4e2300 con 0x7f76d4073060 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-03-20T13:36:12.120 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.105+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4e0990 con 0x55ccdd499dd0 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e3cc0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e3cc0800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e3cc0800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e3cc0800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e3cc0800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.106+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4e0d70 con 0x7f76d4073060 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~346] v32'3 uv3 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e3cc0800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e3cc0800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:36:12.121 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e3cc0800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 94338374573408 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4e5860 con 0x7f76d4073060 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== watch-notify(notify (1) cookie 94338374353984 notify 137438953495 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7f76dc03d040 con 0x7f76d4073060 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f75c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953495 cookie 94338374353984 notifier 4710 bl.length()=522 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f75c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f75c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(65 notify.7 [notify cookie 94338374573408 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.107+0000 7f75c4ff9640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f75a4003e90 con 0x7f76d4073060 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.108+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.108+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== watch-notify(notify_complete (2) cookie 94338374573408 notify 137438953495 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f76dc042570 con 0x7f76d4073060 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.108+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4e1d60 con 0x55ccdd499dd0 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'3 uv3 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e3cc0800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:36:12.122 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e3cc0800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e3cc0800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94338374570288 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4e1d60 con 0x7f76d4073060 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== watch-notify(notify (1) cookie 94338374345424 notify 137438953496 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7f76dc042570 con 0x7f76d4073060 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f75c4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953496 cookie 94338374345424 notifier 4710 bl.length()=177 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f75c4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f75c4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(68 notify.5 [notify cookie 94338374570288 out=8b] v0'0 uv210 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f75c4ff9640 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f75a4003e90 con 0x7f76d4073060 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.109+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x7f76d4073060 2024-03-20T13:36:12.123 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.110+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== watch-notify(notify_complete (2) cookie 94338374570288 notify 137438953496 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f76dc0429e0 con 0x7f76d4073060 2024-03-20T13:36:12.124 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:12.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.110+0000 7f75977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:12.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.110+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94338374356000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4afd50 con 0x55ccdd499dd0 2024-03-20T13:36:12.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.111+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94338374356000] v32'211 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.111+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94338374331792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4af8b0 con 0x55ccdd49e340 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.112+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94338374331792] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.112+0000 7f76e3cc0800 20 remove_watcher() i=0 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.112+0000 7f76e3cc0800 2 removed watcher, disabling cache 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.112+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94338374337216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a6d90 con 0x55ccdd499dd0 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.113+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94338374337216] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc00a4a0 con 0x55ccdd499dd0 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.113+0000 7f76e3cc0800 20 remove_watcher() i=1 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.113+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94338374338272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a6d90 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.114+0000 7f76d8fc5640 1 -- 172.21.15.177:0/2158279181 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94338374338272] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76cc052bc0 con 0x55ccdd4a2ff0 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.114+0000 7f76e3cc0800 20 remove_watcher() i=2 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.114+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94338374344368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a82c0 con 0x55ccdd49e340 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.115+0000 7f76e17c6640 1 -- 172.21.15.177:0/2158279181 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94338374344368] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76d404e020 con 0x55ccdd49e340 2024-03-20T13:36:12.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.115+0000 7f76e3cc0800 20 remove_watcher() i=3 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.115+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94338374347840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a9eb0 con 0x55ccdd499dd0 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.116+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94338374347840] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc04e040 con 0x55ccdd499dd0 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.116+0000 7f76e3cc0800 20 remove_watcher() i=4 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.116+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94338374345424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4a9eb0 con 0x7f76d4073060 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.118+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94338374345424] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc04e040 con 0x7f76d4073060 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.118+0000 7f76e3cc0800 20 remove_watcher() i=5 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.118+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94338374349888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4aac40 con 0x7f76d4073060 2024-03-20T13:36:12.131 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.119+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94338374349888] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc04e040 con 0x7f76d4073060 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.119+0000 7f76e3cc0800 20 remove_watcher() i=6 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.119+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94338374353984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ccdd4ab420 con 0x7f76d4073060 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94338374353984] v32'212 uv210 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f76dc04e040 con 0x7f76d4073060 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 20 remove_watcher() i=7 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f76d4073060 msgr2=0x7f76d400e5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f76d4073060 0x7f76d400e5d0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd499dd0 msgr2=0x55ccdd49c290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd499dd0 0x55ccdd49c290 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd49e340 msgr2=0x55ccdd4a0730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd49e340 0x55ccdd4a0730 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55ccdd4a2ff0 msgr2=0x55ccdd4a54b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55ccdd4a2ff0 0x55ccdd4a54b0 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75ac036790 msgr2=0x7f75ac038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.132 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75ac036790 0x7f75ac038c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x55ccdd46c550 tx=0x7f76cc04f000 comp rx=0 tx=0).stop 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e1fc7640 1 -- 172.21.15.177:0/2158279181 reap_dead start 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 msgr2=0x55ccdd48e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd48e500 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f76d402ada0 tx=0x7f76d402a9a0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 shutdown_connections 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/2158279181 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd487560 0x55ccdd48e500 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 >> 172.21.15.177:0/2158279181 conn(0x55ccdd4838a0 msgr2=0x55ccdd480f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 shutdown_connections 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.120+0000 7f76e3cc0800 1 -- 172.21.15.177:0/2158279181 wait complete. 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75b8036790 msgr2=0x7f75b8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75b8036790 0x7f75b8038c50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x55ccdd460520 tx=0x7f76cc005ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 msgr2=0x55ccdd47a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 0x55ccdd47a760 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f76d404a3a0 tx=0x7f76d401c700 comp rx=0 tx=0).stop 2024-03-20T13:36:12.133 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 shutdown_connections 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75b8036790 0x7f75b8038c50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/3041145399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd47a340 0x55ccdd47a760 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 >> 172.21.15.177:0/3041145399 conn(0x55ccdd46e3e0 msgr2=0x55ccdd46e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 shutdown_connections 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/3041145399 wait complete. 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ccdd469640 msgr2=0x55ccdd46ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ccdd469640 0x55ccdd46ba30 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd369050 msgr2=0x55ccdd462ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ccdd369050 0x55ccdd462ed0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd465780 msgr2=0x55ccdd467b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55ccdd465780 0x55ccdd467b70 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75c80367e0 msgr2=0x7f75c8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.134 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f75c80367e0 0x7f75c8038ca0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f76cc054000 tx=0x7f76cc04e000 comp rx=0 tx=0).stop 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 msgr2=0x55ccdd45c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 --2- 172.21.15.177:0/332968134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ccdd364bc0 0x55ccdd45c2a0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x55ccdd455910 tx=0x7f76d4000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e1fc7640 1 -- 172.21.15.177:0/332968134 reap_dead start 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 shutdown_connections 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 >> 172.21.15.177:0/332968134 conn(0x55ccdd3601c0 msgr2=0x55ccdd453570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 shutdown_connections 2024-03-20T13:36:12.135 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.121+0000 7f76e3cc0800 1 -- 172.21.15.177:0/332968134 wait complete. 2024-03-20T13:36:12.136 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:12.151 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:12.156 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-03-20T13:36:12.156 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-03-20T13:36:12.156 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-03-20T13:36:12.157 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-03-20T13:36:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:12.201 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4c9333800 1 Processor -- start 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4c9333800 1 -- start start 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4c9333800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x559bfca3de70 0x559bfca40260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4c9333800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x559bfc985cd0 con 0x559bfca399e0 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4c9333800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x559bfc93c500 con 0x559bfca3de70 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4bc866640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x559bfca3de70 0x559bfca40260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4bc866640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x559bfca3de70 0x559bfca40260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43088/0 (socket says 172.21.15.177:43088) 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.201+0000 7fe4bc866640 1 -- 172.21.15.177:0/1745013770 learned_addr learned my addr 172.21.15.177:0/1745013770 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.202+0000 7fe4bc866640 1 -- 172.21.15.177:0/1745013770 >> v1:172.21.15.28:6789/0 conn(0x559bfca399e0 legacy=0x559bfca39e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.203 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.202+0000 7fe4bc866640 1 -- 172.21.15.177:0/1745013770 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bfca41890 con 0x559bfca3de70 2024-03-20T13:36:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.203+0000 7fe4bc866640 1 --2- 172.21.15.177:0/1745013770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca3de70 0x559bfca40260 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000a520 tx=0x7fe4b001cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d5bd81cfc25bc56 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c4866640 1 -- 172.21.15.177:0/1745013770 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0052570 con 0x559bfca3de70 2024-03-20T13:36:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c4866640 1 -- 172.21.15.177:0/1745013770 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b00526d0 con 0x559bfca3de70 2024-03-20T13:36:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c4866640 1 -- 172.21.15.177:0/1745013770 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b0052990 con 0x559bfca3de70 2024-03-20T13:36:12.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 -- 172.21.15.177:0/1745013770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca3de70 msgr2=0x559bfca40260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 --2- 172.21.15.177:0/1745013770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca3de70 0x559bfca40260 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000a520 tx=0x7fe4b001cee0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 -- 172.21.15.177:0/1745013770 shutdown_connections 2024-03-20T13:36:12.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 --2- 172.21.15.177:0/1745013770 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca3de70 0x559bfca40260 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 -- 172.21.15.177:0/1745013770 >> 172.21.15.177:0/1745013770 conn(0x559bfca35040 msgr2=0x559bfca37460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 -- 172.21.15.177:0/1745013770 shutdown_connections 2024-03-20T13:36:12.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.204+0000 7fe4c9333800 1 -- 172.21.15.177:0/1745013770 wait complete. 2024-03-20T13:36:12.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.216+0000 7fe4c9333800 1 Processor -- start 2024-03-20T13:36:12.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.216+0000 7fe4c9333800 1 -- start start 2024-03-20T13:36:12.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.216+0000 7fe4c9333800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfc9adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.216+0000 7fe4c9333800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bfc939a30 con 0x559bfca399e0 2024-03-20T13:36:12.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.217+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfc9adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.217+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfc9adcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43100/0 (socket says 172.21.15.177:43100) 2024-03-20T13:36:12.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.217+0000 7fe4c5067640 1 -- 172.21.15.177:0/1248847170 learned_addr learned my addr 172.21.15.177:0/1248847170 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.219+0000 7fe4c5067640 1 -- 172.21.15.177:0/1248847170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b0005de0 con 0x559bfca399e0 2024-03-20T13:36:12.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.219+0000 7fe4c5067640 1 --2- 172.21.15.177:0/1248847170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfc9adcb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8001d50 tx=0x7fe4b800b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=936473e48259d048 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe3b3606640 1 -- 172.21.15.177:0/1248847170 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8014070 con 0x559bfca399e0 2024-03-20T13:36:12.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe3b3606640 1 -- 172.21.15.177:0/1248847170 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8008030 con 0x559bfca399e0 2024-03-20T13:36:12.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe3b3606640 1 -- 172.21.15.177:0/1248847170 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8001ea0 con 0x559bfca399e0 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 -- 172.21.15.177:0/1248847170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 msgr2=0x559bfc9adcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 --2- 172.21.15.177:0/1248847170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfc9adcb0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8001d50 tx=0x7fe4b800b5b0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 -- 172.21.15.177:0/1248847170 shutdown_connections 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 --2- 172.21.15.177:0/1248847170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfc9adcb0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 -- 172.21.15.177:0/1248847170 >> 172.21.15.177:0/1248847170 conn(0x559bfca35040 msgr2=0x559bfcb25290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 -- 172.21.15.177:0/1248847170 shutdown_connections 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.220+0000 7fe4c9333800 1 -- 172.21.15.177:0/1248847170 wait complete. 2024-03-20T13:36:12.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c9333800 1 Processor -- start 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c9333800 1 -- start start 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c9333800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfcb2b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c9333800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bfc935210 con 0x559bfca399e0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfcb2b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfcb2b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43112/0 (socket says 172.21.15.177:43112) 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c5067640 1 -- 172.21.15.177:0/880039948 learned_addr learned my addr 172.21.15.177:0/880039948 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.221+0000 7fe4c5067640 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4b800a040 con 0x559bfca399e0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.222+0000 7fe4c5067640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfcb2b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800b5f0 tx=0x7fe4b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.222+0000 7fe3b1e03640 1 -- 172.21.15.177:0/880039948 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8014070 con 0x559bfca399e0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.222+0000 7fe3b1e03640 1 -- 172.21.15.177:0/880039948 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8020070 con 0x559bfca399e0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.222+0000 7fe3b1e03640 1 -- 172.21.15.177:0/880039948 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b80196d0 con 0x559bfca399e0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.222+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559bfcb297c0 con 0x559bfca399e0 2024-03-20T13:36:12.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.222+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bfcb29d00 con 0x559bfca399e0 2024-03-20T13:36:12.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe3b1e03640 1 -- 172.21.15.177:0/880039948 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4b8019830 con 0x559bfca399e0 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe3b1e03640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe3b1e03640 1 -- 172.21.15.177:0/880039948 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe4b804beb0 con 0x559bfca399e0 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe4bc866640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfca3de70 0x559bfcb3b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb3ba10 con 0x559bfca3de70 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe4c5868640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfca3de70 0x559bfcb3b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe4bc866640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0054000 tx=0x7fe4b004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.223+0000 7fe4c5868640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfca3de70 0x559bfcb3b4d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c5868640 1 -- 172.21.15.177:0/880039948 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfca3de70 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb3bd70 con 0x559bfca3de70 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c5868640 1 -- 172.21.15.177:0/880039948 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfca3de70 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb3d7f0 0x559bfcb3fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb40410 con 0x559bfcb3d7f0 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c5067640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb3d7f0 0x559bfcb3fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.224+0000 7fe4c5067640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb3d7f0 0x559bfcb3fc80 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4c5067640 1 -- 172.21.15.177:0/880039948 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe4b8016070 con 0x559bfcb3d7f0 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb3c570 con 0x559bfca3de70 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4c5868640 1 -- 172.21.15.177:0/880039948 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfca3de70 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559bfcb41830 0x559bfcb43c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb44360 con 0x559bfcb41830 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4bc866640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559bfcb41830 0x559bfcb43c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.225+0000 7fe4bc866640 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559bfcb41830 0x559bfcb43c20 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.226+0000 7fe4bc866640 1 -- 172.21.15.177:0/880039948 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb41830 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.226+0000 7fe4c9333800 1 Processor -- start 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.226+0000 7fe4c9333800 1 -- start start 2024-03-20T13:36:12.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.226+0000 7fe4c9333800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 0x559bfcb528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.226+0000 7fe4c9333800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bfc8d7c70 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 0x559bfcb528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 0x559bfcb528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43118/0 (socket says 172.21.15.177:43118) 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe4c5067640 1 -- 172.21.15.177:0/4025599358 learned_addr learned my addr 172.21.15.177:0/4025599358 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe4c5067640 1 -- 172.21.15.177:0/4025599358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bfcb52df0 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe4c5067640 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 0x559bfcb528b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804a210 tx=0x7fe4b800e630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe3aaffd640 1 -- 172.21.15.177:0/4025599358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8037070 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe3aaffd640 1 -- 172.21.15.177:0/4025599358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b8043c30 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559bfcb53860 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.227+0000 7fe3aaffd640 1 -- 172.21.15.177:0/4025599358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b8043040 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.228+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bfcb53d20 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.228+0000 7fe3aaffd640 1 -- 172.21.15.177:0/4025599358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4b804f020 con 0x559bfcb52490 2024-03-20T13:36:12.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe3aaffd640 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3a0036790 0x7fe3a0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe3aaffd640 1 -- 172.21.15.177:0/4025599358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe4b8046040 con 0x559bfcb52490 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4bc866640 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3a0036790 0x7fe3a0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c9333800 1 Processor -- start 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c9333800 1 -- start start 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4bc866640 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3a0036790 0x7fe3a0038c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559bfcb2a640 tx=0x7fe4b0005ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c9333800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb5fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c9333800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bfc8ad5d0 con 0x559bfcb5f600 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb5fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb5fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43120/0 (socket says 172.21.15.177:43120) 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c5067640 1 -- 172.21.15.177:0/4047719637 learned_addr learned my addr 172.21.15.177:0/4047719637 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.229+0000 7fe4c5067640 1 -- 172.21.15.177:0/4047719637 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bfcb5fff0 con 0x559bfcb5f600 2024-03-20T13:36:12.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c5067640 1 --2- 172.21.15.177:0/4047719637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb5fa20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804abc0 tx=0x7fe4b804a9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58ce48603aabaf16 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe3a8ff9640 1 -- 172.21.15.177:0/4047719637 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b803edb0 con 0x559bfcb5f600 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe3a8ff9640 1 -- 172.21.15.177:0/4047719637 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b804bae0 con 0x559bfcb5f600 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe3a8ff9640 1 -- 172.21.15.177:0/4047719637 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b804bc50 con 0x559bfcb5f600 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 -- 172.21.15.177:0/4047719637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 msgr2=0x559bfcb5fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 --2- 172.21.15.177:0/4047719637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb5fa20 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804abc0 tx=0x7fe4b804a9d0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 -- 172.21.15.177:0/4047719637 shutdown_connections 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 --2- 172.21.15.177:0/4047719637 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb5fa20 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 -- 172.21.15.177:0/4047719637 >> 172.21.15.177:0/4047719637 conn(0x559bfcb5b880 msgr2=0x559bfcb598e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 -- 172.21.15.177:0/4047719637 shutdown_connections 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.230+0000 7fe4c9333800 1 -- 172.21.15.177:0/4047719637 wait complete. 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c9333800 1 Processor -- start 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c9333800 1 -- start start 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c9333800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb664c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c9333800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x559bfcb66a00 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb664c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c5067640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb664c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43128/0 (socket says 172.21.15.177:43128) 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 learned_addr learned my addr 172.21.15.177:0/2488696032 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559bfcb53860 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.231+0000 7fe4c5067640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb664c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80440b0 tx=0x7fe4b8016ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe396ffd640 1 -- 172.21.15.177:0/2488696032 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b804a4f0 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe396ffd640 1 -- 172.21.15.177:0/2488696032 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b804a650 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559bfcb53860 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe396ffd640 1 -- 172.21.15.177:0/2488696032 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe4b80188e0 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559bfcb53860 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe396ffd640 1 -- 172.21.15.177:0/2488696032 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe4b803a020 con 0x559bfcb5f600 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe396ffd640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe390036830 0x7fe390038cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.232+0000 7fe396ffd640 1 -- 172.21.15.177:0/2488696032 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe4b8073d70 con 0x559bfcb5f600 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4bc866640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe390036830 0x7fe390038cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4bc866640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe390036830 0x7fe390038cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0052fd0 tx=0x7fe4b004f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfcb71d00 0x559bfcb741c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb74910 con 0x559bfcb71d00 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4c5868640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfcb71d00 0x559bfcb741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.233+0000 7fe4c5868640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfcb71d00 0x559bfcb741c0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 realm 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb74ce0 con 0x559bfcb71d00 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb758c0 con 0x559bfcb71d00 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb76270 0x559bfcb78660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb78c20 con 0x559bfcb76270 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.234+0000 7fe4c5067640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb76270 0x559bfcb78660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4c5067640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb76270 0x559bfcb78660 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4c9333800 20 searching for the correct realm 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559bfcb7af30 0x559bfcb7d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb7dac0 con 0x559bfcb7af30 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4bc866640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559bfcb7af30 0x559bfcb7d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.235+0000 7fe4bc866640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559bfcb7af30 0x559bfcb7d3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.236+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.236+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb7dac0 con 0x559bfcb76270 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.236+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.236+0000 7fe4c5067640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe4b8052030 0x7fe4b8037930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.236+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb7dac0 con 0x7fe4b8052030 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.236+0000 7fe4c5868640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe4b8052030 0x7fe4b8037930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe4b8052030 0x7fe4b8037930 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.237+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.238+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.238+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.238+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.238+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb76270 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.238+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.238+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb76270 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.239+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.240+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.241+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.242+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.242+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb76270 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.242+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.242+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.242+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.242+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb76270 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb76270 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb7af30 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.243+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x7fe4b8052030 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb71d00 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb75560 con 0x559bfcb76270 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:12.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.244+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb79330 con 0x559bfcb71d00 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb79330 con 0x559bfcb71d00 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.245+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb796e0 con 0x7fe4b8052030 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 zone default found 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 4 Realm: () 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 zonegroup default 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb79ad0 con 0x7fe4b8052030 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb79ed0 con 0x559bfcb7af30 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb7f8e0 con 0x559bfcb7af30 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 started sync module instance, tier type = 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.246+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb7ed70 con 0x559bfcb76270 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.247+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.247+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94128448205136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb7f570 con 0x559bfcb76270 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.248+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb805e0 con 0x559bfcb71d00 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.249+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94128448205136] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.249+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.249+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94128448207936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb80990 con 0x559bfcb71d00 2024-03-20T13:36:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.249+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb813e0 con 0x559bfcb7af30 2024-03-20T13:36:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.250+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.250+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94128448212672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb81c70 con 0x559bfcb7af30 2024-03-20T13:36:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.250+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb826f0 con 0x559bfcb76270 2024-03-20T13:36:12.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.251+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94128448207936] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.251+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94128448212672] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.251+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.251+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94128448217584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb82ad0 con 0x559bfcb76270 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.251+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb832d0 con 0x559bfcb71d00 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.252+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.252+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94128448220368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb83290 con 0x559bfcb71d00 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.252+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb84230 con 0x7fe4b8052030 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.253+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94128448217584] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.253+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.254+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94128448220368] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.254+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94128448224624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb84230 con 0x7fe4b8052030 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.254+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb84780 con 0x7fe4b8052030 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.254+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.255+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94128448222720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb84c20 con 0x7fe4b8052030 2024-03-20T13:36:12.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.255+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb85600 con 0x7fe4b8052030 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.255+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94128448224624] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.255+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94128448222720] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'213 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94128448208992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb85120 con 0x7fe4b8052030 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=0 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=1 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=2 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=3 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=4 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=5 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c9333800 20 add_watcher() i=6 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.256+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94128448208992] v32'214 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.257+0000 7fe4c9333800 20 add_watcher() i=7 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.257+0000 7fe4c9333800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.257+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb88510 con 0x559bfcb71d00 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.257+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.257+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94128448227200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcb859b0 con 0x559bfcb71d00 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94128448227200] v32'212 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe37b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe4c9333800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe4c9333800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe4c9333800 5 note: GC not initialized 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe37a7e4640 20 reqs_thread_entry: start 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.258+0000 7fe4c9333800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 20 Filter name: none 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe2ebfff640 20 reqs_thread_entry: start 2024-03-20T13:36:12.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbba4f0 con 0x7fe4b8052030 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 bar [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv3 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.259+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbe120 con 0x559bfcb76270 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.260+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(63 bud [create,call,writefull 0~181] v32'3 uv3 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.260+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.260+0000 7fe4c9333800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.260+0000 7fe4c9333800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-03-20T13:36:12.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.260+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94128448461696 in=369b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbeda0 con 0x7fe4b8052030 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== watch-notify(notify (1) cookie 94128448224624 notify 137438953498 ret 0) v3 ==== 399+0+0 (crc 0 0 0) 0x7fe4c003d040 con 0x7fe4b8052030 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe3a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953498 cookie 94128448224624 notifier 4717 bl.length()=357 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe3a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe3a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(64 notify.5 [notify cookie 94128448461696 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe3a8ff9640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe388003e90 con 0x7fe4b8052030 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== watch-notify(notify_complete (2) cookie 94128448461696 notify 137438953498 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4c0018ce0 con 0x7fe4b8052030 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbdb80 con 0x559bfcb71d00 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv3 ondisk = 0) v8 ==== 155+0+184 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c9333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 : miss 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.261+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 8.0 8:0786fb48:root::.bucket.meta.myfoo6%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbbea0 con 0x559bfcb7af30 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 .bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 [call out=48b,stat out=16b,read 0~353 out=353b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 333+0+635 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=353 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 info.flags=0x17 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 to cache LRU end 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.262+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 8.0 8:0786fb48:root::.bucket.meta.myfoo6%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.9:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~353 in=353b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5fb0 con 0x559bfcb7af30 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.263+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(68 .bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 [delete,create,call,call,writefull 0~353,setxattr (117)] v32'2 uv2 ondisk = 0) v8 ==== 417+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.263+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 info.flags=0x17 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.263+0000 7fe4c9333800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 to cache LRU end 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.263+0000 7fe4c9333800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.263+0000 7fe4c9333800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9, ofs0, ns] 2024-03-20T13:36:12.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.263+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94128448455440 in=733b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc4c00 con 0x7fe4b8052030 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== watch-notify(notify (1) cookie 94128448222720 notify 137438953499 ret 0) v3 ==== 763+0+0 (crc 0 0 0) 0x7fe4c0018ce0 con 0x7fe4b8052030 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe397fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953499 cookie 94128448222720 notifier 4717 bl.length()=721 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe397fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 info.flags=0x17 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe397fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 to cache LRU end 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe397fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(69 notify.6 [notify cookie 94128448455440 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe397fff640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe2f8003520 con 0x7fe4b8052030 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(70 notify.6 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== watch-notify(notify_complete (2) cookie 94128448455440 notify 137438953499 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4c0042690 con 0x7fe4b8052030 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c9333800 20 handle_bi_update(): bucket=:myfoo6[3852dce3-594b-4724-bee1-f3dae77b7611.4225.9]): orig_sources= new_sources= 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c9333800 20 handle_bi_update(): bucket=:myfoo6[3852dce3-594b-4724-bee1-f3dae77b7611.4225.9]): potential sources added=[] removed=[] 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c9333800 20 handle_bi_update(): bucket=:myfoo6[3852dce3-594b-4724-bee1-f3dae77b7611.4225.9]): orig_dests= new_dests= 2024-03-20T13:36:12.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c9333800 20 handle_bi_update(): bucket=:myfoo6[3852dce3-594b-4724-bee1-f3dae77b7611.4225.9]): potential dests added=[] removed=[] 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.264+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbc310 con 0x559bfcb71d00 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(71 bud.buckets [call] v32'3 uv0 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 20 rados->read ofs=0 len=0 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb71d00 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(72 myfoo6 [call out=48b,read 0~166 out=166b,getxattrs out=75b] v0'0 uv16 ondisk = 0) v8 ==== 234+0+289 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 20 rados_obj.operate() r=0 bl.length=166 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x13 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.265+0000 7fe4c9333800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c9333800 0 bucket entry point user mismatch, can't unlink bucket: bar != bud 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 4.1e 4:7a737f42:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x7fe4b8052030 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(73 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.0 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:74 4.24 4:26b0db4c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x7fe4b8052030 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(74 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:75 4.a 4:5073260b:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb76270 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.266+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(75 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.2 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 4.2 4:41d176d3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb71d00 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:77 4.35 4:ac5d3f1c:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb71d00 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(77 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.4 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 4.3f 4:ff86f8f8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb76270 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(78 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.5 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.267+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:79 4.3c 4:3ce6f7a4:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb71d00 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.268+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(79 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.6 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.268+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:80 4.3b 4:dd98ba4e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb76270 2024-03-20T13:36:12.289 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.268+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(80 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.7 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4b8063020 con 0x559bfcb76270 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.268+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:81 4.15 4:a93c3842:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb7af30 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.268+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(81 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.268+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:82 4.2 4:4191db26:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5950 con 0x559bfcb71d00 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(82 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9 [call out=376b] v0'0 uv6 ondisk = 0) v8 ==== 194+0+376 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 10 cls_bucket_list_unordered: got thirteen 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:83 4.36 4:6da7644a:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc4c50 con 0x559bfcb71d00 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(83 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.10 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 get_obj_state: octx=0x559bfcbba370 obj=myfoo6:thirteen state=0x559bfcbbf308 s->prefetch_data=0 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 3.2fs0 3:f6a537ba:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.9_thirteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc4c50 con 0x559bfcb7af30 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(84 3852dce3-594b-4724-bee1-f3dae77b7611.4225.9_thirteen [getxattrs out=852b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 238+0+868 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 10 manifest: total_size = 8 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.552597672775409774 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.acl 2024-03-20T13:36:12.290 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.content_type 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.etag 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.idtag 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.manifest 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 get_obj_state: octx=0x559bfcbba370 obj=myfoo6:thirteen state=0x559bfcbbf308 s->prefetch_data=0 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 : hit (requested=0x17, cached=0x17) 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:3852dce3-594b-4724-bee1-f3dae77b7611.4225.9 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.269+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:85 4.2 4:4191db26:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc3d70 con 0x559bfcb71d00 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.270+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(85 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9 [stat,call,call] v32'7 uv7 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.270+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 3.2fs0 3:f6a537ba:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.9_thirteen:head [cmpxattr user.rgw.idtag (61) op 1 mode 1 in=75b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc3d70 con 0x559bfcb7af30 2024-03-20T13:36:12.291 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.272+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(86 3852dce3-594b-4724-bee1-f3dae77b7611.4225.9_thirteen [cmpxattr (61) op 1 mode 1,setxattr (117),setxattr (33)] v32'4 uv4 ondisk = 0) v8 ==== 280+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.272+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:87 4.2 4:4191db26:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc9640 con 0x559bfcb71d00 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:1 objects processed in :myfoo6[3852dce3-594b-4724-bee1-f3dae77b7611.4225.9]). Next marker thirteen 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.272+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:88 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbe780 con 0x559bfcb76270 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(87 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.9.9 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe3a8ff9640 20 handle_completion(): completion ok for obj=thirteen 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(88 bud [delete,create,call,writefull 0~346] v32'4 uv4 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fe4b8091040 con 0x559bfcb76270 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe4c9333800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe4c9333800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.273+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:89 7.3 7:c609908c:::notify.5:head [notify cookie 94128448485584 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbf0b0 con 0x7fe4b8052030 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== watch-notify(notify (1) cookie 94128448224624 notify 137438953500 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fe4c0042690 con 0x7fe4b8052030 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe397fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953500 cookie 94128448224624 notifier 4717 bl.length()=522 2024-03-20T13:36:12.292 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe397fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe397fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(89 notify.5 [notify cookie 94128448485584 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe397fff640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe2f80030c0 con 0x7fe4b8052030 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(90 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== watch-notify(notify_complete (2) cookie 94128448485584 notify 137438953500 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4c0042b30 con 0x7fe4b8052030 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.274+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:91 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5050 con 0x559bfcb71d00 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.275+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(91 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v32'4 uv4 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.275+0000 7fe4c9333800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.275+0000 7fe4c9333800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.275+0000 7fe4c9333800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.275+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 7.3 7:c609908c:::notify.5:head [notify cookie 94128448485584 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbf0b0 con 0x7fe4b8052030 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== watch-notify(notify (1) cookie 94128448224624 notify 137438953501 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x7fe4c0042b30 con 0x7fe4b8052030 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe3a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953501 cookie 94128448224624 notifier 4717 bl.length()=177 2024-03-20T13:36:12.293 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe3a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe3a8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe3a8ff9640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:93 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe388003e90 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(92 notify.5 [notify cookie 94128448485584 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(93 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== watch-notify(notify_complete (2) cookie 94128448485584 notify 137438953501 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4c005c560 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c9333800 10 removing user index: bar 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c9333800 10 removing default.rgw.meta+users.uid+bar from cache 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c9333800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 7.9 7:93e5b521:::notify.7:head [notify cookie 94128448485584 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbbf0b0 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== watch-notify(notify (1) cookie 94128448208992 notify 137438953502 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fe4c005c560 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe397fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953502 cookie 94128448208992 notifier 4717 bl.length()=152 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe397fff640 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:95 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe2f80030c0 con 0x7fe4b8052030 2024-03-20T13:36:12.294 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.276+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(94 notify.7 [notify cookie 94128448485584 out=8b] v0'0 uv213 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.277+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(95 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.277+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== watch-notify(notify_complete (2) cookie 94128448485584 notify 137438953502 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fe4c005c6f0 con 0x7fe4b8052030 2024-03-20T13:36:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.277+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:96 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcbc5050 con 0x7fe4b8052030 2024-03-20T13:36:12.295 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.278+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(96 bar [delete] v32'4 uv4 ondisk = 0) v8 ==== 147+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.295 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:12.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.278+0000 7fe37b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:12.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.278+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:97 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94128448227200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x559bfcb71d00 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.279+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(97 data_loggenerations_metadata [watch unwatch cookie 94128448227200] v32'213 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.279+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94128448205136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x559bfcb76270 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.280+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(98 notify.0 [watch unwatch cookie 94128448205136] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b8091040 con 0x559bfcb76270 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.280+0000 7fe4c9333800 20 remove_watcher() i=0 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.280+0000 7fe4c9333800 2 removed watcher, disabling cache 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.280+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94128448207936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fe4c0031040 con 0x559bfcb71d00 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.282+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(99 notify.1 [watch unwatch cookie 94128448207936] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.282+0000 7fe4c9333800 20 remove_watcher() i=1 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.282+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:100 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94128448212672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x559bfcb7af30 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.283+0000 7fe4bc866640 1 -- 172.21.15.177:0/2488696032 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(100 notify.2 [watch unwatch cookie 94128448212672] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b0052b40 con 0x559bfcb7af30 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.283+0000 7fe4c9333800 20 remove_watcher() i=2 2024-03-20T13:36:12.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.283+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:101 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94128448217584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x559bfcb76270 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.284+0000 7fe4c5067640 1 -- 172.21.15.177:0/2488696032 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(101 notify.3 [watch unwatch cookie 94128448217584] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4b8091040 con 0x559bfcb76270 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.284+0000 7fe4c9333800 20 remove_watcher() i=3 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.284+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:102 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94128448220368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x559bfcb71d00 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.285+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(102 notify.4 [watch unwatch cookie 94128448220368] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x559bfcb71d00 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.285+0000 7fe4c9333800 20 remove_watcher() i=4 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.285+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94128448224624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x7fe4b8052030 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.286+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(103 notify.5 [watch unwatch cookie 94128448224624] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.286+0000 7fe4c9333800 20 remove_watcher() i=5 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.286+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94128448222720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x7fe4b8052030 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.287+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(104 notify.6 [watch unwatch cookie 94128448222720] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.287+0000 7fe4c9333800 20 remove_watcher() i=6 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.287+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:105 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94128448208992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x559bfcba4450 con 0x7fe4b8052030 2024-03-20T13:36:12.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(105 notify.7 [watch unwatch cookie 94128448208992] v32'215 uv213 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe4c000a4a0 con 0x7fe4b8052030 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 20 remove_watcher() i=7 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe4b8052030 msgr2=0x7fe4b8037930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe4b8052030 0x7fe4b8037930 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfcb71d00 msgr2=0x559bfcb741c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfcb71d00 0x559bfcb741c0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb76270 msgr2=0x559bfcb78660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb76270 0x559bfcb78660 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559bfcb7af30 msgr2=0x559bfcb7d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x559bfcb7af30 0x559bfcb7d3f0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe390036830 msgr2=0x7fe390038cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe390036830 0x7fe390038cf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0052fd0 tx=0x7fe4b004f000 comp rx=0 tx=0).stop 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 msgr2=0x559bfcb664c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c5868640 1 -- 172.21.15.177:0/2488696032 reap_dead start 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb664c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80440b0 tx=0x7fe4b8016ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 shutdown_connections 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/2488696032 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb5f600 0x559bfcb664c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 >> 172.21.15.177:0/2488696032 conn(0x559bfcb5b880 msgr2=0x559bfcb58ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 shutdown_connections 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/2488696032 wait complete. 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3a0036790 msgr2=0x7fe3a0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.288+0000 7fe4c9333800 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3a0036790 0x7fe3a0038c50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x559bfcb2a640 tx=0x7fe4b0005ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 msgr2=0x559bfcb528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 0x559bfcb528b0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fe4b804a210 tx=0x7fe4b800e630 comp rx=0 tx=0).stop 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 shutdown_connections 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3a0036790 0x7fe3a0038c50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/4025599358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfcb52490 0x559bfcb528b0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 >> 172.21.15.177:0/4025599358 conn(0x559bfcb46530 msgr2=0x559bfcb46930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 shutdown_connections 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/4025599358 wait complete. 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559bfcb41830 msgr2=0x559bfcb43c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x559bfcb41830 0x559bfcb43c20 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfca3de70 msgr2=0x559bfcb3b4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x559bfca3de70 0x559bfcb3b4d0 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb3d7f0 msgr2=0x559bfcb3fc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x559bfcb3d7f0 0x559bfcb3fc80 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3ac0367e0 msgr2=0x7fe3ac038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe3ac0367e0 0x7fe3ac038ca0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0054000 tx=0x7fe4b004e000 comp rx=0 tx=0).stop 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 msgr2=0x559bfcb2b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 --2- 172.21.15.177:0/880039948 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x559bfca399e0 0x559bfcb2b0d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fe4b800b5f0 tx=0x7fe4b8000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:12.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c5868640 1 -- 172.21.15.177:0/880039948 reap_dead start 2024-03-20T13:36:12.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 shutdown_connections 2024-03-20T13:36:12.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 >> 172.21.15.177:0/880039948 conn(0x559bfca35040 msgr2=0x559bfcb23af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:12.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 shutdown_connections 2024-03-20T13:36:12.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:12.289+0000 7fe4c9333800 1 -- 172.21.15.177:0/880039948 wait complete. 2024-03-20T13:36:12.306 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:17.312 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:17.313 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-03-20T13:36:17.313 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-03-20T13:36:17.313 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-03-20T13:36:17.313 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-03-20T13:36:17.371 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:17.371 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:17.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.369+0000 7fb92fb2c800 1 Processor -- start 2024-03-20T13:36:17.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.369+0000 7fb92fb2c800 1 -- start start 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92fb2c800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55646381c130 0x55646381e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92fb2c800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556463762d00 con 0x556463818620 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92fb2c800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x556463719500 con 0x55646381c130 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92aff6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55646381c130 0x55646381e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92b7f7640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x556463818620 0x55646381aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:39700/0 (socket says 172.21.15.177:39700) 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92aff6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55646381c130 0x55646381e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42038/0 (socket says 172.21.15.177:42038) 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92b7f7640 1 -- 172.21.15.177:0/2057251014 learned_addr learned my addr 172.21.15.177:0/2057251014 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92a7f5640 1 -- 172.21.15.177:0/2057251014 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818877317 0 0) 0x556463762d00 con 0x556463818620 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92a7f5640 1 -- 172.21.15.177:0/2057251014 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb914001e10 con 0x556463818620 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92aff6640 1 -- 172.21.15.177:0/2057251014 >> v1:172.21.15.28:6789/0 conn(0x556463818620 legacy=0x55646381aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.370+0000 7fb92aff6640 1 -- 172.21.15.177:0/2057251014 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646381fa70 con 0x55646381c130 2024-03-20T13:36:17.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.372+0000 7fb92aff6640 1 --2- 172.21.15.177:0/2057251014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646381c130 0x55646381e520 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb92000a470 tx=0x7fb92001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51aa83b1dcaf81d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92a7f5640 1 -- 172.21.15.177:0/2057251014 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb92004ad60 con 0x55646381c130 2024-03-20T13:36:17.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92a7f5640 1 -- 172.21.15.177:0/2057251014 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb920052440 con 0x55646381c130 2024-03-20T13:36:17.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92a7f5640 1 -- 172.21.15.177:0/2057251014 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb920052700 con 0x55646381c130 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2057251014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646381c130 msgr2=0x55646381e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/2057251014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646381c130 0x55646381e520 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb92000a470 tx=0x7fb92001cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2057251014 shutdown_connections 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/2057251014 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646381c130 0x55646381e520 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2057251014 >> 172.21.15.177:0/2057251014 conn(0x556463812070 msgr2=0x556463814490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2057251014 shutdown_connections 2024-03-20T13:36:17.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.373+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2057251014 wait complete. 2024-03-20T13:36:17.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92fb2c800 1 Processor -- start 2024-03-20T13:36:17.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92fb2c800 1 -- start start 2024-03-20T13:36:17.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92fb2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463817f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92fb2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463716a30 con 0x556463818620 2024-03-20T13:36:17.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463817f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463817f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42050/0 (socket says 172.21.15.177:42050) 2024-03-20T13:36:17.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3775959527 learned_addr learned my addr 172.21.15.177:0/3775959527 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.387+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3775959527 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb920005d20 con 0x556463818620 2024-03-20T13:36:17.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.388+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/3775959527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463817f60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006e50 tx=0x7fb91c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee636b7048bb66af server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.388+0000 7fb81960a640 1 -- 172.21.15.177:0/3775959527 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c004520 con 0x556463818620 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.388+0000 7fb81960a640 1 -- 172.21.15.177:0/3775959527 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c004680 con 0x556463818620 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.388+0000 7fb81960a640 1 -- 172.21.15.177:0/3775959527 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c004960 con 0x556463818620 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.388+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3775959527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 msgr2=0x556463817f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.388+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3775959527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463817f60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb91c006e50 tx=0x7fb91c001a20 comp rx=0 tx=0).stop 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3775959527 shutdown_connections 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3775959527 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463817f60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3775959527 >> 172.21.15.177:0/3775959527 conn(0x556463812070 msgr2=0x5564639032c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3775959527 shutdown_connections 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3775959527 wait complete. 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 Processor -- start 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 -- start start 2024-03-20T13:36:17.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463911200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92fb2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463712210 con 0x556463818620 2024-03-20T13:36:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463911200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463911200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42054/0 (socket says 172.21.15.177:42054) 2024-03-20T13:36:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.389+0000 7fb92b7f7640 1 -- 172.21.15.177:0/1417683740 learned_addr learned my addr 172.21.15.177:0/1417683740 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.393 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb92b7f7640 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb914001e10 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463911200 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb91c000f80 tx=0x7fb91c001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb817e07640 1 -- 172.21.15.177:0/1417683740 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c0147f0 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb817e07640 1 -- 172.21.15.177:0/1417683740 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c014950 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556463911740 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb817e07640 1 -- 172.21.15.177:0/1417683740 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c014c10 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.390+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556463911c20 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb817e07640 1 -- 172.21.15.177:0/1417683740 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb91c01e3f0 con 0x556463818620 2024-03-20T13:36:17.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb817e07640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8100367e0 0x7fb810038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb817e07640 1 -- 172.21.15.177:0/1417683740 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb91c04c520 con 0x556463818620 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb92aff6640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8100367e0 0x7fb810038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646381c130 0x556463917f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463918520 con 0x55646381c130 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.391+0000 7fb92bff8640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646381c130 0x556463917f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92aff6640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8100367e0 0x7fb810038ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb920054000 tx=0x7fb92004e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92bff8640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646381c130 0x556463917f50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92bff8640 1 -- 172.21.15.177:0/1417683740 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646381c130 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639155c0 con 0x55646381c130 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92bff8640 1 -- 172.21.15.177:0/1417683740 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9240083e0 con 0x55646381c130 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55646391a760 0x55646391cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.392+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646391d240 con 0x55646391a760 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.393+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55646391a760 0x55646391cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.393+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55646391a760 0x55646391cb50 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.393+0000 7fb92b7f7640 1 -- 172.21.15.177:0/1417683740 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fb91c024070 con 0x55646391a760 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.393+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639196e0 con 0x55646381c130 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.393+0000 7fb92bff8640 1 -- 172.21.15.177:0/1417683740 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9240083e0 con 0x55646381c130 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.394+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55646391e660 0x556463920a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.394+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463921190 con 0x55646391e660 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.394+0000 7fb92aff6640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55646391e660 0x556463920a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.394+0000 7fb92aff6640 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55646391e660 0x556463920a50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92aff6640 1 -- 172.21.15.177:0/1417683740 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fb920065040 con 0x55646391e660 2024-03-20T13:36:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92fb2c800 1 Processor -- start 2024-03-20T13:36:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92fb2c800 1 -- start start 2024-03-20T13:36:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92fb2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 0x55646392f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.407 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92fb2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564636b4c70 con 0x55646392f370 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 0x55646392f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 0x55646392f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42062/0 (socket says 172.21.15.177:42062) 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.395+0000 7fb92b7f7640 1 -- 172.21.15.177:0/2910555692 learned_addr learned my addr 172.21.15.177:0/2910555692 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb92b7f7640 1 -- 172.21.15.177:0/2910555692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646392fcd0 con 0x55646392f370 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 0x55646392f790 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb91c01d510 tx=0x7fb91c04af60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb815602640 1 -- 172.21.15.177:0/2910555692 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c010a20 con 0x55646392f370 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb815602640 1 -- 172.21.15.177:0/2910555692 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c044090 con 0x55646392f370 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb815602640 1 -- 172.21.15.177:0/2910555692 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c044330 con 0x55646392f370 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556463930740 con 0x55646392f370 2024-03-20T13:36:17.408 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.396+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556463930740 con 0x55646392f370 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.397+0000 7fb815602640 1 -- 172.21.15.177:0/2910555692 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb91c044490 con 0x55646392f370 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.397+0000 7fb815602640 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8040367e0 0x7fb804038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.397+0000 7fb815602640 1 -- 172.21.15.177:0/2910555692 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb91c007000 con 0x55646392f370 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.397+0000 7fb92aff6640 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8040367e0 0x7fb804038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.397+0000 7fb92fb2c800 1 Processor -- start 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.397+0000 7fb92fb2c800 1 -- start start 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92aff6640 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8040367e0 0x7fb804038ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x556463915940 tx=0x7fb920005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92fb2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x55646393c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92fb2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646368a5d0 con 0x55646393c380 2024-03-20T13:36:17.409 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x55646393c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x55646393c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42064/0 (socket says 172.21.15.177:42064) 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92b7f7640 1 -- 172.21.15.177:0/185044502 learned_addr learned my addr 172.21.15.177:0/185044502 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92b7f7640 1 -- 172.21.15.177:0/185044502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646393cd70 con 0x55646393c380 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/185044502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x55646393c7a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb91c008fd0 tx=0x7fb91c0394c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=292cfa436b118f8c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb80effd640 1 -- 172.21.15.177:0/185044502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c030530 con 0x55646393c380 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb80effd640 1 -- 172.21.15.177:0/185044502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c053070 con 0x55646393c380 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.398+0000 7fb80effd640 1 -- 172.21.15.177:0/185044502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c01db30 con 0x55646393c380 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- 172.21.15.177:0/185044502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 msgr2=0x55646393c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/185044502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x55646393c7a0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fb91c008fd0 tx=0x7fb91c0394c0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- 172.21.15.177:0/185044502 shutdown_connections 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/185044502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x55646393c7a0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- 172.21.15.177:0/185044502 >> 172.21.15.177:0/185044502 conn(0x556463938600 msgr2=0x556463936660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.410 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- 172.21.15.177:0/185044502 shutdown_connections 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- 172.21.15.177:0/185044502 wait complete. 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 Processor -- start 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- start start 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x556463943300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.399+0000 7fb92fb2c800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556463943840 con 0x55646393c380 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x556463943300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92b7f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x556463943300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42074/0 (socket says 172.21.15.177:42074) 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 learned_addr learned my addr 172.21.15.177:0/3862301203 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646392fcd0 con 0x55646393c380 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x556463943300 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb91c008fd0 tx=0x7fb91c02cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb80d7fa640 1 -- 172.21.15.177:0/3862301203 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c06a070 con 0x55646393c380 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb80d7fa640 1 -- 172.21.15.177:0/3862301203 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c0080e0 con 0x55646393c380 2024-03-20T13:36:17.411 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55646392fcd0 con 0x55646393c380 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb80d7fa640 1 -- 172.21.15.177:0/3862301203 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb91c030790 con 0x55646393c380 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.400+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55646392fcd0 con 0x55646393c380 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.401+0000 7fb80d7fa640 1 -- 172.21.15.177:0/3862301203 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb91c0308f0 con 0x55646393c380 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.401+0000 7fb80d7fa640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7f40367e0 0x7fb7f4038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.401+0000 7fb80d7fa640 1 -- 172.21.15.177:0/3862301203 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb91c074a90 con 0x55646393c380 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92aff6640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7f40367e0 0x7fb7f4038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646394eb20 0x556463950fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463951730 con 0x55646394eb20 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92aff6640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7f40367e0 0x7fb7f4038ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x556463921530 tx=0x7fb92005e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92bff8640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646394eb20 0x556463950fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.402+0000 7fb92bff8640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646394eb20 0x556463950fe0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.412 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 realm 2024-03-20T13:36:17.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463951b00 con 0x55646394eb20 2024-03-20T13:36:17.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.413 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639526e0 con 0x55646394eb20 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.414 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556463953090 0x556463955480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463955a90 con 0x556463953090 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.403+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556463953090 0x556463955480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556463953090 0x556463955480 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92fb2c800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92fb2c800 20 searching for the correct realm 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556463957da0 0x55646395a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395a930 con 0x556463957da0 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92aff6640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556463957da0 0x55646395a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.415 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.404+0000 7fb92aff6640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556463957da0 0x55646395a260 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.405+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.405+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395a930 con 0x556463953090 2024-03-20T13:36:17.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.405+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.405+0000 7fb92b7f7640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb91c04c050 0x7fb91c00c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.405+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395a930 con 0x7fb91c04c050 2024-03-20T13:36:17.416 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.405+0000 7fb92bff8640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb91c04c050 0x7fb91c00c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.406+0000 7fb92bff8640 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb91c04c050 0x7fb91c00c150 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.406+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.406+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.406+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.406+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.407+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.428 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.407+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.407+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.407+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.407+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.407+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463953090 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.408+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.408+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.408+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.408+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.408+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.408+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.429 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463953090 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.409+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.410+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.410+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.410+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.430 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.410+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.410+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.410+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.411+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463953090 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.431 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463953090 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.412+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463953090 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463957da0 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.413+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x7fb91c04c050 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.414+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.414+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x55646394eb20 2024-03-20T13:36:17.432 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.414+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.414+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463952380 con 0x556463953090 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639561a0 con 0x55646394eb20 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.433 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463956550 con 0x55646394eb20 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.415+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463956550 con 0x7fb91c04c050 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 zone default found 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 4 Realm: () 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:17.434 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 zonegroup default 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463956dd0 con 0x7fb91c04c050 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463956dd0 con 0x556463957da0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.416+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395c7d0 con 0x556463957da0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.417+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.417+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.417+0000 7fb92fb2c800 20 started sync module instance, tier type = 2024-03-20T13:36:17.435 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.417+0000 7fb92fb2c800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.417+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395c030 con 0x556463953090 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.418+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.418+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93889655847824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395d090 con 0x556463953090 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.418+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395d890 con 0x55646394eb20 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.419+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 93889655847824] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.419+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.419+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93889655854064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395dcb0 con 0x55646394eb20 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.419+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395e530 con 0x556463957da0 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.420+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93889655854064] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.420+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.420+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93889655855600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395e8e0 con 0x556463957da0 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.420+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395f310 con 0x556463953090 2024-03-20T13:36:17.436 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.421+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.421+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93889655862976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395ff80 con 0x556463953090 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.421+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463960970 con 0x55646394eb20 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.422+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 93889655855600] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.423+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 93889655862976] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.423+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.423+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93889655866448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395fae0 con 0x55646394eb20 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.423+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639611c0 con 0x7fb91c04c050 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.424+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93889655866448] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.424+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.424+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93889655856752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639610f0 con 0x7fb91c04c050 2024-03-20T13:36:17.437 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.424+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639618f0 con 0x7fb91c04c050 2024-03-20T13:36:17.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.425+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(56 notify.6 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.425+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93889655870160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463961cd0 con 0x7fb91c04c050 2024-03-20T13:36:17.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.425+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639627a0 con 0x7fb91c04c050 2024-03-20T13:36:17.438 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.425+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93889655856752] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.426+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'216 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.426+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93889655870160] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.426+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93889655874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463960c50 con 0x7fb91c04c050 2024-03-20T13:36:17.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=0 2024-03-20T13:36:17.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=1 2024-03-20T13:36:17.443 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=2 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=3 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=4 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=5 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.427+0000 7fb92fb2c800 20 add_watcher() i=6 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.428+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93889655874176] v32'217 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.428+0000 7fb92fb2c800 20 add_watcher() i=7 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.428+0000 7fb92fb2c800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.428+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463965790 con 0x55646394eb20 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.428+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.428+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93889655871344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463962c00 con 0x55646394eb20 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.429+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93889655871344] v32'214 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.429+0000 7fb7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.444 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.429+0000 7fb92fb2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.429+0000 7fb92fb2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.429+0000 7fb92fb2c800 5 note: GC not initialized 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.429+0000 7fb7e0fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 20 Filter name: none 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb75a7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463997660 con 0x7fb91c04c050 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:36:17.445 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463995cf0 con 0x7fb91c04c050 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 206+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.430+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~346 in=346b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639960d0 con 0x7fb91c04c050 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~346] v32'5 uv5 ondisk = 0) v8 ==== 273+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92fb2c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92fb2c800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92fb2c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:36:17.446 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 93889656090816 in=534b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646399abc0 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== watch-notify(notify (1) cookie 93889655856752 notify 137438953503 ret 0) v3 ==== 564+0+0 (crc 0 0 0) 0x7fb92400abd0 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb80effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953503 cookie 93889655856752 notifier 4724 bl.length()=522 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb80effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb80effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(65 notify.5 [notify cookie 93889656090816 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb80effd640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb7f0003e90 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== watch-notify(notify_complete (2) cookie 93889656090816 notify 137438953503 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb92400ae30 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.432+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639970c0 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v32'9 uv9 ondisk = 0) v8 ==== 248+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92fb2c800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92fb2c800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:36:17.447 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92fb2c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93889656090816 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646399ab90 con 0x556463957da0 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== watch-notify(notify (1) cookie 93889655855600 notify 137438953482 ret 0) v3 ==== 219+0+0 (crc 0 0 0) 0x55646381fa70 con 0x556463957da0 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb80e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953482 cookie 93889655855600 notifier 4724 bl.length()=177 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb80e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb80e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(68 notify.2 [notify cookie 93889656090816 out=8b] v0'0 uv216 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb80e7fc640 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fb7600033f0 con 0x556463957da0 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.434+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== watch-notify(notify_complete (2) cookie 93889656090816 notify 137438953482 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fb92004e070 con 0x556463957da0 2024-03-20T13:36:17.448 INFO:teuthology.orchestra.run.smithi177.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2024-03-20T13:36:17.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.435+0000 7fb7e1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.435+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93889655871344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x5564639651a0 con 0x55646394eb20 2024-03-20T13:36:17.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.436+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93889655871344] v32'215 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.436+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93889655847824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x556463961770 con 0x556463953090 2024-03-20T13:36:17.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.437+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93889655847824] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.454 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.437+0000 7fb92fb2c800 20 remove_watcher() i=0 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.437+0000 7fb92fb2c800 2 removed watcher, disabling cache 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.437+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93889655854064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395bb90 con 0x55646394eb20 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.438+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93889655854064] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.438+0000 7fb92fb2c800 20 remove_watcher() i=1 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.438+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93889655855600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395bb90 con 0x556463957da0 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.439+0000 7fb92aff6640 1 -- 172.21.15.177:0/3862301203 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93889655855600] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb920065040 con 0x556463957da0 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.439+0000 7fb92fb2c800 20 remove_watcher() i=2 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.439+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93889655862976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395d9f0 con 0x556463953090 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.440+0000 7fb92b7f7640 1 -- 172.21.15.177:0/3862301203 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93889655862976] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb91c06c070 con 0x556463953090 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.440+0000 7fb92fb2c800 20 remove_watcher() i=3 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.440+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93889655866448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395bb90 con 0x55646394eb20 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.441+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93889655866448] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x55646394eb20 2024-03-20T13:36:17.455 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.441+0000 7fb92fb2c800 20 remove_watcher() i=4 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.441+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93889655856752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395d9f0 con 0x7fb91c04c050 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.443+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93889655856752] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.443+0000 7fb92fb2c800 20 remove_watcher() i=5 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.443+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93889655870160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395bb90 con 0x7fb91c04c050 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.444+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93889655870160] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.444+0000 7fb92fb2c800 20 remove_watcher() i=6 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.444+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93889655874176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55646395d9f0 con 0x7fb91c04c050 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93889655874176] v32'218 uv216 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fb9240083e0 con 0x7fb91c04c050 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 20 remove_watcher() i=7 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb91c04c050 msgr2=0x7fb91c00c150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fb91c04c050 0x7fb91c00c150 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646394eb20 msgr2=0x556463950fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646394eb20 0x556463950fe0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.456 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556463953090 msgr2=0x556463955480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x556463953090 0x556463955480 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556463957da0 msgr2=0x55646395a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x556463957da0 0x55646395a260 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7f40367e0 msgr2=0x7fb7f4038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb7f40367e0 0x7fb7f4038ca0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x556463921530 tx=0x7fb92005e040 comp rx=0 tx=0).stop 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 msgr2=0x556463943300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/3862301203 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646393c380 0x556463943300 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb91c008fd0 tx=0x7fb91c02cee0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 reap_dead start 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92bff8640 1 -- 172.21.15.177:0/3862301203 reap_dead start 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 shutdown_connections 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 >> 172.21.15.177:0/3862301203 conn(0x556463938600 msgr2=0x556463935c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 shutdown_connections 2024-03-20T13:36:17.457 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/3862301203 wait complete. 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8040367e0 msgr2=0x7fb804038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8040367e0 0x7fb804038ca0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x556463915940 tx=0x7fb920005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 msgr2=0x55646392f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.445+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 0x55646392f790 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb91c01d510 tx=0x7fb91c04af60 comp rx=0 tx=0).stop 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 shutdown_connections 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8040367e0 0x7fb804038ca0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/2910555692 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55646392f370 0x55646392f790 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 >> 172.21.15.177:0/2910555692 conn(0x556463923410 msgr2=0x556463923810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 shutdown_connections 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/2910555692 wait complete. 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55646391e660 msgr2=0x556463920a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55646391e660 0x556463920a50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646381c130 msgr2=0x556463917f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.458 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55646381c130 0x556463917f50 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55646391a760 msgr2=0x55646391cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55646391a760 0x55646391cb50 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8100367e0 msgr2=0x7fb810038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb8100367e0 0x7fb810038ca0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb920054000 tx=0x7fb92004e000 comp rx=0 tx=0).stop 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 msgr2=0x556463911200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 --2- 172.21.15.177:0/1417683740 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556463818620 0x556463911200 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb91c000f80 tx=0x7fb91c001250 comp rx=0 tx=0).stop 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92bff8640 1 -- 172.21.15.177:0/1417683740 reap_dead start 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 shutdown_connections 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 >> 172.21.15.177:0/1417683740 conn(0x556463812070 msgr2=0x5564638169c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 shutdown_connections 2024-03-20T13:36:17.459 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.446+0000 7fb92fb2c800 1 -- 172.21.15.177:0/1417683740 wait complete. 2024-03-20T13:36:17.460 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-03-20T13:36:17.472 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:17.477 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-03-20T13:36:17.477 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-03-20T13:36:17.477 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-03-20T13:36:17.478 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-03-20T13:36:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:17.522 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:17.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe942630800 1 Processor -- start 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe942630800 1 -- start start 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe942630800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56401fbbff60 0x56401fbc8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe942630800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56401fb0acd0 con 0x56401fbbe420 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe942630800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56401fac1500 con 0x56401fbbff60 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe935091640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56401fbbff60 0x56401fbc8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe93d892640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56401fbbe420 0x56401fbbe840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:39712/0 (socket says 172.21.15.177:39712) 2024-03-20T13:36:17.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe93d892640 1 -- 172.21.15.177:0/3994393312 learned_addr learned my addr 172.21.15.177:0/3994393312 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:17.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe935091640 1 -- 172.21.15.177:0/3994393312 >> v1:172.21.15.28:6789/0 conn(0x56401fbbe420 legacy=0x56401fbbe840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.521+0000 7fe935091640 1 -- 172.21.15.177:0/3994393312 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401fb32ee0 con 0x56401fbbff60 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.523+0000 7fe935091640 1 --2- 172.21.15.177:0/3994393312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbff60 0x56401fbc8a60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe92800a470 tx=0x7fe92801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86a97ae7a718202 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.523+0000 7fe93d091640 1 -- 172.21.15.177:0/3994393312 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe92804ad40 con 0x56401fbbff60 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe93d091640 1 -- 172.21.15.177:0/3994393312 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe928052440 con 0x56401fbbff60 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe93d091640 1 -- 172.21.15.177:0/3994393312 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe92804aea0 con 0x56401fbbff60 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 -- 172.21.15.177:0/3994393312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbff60 msgr2=0x56401fbc8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 --2- 172.21.15.177:0/3994393312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbff60 0x56401fbc8a60 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe92800a470 tx=0x7fe92801cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 -- 172.21.15.177:0/3994393312 shutdown_connections 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 --2- 172.21.15.177:0/3994393312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbff60 0x56401fbc8a60 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 -- 172.21.15.177:0/3994393312 >> 172.21.15.177:0/3994393312 conn(0x56401fbba040 msgr2=0x56401fbbc460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 -- 172.21.15.177:0/3994393312 shutdown_connections 2024-03-20T13:36:17.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.524+0000 7fe942630800 1 -- 172.21.15.177:0/3994393312 wait complete. 2024-03-20T13:36:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe942630800 1 Processor -- start 2024-03-20T13:36:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe942630800 1 -- start start 2024-03-20T13:36:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe942630800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe942630800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401fabea30 con 0x56401fbbe420 2024-03-20T13:36:17.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42084/0 (socket says 172.21.15.177:42084) 2024-03-20T13:36:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe93d892640 1 -- 172.21.15.177:0/473799139 learned_addr learned my addr 172.21.15.177:0/473799139 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.536+0000 7fe93d892640 1 -- 172.21.15.177:0/473799139 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928005d20 con 0x56401fbbe420 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.537+0000 7fe93d892640 1 --2- 172.21.15.177:0/473799139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb1ef0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe930001c50 tx=0x7fe93000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61688839a5ee7948 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.537+0000 7fe82be07640 1 -- 172.21.15.177:0/473799139 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93000e470 con 0x56401fbbe420 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.537+0000 7fe82be07640 1 -- 172.21.15.177:0/473799139 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000e5d0 con 0x56401fbbe420 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.537+0000 7fe82be07640 1 -- 172.21.15.177:0/473799139 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93000e8d0 con 0x56401fbbe420 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- 172.21.15.177:0/473799139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 msgr2=0x56401fcb1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 --2- 172.21.15.177:0/473799139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb1ef0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe930001c50 tx=0x7fe93000b6c0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- 172.21.15.177:0/473799139 shutdown_connections 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 --2- 172.21.15.177:0/473799139 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb1ef0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- 172.21.15.177:0/473799139 >> 172.21.15.177:0/473799139 conn(0x56401fbba040 msgr2=0x56401fcad690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- 172.21.15.177:0/473799139 shutdown_connections 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- 172.21.15.177:0/473799139 wait complete. 2024-03-20T13:36:17.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 Processor -- start 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- start start 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe942630800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401faba210 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42094/0 (socket says 172.21.15.177:42094) 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.538+0000 7fe93d892640 1 -- 172.21.15.177:0/3893405830 learned_addr learned my addr 172.21.15.177:0/3893405830 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe93d892640 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401fb0acd0 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe93d892640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb93d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe82a604640 1 -- 172.21.15.177:0/3893405830 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93001f070 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe82a604640 1 -- 172.21.15.177:0/3893405830 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930018770 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56401fcb9910 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe82a604640 1 -- 172.21.15.177:0/3893405830 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe930018a30 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.539+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56401fcb9df0 con 0x56401fbbe420 2024-03-20T13:36:17.544 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe82a604640 1 -- 172.21.15.177:0/3893405830 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe930018c20 con 0x56401fbbe420 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe82a604640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe824036790 0x7fe824038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe82a604640 1 -- 172.21.15.177:0/3893405830 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe93004c410 con 0x56401fbbe420 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe935091640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe824036790 0x7fe824038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fbbff60 0x56401fcc00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcc0690 con 0x56401fbbff60 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe93e093640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fbbff60 0x56401fcc00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.540+0000 7fe935091640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe824036790 0x7fe824038c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe928054000 tx=0x7fe92804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe93e093640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fbbff60 0x56401fcc00c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe93e093640 1 -- 172.21.15.177:0/3893405830 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fbbff60 2024-03-20T13:36:17.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcbd7b0 con 0x56401fbbff60 2024-03-20T13:36:17.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe93e093640 1 -- 172.21.15.177:0/3893405830 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fbbff60 2024-03-20T13:36:17.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcc28d0 0x56401fcc4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcc5390 con 0x56401fcc28d0 2024-03-20T13:36:17.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.541+0000 7fe93d892640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcc28d0 0x56401fcc4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.542+0000 7fe93d892640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcc28d0 0x56401fcc4cc0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.542+0000 7fe93d892640 1 -- 172.21.15.177:0/3893405830 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fe930014070 con 0x56401fcc28d0 2024-03-20T13:36:17.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.542+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcc1850 con 0x56401fbbff60 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.542+0000 7fe93e093640 1 -- 172.21.15.177:0/3893405830 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fbbff60 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.542+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56401fcc6790 0x56401fcc8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.542+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcc92e0 con 0x56401fcc6790 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.543+0000 7fe935091640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56401fcc6790 0x56401fcc8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.543+0000 7fe935091640 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56401fcc6790 0x56401fcc8b80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.543+0000 7fe935091640 1 -- 172.21.15.177:0/3893405830 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcc6790 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe942630800 1 Processor -- start 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe942630800 1 -- start start 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe942630800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 0x56401fcd7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe942630800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401fa5cc70 con 0x56401fcd74e0 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 0x56401fcd7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 0x56401fcd7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42104/0 (socket says 172.21.15.177:42104) 2024-03-20T13:36:17.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe93d892640 1 -- 172.21.15.177:0/2794976222 learned_addr learned my addr 172.21.15.177:0/2794976222 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.544+0000 7fe93d892640 1 -- 172.21.15.177:0/2794976222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401fcd7e40 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.545+0000 7fe93d892640 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 0x56401fcd7900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe93004a730 tx=0x7fe93004c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.545+0000 7fe8237fe640 1 -- 172.21.15.177:0/2794976222 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe930022ae0 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.545+0000 7fe8237fe640 1 -- 172.21.15.177:0/2794976222 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930033050 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.545+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56401fcd88b0 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.545+0000 7fe8237fe640 1 -- 172.21.15.177:0/2794976222 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe930022d70 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.545+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56401fcd8d70 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe8237fe640 1 -- 172.21.15.177:0/2794976222 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe93004ad50 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe8237fe640 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe818036790 0x7fe818038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe8237fe640 1 -- 172.21.15.177:0/2794976222 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe930049610 con 0x56401fcd74e0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe935091640 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe818036790 0x7fe818038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe942630800 1 Processor -- start 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe942630800 1 -- start start 2024-03-20T13:36:17.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe935091640 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe818036790 0x7fe818038c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x56401fcbd6f0 tx=0x7fe928005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe942630800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fce49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.546+0000 7fe942630800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401fa325d0 con 0x56401fce45b0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fce49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fce49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42116/0 (socket says 172.21.15.177:42116) 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe93d892640 1 -- 172.21.15.177:0/2080697910 learned_addr learned my addr 172.21.15.177:0/2080697910 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe93d892640 1 -- 172.21.15.177:0/2080697910 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401fce4fa0 con 0x56401fce45b0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe93d892640 1 --2- 172.21.15.177:0/2080697910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fce49d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe930022ff0 tx=0x7fe930024780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1781b4c0aafd5c8e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe8217fa640 1 -- 172.21.15.177:0/2080697910 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93000d570 con 0x56401fce45b0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe8217fa640 1 -- 172.21.15.177:0/2080697910 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93002d440 con 0x56401fce45b0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.547+0000 7fe8217fa640 1 -- 172.21.15.177:0/2080697910 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93000d960 con 0x56401fce45b0 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- 172.21.15.177:0/2080697910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 msgr2=0x56401fce49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 --2- 172.21.15.177:0/2080697910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fce49d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe930022ff0 tx=0x7fe930024780 comp rx=0 tx=0).stop 2024-03-20T13:36:17.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- 172.21.15.177:0/2080697910 shutdown_connections 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 --2- 172.21.15.177:0/2080697910 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fce49d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- 172.21.15.177:0/2080697910 >> 172.21.15.177:0/2080697910 conn(0x56401fce0880 msgr2=0x56401fcde8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- 172.21.15.177:0/2080697910 shutdown_connections 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- 172.21.15.177:0/2080697910 wait complete. 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 Processor -- start 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- start start 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fceb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe942630800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56401fceba60 con 0x56401fce45b0 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fceb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe93d892640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fceb520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42128/0 (socket says 172.21.15.177:42128) 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.548+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 learned_addr learned my addr 172.21.15.177:0/209611031 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56401fcd88b0 con 0x56401fce45b0 2024-03-20T13:36:17.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe93d892640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fceb520 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe9300245e0 tx=0x7fe93001fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe80f7fe640 1 -- 172.21.15.177:0/209611031 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93002ce70 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe80f7fe640 1 -- 172.21.15.177:0/209611031 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe930043f40 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56401fcd88b0 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe80f7fe640 1 -- 172.21.15.177:0/209611031 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe93002d770 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.549+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56401fcd88b0 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe80f7fe640 1 -- 172.21.15.177:0/209611031 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe930059070 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe80f7fe640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe8080367e0 0x7fe808038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe80f7fe640 1 -- 172.21.15.177:0/209611031 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe930056070 con 0x56401fce45b0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe935091640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe8080367e0 0x7fe808038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fcf6d80 0x56401fcf9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcf9990 con 0x56401fcf6d80 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.550+0000 7fe93e093640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fcf6d80 0x56401fcf9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe935091640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe8080367e0 0x7fe808038ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x56401fcc96a0 tx=0x7fe92805e040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe93e093640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fcf6d80 0x56401fcf9240 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 realm 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcf9d60 con 0x56401fcf6d80 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.551+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa940 con 0x56401fcf6d80 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcfb2f0 0x56401fcfd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfdcf0 con 0x56401fcfb2f0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe93d892640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcfb2f0 0x56401fcfd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe93d892640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcfb2f0 0x56401fcfd6e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 20 searching for the correct realm 2024-03-20T13:36:17.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56401fcfffa0 0x56401fd02460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.552+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd02ae0 con 0x56401fcfffa0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe935091640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56401fcfffa0 0x56401fd02460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe935091640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56401fcfffa0 0x56401fd02460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd02ae0 con 0x56401fcfb2f0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe93d892640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe93006e070 0x7fe93004c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.553+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd02ae0 con 0x7fe93006e070 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.554+0000 7fe93e093640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe93006e070 0x7fe93004c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.554+0000 7fe93e093640 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe93006e070 0x7fe93004c6f0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.554+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.554+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.555+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.556+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.557+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.558+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.559+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.560+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.560+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.560+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.560+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.560+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.560+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfffa0 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x7fe93006e070 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.561+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcf6d80 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfa5e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:17.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfe3e0 con 0x56401fcf6d80 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfe3e0 con 0x56401fcf6d80 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.562+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfe790 con 0x7fe93006e070 2024-03-20T13:36:17.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 zone default found 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 4 Realm: () 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 zonegroup default 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfeb80 con 0x7fe93006e070 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fcfef80 con 0x56401fcfffa0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.563+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd04900 con 0x56401fcfffa0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.564+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.564+0000 7fe942630800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.564+0000 7fe942630800 20 started sync module instance, tier type = 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.564+0000 7fe942630800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.564+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd03d90 con 0x56401fcfb2f0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.565+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.565+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94833411637568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd04560 con 0x56401fcfb2f0 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.565+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd05710 con 0x56401fcf6d80 2024-03-20T13:36:17.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.566+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94833411637568] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.566+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.566+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94833411641968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd05b30 con 0x56401fcf6d80 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.566+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd064a0 con 0x56401fcfffa0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.567+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.567+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94833411645440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd06d30 con 0x56401fcfffa0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.567+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd077e0 con 0x56401fcfb2f0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.567+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94833411641968] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.568+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.568+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94833411645440] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.568+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94833411643024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd08030 con 0x56401fcfb2f0 2024-03-20T13:36:17.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.568+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd06850 con 0x56401fcf6d80 2024-03-20T13:36:17.600 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.574+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.574+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94833411654912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd08dc0 con 0x56401fcf6d80 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.574+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd09730 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.576+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94833411643024] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.576+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94833411654912] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.576+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.576+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94833411658384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd08dc0 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.576+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd096b0 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.577+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94833411658384] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.577+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.577+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94833411655968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd08d40 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.577+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a590 con 0x7fe93006e070 2024-03-20T13:36:17.601 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'219 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94833411662064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a9b0 con 0x7fe93006e070 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=0 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=1 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=2 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=3 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=4 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=5 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94833411655968] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.578+0000 7fe942630800 20 add_watcher() i=6 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.579+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94833411662064] v32'220 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.579+0000 7fe942630800 20 add_watcher() i=7 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.579+0000 7fe942630800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:17.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.579+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd09ae0 con 0x56401fcf6d80 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.579+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.579+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94833411663120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd09ae0 con 0x56401fcf6d80 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.580+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94833411663120] v32'216 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.580+0000 7fe7ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.580+0000 7fe942630800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.580+0000 7fe942630800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe942630800 5 note: GC not initialized 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe7ee7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe942630800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe942630800 20 Filter name: none 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe75ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe942630800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe942630800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.581+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd3f900 con 0x56401fcfb2f0 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.582+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(62 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.582+0000 7fe942630800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.582+0000 7fe942630800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.582+0000 7fe942630800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.582+0000 7fe942630800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.582+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~181 in=181b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd435d0 con 0x7fe93006e070 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.583+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 fud [create,call,writefull 0~181] v32'6 uv5 ondisk = -17 ((17) File exists)) v8 ==== 231+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.583+0000 7fe7ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.583+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94833411663120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd17480 con 0x56401fcf6d80 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.584+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94833411663120] v32'217 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.584+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94833411637568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a510 con 0x56401fcfb2f0 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.585+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94833411637568] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.585+0000 7fe942630800 20 remove_watcher() i=0 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.585+0000 7fe942630800 2 removed watcher, disabling cache 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.585+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94833411641968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a510 con 0x56401fcf6d80 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.586+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94833411641968] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.586+0000 7fe942630800 20 remove_watcher() i=1 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.586+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94833411645440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd05270 con 0x56401fcfffa0 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.587+0000 7fe935091640 1 -- 172.21.15.177:0/209611031 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94833411645440] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe9280651d0 con 0x56401fcfffa0 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.587+0000 7fe942630800 20 remove_watcher() i=2 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.587+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94833411643024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a510 con 0x56401fcfb2f0 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.588+0000 7fe93d892640 1 -- 172.21.15.177:0/209611031 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94833411643024] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe930014070 con 0x56401fcfb2f0 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.588+0000 7fe942630800 20 remove_watcher() i=3 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.588+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94833411654912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a510 con 0x56401fcf6d80 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.589+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94833411654912] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x56401fcf6d80 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.589+0000 7fe942630800 20 remove_watcher() i=4 2024-03-20T13:36:17.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.589+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94833411658384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd08500 con 0x7fe93006e070 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.590+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94833411658384] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.591+0000 7fe942630800 20 remove_watcher() i=5 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.591+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94833411655968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd0a510 con 0x7fe93006e070 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.592+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94833411655968] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.592+0000 7fe942630800 20 remove_watcher() i=6 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.592+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94833411662064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56401fd09290 con 0x7fe93006e070 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94833411662064] v32'221 uv219 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fe93800a4a0 con 0x7fe93006e070 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 20 remove_watcher() i=7 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe93006e070 msgr2=0x7fe93004c6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fe93006e070 0x7fe93004c6f0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fcf6d80 msgr2=0x56401fcf9240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fcf6d80 0x56401fcf9240 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcfb2f0 msgr2=0x56401fcfd6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcfb2f0 0x56401fcfd6e0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56401fcfffa0 msgr2=0x56401fd02460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56401fcfffa0 0x56401fd02460 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe8080367e0 msgr2=0x7fe808038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe8080367e0 0x7fe808038ca0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x56401fcc96a0 tx=0x7fe92805e040 comp rx=0 tx=0).stop 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 msgr2=0x56401fceb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/209611031 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fce45b0 0x56401fceb520 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fe9300245e0 tx=0x7fe93001fef0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 reap_dead start 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe93e093640 1 -- 172.21.15.177:0/209611031 reap_dead start 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 shutdown_connections 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 >> 172.21.15.177:0/209611031 conn(0x56401fce0880 msgr2=0x56401fcddee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.607 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 shutdown_connections 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/209611031 wait complete. 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe818036790 msgr2=0x7fe818038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe818036790 0x7fe818038c50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x56401fcbd6f0 tx=0x7fe928005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 msgr2=0x56401fcd7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 0x56401fcd7900 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fe93004a730 tx=0x7fe93004c340 comp rx=0 tx=0).stop 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 shutdown_connections 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe818036790 0x7fe818038c50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 --2- 172.21.15.177:0/2794976222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fcd74e0 0x56401fcd7900 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 >> 172.21.15.177:0/2794976222 conn(0x56401fccb580 msgr2=0x56401fccb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 shutdown_connections 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.593+0000 7fe942630800 1 -- 172.21.15.177:0/2794976222 wait complete. 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56401fcc6790 msgr2=0x56401fcc8b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56401fcc6790 0x56401fcc8b80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.608 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fbbff60 msgr2=0x56401fcc00c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56401fbbff60 0x56401fcc00c0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcc28d0 msgr2=0x56401fcc4cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56401fcc28d0 0x56401fcc4cc0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe824036790 msgr2=0x7fe824038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe824036790 0x7fe824038c50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe928054000 tx=0x7fe92804e000 comp rx=0 tx=0).stop 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 msgr2=0x56401fcb93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 --2- 172.21.15.177:0/3893405830 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56401fbbe420 0x56401fcb93d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe930000c00 tx=0x7fe930000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe93e093640 1 -- 172.21.15.177:0/3893405830 reap_dead start 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 shutdown_connections 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 >> 172.21.15.177:0/3893405830 conn(0x56401fbba040 msgr2=0x56401fcabf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 shutdown_connections 2024-03-20T13:36:17.609 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.594+0000 7fe942630800 1 -- 172.21.15.177:0/3893405830 wait complete. 2024-03-20T13:36:17.610 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-03-20T13:36:17.615 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:17.615 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-03-20T13:36:17.619 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-03-20T13:36:17.619 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-03-20T13:36:17.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-03-20T13:36:17.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-03-20T13:36:17.620 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-03-20T13:36:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:17.663 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec97af800 1 Processor -- start 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec97af800 1 -- start start 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec97af800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563956bc89e0 0x563956bc8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec97af800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x563956b14cd0 con 0x563956bc9c40 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec97af800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x563956acb500 con 0x563956bc89e0 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec72ae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563956bc89e0 0x563956bc8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec6aad640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x563956bc9c40 0x563956bca0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:39716/0 (socket says 172.21.15.177:39716) 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec6aad640 1 -- 172.21.15.177:0/2061381939 learned_addr learned my addr 172.21.15.177:0/2061381939 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec72ae640 1 -- 172.21.15.177:0/2061381939 >> v1:172.21.15.28:6789/0 conn(0x563956bc9c40 legacy=0x563956bca0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.665 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.662+0000 7f2ec72ae640 1 -- 172.21.15.177:0/2061381939 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563956bc94d0 con 0x563956bc89e0 2024-03-20T13:36:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.664+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/2061381939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956bc8e00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800a600 tx=0x7f2eb801ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e53feb4df9ff8bc server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.666 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.664+0000 7f2ec62ac640 1 -- 172.21.15.177:0/2061381939 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb800a200 con 0x563956bc89e0 2024-03-20T13:36:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.664+0000 7f2ec62ac640 1 -- 172.21.15.177:0/2061381939 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb800a360 con 0x563956bc89e0 2024-03-20T13:36:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.664+0000 7f2ec62ac640 1 -- 172.21.15.177:0/2061381939 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb80086e0 con 0x563956bc89e0 2024-03-20T13:36:17.667 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 -- 172.21.15.177:0/2061381939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 msgr2=0x563956bc8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 --2- 172.21.15.177:0/2061381939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956bc8e00 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800a600 tx=0x7f2eb801ec40 comp rx=0 tx=0).stop 2024-03-20T13:36:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 -- 172.21.15.177:0/2061381939 shutdown_connections 2024-03-20T13:36:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 --2- 172.21.15.177:0/2061381939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956bc8e00 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 -- 172.21.15.177:0/2061381939 >> 172.21.15.177:0/2061381939 conn(0x563956bc4040 msgr2=0x563956bc6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 -- 172.21.15.177:0/2061381939 shutdown_connections 2024-03-20T13:36:17.668 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.665+0000 7f2ec97af800 1 -- 172.21.15.177:0/2061381939 wait complete. 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.676+0000 7f2ec97af800 1 Processor -- start 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec97af800 1 -- start start 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec97af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cb7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec97af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563956ac8a30 con 0x563956bc89e0 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cb7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cb7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42140/0 (socket says 172.21.15.177:42140) 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3069853664 learned_addr learned my addr 172.21.15.177:0/3069853664 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3069853664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8005d20 con 0x563956bc89e0 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.677+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/3069853664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cb7c30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8056040 tx=0x7f2eb804e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afc8a9707ebb1fb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.680 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2db560a640 1 -- 172.21.15.177:0/3069853664 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb80086c0 con 0x563956bc89e0 2024-03-20T13:36:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2db560a640 1 -- 172.21.15.177:0/3069853664 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb8008820 con 0x563956bc89e0 2024-03-20T13:36:17.681 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2db560a640 1 -- 172.21.15.177:0/3069853664 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8008ae0 con 0x563956bc89e0 2024-03-20T13:36:17.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 -- 172.21.15.177:0/3069853664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 msgr2=0x563956cb7c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3069853664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cb7c30 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8056040 tx=0x7f2eb804e000 comp rx=0 tx=0).stop 2024-03-20T13:36:17.685 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 -- 172.21.15.177:0/3069853664 shutdown_connections 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3069853664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cb7c30 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 -- 172.21.15.177:0/3069853664 >> 172.21.15.177:0/3069853664 conn(0x563956bc4040 msgr2=0x563956cb3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 -- 172.21.15.177:0/3069853664 shutdown_connections 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.678+0000 7f2ec97af800 1 -- 172.21.15.177:0/3069853664 wait complete. 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec97af800 1 Processor -- start 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec97af800 1 -- start start 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec97af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cbf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec97af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563956ac4210 con 0x563956bc89e0 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cbf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cbf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42154/0 (socket says 172.21.15.177:42154) 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.679+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3985519170 learned_addr learned my addr 172.21.15.177:0/3985519170 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8050070 con 0x563956bc89e0 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cbf290 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800a600 tx=0x7f2eb8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.686 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2db3e07640 1 -- 172.21.15.177:0/3985519170 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8060680 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2db3e07640 1 -- 172.21.15.177:0/3985519170 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb80607e0 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563956cbf7d0 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2db3e07640 1 -- 172.21.15.177:0/3985519170 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8060aa0 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.680+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563956cbfd10 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2db3e07640 1 -- 172.21.15.177:0/3985519170 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2eb8067040 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2db3e07640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2dac036790 0x7f2dac038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2db3e07640 1 -- 172.21.15.177:0/3985519170 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f2eb808f730 con 0x563956bc89e0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2dac036790 0x7f2dac038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956bc9c40 0x563956cc5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956cc6430 con 0x563956bc9c40 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2ec7aaf640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956bc9c40 0x563956cc5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.681+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2dac036790 0x7f2dac038c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f60 tx=0x7f2ebc0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec7aaf640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956bc9c40 0x563956cc5ef0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.687 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/3985519170 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956bc9c40 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956cc35f0 con 0x563956bc9c40 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/3985519170 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956bc9c40 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956cc8640 0x563956ccaa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956ccb0d0 con 0x563956cc8640 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.682+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956cc8640 0x563956ccaa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956cc8640 0x563956ccaa30 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3985519170 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f2eb804cdb0 con 0x563956cc8640 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956cc7500 con 0x563956bc9c40 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/3985519170 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956bc9c40 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563956ccc4d0 0x563956cce8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956ccef60 con 0x563956ccc4d0 2024-03-20T13:36:17.688 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.683+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563956ccc4d0 0x563956cce8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.684+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563956ccc4d0 0x563956cce8c0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.684+0000 7f2ec6aad640 1 -- 172.21.15.177:0/3985519170 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f2ebc006070 con 0x563956ccc4d0 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.684+0000 7f2ec97af800 1 Processor -- start 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec97af800 1 -- start start 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec97af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 0x563956ce1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec97af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563956a66c70 con 0x563956ce1500 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 0x563956ce1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 0x563956ce1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42166/0 (socket says 172.21.15.177:42166) 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3306931810 learned_addr learned my addr 172.21.15.177:0/3306931810 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.698 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3306931810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563956ce1e60 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 0x563956ce1920 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2eb808d9f0 tx=0x7f2eb805d810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2db1602640 1 -- 172.21.15.177:0/3306931810 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8083070 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2db1602640 1 -- 172.21.15.177:0/3306931810 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb8061a80 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563956ce28d0 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.685+0000 7f2db1602640 1 -- 172.21.15.177:0/3306931810 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8061d20 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.686+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563956ce2d90 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.686+0000 7f2db1602640 1 -- 172.21.15.177:0/3306931810 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2eb8005040 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.686+0000 7f2db1602640 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2da0036790 0x7f2da0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.686+0000 7f2db1602640 1 -- 172.21.15.177:0/3306931810 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f2eb8089d40 con 0x563956ce1500 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2da0036790 0x7f2da0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec97af800 1 Processor -- start 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec97af800 1 -- start start 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2da0036790 0x7f2da0038c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00bf50 tx=0x7f2ebc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.699 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec97af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956ceeab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec97af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563956a3c5d0 con 0x563956cee6b0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956ceeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956ceeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42176/0 (socket says 172.21.15.177:42176) 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3612860450 learned_addr learned my addr 172.21.15.177:0/3612860450 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.687+0000 7f2ec72ae640 1 -- 172.21.15.177:0/3612860450 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563956cef080 con 0x563956cee6b0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/3612860450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956ceeab0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8061930 tx=0x7f2eb807eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45acbfd18a53aea server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2daaffd640 1 -- 172.21.15.177:0/3612860450 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb8056430 con 0x563956cee6b0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2daaffd640 1 -- 172.21.15.177:0/3612860450 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb807cce0 con 0x563956cee6b0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2daaffd640 1 -- 172.21.15.177:0/3612860450 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb806d070 con 0x563956cee6b0 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 -- 172.21.15.177:0/3612860450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 msgr2=0x563956ceeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3612860450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956ceeab0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8061930 tx=0x7f2eb807eda0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 -- 172.21.15.177:0/3612860450 shutdown_connections 2024-03-20T13:36:17.700 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3612860450 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956ceeab0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 -- 172.21.15.177:0/3612860450 >> 172.21.15.177:0/3612860450 conn(0x563956cea980 msgr2=0x563956ce89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 -- 172.21.15.177:0/3612860450 shutdown_connections 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 -- 172.21.15.177:0/3612860450 wait complete. 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.688+0000 7f2ec97af800 1 Processor -- start 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec97af800 1 -- start start 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec97af800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956cf55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec97af800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563956cf5b20 con 0x563956cee6b0 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956cf55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec72ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956cf55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42184/0 (socket says 172.21.15.177:42184) 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 learned_addr learned my addr 172.21.15.177:0/1839818152 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb8093020 con 0x563956cee6b0 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956cf55e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8061930 tx=0x7f2eb8067f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.701 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.689+0000 7f2da97fa640 1 -- 172.21.15.177:0/1839818152 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb80ac070 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2da97fa640 1 -- 172.21.15.177:0/1839818152 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2eb806d070 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563956cf5d20 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2da97fa640 1 -- 172.21.15.177:0/1839818152 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2eb808fc20 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563956cf5d20 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2da97fa640 1 -- 172.21.15.177:0/1839818152 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f2eb8069910 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2da97fa640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d900367e0 0x7f2d90038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.690+0000 7f2da97fa640 1 -- 172.21.15.177:0/1839818152 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f2eb80b2d50 con 0x563956cee6b0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d900367e0 0x7f2d90038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d900367e0 0x7f2d90038ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc001b60 tx=0x7f2ebc010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956d00e10 0x563956d032d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d03a20 con 0x563956d00e10 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec7aaf640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956d00e10 0x563956d032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.702 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.691+0000 7f2ec7aaf640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956d00e10 0x563956d032d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 realm 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d03df0 con 0x563956d00e10 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.703 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d049d0 con 0x563956d00e10 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956d05380 0x563956d07770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d07d80 con 0x563956d05380 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.692+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956d05380 0x563956d07770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956d05380 0x563956d07770 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec97af800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec97af800 20 searching for the correct realm 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563956d0a030 0x563956d0c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0cb70 con 0x563956d0a030 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563956d0a030 0x563956d0c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.704 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.693+0000 7f2ec6aad640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563956d0a030 0x563956d0c4f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.694+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.694+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0cb70 con 0x563956d05380 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.694+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.694+0000 7f2ec72ae640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2eb80a4050 0x7f2eb807b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.694+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0cb70 con 0x7f2eb80a4050 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.694+0000 7f2ec7aaf640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2eb80a4050 0x7f2eb807b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.695+0000 7f2ec7aaf640 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2eb80a4050 0x7f2eb807b610 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.695+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.695+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.705 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.696+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d05380 2024-03-20T13:36:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.697+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d05380 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.698+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.699+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.718 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d05380 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.700+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d05380 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.719 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.701+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d05380 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.702+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.702+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d0a030 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.702+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.702+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x7f2eb80a4050 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.702+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.702+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d00e10 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d04670 con 0x563956d05380 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:17.720 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d08470 con 0x563956d00e10 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d08470 con 0x563956d00e10 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.703+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d08820 con 0x7f2eb80a4050 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.721 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 zone default found 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 4 Realm: () 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 zonegroup default 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d08c10 con 0x7f2eb80a4050 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d09010 con 0x563956d0a030 2024-03-20T13:36:17.722 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0e990 con 0x563956d0a030 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.704+0000 7f2ec97af800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.705+0000 7f2ec97af800 20 started sync module instance, tier type = 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.705+0000 7f2ec97af800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.705+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0e270 con 0x563956d05380 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.706+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.706+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94804269653456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0e620 con 0x563956d05380 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.706+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0f7a0 con 0x563956d00e10 2024-03-20T13:36:17.723 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.707+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94804269653456] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.707+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.707+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94804269658880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0fbc0 con 0x563956d00e10 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.707+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d10530 con 0x563956d0a030 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.708+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94804269658880] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.708+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.708+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94804269659936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0fb40 con 0x563956d0a030 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.708+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d11340 con 0x563956d05380 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.709+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94804269659936] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.709+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.709+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94804269664400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d11b40 con 0x563956d05380 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.709+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d12380 con 0x563956d00e10 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.710+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.724 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.710+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94804269664400] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.710+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94804269670048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d12c10 con 0x563956d00e10 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.710+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d134c0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.711+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.711+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94804269674480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d138b0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.711+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d140b0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.711+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94804269670048] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.712+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94804269674480] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.712+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.712+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94804269675536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d13ac0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.713+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d14040 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'222 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94804269679712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d14080 con 0x7f2eb80a4050 2024-03-20T13:36:17.725 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=0 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=1 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=2 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=3 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=4 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=5 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94804269675536] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.726 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.714+0000 7f2ec97af800 20 add_watcher() i=6 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.716+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94804269679712] v32'223 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.716+0000 7f2ec97af800 20 add_watcher() i=7 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.716+0000 7f2ec97af800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.716+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d12730 con 0x563956d00e10 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.717+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.717+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94804269680768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d12730 con 0x563956d00e10 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.718+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94804269680768] v32'218 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.729 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.718+0000 7f2d7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.718+0000 7f2ec97af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.718+0000 7f2ec97af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.718+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d20290 con 0x563956d00e10 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.719+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.719+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d206d0 con 0x7f2eb80a4050 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.720+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.730 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.720+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d206d0 con 0x563956d0a030 2024-03-20T13:36:17.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.721+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.721+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d20c00 con 0x563956d00e10 2024-03-20T13:36:17.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.722+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'219 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.722+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d21130 con 0x563956d05380 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.723+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'69 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.723+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d21b00 con 0x563956d0a030 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.724+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'45 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.724+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d22030 con 0x563956d00e10 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.725+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.725+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d224d0 con 0x7f2eb80a4050 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.726+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'47 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.726+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d224d0 con 0x563956d05380 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.727+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.727+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d22a00 con 0x563956d0a030 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.728+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.728+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d22f30 con 0x563956d05380 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.729+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'70 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.729+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23460 con 0x7f2eb80a4050 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.730+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'31 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.731+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23460 con 0x563956d05380 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.731+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.732+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d223d0 con 0x7f2eb80a4050 2024-03-20T13:36:17.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.733+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'51 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.733+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d223d0 con 0x563956d00e10 2024-03-20T13:36:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.734+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'220 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.734+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d223d0 con 0x563956d0a030 2024-03-20T13:36:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.735+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'63 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.735+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d22490 con 0x563956d05380 2024-03-20T13:36:17.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.736+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'71 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.736+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d22490 con 0x563956d0a030 2024-03-20T13:36:17.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.737+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.737+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d00e10 2024-03-20T13:36:17.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.738+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'34 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.738+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d00e10 2024-03-20T13:36:17.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.739+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'221 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.739+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.740+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'64 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.740+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d05380 2024-03-20T13:36:17.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.741+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'36 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.743 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.741+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.742+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.742+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.744 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.743+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.745 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.743+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.744+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'22 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.744+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.744+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'46 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.746 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.745+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x7f2eb80a4050 2024-03-20T13:36:17.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.746+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'28 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.748 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.746+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.747+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'26 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.749 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.747+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x7f2eb80a4050 2024-03-20T13:36:17.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.748+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'48 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.748+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d0a030 2024-03-20T13:36:17.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.749+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'65 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.749+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x7f2eb80a4050 2024-03-20T13:36:17.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.750+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'52 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.750+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d23680 con 0x563956d05380 2024-03-20T13:36:17.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.751+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'32 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.751+0000 7f2d7cfe1640 20 reqs_thread_entry: start 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 20 Filter name: none 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2cf67fc640 20 reqs_thread_entry: start 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4cec0 con 0x563956d05380 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(94 bud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv4 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-03-20T13:36:17.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4f3c0 con 0x563956d00e10 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(95 bud.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.752+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify cookie 94804269712864 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4fa40 con 0x7f2eb80a4050 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== watch-notify(notify (1) cookie 94804269674480 notify 137438953504 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f2ec003d040 con 0x7f2eb80a4050 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2daaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94804269674480 notifier 4738 bl.length()=170 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(96 notify.5 [notify cookie 94804269712864 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2daaffd640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2d8c003d50 con 0x7f2eb80a4050 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(97 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== watch-notify(notify_complete (2) cookie 94804269712864 notify 137438953504 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2ec0018e40 con 0x7f2eb80a4050 2024-03-20T13:36:17.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.753+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:98 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4f9c0 con 0x563956d00e10 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.754+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(98 NX5QOQKC6BH2IDN8HC7A [delete] v32'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.754+0000 7f2ec97af800 10 removing email index: 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.754+0000 7f2ec97af800 10 removing user buckets index 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.754+0000 7f2ec97af800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.754+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:99 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94804269712864 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4f9c0 con 0x7f2eb80a4050 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== watch-notify(notify (1) cookie 94804269675536 notify 137438953505 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f2ec0018e40 con 0x7f2eb80a4050 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2daa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94804269675536 notifier 4738 bl.length()=160 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(99 notify.6 [notify cookie 94804269712864 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2daa7fc640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2cfc0032b0 con 0x7f2eb80a4050 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== watch-notify(notify_complete (2) cookie 94804269712864 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2ec0042640 con 0x7f2eb80a4050 2024-03-20T13:36:17.760 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(100 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.755+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4f9c0 con 0x563956d00e10 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.756+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(101 bud.buckets [delete] v32'4 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 155+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.756+0000 7f2ec97af800 10 removing user index: bud 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.756+0000 7f2ec97af800 10 removing default.rgw.meta+users.uid+bud from cache 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.756+0000 7f2ec97af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.756+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [notify cookie 94804269712864 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d4f9c0 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== watch-notify(notify (1) cookie 94804269674480 notify 137438953506 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f2ec0042640 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2daa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94804269674480 notifier 4738 bl.length()=152 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(102 notify.5 [notify cookie 94804269712864 out=8b] v0'0 uv222 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2daa7fc640 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f2cfc0032b0 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== watch-notify(notify_complete (2) cookie 94804269712864 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f2ec0042ae0 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(103 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.761 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.757+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:104 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d1c5e0 con 0x563956d05380 2024-03-20T13:36:17.762 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.758+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(104 bud [call,call,delete] v32'5 uv5 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.759+0000 7f2d7dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.759+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94804269680768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d1c5e0 con 0x563956d00e10 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.760+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94804269680768] v32'222 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.760+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94804269653456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d1c5e0 con 0x563956d05380 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.761+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94804269653456] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.761+0000 7f2ec97af800 20 remove_watcher() i=0 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.761+0000 7f2ec97af800 2 removed watcher, disabling cache 2024-03-20T13:36:17.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.761+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94804269658880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0ddd0 con 0x563956d00e10 2024-03-20T13:36:17.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.762+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94804269658880] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.762+0000 7f2ec97af800 20 remove_watcher() i=1 2024-03-20T13:36:17.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.762+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94804269659936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d1c5e0 con 0x563956d0a030 2024-03-20T13:36:17.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.763+0000 7f2ec6aad640 1 -- 172.21.15.177:0/1839818152 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94804269659936] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ebc006070 con 0x563956d0a030 2024-03-20T13:36:17.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.763+0000 7f2ec97af800 20 remove_watcher() i=2 2024-03-20T13:36:17.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.763+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94804269664400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0ddd0 con 0x563956d05380 2024-03-20T13:36:17.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.764+0000 7f2ec72ae640 1 -- 172.21.15.177:0/1839818152 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94804269664400] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2eb80a1070 con 0x563956d05380 2024-03-20T13:36:17.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.764+0000 7f2ec97af800 20 remove_watcher() i=3 2024-03-20T13:36:17.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.764+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94804269670048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d1c5e0 con 0x563956d00e10 2024-03-20T13:36:17.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.765+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94804269670048] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x563956d00e10 2024-03-20T13:36:17.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.765+0000 7f2ec97af800 20 remove_watcher() i=4 2024-03-20T13:36:17.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.765+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94804269674480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d10890 con 0x7f2eb80a4050 2024-03-20T13:36:17.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.766+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94804269674480] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.766+0000 7f2ec97af800 20 remove_watcher() i=5 2024-03-20T13:36:17.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.766+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94804269675536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d0ddd0 con 0x7f2eb80a4050 2024-03-20T13:36:17.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.767+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94804269675536] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.767+0000 7f2ec97af800 20 remove_watcher() i=6 2024-03-20T13:36:17.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.767+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94804269679712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563956d1c5e0 con 0x7f2eb80a4050 2024-03-20T13:36:17.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94804269679712] v32'224 uv222 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f2ec000a4a0 con 0x7f2eb80a4050 2024-03-20T13:36:17.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 20 remove_watcher() i=7 2024-03-20T13:36:17.773 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2eb80a4050 msgr2=0x7f2eb807b610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f2eb80a4050 0x7f2eb807b610 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956d00e10 msgr2=0x563956d032d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956d00e10 0x563956d032d0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956d05380 msgr2=0x563956d07770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956d05380 0x563956d07770 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563956d0a030 msgr2=0x563956d0c4f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x563956d0a030 0x563956d0c4f0 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d900367e0 msgr2=0x7f2d90038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2d900367e0 0x7f2d90038ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc001b60 tx=0x7f2ebc010000 comp rx=0 tx=0).stop 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 msgr2=0x563956cf55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 --2- 172.21.15.177:0/1839818152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956cee6b0 0x563956cf55e0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f2eb8061930 tx=0x7f2eb8067f60 comp rx=0 tx=0).stop 2024-03-20T13:36:17.774 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 reap_dead start 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/1839818152 reap_dead start 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 shutdown_connections 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 >> 172.21.15.177:0/1839818152 conn(0x563956cea980 msgr2=0x563956ce89b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 shutdown_connections 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.768+0000 7f2ec97af800 1 -- 172.21.15.177:0/1839818152 wait complete. 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2da0036790 msgr2=0x7f2da0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2da0036790 0x7f2da0038c50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00bf50 tx=0x7f2ebc00f000 comp rx=0 tx=0).stop 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 msgr2=0x563956ce1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 0x563956ce1920 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f2eb808d9f0 tx=0x7f2eb805d810 comp rx=0 tx=0).stop 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 shutdown_connections 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2da0036790 0x7f2da0038c50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3306931810 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956ce1500 0x563956ce1920 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.775 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 >> 172.21.15.177:0/3306931810 conn(0x563956cd1190 msgr2=0x563956cd1590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 shutdown_connections 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3306931810 wait complete. 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563956ccc4d0 msgr2=0x563956cce8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563956ccc4d0 0x563956cce8c0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956bc9c40 msgr2=0x563956cc5ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563956bc9c40 0x563956cc5ef0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956cc8640 msgr2=0x563956ccaa30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563956cc8640 0x563956ccaa30 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2dac036790 msgr2=0x7f2dac038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2dac036790 0x7f2dac038c50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc000f60 tx=0x7f2ebc0012b0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 msgr2=0x563956cbf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 --2- 172.21.15.177:0/3985519170 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563956bc89e0 0x563956cbf290 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800a600 tx=0x7f2eb8002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.776 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec7aaf640 1 -- 172.21.15.177:0/3985519170 reap_dead start 2024-03-20T13:36:17.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 shutdown_connections 2024-03-20T13:36:17.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 >> 172.21.15.177:0/3985519170 conn(0x563956bc4040 msgr2=0x563956cb1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 shutdown_connections 2024-03-20T13:36:17.777 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.769+0000 7f2ec97af800 1 -- 172.21.15.177:0/3985519170 wait complete. 2024-03-20T13:36:17.779 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-03-20T13:36:17.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-03-20T13:36:17.780 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-03-20T13:36:17.865 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:17.865 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.864+0000 7f1aa231f800 1 Processor -- start 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.864+0000 7f1aa231f800 1 -- start start 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.864+0000 7f1aa231f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b7ae581610 0x55b7ae583a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.864+0000 7f1aa231f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b7ae4cbcd0 con 0x55b7ae583f40 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.864+0000 7f1aa231f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b7ae482500 con 0x55b7ae581610 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9dfec640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b7ae581610 0x55b7ae583a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9d7eb640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55b7ae583f40 0x55b7ae586330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:39726/0 (socket says 172.21.15.177:39726) 2024-03-20T13:36:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3220929977 learned_addr learned my addr 172.21.15.177:0/3220929977 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9cfea640 1 -- 172.21.15.177:0/3220929977 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616776602 0 0) 0x55b7ae4cbcd0 con 0x55b7ae583f40 2024-03-20T13:36:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9cfea640 1 -- 172.21.15.177:0/3220929977 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1a88001e10 con 0x55b7ae583f40 2024-03-20T13:36:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3220929977 >> v1:172.21.15.28:6789/0 conn(0x55b7ae583f40 legacy=0x55b7ae586330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.868 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.865+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3220929977 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ae588a60 con 0x55b7ae581610 2024-03-20T13:36:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3220929977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae583a00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000a470 tx=0x7f1a9001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e7ff542aba953 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1a9cfea640 1 -- 172.21.15.177:0/3220929977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9004ad60 con 0x55b7ae581610 2024-03-20T13:36:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1a9cfea640 1 -- 172.21.15.177:0/3220929977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90052440 con 0x55b7ae581610 2024-03-20T13:36:17.869 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1a9cfea640 1 -- 172.21.15.177:0/3220929977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a900526e0 con 0x55b7ae581610 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1aa231f800 1 -- 172.21.15.177:0/3220929977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 msgr2=0x55b7ae583a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3220929977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae583a00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f1a9000a470 tx=0x7f1a9001cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1aa231f800 1 -- 172.21.15.177:0/3220929977 shutdown_connections 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3220929977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae583a00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1aa231f800 1 -- 172.21.15.177:0/3220929977 >> 172.21.15.177:0/3220929977 conn(0x55b7ae57b040 msgr2=0x55b7ae57d460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.867+0000 7f1aa231f800 1 -- 172.21.15.177:0/3220929977 shutdown_connections 2024-03-20T13:36:17.870 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.868+0000 7f1aa231f800 1 -- 172.21.15.177:0/3220929977 wait complete. 2024-03-20T13:36:17.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.879+0000 7f1aa231f800 1 Processor -- start 2024-03-20T13:36:17.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.879+0000 7f1aa231f800 1 -- start start 2024-03-20T13:36:17.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.879+0000 7f1aa231f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae670810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.881 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.879+0000 7f1aa231f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ae47fa30 con 0x55b7ae581610 2024-03-20T13:36:17.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae670810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.882 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae670810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42194/0 (socket says 172.21.15.177:42194) 2024-03-20T13:36:17.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f1a9dfec640 1 -- 172.21.15.177:0/1513216053 learned_addr learned my addr 172.21.15.177:0/1513216053 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f1a9dfec640 1 -- 172.21.15.177:0/1513216053 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90005d20 con 0x55b7ae581610 2024-03-20T13:36:17.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/1513216053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae670810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1a9001ccc0 tx=0x7f1a9004c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315682e487fd7975 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f198be07640 1 -- 172.21.15.177:0/1513216053 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9000a040 con 0x55b7ae581610 2024-03-20T13:36:17.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f198be07640 1 -- 172.21.15.177:0/1513216053 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9000a1a0 con 0x55b7ae581610 2024-03-20T13:36:17.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.880+0000 7f198be07640 1 -- 172.21.15.177:0/1513216053 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a900525b0 con 0x55b7ae581610 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 -- 172.21.15.177:0/1513216053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 msgr2=0x55b7ae670810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 --2- 172.21.15.177:0/1513216053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae670810 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f1a9001ccc0 tx=0x7f1a9004c000 comp rx=0 tx=0).stop 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 -- 172.21.15.177:0/1513216053 shutdown_connections 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 --2- 172.21.15.177:0/1513216053 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae670810 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 -- 172.21.15.177:0/1513216053 >> 172.21.15.177:0/1513216053 conn(0x55b7ae57b040 msgr2=0x55b7ae66c130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 -- 172.21.15.177:0/1513216053 shutdown_connections 2024-03-20T13:36:17.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.881+0000 7f1aa231f800 1 -- 172.21.15.177:0/1513216053 wait complete. 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1aa231f800 1 Processor -- start 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1aa231f800 1 -- start start 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1aa231f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae677d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1aa231f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ae47b210 con 0x55b7ae581610 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae677d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae677d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42200/0 (socket says 172.21.15.177:42200) 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3649190982 learned_addr learned my addr 172.21.15.177:0/3649190982 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.882+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ae588a60 con 0x55b7ae581610 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.883+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae677d90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1a9001d3b0 tx=0x7f1a90002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.883+0000 7f198a604640 1 -- 172.21.15.177:0/3649190982 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9006b070 con 0x55b7ae581610 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.883+0000 7f198a604640 1 -- 172.21.15.177:0/3649190982 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a90052cb0 con 0x55b7ae581610 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.883+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7ae6782d0 con 0x55b7ae581610 2024-03-20T13:36:17.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.883+0000 7f198a604640 1 -- 172.21.15.177:0/3649190982 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9006f410 con 0x55b7ae581610 2024-03-20T13:36:17.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.883+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7ae678810 con 0x55b7ae581610 2024-03-20T13:36:17.892 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f198a604640 1 -- 172.21.15.177:0/3649190982 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1a90059050 con 0x55b7ae581610 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f198a604640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1984036790 0x7f1984038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f198a604640 1 -- 172.21.15.177:0/3649190982 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f1a9008d450 con 0x55b7ae581610 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1984036790 0x7f1984038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae583f40 0x55b7ae67eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae67f0e0 con 0x55b7ae583f40 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f1a9e7ed640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae583f40 0x55b7ae67eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1984036790 0x7f1984038c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1a94000f60 tx=0x7f1a940010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.884+0000 7f1a9e7ed640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae583f40 0x55b7ae67eb60 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3649190982 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae583f40 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae67c120 con 0x55b7ae583f40 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3649190982 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae583f40 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6812f0 0x55b7ae6836e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.893 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae683db0 con 0x55b7ae6812f0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6812f0 0x55b7ae6836e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.885+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6812f0 0x55b7ae6836e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.886+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3649190982 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f1a9007f040 con 0x55b7ae6812f0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.886+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae680270 con 0x55b7ae583f40 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.886+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3649190982 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae583f40 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.886+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7ae6851b0 0x55b7ae6875a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.886+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae687ce0 con 0x55b7ae6851b0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.886+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7ae6851b0 0x55b7ae6875a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.887+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7ae6851b0 0x55b7ae6875a0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.887+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3649190982 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6851b0 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.887+0000 7f1aa231f800 1 Processor -- start 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.887+0000 7f1aa231f800 1 -- start start 2024-03-20T13:36:17.894 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.887+0000 7f1aa231f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 0x55b7ae696300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.887+0000 7f1aa231f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ae41dc70 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 0x55b7ae696300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 0x55b7ae696300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42202/0 (socket says 172.21.15.177:42202) 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3517698115 learned_addr learned my addr 172.21.15.177:0/3517698115 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3517698115 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ae696840 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 0x55b7ae696300 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001eb0 tx=0x7f1a9006ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f19837fe640 1 -- 172.21.15.177:0/3517698115 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9008b440 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f19837fe640 1 -- 172.21.15.177:0/3517698115 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9008b5a0 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7ae6972b0 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f19837fe640 1 -- 172.21.15.177:0/3517698115 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9005b820 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.888+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7ae6972b0 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.889+0000 7f19837fe640 1 -- 172.21.15.177:0/3517698115 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1a9008b910 con 0x55b7ae695ee0 2024-03-20T13:36:17.895 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.889+0000 7f19837fe640 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1978036790 0x7f1978038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.889+0000 7f19837fe640 1 -- 172.21.15.177:0/3517698115 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f1a90054600 con 0x55b7ae695ee0 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.889+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1978036790 0x7f1978038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.889+0000 7f1aa231f800 1 Processor -- start 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1aa231f800 1 -- start start 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1978036790 0x7f1978038c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400bf90 tx=0x7f1a9400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1aa231f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1aa231f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ae3f35d0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a3300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42218/0 (socket says 172.21.15.177:42218) 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1a9dfec640 1 -- 172.21.15.177:0/1267912614 learned_addr learned my addr 172.21.15.177:0/1267912614 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1a9dfec640 1 -- 172.21.15.177:0/1267912614 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ae6a38d0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/1267912614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a3300 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1a900854c0 tx=0x7f1a90060f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d431bebb4afe7ed9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.890+0000 7f19817fa640 1 -- 172.21.15.177:0/1267912614 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a9009b070 con 0x55b7ae6a2f00 2024-03-20T13:36:17.896 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f19817fa640 1 -- 172.21.15.177:0/1267912614 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9005b980 con 0x55b7ae6a2f00 2024-03-20T13:36:17.897 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f19817fa640 1 -- 172.21.15.177:0/1267912614 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a90054d80 con 0x55b7ae6a2f00 2024-03-20T13:36:17.911 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- 172.21.15.177:0/1267912614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 msgr2=0x55b7ae6a3300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 --2- 172.21.15.177:0/1267912614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a3300 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f1a900854c0 tx=0x7f1a90060f80 comp rx=0 tx=0).stop 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- 172.21.15.177:0/1267912614 shutdown_connections 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 --2- 172.21.15.177:0/1267912614 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a3300 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- 172.21.15.177:0/1267912614 >> 172.21.15.177:0/1267912614 conn(0x55b7ae69f1d0 msgr2=0x55b7ae69d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- 172.21.15.177:0/1267912614 shutdown_connections 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- 172.21.15.177:0/1267912614 wait complete. 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 Processor -- start 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- start start 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.891+0000 7f1aa231f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ae6aa3c0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.912 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1a9dfec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:42232/0 (socket says 172.21.15.177:42232) 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 learned_addr learned my addr 172.21.15.177:0/3041199559 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a90091070 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a9e80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1a90054340 tx=0x7f1a9008d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f196f7fe640 1 -- 172.21.15.177:0/3041199559 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a900a7040 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f196f7fe640 1 -- 172.21.15.177:0/3041199559 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900509c0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f196f7fe640 1 -- 172.21.15.177:0/3041199559 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1a90050c60 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b7ae6aa5c0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.892+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7ae6aa5c0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.893+0000 7f196f7fe640 1 -- 172.21.15.177:0/3041199559 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f1a9008d7b0 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.893+0000 7f196f7fe640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1968036790 0x7f1968038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.893+0000 7f196f7fe640 1 -- 172.21.15.177:0/3041199559 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f1a900b7d70 con 0x55b7ae6a2f00 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.893+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1968036790 0x7f1968038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.913 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae6b5700 0x55b7ae6b7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8310 con 0x55b7ae6b5700 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1968036790 0x7f1968038c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55b7ae67c060 tx=0x7f1a94010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1a9e7ed640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae6b5700 0x55b7ae6b7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1a9e7ed640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae6b5700 0x55b7ae6b7bc0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1aa231f800 20 realm 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.894+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b86e0 con 0x55b7ae6b5700 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:17.914 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b92c0 con 0x55b7ae6b5700 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6b9c70 0x55b7ae6bc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6bc670 con 0x55b7ae6b9c70 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.895+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6b9c70 0x55b7ae6bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6b9c70 0x55b7ae6bc060 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.915 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1aa231f800 20 searching for the correct realm 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7ae6be920 0x55b7ae6c0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c1460 con 0x55b7ae6be920 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7ae6be920 0x55b7ae6c0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.896+0000 7f1a9d7eb640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7ae6be920 0x55b7ae6c0de0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.897+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.897+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c1460 con 0x55b7ae6b9c70 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.897+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.897+0000 7f1a9dfec640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1a900b6060 0x7f1a90070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.897+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c1460 con 0x7f1a900b6060 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.897+0000 7f1a9e7ed640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1a900b6060 0x7f1a90070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1a900b6060 0x7f1a90070270 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.916 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.898+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.899+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.899+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.899+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.899+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.899+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.899+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.917 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.900+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.901+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.918 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.902+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.919 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.903+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.904+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.904+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.904+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.904+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.904+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.904+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6be920 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x7f1a900b6060 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b5700 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.920 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.905+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6b8f60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6bcd60 con 0x55b7ae6b5700 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6bcd60 con 0x55b7ae6b5700 2024-03-20T13:36:17.921 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6bd110 con 0x7f1a900b6060 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 zone default found 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 4 Realm: () 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 zonegroup default 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.906+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.922 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6bd500 con 0x7f1a900b6060 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6bd900 con 0x55b7ae6be920 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c3280 con 0x55b7ae6be920 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 started sync module instance, tier type = 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.907+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c2b60 con 0x55b7ae6b9c70 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.908+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.923 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.908+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94247393699520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c3a80 con 0x55b7ae6b9c70 2024-03-20T13:36:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.908+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c4280 con 0x55b7ae6b5700 2024-03-20T13:36:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.909+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94247393699520] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.909+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.909+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94247393705440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c46a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.924 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.910+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c4ee0 con 0x55b7ae6be920 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.911+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94247393705440] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.911+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.911+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94247393706976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c52c0 con 0x55b7ae6be920 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.911+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c5c70 con 0x55b7ae6b9c70 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.912+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94247393706976] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.912+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.912+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94247393708224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c64f0 con 0x55b7ae6b9c70 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.912+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c6e60 con 0x55b7ae6b5700 2024-03-20T13:36:17.929 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.913+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94247393708224] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.913+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.913+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94247393716672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c7280 con 0x55b7ae6b5700 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.913+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c7bf0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.914+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.914+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94247393720144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c8010 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.914+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c8aa0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.914+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94247393716672] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.915+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94247393720144] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.915+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.916+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94247393717728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c85c0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.916+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c8f70 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'225 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.930 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94247393717728] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94247393725072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c93d0 con 0x7f1a900b6060 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=0 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=1 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=2 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=3 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=4 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=5 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.917+0000 7f1aa231f800 20 add_watcher() i=6 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.918+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94247393725072] v32'226 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.918+0000 7f1aa231f800 20 add_watcher() i=7 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.918+0000 7f1aa231f800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.918+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c7c60 con 0x55b7ae6b5700 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.918+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.931 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.918+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94247393726128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6c9c50 con 0x55b7ae6b5700 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.919+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94247393726128] v32'223 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.919+0000 7f194f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.919+0000 7f1aa231f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.919+0000 7f1aa231f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.919+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d4cd0 con 0x55b7ae6b5700 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.921+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.921+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d5110 con 0x7f1a900b6060 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.922+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.922+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d5110 con 0x55b7ae6be920 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.923+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.923+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6cbc80 con 0x55b7ae6b5700 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.924+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'224 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.924+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6cb7e0 con 0x55b7ae6b9c70 2024-03-20T13:36:17.932 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.925+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'72 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.925+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d6650 con 0x55b7ae6be920 2024-03-20T13:36:17.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.926+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'47 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.926+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7020 con 0x55b7ae6b5700 2024-03-20T13:36:17.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.927+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.933 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.927+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7020 con 0x7f1a900b6060 2024-03-20T13:36:17.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.928+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'49 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.928+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d70b0 con 0x55b7ae6b9c70 2024-03-20T13:36:17.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.929+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.934 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.929+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7600 con 0x55b7ae6be920 2024-03-20T13:36:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.930+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.937 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.930+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7b30 con 0x55b7ae6b9c70 2024-03-20T13:36:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.931+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'73 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.931+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8060 con 0x7f1a900b6060 2024-03-20T13:36:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.932+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'32 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.938 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.932+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8060 con 0x55b7ae6b9c70 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.933+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.933+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d82c0 con 0x7f1a900b6060 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.935+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'53 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.935+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d82c0 con 0x55b7ae6b5700 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.936+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'225 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.936+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d82c0 con 0x55b7ae6be920 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.937+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'66 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.939 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.937+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d82c0 con 0x55b7ae6b9c70 2024-03-20T13:36:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.938+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'74 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.940 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.938+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8230 con 0x55b7ae6be920 2024-03-20T13:36:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.939+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.941 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.939+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d82c0 con 0x55b7ae6b5700 2024-03-20T13:36:17.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.940+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'35 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.942 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.940+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8350 con 0x55b7ae6b5700 2024-03-20T13:36:17.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.941+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'226 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:17.943 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.941+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8350 con 0x55b7ae6be920 2024-03-20T13:36:17.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.942+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'67 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.944 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.942+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d83e0 con 0x55b7ae6b9c70 2024-03-20T13:36:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.943+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'37 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:17.945 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.943+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d83e0 con 0x55b7ae6be920 2024-03-20T13:36:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.944+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.946 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.944+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d83e0 con 0x55b7ae6be920 2024-03-20T13:36:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.945+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.947 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.945+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8450 con 0x55b7ae6be920 2024-03-20T13:36:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.946+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'23 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.948 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.946+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8450 con 0x55b7ae6be920 2024-03-20T13:36:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.947+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'48 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.949 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.947+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d8450 con 0x7f1a900b6060 2024-03-20T13:36:17.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.948+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'29 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.950 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.948+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7e90 con 0x55b7ae6be920 2024-03-20T13:36:17.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.949+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'27 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.951 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.949+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7e90 con 0x7f1a900b6060 2024-03-20T13:36:17.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.950+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'50 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:17.952 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.950+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7e90 con 0x55b7ae6be920 2024-03-20T13:36:17.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.951+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'68 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:17.953 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.951+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7e90 con 0x7f1a900b6060 2024-03-20T13:36:17.954 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.952+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'54 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.069 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.952+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae6d7e90 con 0x55b7ae6b9c70 2024-03-20T13:36:18.093 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.953+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'33 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.953+0000 7f194e7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 20 Filter name: none 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f18bffff640 20 reqs_thread_entry: start 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae702260 con 0x7f1a900b6060 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(94 fud [call out=48b,read 0~346 out=346b,getxattrs out=75b] v0'0 uv5 ondisk = 0) v8 ==== 231+0+469 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=346 2024-03-20T13:36:18.094 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.954+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae704280 con 0x7f1a900b6060 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv5 ondisk = 0) v8 ==== 155+0+186 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 : miss 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:96 8.1a 8:5c1f93e8:root::.bucket.meta.myfoo7%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae704630 con 0x7f1a900b6060 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 [call out=48b,stat out=16b,read 0~355 out=355b,getxattrs out=218b] v0'0 uv3 ondisk = 0) v8 ==== 334+0+637 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=355 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 info.flags=0x17 2024-03-20T13:36:18.095 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 to cache LRU end 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.955+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 4.16 4:68ec9627:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781b70 con 0x55b7ae6be920 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.956+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(97 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.956+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:98 4.d 4:b10807b8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bb0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.956+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(98 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.956+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:99 4.21 4:850bc884:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bf0 con 0x7f1a900b6060 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.957+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(99 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.957+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:100 4.8 4:106ae4b6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bf0 con 0x55b7ae6be920 2024-03-20T13:36:18.096 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.957+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(100 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.957+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:101 4.7 4:e30e287f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bf0 con 0x7f1a900b6060 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.957+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(101 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.957+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:102 4.30 4:0d0115db:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bf0 con 0x55b7ae6be920 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(102 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 [call out=378b] v0'0 uv9 ondisk = 0) v8 ==== 195+0+378 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1aa231f800 10 cls_bucket_list_unordered: got fourteen 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:103 4.34 4:2c58bb2f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bf0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(103 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:104 4.4 4:23fd9512:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781bf0 con 0x7f1a900b6060 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(104 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7 [call out=85b] v0'0 uv16 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.958+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:105 4.34 4:2cc2ff3e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781b70 con 0x55b7ae6b9c70 2024-03-20T13:36:18.097 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.959+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(105 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.959+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:106 4.36 4:6d76e0e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781b70 con 0x55b7ae6b5700 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.959+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(106 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.959+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:107 4.39 4:9d7df6fa:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781b70 con 0x7f1a900b6060 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(107 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 20 get_obj_state: octx=0x7f1a9006f930 obj=myfoo7:fourteen state=0x55b7ae77fbb8 s->prefetch_data=0 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:108 3.26s0 3:6423e9d3:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.10_fourteen:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae7809c0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(108 3852dce3-594b-4724-bee1-f3dae77b7611.4225.10_fourteen [getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) v8 ==== 239+0+874 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 10 manifest: total_size = 8 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.11341720553590275016 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 20 get_obj_state: octx=0x7f1a9006f930 obj=myfoo7:fourteen state=0x55b7ae77fbb8 s->prefetch_data=0 2024-03-20T13:36:18.098 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 20 prepare_atomic_modification: state is not atomic. state=0x55b7ae77fbb8 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.960+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:109 4.30 4:0d0115db:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6be920 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.962+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(109 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 [stat,call,call] v32'10 uv10 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.962+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:110 3.26s0 3:6423e9d3:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b9c70 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.963+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(110 3852dce3-594b-4724-bee1-f3dae77b7611.4225.10_fourteen [call] v32'2 uv2 ondisk = 0) v8 ==== 197+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:111 4.30 4:0d0115db:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6be920 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 20 list_objects_ordered: starting attempt 1 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:112 4.16 4:68ec9627:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6be920 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:113 4.d 4:b10807b8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b9c70 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:114 4.21 4:850bc884:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae70ec40 con 0x7f1a900b6060 2024-03-20T13:36:18.099 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:115 4.8 4:106ae4b6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae7119b0 con 0x55b7ae6be920 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:116 4.7 4:e30e287f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae70ec40 con 0x7f1a900b6060 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:117 4.30 4:0d0115db:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae716c30 con 0x55b7ae6be920 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:118 4.34 4:2c58bb2f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae7194b0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:119 4.4 4:23fd9512:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae71bda0 con 0x7f1a900b6060 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:120 4.34 4:2cc2ff3e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae71bda0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:121 4.36 4:6d76e0e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720f50 con 0x55b7ae6b5700 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:122 4.39 4:9d7df6fa:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae723930 con 0x7f1a900b6060 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(114 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(113 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(116 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(118 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.100 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.964+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(119 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7 [call out=85b] v0'0 uv16 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.965+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(112 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.965+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(122 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.965+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(121 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.965+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(115 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.965+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(120 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.966+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(111 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 [stat,call,call] v32'11 uv11 ondisk = 0) v8 ==== 279+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.966+0000 7f1980ff9640 20 handle_completion(): completion ok for obj=fourteen 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.966+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== osd_op_reply(117 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-20T13:36:18.101 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[3852dce3-594b-4724-bee1-f3dae77b7611.4225.10])"; uploads.size()=0; is_truncated=0 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:123 4.16 4:68ec9627:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae7238f0 con 0x55b7ae6be920 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:124 4.d 4:b10807b8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720ed0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:125 4.21 4:850bc884:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae719010 con 0x7f1a900b6060 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:126 4.8 4:106ae4b6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae780a70 con 0x55b7ae6be920 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:127 4.7 4:e30e287f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae780e80 con 0x7f1a900b6060 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:128 4.30 4:0d0115db:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720ed0 con 0x55b7ae6be920 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:129 4.34 4:2c58bb2f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae780a70 con 0x55b7ae6b9c70 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:130 4.4 4:23fd9512:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae780e80 con 0x7f1a900b6060 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:131 4.34 4:2cc2ff3e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720ed0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.102 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:132 4.36 4:6d76e0e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720ed0 con 0x55b7ae6b5700 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:133 4.39 4:9d7df6fa:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae70b6d0 con 0x7f1a900b6060 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(123 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== osd_op_reply(126 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(124 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(125 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(128 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 [call out=124b] v0'0 uv11 ondisk = 0) v8 ==== 195+0+124 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(127 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(130 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7 [call out=85b] v0'0 uv16 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(132 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9 [call out=85b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(129 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6 [call out=85b] v0'0 uv5 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(133 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10 [call out=85b] v0'0 uv4 ondisk = 0) v8 ==== 196+0+85 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.103 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== osd_op_reply(131 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8 [call out=85b] v0'0 uv6 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.967+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720e90 con 0x7f1a900b6060 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(134 fud.buckets [call] v32'6 uv6 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720e90 con 0x55b7ae6b9c70 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) v8 ==== 192+0+216 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 20 rados_obj.operate() r=0 bl.length=168 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-03-20T13:36:18.104 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:136 7.e 7:7759931f:::notify.3:head [notify cookie 94247394043104 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720e90 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== watch-notify(notify (1) cookie 94247393708224 notify 137438953504 ret 0) v3 ==== 192+0+0 (crc 0 0 0) 0x55b7ae6a38d0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953504 cookie 94247393708224 notifier 4745 bl.length()=150 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(136 notify.3 [notify cookie 94247394043104 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.969+0000 7f1980ff9640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f18c8003310 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.970+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== watch-notify(notify_complete (2) cookie 94247394043104 notify 137438953504 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b7ae696840 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.970+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(137 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.970+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:138 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720e90 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(138 myfoo7 [call,call,delete] v32'45 uv45 ondisk = 0) v8 ==== 234+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f1aa231f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 from cache 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f1aa231f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10, ofs0, ns] 2024-03-20T13:36:18.105 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:139 7.e 7:7759931f:::notify.3:head [notify cookie 94247394043104 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720e90 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== watch-notify(notify (1) cookie 94247393708224 notify 137438953505 ret 0) v3 ==== 250+0+0 (crc 0 0 0) 0x55b7ae696840 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f19817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953505 cookie 94247393708224 notifier 4745 bl.length()=208 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.971+0000 7f19817fa640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1960003d50 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.972+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 38 ==== osd_op_reply(139 notify.3 [notify cookie 94247394043104 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.972+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 39 ==== watch-notify(notify_complete (2) cookie 94247394043104 notify 137438953505 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b7ae678810 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.972+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 40 ==== osd_op_reply(140 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.972+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:141 8.1a 8:5c1f93e8:root::.bucket.meta.myfoo7%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(141 .bucket.meta.myfoo7:3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 [call,call,delete] v32'4 uv4 ondisk = 0) v8 ==== 292+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:142 4.16 4:68ec9627:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6be920 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:143 4.d 4:b10807b8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae702b20 con 0x55b7ae6b9c70 2024-03-20T13:36:18.106 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:144 4.21 4:850bc884:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae703360 con 0x7f1a900b6060 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:145 4.8 4:106ae4b6:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae721850 con 0x55b7ae6be920 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:146 4.7 4:e30e287f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:147 4.30 4:0d0115db:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae703360 con 0x55b7ae6be920 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:148 4.34 4:2c58bb2f:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae721850 con 0x55b7ae6b9c70 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:149 4.4 4:23fd9512:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae702b20 con 0x7f1a900b6060 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:150 4.34 4:2cc2ff3e:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b9c70 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:151 4.36 4:6d76e0e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae703360 con 0x55b7ae6b5700 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.973+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:152 4.39 4:9d7df6fa:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae702b20 con 0x7f1a900b6060 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.974+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(142 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.0 [delete] v32'6 uv6 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.974+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(144 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.107 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(146 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.4 [delete] v32'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(151 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.9 [delete] v32'3 uv3 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 41 ==== osd_op_reply(148 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.6 [delete] v32'7 uv7 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 42 ==== osd_op_reply(143 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(149 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.7 [delete] v32'17 uv17 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== osd_op_reply(152 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.10 [delete] v32'5 uv5 ondisk = 0) v8 ==== 196+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(147 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.5 [delete] v32'12 uv12 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 43 ==== osd_op_reply(150 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.8 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 38 ==== osd_op_reply(145 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.10.3 [delete] v32'4 uv4 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1aa231f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 : miss 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1aa231f800 20 rados->read ofs=0 len=0 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.975+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:153 6.18 6:1afad0ec:::pubsub..bucket.myfoo7%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae721850 con 0x7f1a900b6060 2024-03-20T13:36:18.108 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(153 pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 info.flags=0x0 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 to cache LRU end 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 10 removing default.rgw.log++pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 from cache 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10, ofs0, ns] 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:154 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94247394087856 in=217b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b9c70 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 44 ==== watch-notify(notify (1) cookie 94247393699520 notify 137438953506 ret 0) v3 ==== 247+0+0 (crc 0 0 0) 0x55b7ae678810 con 0x55b7ae6b9c70 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f19817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953506 cookie 94247393699520 notifier 4745 bl.length()=205 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f19817fa640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:155 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1960003d50 con 0x55b7ae6b9c70 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 45 ==== osd_op_reply(154 notify.0 [notify cookie 94247394087856 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 46 ==== watch-notify(notify_complete (2) cookie 94247394087856 notify 137438953506 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x55b7ae6782d0 con 0x55b7ae6b9c70 2024-03-20T13:36:18.109 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 47 ==== osd_op_reply(155 notify.0 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.976+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:156 6.18 6:1afad0ec:::pubsub..bucket.myfoo7%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.978+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(156 pubsub..bucket.myfoo7/3852dce3-594b-4724-bee1-f3dae77b7611.4225.10 [delete] v32'28 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 210+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.978+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:157 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=59b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(157 fud.buckets [call] v32'7 uv7 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1aa231f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1aa231f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify cookie 94247393964096 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae703460 con 0x55b7ae6be920 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 39 ==== watch-notify(notify (1) cookie 94247393706976 notify 137438953483 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x7f1a9403e000 con 0x55b7ae6be920 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1980ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953483 cookie 94247393706976 notifier 4745 bl.length()=170 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1980ff9640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:159 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f18c80032b0 con 0x55b7ae6be920 2024-03-20T13:36:18.110 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 40 ==== osd_op_reply(158 notify.2 [notify cookie 94247393964096 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 41 ==== watch-notify(notify_complete (2) cookie 94247393964096 notify 137438953483 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1a9403e190 con 0x55b7ae6be920 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 42 ==== osd_op_reply(159 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.979+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:160 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 49 ==== osd_op_reply(160 p5YnriCv1nAtykxBrupQ [delete] v32'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1aa231f800 10 removing email index: 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1aa231f800 10 removing user buckets index 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1aa231f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94247393964096 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 50 ==== watch-notify(notify (1) cookie 94247393717728 notify 137438953507 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7f1a9804b040 con 0x7f1a900b6060 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f19817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94247393717728 notifier 4745 bl.length()=160 2024-03-20T13:36:18.111 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 51 ==== osd_op_reply(161 notify.6 [notify cookie 94247393964096 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f19817fa640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:162 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1960003d50 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 52 ==== watch-notify(notify_complete (2) cookie 94247393964096 notify 137438953507 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1a9803d040 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 53 ==== osd_op_reply(162 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.981+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:163 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.982+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 54 ==== osd_op_reply(163 fud.buckets [delete] v32'8 uv8 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.982+0000 7f1aa231f800 10 removing user index: fud 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.982+0000 7f1aa231f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.982+0000 7f1aa231f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.982+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94247393959984 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.982+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 55 ==== watch-notify(notify (1) cookie 94247393720144 notify 137438953508 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7f1a9803d040 con 0x7f1a900b6060 2024-03-20T13:36:18.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.983+0000 7f19817fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94247393720144 notifier 4745 bl.length()=152 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.983+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 56 ==== osd_op_reply(164 notify.5 [notify cookie 94247393959984 out=8b] v0'0 uv225 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.983+0000 7f19817fa640 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7f1960003d50 con 0x7f1a900b6060 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.983+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 57 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.983+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 58 ==== watch-notify(notify_complete (2) cookie 94247393959984 notify 137438953508 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7f1a98005190 con 0x7f1a900b6060 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.983+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:166 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.984+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 59 ==== osd_op_reply(166 fud [call,call,delete] v32'7 uv7 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.985+0000 7f194f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.985+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:167 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94247393726128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae720ff0 con 0x55b7ae6b5700 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.986+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(167 data_loggenerations_metadata [watch unwatch cookie 94247393726128] v32'227 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.986+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:168 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94247393699520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b9c70 2024-03-20T13:36:18.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.987+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 48 ==== osd_op_reply(168 notify.0 [watch unwatch cookie 94247393699520] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.987+0000 7f1aa231f800 20 remove_watcher() i=0 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.987+0000 7f1aa231f800 2 removed watcher, disabling cache 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.987+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:169 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94247393705440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b5700 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.988+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(169 notify.1 [watch unwatch cookie 94247393705440] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.988+0000 7f1aa231f800 20 remove_watcher() i=1 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.988+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:170 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94247393706976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6be920 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.989+0000 7f1a9d7eb640 1 -- 172.21.15.177:0/3041199559 <== osd.3 v2:172.21.15.177:6809/1493521224 43 ==== osd_op_reply(170 notify.2 [watch unwatch cookie 94247393706976] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a94006070 con 0x55b7ae6be920 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.989+0000 7f1aa231f800 20 remove_watcher() i=2 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.989+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:171 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94247393708224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b9c70 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.990+0000 7f1a9dfec640 1 -- 172.21.15.177:0/3041199559 <== osd.2 v2:172.21.15.177:6800/3663022842 49 ==== osd_op_reply(171 notify.3 [watch unwatch cookie 94247393708224] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9008a070 con 0x55b7ae6b9c70 2024-03-20T13:36:18.114 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.990+0000 7f1aa231f800 20 remove_watcher() i=3 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.990+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:172 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94247393716672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x55b7ae6b5700 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.991+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(172 notify.4 [watch unwatch cookie 94247393716672] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x55b7ae6b5700 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.991+0000 7f1aa231f800 20 remove_watcher() i=4 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.991+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:173 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94247393720144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.992+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 60 ==== osd_op_reply(173 notify.5 [watch unwatch cookie 94247393720144] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.992+0000 7f1aa231f800 20 remove_watcher() i=5 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.992+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:174 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94247393717728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.993+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 61 ==== osd_op_reply(174 notify.6 [watch unwatch cookie 94247393717728] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.993+0000 7f1aa231f800 20 remove_watcher() i=6 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.993+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:175 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94247393725072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b7ae781200 con 0x7f1a900b6060 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 <== osd.0 v2:172.21.15.28:6800/801909073 62 ==== osd_op_reply(175 notify.7 [watch unwatch cookie 94247393725072] v32'227 uv225 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f1a9800a4a0 con 0x7f1a900b6060 2024-03-20T13:36:18.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 20 remove_watcher() i=7 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1a900b6060 msgr2=0x7f1a90070270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f1a900b6060 0x7f1a90070270 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae6b5700 msgr2=0x55b7ae6b7bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae6b5700 0x55b7ae6b7bc0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6b9c70 msgr2=0x55b7ae6bc060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6b9c70 0x55b7ae6bc060 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7ae6be920 msgr2=0x55b7ae6c0de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b7ae6be920 0x55b7ae6c0de0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1968036790 msgr2=0x7f1968038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1968036790 0x7f1968038c50 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x55b7ae67c060 tx=0x7f1a94010000 comp rx=0 tx=0).stop 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 msgr2=0x55b7ae6a9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.116 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3041199559 reap_dead start 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a9e80 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1a90054340 tx=0x7f1a9008d3e0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 shutdown_connections 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3041199559 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae6a2f00 0x55b7ae6a9e80 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 >> 172.21.15.177:0/3041199559 conn(0x55b7ae69f1d0 msgr2=0x55b7ae69c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 shutdown_connections 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.994+0000 7f1aa231f800 1 -- 172.21.15.177:0/3041199559 wait complete. 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1978036790 msgr2=0x7f1978038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1978036790 0x7f1978038c50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400bf90 tx=0x7f1a9400f000 comp rx=0 tx=0).stop 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 msgr2=0x55b7ae696300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 0x55b7ae696300 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f1a90001eb0 tx=0x7f1a9006ed30 comp rx=0 tx=0).stop 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 shutdown_connections 2024-03-20T13:36:18.117 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1978036790 0x7f1978038c50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3517698115 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae695ee0 0x55b7ae696300 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 >> 172.21.15.177:0/3517698115 conn(0x55b7ae689f80 msgr2=0x55b7ae68a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 shutdown_connections 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3517698115 wait complete. 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7ae6851b0 msgr2=0x55b7ae6875a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55b7ae6851b0 0x55b7ae6875a0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae583f40 msgr2=0x55b7ae67eb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b7ae583f40 0x55b7ae67eb60 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6812f0 msgr2=0x55b7ae6836e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b7ae6812f0 0x55b7ae6836e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.118 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1984036790 msgr2=0x7f1984038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f1984036790 0x7f1984038c50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f1a94000f60 tx=0x7f1a940010a0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 msgr2=0x55b7ae677d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 --2- 172.21.15.177:0/3649190982 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b7ae581610 0x55b7ae677d90 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f1a9001d3b0 tx=0x7f1a90002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1a9e7ed640 1 -- 172.21.15.177:0/3649190982 reap_dead start 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 shutdown_connections 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 >> 172.21.15.177:0/3649190982 conn(0x55b7ae57b040 msgr2=0x55b7ae66a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 shutdown_connections 2024-03-20T13:36:18.119 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:17.995+0000 7f1aa231f800 1 -- 172.21.15.177:0/3649190982 wait complete. 2024-03-20T13:36:23.120 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-03-20T13:36:23.121 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-03-20T13:36:23.121 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-03-20T13:36:23.171 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:23.171 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.170+0000 7f7bd1ee0800 1 Processor -- start 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.170+0000 7f7bd1ee0800 1 -- start start 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bd1ee0800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56473f686e70 0x56473f689260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bd1ee0800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56473f5cecd0 con 0x56473f6829e0 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bd1ee0800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x56473f585500 con 0x56473f686e70 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bcf1de640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x56473f686e70 0x56473f689260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bcf9df640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x56473f6829e0 0x56473f682e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51592/0 (socket says 172.21.15.177:51592) 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bcf9df640 1 -- 172.21.15.177:0/683621831 learned_addr learned my addr 172.21.15.177:0/683621831 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:23.173 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bcf1de640 1 -- 172.21.15.177:0/683621831 >> v1:172.21.15.28:6789/0 conn(0x56473f6829e0 legacy=0x56473f682e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.171+0000 7f7bcf1de640 1 -- 172.21.15.177:0/683621831 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56473f68a890 con 0x56473f686e70 2024-03-20T13:36:23.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.173+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/683621831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f686e70 0x56473f689260 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400a470 tx=0x7f7bc401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df26f1306eb0fee8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.174 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.173+0000 7f7bce9dd640 1 -- 172.21.15.177:0/683621831 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4052570 con 0x56473f686e70 2024-03-20T13:36:23.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.173+0000 7f7bce9dd640 1 -- 172.21.15.177:0/683621831 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc40526d0 con 0x56473f686e70 2024-03-20T13:36:23.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.173+0000 7f7bce9dd640 1 -- 172.21.15.177:0/683621831 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc4052990 con 0x56473f686e70 2024-03-20T13:36:23.175 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/683621831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f686e70 msgr2=0x56473f689260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/683621831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f686e70 0x56473f689260 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f7bc400a470 tx=0x7f7bc401cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:23.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/683621831 shutdown_connections 2024-03-20T13:36:23.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/683621831 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f686e70 0x56473f689260 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/683621831 >> 172.21.15.177:0/683621831 conn(0x56473f67e040 msgr2=0x56473f680460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/683621831 shutdown_connections 2024-03-20T13:36:23.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.174+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/683621831 wait complete. 2024-03-20T13:36:23.204 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.188+0000 7f7bd1ee0800 1 Processor -- start 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.188+0000 7f7bd1ee0800 1 -- start start 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.188+0000 7f7bd1ee0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f5f6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.188+0000 7f7bd1ee0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473f582a30 con 0x56473f6829e0 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f5f6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f5f6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43822/0 (socket says 172.21.15.177:43822) 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7bcf9df640 1 -- 172.21.15.177:0/727313252 learned_addr learned my addr 172.21.15.177:0/727313252 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7bcf9df640 1 -- 172.21.15.177:0/727313252 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc4005d20 con 0x56473f6829e0 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/727313252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f5f6cb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0001c80 tx=0x7f7bc000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80165ee479400e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7abde0b640 1 -- 172.21.15.177:0/727313252 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc000e470 con 0x56473f6829e0 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7abde0b640 1 -- 172.21.15.177:0/727313252 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000e5d0 con 0x56473f6829e0 2024-03-20T13:36:23.205 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.189+0000 7f7abde0b640 1 -- 172.21.15.177:0/727313252 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc000e8d0 con 0x56473f6829e0 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/727313252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 msgr2=0x56473f5f6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/727313252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f5f6cb0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0001c80 tx=0x7f7bc000b6c0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/727313252 shutdown_connections 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/727313252 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f5f6cb0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/727313252 >> 172.21.15.177:0/727313252 conn(0x56473f67e040 msgr2=0x56473f76e290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/727313252 shutdown_connections 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.190+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/727313252 wait complete. 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bd1ee0800 1 Processor -- start 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bd1ee0800 1 -- start start 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bd1ee0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f77b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bd1ee0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473f57e210 con 0x56473f6829e0 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f77b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.206 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f77b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43830/0 (socket says 172.21.15.177:43830) 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.191+0000 7f7bcf9df640 1 -- 172.21.15.177:0/1198562541 learned_addr learned my addr 172.21.15.177:0/1198562541 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7bcf9df640 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56473f5cecd0 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f77b180 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0001c80 tx=0x7f7bc0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7ab7fff640 1 -- 172.21.15.177:0/1198562541 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc001f070 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7ab7fff640 1 -- 172.21.15.177:0/1198562541 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc0018640 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56473f77b6c0 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7ab7fff640 1 -- 172.21.15.177:0/1198562541 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc00188e0 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.192+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56473f77bba0 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.193+0000 7f7ab7fff640 1 -- 172.21.15.177:0/1198562541 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bc0018b10 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.193+0000 7f7ab7fff640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.193+0000 7f7ab7fff640 1 -- 172.21.15.177:0/1198562541 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7bc004c370 con 0x56473f6829e0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.193+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.207 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.193+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f686e70 0x56473f781e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.193+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f782440 con 0x56473f686e70 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd01e0640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f686e70 0x56473f781e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4054000 tx=0x7f7bc404e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd01e0640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f686e70 0x56473f781e70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd01e0640 1 -- 172.21.15.177:0/1198562541 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f686e70 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f77f580 con 0x56473f686e70 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd01e0640 1 -- 172.21.15.177:0/1198562541 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f686e70 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7846b0 0x56473f786aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.194+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f787190 con 0x56473f7846b0 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.195+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7846b0 0x56473f786aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.195+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7846b0 0x56473f786aa0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.208 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.195+0000 7f7bcf9df640 1 -- 172.21.15.177:0/1198562541 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7846b0 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.195+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f783630 con 0x56473f686e70 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.195+0000 7f7bd01e0640 1 -- 172.21.15.177:0/1198562541 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f686e70 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.196+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56473f7885b0 0x56473f78a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.196+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f78b0e0 con 0x56473f7885b0 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.196+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56473f7885b0 0x56473f78a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.196+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56473f7885b0 0x56473f78a9a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.197+0000 7f7bcf1de640 1 -- 172.21.15.177:0/1198562541 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7885b0 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.197+0000 7f7bd1ee0800 1 Processor -- start 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.197+0000 7f7bd1ee0800 1 -- start start 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.197+0000 7f7bd1ee0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 0x56473f7727a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.197+0000 7f7bd1ee0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473f520c70 con 0x56473f774330 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 0x56473f7727a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 0x56473f7727a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43836/0 (socket says 172.21.15.177:43836) 2024-03-20T13:36:23.209 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3594813470 learned_addr learned my addr 172.21.15.177:0/3594813470 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3594813470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56473f772ce0 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 0x56473f7727a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0049470 tx=0x7f7bc0022fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7ab57fa640 1 -- 172.21.15.177:0/3594813470 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc0032040 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7ab57fa640 1 -- 172.21.15.177:0/3594813470 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc0043f60 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7ab57fa640 1 -- 172.21.15.177:0/3594813470 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc0044200 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56473f772f30 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.198+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56473f772f30 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.199+0000 7f7ab57fa640 1 -- 172.21.15.177:0/3594813470 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bc0044360 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.199+0000 7f7ab57fa640 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa80367e0 0x7f7aa8038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.199+0000 7f7ab57fa640 1 -- 172.21.15.177:0/3594813470 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7bc0038d60 con 0x56473f774330 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa80367e0 0x7f7aa8038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bd1ee0800 1 Processor -- start 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bd1ee0800 1 -- start start 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa80367e0 0x7f7aa8038ca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x56473f77f4a0 tx=0x7f7bc4005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bd1ee0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bd1ee0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473f4f65d0 con 0x56473f7a8490 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7a8890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43846/0 (socket says 172.21.15.177:43846) 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.200+0000 7f7bcf9df640 1 -- 172.21.15.177:0/2594104678 learned_addr learned my addr 172.21.15.177:0/2594104678 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7bcf9df640 1 -- 172.21.15.177:0/2594104678 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56473f7a8e60 con 0x56473f7a8490 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/2594104678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7a8890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0024750 tx=0x7f7bc00244e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c32aa5d93d4be58 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7aaeffd640 1 -- 172.21.15.177:0/2594104678 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc00249f0 con 0x56473f7a8490 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7aaeffd640 1 -- 172.21.15.177:0/2594104678 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc0016c50 con 0x56473f7a8490 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7aaeffd640 1 -- 172.21.15.177:0/2594104678 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc003e500 con 0x56473f7a8490 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/2594104678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 msgr2=0x56473f7a8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.201+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/2594104678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7a8890 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0024750 tx=0x7f7bc00244e0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/2594104678 shutdown_connections 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/2594104678 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7a8890 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/2594104678 >> 172.21.15.177:0/2594104678 conn(0x56473f7a4710 msgr2=0x56473f7a2770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/2594104678 shutdown_connections 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/2594104678 wait complete. 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 Processor -- start 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 -- start start 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bd1ee0800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56473f7af830 con 0x56473f7a8490 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bcf9df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43854/0 (socket says 172.21.15.177:43854) 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.202+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 learned_addr learned my addr 172.21.15.177:0/3256921548 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bc003b030 con 0x56473f7a8490 2024-03-20T13:36:23.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7af2f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7bc004c2e0 tx=0x7f7bc0011fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7aad7fa640 1 -- 172.21.15.177:0/3256921548 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc0064070 con 0x56473f7a8490 2024-03-20T13:36:23.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7aad7fa640 1 -- 172.21.15.177:0/3256921548 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bc000d500 con 0x56473f7a8490 2024-03-20T13:36:23.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56473f7afa30 con 0x56473f7a8490 2024-03-20T13:36:23.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7aad7fa640 1 -- 172.21.15.177:0/3256921548 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7bc004e1d0 con 0x56473f7a8490 2024-03-20T13:36:23.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.203+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56473f7afa30 con 0x56473f7a8490 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.204+0000 7f7aad7fa640 1 -- 172.21.15.177:0/3256921548 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f7bc0059070 con 0x56473f7a8490 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.204+0000 7f7aad7fa640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7a98036790 0x7f7a98038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.204+0000 7f7aad7fa640 1 -- 172.21.15.177:0/3256921548 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f7bc0056040 con 0x56473f7a8490 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.205+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7a98036790 0x7f7a98038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.205+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7a98036790 0x7f7a98038c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56473f78b4a0 tx=0x7f7bc404f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.205+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.205+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f7bad40 0x56473f7bd200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.205+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7bd950 con 0x56473f7bad40 2024-03-20T13:36:23.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.205+0000 7f7bd01e0640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f7bad40 0x56473f7bd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd01e0640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f7bad40 0x56473f7bd200 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 realm 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7bdd20 con 0x56473f7bad40 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.206+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be900 con 0x56473f7bad40 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7bf2b0 0x56473f7c16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c1c60 con 0x56473f7bf2b0 2024-03-20T13:36:23.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7bf2b0 0x56473f7c16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7bf2b0 0x56473f7c16a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 20 searching for the correct realm 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56473f7c3f70 0x56473f7c6430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c6b00 con 0x56473f7c3f70 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.207+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56473f7c3f70 0x56473f7c6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.208+0000 7f7bcf1de640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56473f7c3f70 0x56473f7c6430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.208+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.208+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c6b00 con 0x56473f7bf2b0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.208+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.208+0000 7f7bcf9df640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bc0017050 0x7f7bc005d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.208+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c6b00 con 0x7f7bc0017050 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.209+0000 7f7bd01e0640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bc0017050 0x7f7bc005d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.209+0000 7f7bd01e0640 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bc0017050 0x7f7bc005d8a0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.209+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.209+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.210+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.210+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.210+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.210+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.210+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.210+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bf2b0 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.211+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.212+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.212+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.212+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.212+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bf2b0 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.212+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.212+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.213+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.214+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.214+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.214+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.214+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.214+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.214+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bf2b0 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.215+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.216+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.216+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bf2b0 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.216+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.216+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.216+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.216+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bf2b0 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.217+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.217+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7c3f70 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.217+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.217+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x7f7bc0017050 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.217+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.217+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bad40 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7be5a0 con 0x56473f7bf2b0 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:23.237 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c2370 con 0x56473f7bad40 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c2370 con 0x56473f7bad40 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.218+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c2320 con 0x7f7bc0017050 2024-03-20T13:36:23.238 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 20 zone default found 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 4 Realm: () 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 20 zonegroup default 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c2c10 con 0x7f7bc0017050 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.239 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.219+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c3010 con 0x56473f7c3f70 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c8920 con 0x56473f7c3f70 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 20 started sync module instance, tier type = 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.220+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c2900 con 0x56473f7bf2b0 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.221+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.221+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864007790192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c8c80 con 0x56473f7bf2b0 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.221+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c9700 con 0x56473f7bad40 2024-03-20T13:36:23.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.222+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864007790192] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.223+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.223+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864007795200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c9ae0 con 0x56473f7bad40 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.223+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7ca4e0 con 0x56473f7c3f70 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.224+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.224+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864007798752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cad60 con 0x56473f7c3f70 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.224+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cb810 con 0x56473f7bf2b0 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.224+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864007795200] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.225+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.225+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864007791344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cc090 con 0x56473f7bf2b0 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.225+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cca00 con 0x56473f7bad40 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.225+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864007798752] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.226+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864007791344] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.226+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.226+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864007801024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cca00 con 0x56473f7bad40 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.227+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cd200 con 0x7f7bc0017050 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.228+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864007801024] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.228+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.228+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864007808832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cd0c0 con 0x7f7bc0017050 2024-03-20T13:36:23.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.228+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cdb60 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.229+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864007808832] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.229+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.229+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864007812672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cdb20 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.229+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7ce500 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864007812672] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(58 notify.7 [create] v32'228 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864007809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7ce4c0 con 0x7f7bc0017050 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=0 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=1 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=2 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=3 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=4 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=5 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.230+0000 7f7bd1ee0800 20 add_watcher() i=6 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.231+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864007809888] v32'229 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.231+0000 7f7bd1ee0800 20 add_watcher() i=7 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.231+0000 7f7bd1ee0800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.231+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7d1970 con 0x56473f7bad40 2024-03-20T13:36:23.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.232+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.232+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864007815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cee50 con 0x56473f7bad40 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864007815664] v32'228 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7a85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7bd1ee0800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7bd1ee0800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7bd1ee0800 5 note: GC not initialized 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7a84fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.233+0000 7f7bd1ee0800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 20 Filter name: none 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f79fe7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f8038d0 con 0x56473f7bad40 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.234+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f805df0 con 0x7f7bc0017050 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.236+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call] v32'33 uv33 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.236+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f805df0 con 0x7f7bc0017050 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.237+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(64 usage.10 [call] v32'34 uv33 ondisk = -61 ((61) No data available)) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.238+0000 7f7a85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.238+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864007815664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7d0fd0 con 0x56473f7bad40 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.239+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94864007815664] v32'229 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.256 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.239+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864007790192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f803300 con 0x56473f7bf2b0 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.240+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94864007790192] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.240+0000 7f7bd1ee0800 20 remove_watcher() i=0 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.240+0000 7f7bd1ee0800 2 removed watcher, disabling cache 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.240+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864007795200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c7e70 con 0x56473f7bad40 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.241+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94864007795200] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.241+0000 7f7bd1ee0800 20 remove_watcher() i=1 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.241+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864007798752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c7e70 con 0x56473f7c3f70 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.242+0000 7f7bcf1de640 1 -- 172.21.15.177:0/3256921548 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94864007798752] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc4059040 con 0x56473f7c3f70 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.242+0000 7f7bd1ee0800 20 remove_watcher() i=2 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.242+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864007791344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c9200 con 0x56473f7bf2b0 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.243+0000 7f7bcf9df640 1 -- 172.21.15.177:0/3256921548 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94864007791344] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc0014070 con 0x56473f7bf2b0 2024-03-20T13:36:23.257 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.243+0000 7f7bd1ee0800 20 remove_watcher() i=3 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.243+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864007801024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c9200 con 0x56473f7bad40 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.244+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94864007801024] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x56473f7bad40 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.244+0000 7f7bd1ee0800 20 remove_watcher() i=4 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.244+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864007808832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7c9200 con 0x7f7bc0017050 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.245+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94864007808832] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.245+0000 7f7bd1ee0800 20 remove_watcher() i=5 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.246+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864007812672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cc740 con 0x7f7bc0017050 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.247+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94864007812672] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.247+0000 7f7bd1ee0800 20 remove_watcher() i=6 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.247+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864007809888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x56473f7cd640 con 0x7f7bc0017050 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94864007809888] v32'230 uv228 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7bc800a4a0 con 0x7f7bc0017050 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 20 remove_watcher() i=7 2024-03-20T13:36:23.258 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bc0017050 msgr2=0x7f7bc005d8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f7bc0017050 0x7f7bc005d8a0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f7bad40 msgr2=0x56473f7bd200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f7bad40 0x56473f7bd200 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7bf2b0 msgr2=0x56473f7c16a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7bf2b0 0x56473f7c16a0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56473f7c3f70 msgr2=0x56473f7c6430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x56473f7c3f70 0x56473f7c6430 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7a98036790 msgr2=0x7f7a98038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7a98036790 0x7f7a98038c50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x56473f78b4a0 tx=0x7f7bc404f000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 msgr2=0x56473f7af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd01e0640 1 -- 172.21.15.177:0/3256921548 reap_dead start 2024-03-20T13:36:23.259 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7af2f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7bc004c2e0 tx=0x7f7bc0011fa0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 shutdown_connections 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3256921548 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f7a8490 0x56473f7af2f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 >> 172.21.15.177:0/3256921548 conn(0x56473f7a4710 msgr2=0x56473f7a1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 shutdown_connections 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.248+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3256921548 wait complete. 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa80367e0 msgr2=0x7f7aa8038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa80367e0 0x7f7aa8038ca0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x56473f77f4a0 tx=0x7f7bc4005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 msgr2=0x56473f7727a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 0x56473f7727a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0049470 tx=0x7f7bc0022fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 shutdown_connections 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7aa80367e0 0x7f7aa8038ca0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/3594813470 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f774330 0x56473f7727a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.260 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 >> 172.21.15.177:0/3594813470 conn(0x56473f78d310 msgr2=0x56473f78d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 shutdown_connections 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/3594813470 wait complete. 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56473f7885b0 msgr2=0x56473f78a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x56473f7885b0 0x56473f78a9a0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f686e70 msgr2=0x56473f781e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x56473f686e70 0x56473f781e70 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7846b0 msgr2=0x56473f786aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x56473f7846b0 0x56473f786aa0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 msgr2=0x7f7ab8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f7ab8036790 0x7f7ab8038c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4054000 tx=0x7f7bc404e000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 msgr2=0x56473f77b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 --2- 172.21.15.177:0/1198562541 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x56473f6829e0 0x56473f77b180 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f7bc0001c80 tx=0x7f7bc0000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd01e0640 1 -- 172.21.15.177:0/1198562541 reap_dead start 2024-03-20T13:36:23.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 shutdown_connections 2024-03-20T13:36:23.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 >> 172.21.15.177:0/1198562541 conn(0x56473f67e040 msgr2=0x56473f76caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 shutdown_connections 2024-03-20T13:36:23.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.249+0000 7f7bd1ee0800 1 -- 172.21.15.177:0/1198562541 wait complete. 2024-03-20T13:36:23.263 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-03-20T13:36:23.263 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-03-20T13:36:23.263 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-03-20T13:36:23.306 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:23.306 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c2d533800 1 Processor -- start 2024-03-20T13:36:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c2d533800 1 -- start start 2024-03-20T13:36:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c2d533800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x558ea9fde610 0x558ea9fe0a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c2d533800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558ea9f28cd0 con 0x558ea9fe0f40 2024-03-20T13:36:23.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c2d533800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x558ea9edf500 con 0x558ea9fde610 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c292f2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x558ea9fde610 0x558ea9fe0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c28af1640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x558ea9fe0f40 0x558ea9fe3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51594/0 (socket says 172.21.15.177:51594) 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.306+0000 7f8c28af1640 1 -- 172.21.15.177:0/3896916529 learned_addr learned my addr 172.21.15.177:0/3896916529 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.307+0000 7f8c1bfff640 1 -- 172.21.15.177:0/3896916529 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 117260040 0 0) 0x558ea9f28cd0 con 0x558ea9fe0f40 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.307+0000 7f8c1bfff640 1 -- 172.21.15.177:0/3896916529 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c14001e10 con 0x558ea9fe0f40 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.307+0000 7f8c292f2640 1 -- 172.21.15.177:0/3896916529 >> v1:172.21.15.28:6789/0 conn(0x558ea9fe0f40 legacy=0x558ea9fe3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.307+0000 7f8c292f2640 1 -- 172.21.15.177:0/3896916529 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ea9fe5a60 con 0x558ea9fde610 2024-03-20T13:36:23.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c292f2640 1 --2- 172.21.15.177:0/3896916529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558ea9fe0a00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00a470 tx=0x7f8c1c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3cdbab2c03b78d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c1bfff640 1 -- 172.21.15.177:0/3896916529 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c04ad60 con 0x558ea9fde610 2024-03-20T13:36:23.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c1bfff640 1 -- 172.21.15.177:0/3896916529 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c052440 con 0x558ea9fde610 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c1bfff640 1 -- 172.21.15.177:0/3896916529 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c052700 con 0x558ea9fde610 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 -- 172.21.15.177:0/3896916529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 msgr2=0x558ea9fe0a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 --2- 172.21.15.177:0/3896916529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558ea9fe0a00 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c00a470 tx=0x7f8c1c01cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 -- 172.21.15.177:0/3896916529 shutdown_connections 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 --2- 172.21.15.177:0/3896916529 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558ea9fe0a00 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 -- 172.21.15.177:0/3896916529 >> 172.21.15.177:0/3896916529 conn(0x558ea9fd8040 msgr2=0x558ea9fda460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 -- 172.21.15.177:0/3896916529 shutdown_connections 2024-03-20T13:36:23.311 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.309+0000 7f8c2d533800 1 -- 172.21.15.177:0/3896916529 wait complete. 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c2d533800 1 Processor -- start 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c2d533800 1 -- start start 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c2d533800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c2d533800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9edca30 con 0x558ea9fde610 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0cd890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43858/0 (socket says 172.21.15.177:43858) 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.321+0000 7f8c292f2640 1 -- 172.21.15.177:0/2832555689 learned_addr learned my addr 172.21.15.177:0/2832555689 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.322+0000 7f8c292f2640 1 -- 172.21.15.177:0/2832555689 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c1c005d20 con 0x558ea9fde610 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.322+0000 7f8c292f2640 1 --2- 172.21.15.177:0/2832555689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0cd890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c055040 tx=0x7f8c1c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498a058662babe69 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.322+0000 7f8b17606640 1 -- 172.21.15.177:0/2832555689 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c00a040 con 0x558ea9fde610 2024-03-20T13:36:23.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.322+0000 7f8b17606640 1 -- 172.21.15.177:0/2832555689 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c00a1a0 con 0x558ea9fde610 2024-03-20T13:36:23.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.322+0000 7f8b17606640 1 -- 172.21.15.177:0/2832555689 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c0525b0 con 0x558ea9fde610 2024-03-20T13:36:23.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- 172.21.15.177:0/2832555689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 msgr2=0x558eaa0cd890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 --2- 172.21.15.177:0/2832555689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0cd890 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c055040 tx=0x7f8c1c04c000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- 172.21.15.177:0/2832555689 shutdown_connections 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 --2- 172.21.15.177:0/2832555689 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0cd890 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- 172.21.15.177:0/2832555689 >> 172.21.15.177:0/2832555689 conn(0x558ea9fd8040 msgr2=0x558eaa0c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- 172.21.15.177:0/2832555689 shutdown_connections 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- 172.21.15.177:0/2832555689 wait complete. 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 Processor -- start 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- start start 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0d4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c2d533800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9ed8210 con 0x558ea9fde610 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0d4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0d4ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43872/0 (socket says 172.21.15.177:43872) 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.323+0000 7f8c292f2640 1 -- 172.21.15.177:0/1477768334 learned_addr learned my addr 172.21.15.177:0/1477768334 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8c292f2640 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ea9fe5a60 con 0x558ea9fde610 2024-03-20T13:36:23.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0d4ee0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c055040 tx=0x7f8c1c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8b15e03640 1 -- 172.21.15.177:0/1477768334 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c06b070 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8b15e03640 1 -- 172.21.15.177:0/1477768334 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c052c60 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558eaa0d5420 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8b15e03640 1 -- 172.21.15.177:0/1477768334 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c06f410 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.324+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eaa0d5960 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8b15e03640 1 -- 172.21.15.177:0/1477768334 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c1c059050 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8b15e03640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b10036790 0x7f8b10038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8b15e03640 1 -- 172.21.15.177:0/1477768334 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f8c1c08d250 con 0x558ea9fde610 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b10036790 0x7f8b10038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558ea9fe0f40 0x558eaa0dbd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa0dc240 con 0x558ea9fe0f40 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8c29af3640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558ea9fe0f40 0x558eaa0dbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.325+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b10036790 0x7f8b10038c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c20000f60 tx=0x7f8c200010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c29af3640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558ea9fe0f40 0x558eaa0dbd00 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c29af3640 1 -- 172.21.15.177:0/1477768334 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558ea9fe0f40 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa0d92c0 con 0x558ea9fe0f40 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c29af3640 1 -- 172.21.15.177:0/1477768334 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558ea9fe0f40 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa0de480 0x558eaa0e0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa0e0f40 con 0x558eaa0de480 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.326+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa0de480 0x558eaa0e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.327+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa0de480 0x558eaa0e0870 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.327+0000 7f8c292f2640 1 -- 172.21.15.177:0/1477768334 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f8c1c06ec70 con 0x558eaa0de480 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.327+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa0dd400 con 0x558ea9fe0f40 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.327+0000 7f8c29af3640 1 -- 172.21.15.177:0/1477768334 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558ea9fe0f40 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.327+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558eaa0e2340 0x558eaa0e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.327+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa0e4e90 con 0x558eaa0e2340 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.328+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558eaa0e2340 0x558eaa0e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.328+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558eaa0e2340 0x558eaa0e4730 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.328+0000 7f8c28af1640 1 -- 172.21.15.177:0/1477768334 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa0e2340 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c2d533800 1 Processor -- start 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c2d533800 1 -- start start 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c2d533800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 0x558eaa0f3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c2d533800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9e7ac70 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 0x558eaa0f3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 0x558eaa0f3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43874/0 (socket says 172.21.15.177:43874) 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c292f2640 1 -- 172.21.15.177:0/1305789340 learned_addr learned my addr 172.21.15.177:0/1305789340 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.329+0000 7f8c292f2640 1 -- 172.21.15.177:0/1305789340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eaa0f3980 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.330+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 0x558eaa0f3440 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c08b630 tx=0x7f8c1c05b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.330+0000 7f8b0effd640 1 -- 172.21.15.177:0/1305789340 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c08b3a0 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.330+0000 7f8b0effd640 1 -- 172.21.15.177:0/1305789340 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c0783b0 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.330+0000 7f8b0effd640 1 -- 172.21.15.177:0/1305789340 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c078650 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.330+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558eaa0f43f0 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.330+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eaa0f48b0 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8b0effd640 1 -- 172.21.15.177:0/1305789340 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c1c0703b0 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8b0effd640 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b000367e0 0x7f8b00038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8b0effd640 1 -- 172.21.15.177:0/1305789340 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f8c1c097d20 con 0x558eaa0f3020 2024-03-20T13:36:23.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b000367e0 0x7f8b00038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c2d533800 1 Processor -- start 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c2d533800 1 -- start start 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b000367e0 0x7f8b00038ca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000bf90 tx=0x7f8c2000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c2d533800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa100580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c2d533800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ea9e505d0 con 0x558eaa100180 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa100580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa100580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43880/0 (socket says 172.21.15.177:43880) 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.331+0000 7f8c292f2640 1 -- 172.21.15.177:0/1460938569 learned_addr learned my addr 172.21.15.177:0/1460938569 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8c292f2640 1 -- 172.21.15.177:0/1460938569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eaa100b50 con 0x558eaa100180 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1460938569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa100580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c052800 tx=0x7f8c1c08ddc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b582ee467bb5b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8b0cff9640 1 -- 172.21.15.177:0/1460938569 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c08d530 con 0x558eaa100180 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8b0cff9640 1 -- 172.21.15.177:0/1460938569 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c08d690 con 0x558eaa100180 2024-03-20T13:36:23.342 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8b0cff9640 1 -- 172.21.15.177:0/1460938569 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c053d30 con 0x558eaa100180 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8c2d533800 1 -- 172.21.15.177:0/1460938569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 msgr2=0x558eaa100580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.332+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1460938569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa100580 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c052800 tx=0x7f8c1c08ddc0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 -- 172.21.15.177:0/1460938569 shutdown_connections 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1460938569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa100580 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 -- 172.21.15.177:0/1460938569 >> 172.21.15.177:0/1460938569 conn(0x558eaa0fc450 msgr2=0x558eaa0fa4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 -- 172.21.15.177:0/1460938569 shutdown_connections 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 -- 172.21.15.177:0/1460938569 wait complete. 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 Processor -- start 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 -- start start 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c2d533800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eaa107480 con 0x558eaa100180 2024-03-20T13:36:23.343 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c292f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43882/0 (socket says 172.21.15.177:43882) 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.333+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 learned_addr learned my addr 172.21.15.177:0/1867408440 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eaa0f43f0 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa106f40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0778f0 tx=0x7f8c1c07ff00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8afeffd640 1 -- 172.21.15.177:0/1867408440 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c0b6070 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8afeffd640 1 -- 172.21.15.177:0/1867408440 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1c079a50 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8afeffd640 1 -- 172.21.15.177:0/1867408440 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8c1c08bb70 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558eaa0f43f0 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.334+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558eaa0f43f0 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8afeffd640 1 -- 172.21.15.177:0/1867408440 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8c1c077960 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8afeffd640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8af4036790 0x7f8af4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8afeffd640 1 -- 172.21.15.177:0/1867408440 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f8c1c0bfa40 con 0x558eaa100180 2024-03-20T13:36:23.344 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8af4036790 0x7f8af4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558eaa112540 0x558eaa114a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115150 con 0x558eaa112540 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.335+0000 7f8c29af3640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558eaa112540 0x558eaa114a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8af4036790 0x7f8af4038c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x558eaa0d9200 tx=0x7f8c20010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c29af3640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558eaa112540 0x558eaa114a00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 realm 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115520 con 0x558eaa112540 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.345 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.336+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1160d0 con 0x558eaa112540 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa116a80 0x558eaa118e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1193b0 con 0x558eaa116a80 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa116a80 0x558eaa118e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa116a80 0x558eaa118e70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.346 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 20 searching for the correct realm 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558eaa11b3b0 0x558eaa11d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11df40 con 0x558eaa11b3b0 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.337+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558eaa11b3b0 0x558eaa11d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.338+0000 7f8c28af1640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558eaa11b3b0 0x558eaa11d870 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.338+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.338+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11df40 con 0x558eaa116a80 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.338+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.338+0000 7f8c292f2640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c1c086040 0x7f8c1c0513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.338+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11df40 con 0x7f8c1c086040 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.339+0000 7f8c29af3640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c1c086040 0x7f8c1c0513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.339+0000 7f8c29af3640 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c1c086040 0x7f8c1c0513a0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.339+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.339+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.339+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.340+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa116a80 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.341+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa116a80 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.342+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.343+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa116a80 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.344+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.345+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.345+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa116a80 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.345+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.345+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.345+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.345+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa116a80 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.346+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.346+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa11b3b0 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.346+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.346+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x7f8c1c086040 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.346+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.346+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa112540 2024-03-20T13:36:23.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa115d70 con 0x558eaa116a80 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa119cb0 con 0x558eaa112540 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa119cb0 con 0x558eaa112540 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.347+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa119cb0 con 0x7f8c1c086040 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 zone default found 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 4 Realm: () 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:23.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 zonegroup default 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11a550 con 0x7f8c1c086040 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11a950 con 0x558eaa11b3b0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.348+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11fd60 con 0x558eaa11b3b0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.349+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.349+0000 7f8c2d533800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.349+0000 7f8c2d533800 20 started sync module instance, tier type = 2024-03-20T13:36:23.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.349+0000 7f8c2d533800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.349+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11f1f0 con 0x558eaa116a80 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.350+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.350+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94071227020704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa11f9c0 con 0x558eaa116a80 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.350+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa120b70 con 0x558eaa112540 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.351+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94071227020704] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.351+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.351+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94071227025104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa120f90 con 0x558eaa112540 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.351+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa121900 con 0x558eaa11b3b0 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.352+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.352+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94071227028576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa122100 con 0x558eaa11b3b0 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.352+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa122b90 con 0x558eaa116a80 2024-03-20T13:36:23.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.352+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94071227025104] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.353+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.353+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94071227026160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1233e0 con 0x558eaa116a80 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.353+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94071227028576] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.353+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa123d50 con 0x558eaa112540 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.354+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.354+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94071227030624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa123d50 con 0x558eaa112540 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.354+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94071227026160] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.354+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1246c0 con 0x7f8c1c086040 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.355+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94071227030624] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.355+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.356+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94071227037872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa123cd0 con 0x7f8c1c086040 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.356+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa124b60 con 0x7f8c1c086040 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.357+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94071227037872] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.357+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.357+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94071227040288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa124ae0 con 0x7f8c1c086040 2024-03-20T13:36:23.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.357+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa125530 con 0x7f8c1c086040 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'231 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94071227040288] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94071227043888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1254f0 con 0x7f8c1c086040 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=0 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=1 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=2 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=3 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=4 2024-03-20T13:36:23.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=5 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.358+0000 7f8c2d533800 20 add_watcher() i=6 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.359+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94071227043888] v32'232 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.359+0000 7f8c2d533800 20 add_watcher() i=7 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.359+0000 7f8c2d533800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.359+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa124700 con 0x558eaa112540 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.359+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.359+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94071227046080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa124700 con 0x558eaa112540 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.360+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94071227046080] v32'230 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.360+0000 7f8adf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.360+0000 7f8c2d533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.360+0000 7f8c2d533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.360+0000 7f8c2d533800 5 note: GC not initialized 2024-03-20T13:36:23.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8ade7e4640 20 reqs_thread_entry: start 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c2d533800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c2d533800 20 Filter name: none 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8a4ffff640 20 reqs_thread_entry: start 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c2d533800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa15a4f0 con 0x558eaa112540 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c2d533800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.361+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa15ba00 con 0x7f8c1c086040 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.362+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) v8 ==== 152+0+15 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.362+0000 7f8adf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.362+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94071227046080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa15a4f0 con 0x558eaa112540 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.363+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94071227046080] v32'231 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.363+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94071227020704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa15a4f0 con 0x558eaa116a80 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.364+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94071227020704] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.364+0000 7f8c2d533800 20 remove_watcher() i=0 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.364+0000 7f8c2d533800 2 removed watcher, disabling cache 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.364+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94071227025104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa15a4f0 con 0x558eaa112540 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.366+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94071227025104] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.366+0000 7f8c2d533800 20 remove_watcher() i=1 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.366+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94071227028576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa15a4f0 con 0x558eaa11b3b0 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.367+0000 7f8c28af1640 1 -- 172.21.15.177:0/1867408440 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94071227028576] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c20006070 con 0x558eaa11b3b0 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.367+0000 7f8c2d533800 20 remove_watcher() i=2 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.367+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94071227026160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1206d0 con 0x558eaa116a80 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.368+0000 7f8c292f2640 1 -- 172.21.15.177:0/1867408440 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94071227026160] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c1c0b8070 con 0x558eaa116a80 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.368+0000 7f8c2d533800 20 remove_watcher() i=3 2024-03-20T13:36:23.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.368+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94071227030624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa121460 con 0x558eaa112540 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.369+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94071227030624] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x558eaa112540 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.369+0000 7f8c2d533800 20 remove_watcher() i=4 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.369+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94071227037872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa121c60 con 0x7f8c1c086040 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.370+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94071227037872] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.370+0000 7f8c2d533800 20 remove_watcher() i=5 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.370+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94071227040288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa121460 con 0x7f8c1c086040 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.372+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94071227040288] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.372+0000 7f8c2d533800 20 remove_watcher() i=6 2024-03-20T13:36:23.377 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.372+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94071227043888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558eaa1238b0 con 0x7f8c1c086040 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94071227043888] v32'233 uv231 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f8c2400a4a0 con 0x7f8c1c086040 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 20 remove_watcher() i=7 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c1c086040 msgr2=0x7f8c1c0513a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f8c1c086040 0x7f8c1c0513a0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558eaa112540 msgr2=0x558eaa114a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558eaa112540 0x558eaa114a00 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.380 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa116a80 msgr2=0x558eaa118e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa116a80 0x558eaa118e70 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558eaa11b3b0 msgr2=0x558eaa11d870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558eaa11b3b0 0x558eaa11d870 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8af4036790 msgr2=0x7f8af4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8af4036790 0x7f8af4038c50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x558eaa0d9200 tx=0x7f8c20010000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 msgr2=0x558eaa106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1867408440 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa100180 0x558eaa106f40 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c0778f0 tx=0x7f8c1c07ff00 comp rx=0 tx=0).stop 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 reap_dead start 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c29af3640 1 -- 172.21.15.177:0/1867408440 reap_dead start 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 shutdown_connections 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 >> 172.21.15.177:0/1867408440 conn(0x558eaa0fc450 msgr2=0x558eaa0f9ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 shutdown_connections 2024-03-20T13:36:23.381 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.373+0000 7f8c2d533800 1 -- 172.21.15.177:0/1867408440 wait complete. 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b000367e0 msgr2=0x7f8b00038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b000367e0 0x7f8b00038ca0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000bf90 tx=0x7f8c2000f000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 msgr2=0x558eaa0f3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 0x558eaa0f3440 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c08b630 tx=0x7f8c1c05b430 comp rx=0 tx=0).stop 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 shutdown_connections 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b000367e0 0x7f8b00038ca0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1305789340 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558eaa0f3020 0x558eaa0f3440 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 >> 172.21.15.177:0/1305789340 conn(0x558eaa0e70c0 msgr2=0x558eaa0e74c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 shutdown_connections 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1305789340 wait complete. 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558eaa0e2340 msgr2=0x558eaa0e4730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558eaa0e2340 0x558eaa0e4730 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.382 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558ea9fe0f40 msgr2=0x558eaa0dbd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558ea9fe0f40 0x558eaa0dbd00 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa0de480 msgr2=0x558eaa0e0870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558eaa0de480 0x558eaa0e0870 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b10036790 msgr2=0x7f8b10038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8b10036790 0x7f8b10038c50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f8c20000f60 tx=0x7f8c200010a0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 msgr2=0x558eaa0d4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 --2- 172.21.15.177:0/1477768334 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558ea9fde610 0x558eaa0d4ee0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f8c1c055040 tx=0x7f8c1c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c29af3640 1 -- 172.21.15.177:0/1477768334 reap_dead start 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 shutdown_connections 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 >> 172.21.15.177:0/1477768334 conn(0x558ea9fd8040 msgr2=0x558eaa0c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 shutdown_connections 2024-03-20T13:36:23.383 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.374+0000 7f8c2d533800 1 -- 172.21.15.177:0/1477768334 wait complete. 2024-03-20T13:36:23.384 INFO:teuthology.orchestra.run.smithi177.stdout:{"entries":[],"summary":[]} 2024-03-20T13:36:23.384 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-03-20T13:36:23.385 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-03-20T13:36:23.385 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-03-20T13:36:23.385 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-03-20T13:36:23.468 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:23.469 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.468+0000 7fa584a44800 1 Processor -- start 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.468+0000 7fa584a44800 1 -- start start 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.468+0000 7fa584a44800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564a607ba5f0 0x564a607bc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.468+0000 7fa584a44800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x564a60704cd0 con 0x564a607bcf20 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.468+0000 7fa584a44800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x564a606bb500 con 0x564a607ba5f0 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.469+0000 7fa582543640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x564a607ba5f0 0x564a607bc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.469+0000 7fa57bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x564a607bcf20 0x564a607bf310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51604/0 (socket says 172.21.15.177:51604) 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.469+0000 7fa57bfff640 1 -- 172.21.15.177:0/2569153012 learned_addr learned my addr 172.21.15.177:0/2569153012 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:23.470 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.469+0000 7fa582543640 1 -- 172.21.15.177:0/2569153012 >> v1:172.21.15.28:6789/0 conn(0x564a607bcf20 legacy=0x564a607bf310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.471 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.469+0000 7fa582543640 1 -- 172.21.15.177:0/2569153012 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a607c1a40 con 0x564a607ba5f0 2024-03-20T13:36:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa582543640 1 --2- 172.21.15.177:0/2569153012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607bc9e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa57400a470 tx=0x7fa57401cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eab4e6906cf582 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa581d42640 1 -- 172.21.15.177:0/2569153012 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa574052570 con 0x564a607ba5f0 2024-03-20T13:36:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa581d42640 1 -- 172.21.15.177:0/2569153012 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5740526d0 con 0x564a607ba5f0 2024-03-20T13:36:23.472 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa581d42640 1 -- 172.21.15.177:0/2569153012 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa574052990 con 0x564a607ba5f0 2024-03-20T13:36:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa584a44800 1 -- 172.21.15.177:0/2569153012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 msgr2=0x564a607bc9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa584a44800 1 --2- 172.21.15.177:0/2569153012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607bc9e0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fa57400a470 tx=0x7fa57401cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa584a44800 1 -- 172.21.15.177:0/2569153012 shutdown_connections 2024-03-20T13:36:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa584a44800 1 --2- 172.21.15.177:0/2569153012 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607bc9e0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.471+0000 7fa584a44800 1 -- 172.21.15.177:0/2569153012 >> 172.21.15.177:0/2569153012 conn(0x564a607b4040 msgr2=0x564a607b6460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.473 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.472+0000 7fa584a44800 1 -- 172.21.15.177:0/2569153012 shutdown_connections 2024-03-20T13:36:23.474 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.472+0000 7fa584a44800 1 -- 172.21.15.177:0/2569153012 wait complete. 2024-03-20T13:36:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.483+0000 7fa584a44800 1 Processor -- start 2024-03-20T13:36:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.483+0000 7fa584a44800 1 -- start start 2024-03-20T13:36:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.483+0000 7fa584a44800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a608a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.483+0000 7fa584a44800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a606b8a30 con 0x564a607ba5f0 2024-03-20T13:36:23.485 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a608a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a608a99e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43898/0 (socket says 172.21.15.177:43898) 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa582543640 1 -- 172.21.15.177:0/812132748 learned_addr learned my addr 172.21.15.177:0/812132748 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa582543640 1 -- 172.21.15.177:0/812132748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa574005d20 con 0x564a607ba5f0 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa582543640 1 --2- 172.21.15.177:0/812132748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a608a99e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa574055040 tx=0x7fa57404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=540425ee689d1da server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa470608640 1 -- 172.21.15.177:0/812132748 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57400a180 con 0x564a607ba5f0 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa470608640 1 -- 172.21.15.177:0/812132748 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57400a300 con 0x564a607ba5f0 2024-03-20T13:36:23.486 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.484+0000 7fa470608640 1 -- 172.21.15.177:0/812132748 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa5740529b0 con 0x564a607ba5f0 2024-03-20T13:36:23.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 -- 172.21.15.177:0/812132748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 msgr2=0x564a608a99e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 --2- 172.21.15.177:0/812132748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a608a99e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fa574055040 tx=0x7fa57404c000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 -- 172.21.15.177:0/812132748 shutdown_connections 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 --2- 172.21.15.177:0/812132748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a608a99e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 -- 172.21.15.177:0/812132748 >> 172.21.15.177:0/812132748 conn(0x564a607b4040 msgr2=0x564a608a5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 -- 172.21.15.177:0/812132748 shutdown_connections 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 -- 172.21.15.177:0/812132748 wait complete. 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 Processor -- start 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.485+0000 7fa584a44800 1 -- start start 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa584a44800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607b9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa584a44800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a606b4210 con 0x564a607ba5f0 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607b9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607b9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43906/0 (socket says 172.21.15.177:43906) 2024-03-20T13:36:23.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa582543640 1 -- 172.21.15.177:0/349198619 learned_addr learned my addr 172.21.15.177:0/349198619 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa582543640 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a607c1a40 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa582543640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607b9f50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa57405f040 tx=0x7fa574002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa46ee05640 1 -- 172.21.15.177:0/349198619 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57406a070 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa46ee05640 1 -- 172.21.15.177:0/349198619 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57405d420 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a607b8640 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa46ee05640 1 -- 172.21.15.177:0/349198619 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57405d6c0 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.486+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a607b8b20 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.487+0000 7fa46ee05640 1 -- 172.21.15.177:0/349198619 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa57405d820 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.487+0000 7fa46ee05640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa468036790 0x7fa468038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.487+0000 7fa46ee05640 1 -- 172.21.15.177:0/349198619 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fa57408dce0 con 0x564a607ba5f0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa57bfff640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa468036790 0x7fa468038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a607bcf20 0x564a608ba350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608ba890 con 0x564a607bcf20 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa582d44640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a607bcf20 0x564a608ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa57bfff640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa468036790 0x7fa468038c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa56c000f60 tx=0x7fa56c0012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa582d44640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a607bcf20 0x564a608ba350 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa582d44640 1 -- 172.21.15.177:0/349198619 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a607bcf20 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.488+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608babf0 con 0x564a607bcf20 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa582d44640 1 -- 172.21.15.177:0/349198619 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a607bcf20 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608bc630 0x564a608beac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608bf250 con 0x564a608bc630 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa582543640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608bc630 0x564a608beac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa582543640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608bc630 0x564a608beac0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa582543640 1 -- 172.21.15.177:0/349198619 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fa574059040 con 0x564a608bc630 2024-03-20T13:36:23.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608bb3f0 con 0x564a607bcf20 2024-03-20T13:36:23.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.489+0000 7fa582d44640 1 -- 172.21.15.177:0/349198619 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a607bcf20 2024-03-20T13:36:23.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.490+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a608c0670 0x564a608c2a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.490+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608c31a0 con 0x564a608c0670 2024-03-20T13:36:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.490+0000 7fa57bfff640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a608c0670 0x564a608c2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.490+0000 7fa57bfff640 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a608c0670 0x564a608c2a60 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa57bfff640 1 -- 172.21.15.177:0/349198619 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fa56c006070 con 0x564a608c0670 2024-03-20T13:36:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa584a44800 1 Processor -- start 2024-03-20T13:36:23.506 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa584a44800 1 -- start start 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa584a44800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 0x564a608d1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa584a44800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a60656c70 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 0x564a608d1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 0x564a608d1750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43922/0 (socket says 172.21.15.177:43922) 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.491+0000 7fa582543640 1 -- 172.21.15.177:0/1091662601 learned_addr learned my addr 172.21.15.177:0/1091662601 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa582543640 1 -- 172.21.15.177:0/1091662601 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a608d1c90 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa582543640 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 0x564a608d1750 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa57408bf70 tx=0x7fa574077b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa467fff640 1 -- 172.21.15.177:0/1091662601 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57406d990 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa467fff640 1 -- 172.21.15.177:0/1091662601 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57408a040 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a608d2700 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa467fff640 1 -- 172.21.15.177:0/1091662601 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57406dc20 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.492+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a608d2bc0 con 0x564a608d1330 2024-03-20T13:36:23.507 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa467fff640 1 -- 172.21.15.177:0/1091662601 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa574065850 con 0x564a608d1330 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa467fff640 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa45c036790 0x7fa45c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa467fff640 1 -- 172.21.15.177:0/1091662601 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fa574096d30 con 0x564a608d1330 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa57bfff640 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa45c036790 0x7fa45c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa584a44800 1 Processor -- start 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa584a44800 1 -- start start 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa57bfff640 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa45c036790 0x7fa45c038c50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00bf50 tx=0x7fa56c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa584a44800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608de820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.493+0000 7fa584a44800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6062c5d0 con 0x564a608de400 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608de820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608de820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43926/0 (socket says 172.21.15.177:43926) 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa582543640 1 -- 172.21.15.177:0/97097311 learned_addr learned my addr 172.21.15.177:0/97097311 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa582543640 1 -- 172.21.15.177:0/97097311 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a608dedf0 con 0x564a608de400 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa582543640 1 --2- 172.21.15.177:0/97097311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608de820 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa574071ff0 tx=0x7fa574097f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a2887662d3e2d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.508 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa465ffb640 1 -- 172.21.15.177:0/97097311 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57408d590 con 0x564a608de400 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa465ffb640 1 -- 172.21.15.177:0/97097311 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574065b00 con 0x564a608de400 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.494+0000 7fa465ffb640 1 -- 172.21.15.177:0/97097311 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57405c380 con 0x564a608de400 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- 172.21.15.177:0/97097311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 msgr2=0x564a608de820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 --2- 172.21.15.177:0/97097311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608de820 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fa574071ff0 tx=0x7fa574097f90 comp rx=0 tx=0).stop 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- 172.21.15.177:0/97097311 shutdown_connections 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 --2- 172.21.15.177:0/97097311 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608de820 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- 172.21.15.177:0/97097311 >> 172.21.15.177:0/97097311 conn(0x564a608da760 msgr2=0x564a608d87c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- 172.21.15.177:0/97097311 shutdown_connections 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- 172.21.15.177:0/97097311 wait complete. 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 Processor -- start 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- start start 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608e5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.509 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa584a44800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a608e5740 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa582543640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608e5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43934/0 (socket says 172.21.15.177:43934) 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.495+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 learned_addr learned my addr 172.21.15.177:0/2310876578 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a608d2700 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa582543640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608e5200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa574097fd0 tx=0x7fa574075e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa453fff640 1 -- 172.21.15.177:0/2310876578 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa57405c920 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa453fff640 1 -- 172.21.15.177:0/2310876578 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa57405ca80 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x564a608d2700 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa453fff640 1 -- 172.21.15.177:0/2310876578 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa574009b70 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.496+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564a608d2700 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.497+0000 7fa453fff640 1 -- 172.21.15.177:0/2310876578 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa574009cd0 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.497+0000 7fa453fff640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa44c036790 0x7fa44c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.497+0000 7fa453fff640 1 -- 172.21.15.177:0/2310876578 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fa5740bcd40 con 0x564a608de400 2024-03-20T13:36:23.510 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.497+0000 7fa57bfff640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa44c036790 0x7fa44c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a608f0960 0x564a608f2e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f3570 con 0x564a608f0960 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa57bfff640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa44c036790 0x7fa44c038c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa56c001b60 tx=0x7fa56c010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa582d44640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a608f0960 0x564a608f2e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa582d44640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a608f0960 0x564a608f2e20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 20 realm 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f3940 con 0x564a608f0960 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.511 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.498+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f4520 con 0x564a608f0960 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608f4ed0 0x564a608f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f7880 con 0x564a608f4ed0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa582543640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608f4ed0 0x564a608f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa582543640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608f4ed0 0x564a608f72c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.512 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.499+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa584a44800 20 searching for the correct realm 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a608f9b90 0x564a608fc050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608fc720 con 0x564a608f9b90 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa57bfff640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a608f9b90 0x564a608fc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa57bfff640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a608f9b90 0x564a608fc050 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.500+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608fc720 con 0x564a608f4ed0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.501+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.501+0000 7fa582543640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa574078060 0x7fa5740596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.501+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608fc720 con 0x7fa574078060 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.501+0000 7fa582d44640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa574078060 0x7fa5740596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.501+0000 7fa582d44640 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa574078060 0x7fa5740596f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.513 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.502+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f4ed0 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.514 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.503+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f4ed0 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.504+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.515 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.516 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.505+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.525 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.506+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f4ed0 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.526 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.507+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f4ed0 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f4ed0 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f9b90 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.508+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x7fa574078060 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f0960 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f41c0 con 0x564a608f4ed0 2024-03-20T13:36:23.527 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f7f90 con 0x564a608f0960 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.509+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f7f90 con 0x564a608f0960 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.528 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f7f40 con 0x7fa574078060 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 zone default found 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 4 Realm: () 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 zonegroup default 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.529 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f87e0 con 0x7fa574078060 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.510+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608f8be0 con 0x564a608f9b90 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608fe540 con 0x564a608f9b90 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 20 started sync module instance, tier type = 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.511+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608fde20 con 0x564a608f4ed0 2024-03-20T13:36:23.530 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.512+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.512+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94877447608704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608fe1d0 con 0x564a608f4ed0 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.512+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608ff350 con 0x564a608f0960 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.513+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94877447608704] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.513+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.513+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94877447614128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608ff770 con 0x564a608f0960 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.513+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609000e0 con 0x564a608f9b90 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.514+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94877447614128] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.515+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.515+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94877447615184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a608ff6f0 con 0x564a608f9b90 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.515+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60900f40 con 0x564a608f4ed0 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.516+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94877447615184] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.516+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.531 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.516+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94877447619728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60901740 con 0x564a608f4ed0 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.516+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60901fc0 con 0x564a608f0960 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.517+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94877447619728] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.517+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.517+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94877447625376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60902370 con 0x564a608f0960 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.517+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60902d60 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.518+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94877447625376] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.518+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.518+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94877447628864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60902d20 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.518+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60903760 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.519+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94877447628864] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.520+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.520+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94877447631488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60903760 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.520+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60904130 con 0x7fa574078060 2024-03-20T13:36:23.532 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'234 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94877447631488] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94877447633968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609040f0 con 0x7fa574078060 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=0 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=1 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=2 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=3 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=4 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=5 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.521+0000 7fa584a44800 20 add_watcher() i=6 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.522+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94877447633968] v32'235 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.522+0000 7fa584a44800 20 add_watcher() i=7 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.522+0000 7fa584a44800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.522+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60907570 con 0x564a608f0960 2024-03-20T13:36:23.533 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.522+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.522+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94877447623328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60904a40 con 0x564a608f0960 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.523+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94877447623328] v32'232 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.523+0000 7fa438fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.523+0000 7fa584a44800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.523+0000 7fa584a44800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.523+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090fe80 con 0x564a608f0960 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.524+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.534 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.524+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090ff00 con 0x7fa574078060 2024-03-20T13:36:23.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.525+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.536 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.525+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60910360 con 0x564a608f9b90 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.526+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.526+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60910890 con 0x564a608f0960 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.527+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'233 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.527+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60910dc0 con 0x564a608f4ed0 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.528+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'75 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.528+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609112f0 con 0x564a608f9b90 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.529+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'49 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.529+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60911820 con 0x564a608f0960 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.531+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.531+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60911cc0 con 0x7fa574078060 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.532+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'51 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.532+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609112f0 con 0x564a608f4ed0 2024-03-20T13:36:23.537 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.533+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.533+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60911e90 con 0x564a608f9b90 2024-03-20T13:36:23.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.534+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.534+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609123c0 con 0x564a608f4ed0 2024-03-20T13:36:23.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.535+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'76 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.538 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.535+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609128f0 con 0x7fa574078060 2024-03-20T13:36:23.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.536+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'35 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.536+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912d90 con 0x564a608f4ed0 2024-03-20T13:36:23.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.537+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.537+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912a30 con 0x7fa574078060 2024-03-20T13:36:23.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.538+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'55 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.539 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.538+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912860 con 0x564a608f0960 2024-03-20T13:36:23.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.539+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'234 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.540 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.539+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912860 con 0x564a608f9b90 2024-03-20T13:36:23.541 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.540+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'69 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.540+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609129a0 con 0x564a608f4ed0 2024-03-20T13:36:23.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.541+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'77 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.542 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.541+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609129a0 con 0x564a608f9b90 2024-03-20T13:36:23.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.542+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.543 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.542+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609129d0 con 0x564a608f0960 2024-03-20T13:36:23.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.544+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'36 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.545 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.544+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912f40 con 0x564a608f0960 2024-03-20T13:36:23.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.545+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'235 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.546 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.545+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e90 con 0x564a608f9b90 2024-03-20T13:36:23.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.546+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'70 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.547 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.546+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e70 con 0x564a608f4ed0 2024-03-20T13:36:23.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.547+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'38 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.548 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.547+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e70 con 0x564a608f9b90 2024-03-20T13:36:23.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.548+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.549 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.548+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e70 con 0x564a608f9b90 2024-03-20T13:36:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.549+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.549+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e70 con 0x564a608f9b90 2024-03-20T13:36:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.549+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'24 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.550 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.550+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e70 con 0x564a608f9b90 2024-03-20T13:36:23.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.550+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'50 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.551 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.550+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912e70 con 0x7fa574078060 2024-03-20T13:36:23.553 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.552+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'30 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.553 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.552+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912de0 con 0x564a608f9b90 2024-03-20T13:36:23.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.553+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'28 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.553+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912de0 con 0x7fa574078060 2024-03-20T13:36:23.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.554+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'52 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.554+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912de0 con 0x564a608f9b90 2024-03-20T13:36:23.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.555+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'71 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.555+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912de0 con 0x7fa574078060 2024-03-20T13:36:23.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.556+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'56 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.556+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60912de0 con 0x564a608f4ed0 2024-03-20T13:36:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.557+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'34 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.557+0000 7fa3b37fe640 20 reqs_thread_entry: start 2024-03-20T13:36:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.557+0000 7fa584a44800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.557+0000 7fa584a44800 20 Filter name: none 2024-03-20T13:36:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.557+0000 7fa3b17fa640 20 reqs_thread_entry: start 2024-03-20T13:36:23.560 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090f0e0 con 0x564a608f0960 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 foo [call out=48b,read 0~357 out=357b,getxattrs out=75b] v0'0 uv15 ondisk = 0) v8 ==== 231+0+480 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=357 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6093ed80 con 0x564a608f4ed0 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) v8 ==== 155+0+183 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 : miss 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.558+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:96 8.11 8:898d4ac1:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6093eae0 con 0x564a608f9b90 2024-03-20T13:36:23.561 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(96 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 [call out=48b,stat out=16b,read 0~352 out=352b,getxattrs out=218b] v0'0 uv1 ondisk = 0) v8 ==== 332+0+634 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=352 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 info.flags=0x17 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 to cache LRU end 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:97 4.29 4:977382e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bbfc0 con 0x564a608f9b90 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(97 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.562 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:98 4.39 4:9cc2aeee:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc000 con 0x7fa574078060 2024-03-20T13:36:23.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.559+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(98 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:99 4.2d 4:b76421e3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc000 con 0x7fa574078060 2024-03-20T13:36:23.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(99 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:100 4.31 4:8eec1cf1:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc000 con 0x564a608f0960 2024-03-20T13:36:23.565 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(100 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:101 4.22 4:47c53df3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc000 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(101 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 [call out=426b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+426 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa584a44800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.560+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:102 4.2a 4:5723e6cf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc4e0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.561+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(102 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.561+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:103 4.f 4:f3be7caf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc4e0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.561+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(103 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.561+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:104 4.12 4:4b0c7d20:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc4e0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.561+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(104 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.561+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:105 4.13 4:cb5f32dd:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc4e0 con 0x564a608f4ed0 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(105 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.566 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:106 4.4 4:2360ff2d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc4e0 con 0x7fa574078060 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(106 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:107 4.3e 4:7d84c993:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bc4e0 con 0x564a608f4ed0 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(107 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa584a44800 20 get_obj_state: octx=0x7fa574075c50 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564a609ba1d8 s->prefetch_data=0 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.562+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:108 3.15s0 3:ab002198:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb240 con 0x564a608f4ed0 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(108 3852dce3-594b-4724-bee1-f3dae77b7611.4225.7_15f6f8dc036519d7fe15b39338f6e5db [getxattrs out=879b,stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 262+0+895 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa584a44800 10 manifest: total_size = 6 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa584a44800 20 get_obj_state: setting s->obj_tag to 3852dce3-594b-4724-bee1-f3dae77b7611.4225.17777875613203286400 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa584a44800 20 get_obj_state: octx=0x7fa574075c50 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x564a609ba1d8 s->prefetch_data=0 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa584a44800 20 prepare_atomic_modification: state is not atomic. state=0x564a609ba1d8 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa584a44800 20 bucket index object: :.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.563+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:109 4.22 4:47c53df3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609431a0 con 0x564a608f0960 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.564+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(109 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 [stat,call,call] v32'8 uv8 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.567 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.564+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:110 3.15s0 3:ab002198:::3852dce3-594b-4724-bee1-f3dae77b7611.4225.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60941180 con 0x564a608f4ed0 2024-03-20T13:36:23.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(110 3852dce3-594b-4724-bee1-f3dae77b7611.4225.7_15f6f8dc036519d7fe15b39338f6e5db [call] v32'4 uv4 ondisk = 0) v8 ==== 220+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:111 4.22 4:47c53df3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609431a0 con 0x564a608f0960 2024-03-20T13:36:23.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 20 list_objects_ordered: starting attempt 1 2024-03-20T13:36:23.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-03-20T13:36:23.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:112 4.29 4:977382e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609431a0 con 0x564a608f9b90 2024-03-20T13:36:23.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:113 4.39 4:9cc2aeee:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60947610 con 0x7fa574078060 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:114 4.2d 4:b76421e3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60949f20 con 0x7fa574078060 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:115 4.31 4:8eec1cf1:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6094c9c0 con 0x564a608f0960 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:116 4.22 4:47c53df3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6094f6c0 con 0x564a608f0960 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:117 4.2a 4:5723e6cf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60952490 con 0x564a608f0960 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:118 4.f 4:f3be7caf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60955240 con 0x564a608f0960 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:119 4.12 4:4b0c7d20:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60958020 con 0x564a608f0960 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:120 4.13 4:cb5f32dd:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095ae00 con 0x564a608f4ed0 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:121 4.4 4:2360ff2d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095dbe0 con 0x7fa574078060 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.565+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:122 4.3e 4:7d84c993:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60960a10 con 0x564a608f4ed0 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(112 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(113 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(120 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(114 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(122 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(121 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(115 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(117 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 36 ==== osd_op_reply(118 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 37 ==== osd_op_reply(119 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 38 ==== osd_op_reply(111 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 [stat,call,call] v32'9 uv9 ondisk = 0) v8 ==== 278+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.566+0000 7fa465ffb640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 39 ==== osd_op_reply(116 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-03-20T13:36:23.578 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[3852dce3-594b-4724-bee1-f3dae77b7611.4225.7])"; uploads.size()=0; is_truncated=0 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:123 4.29 4:977382e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6094f6c0 con 0x564a608f9b90 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:124 4.39 4:9cc2aeee:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095ae00 con 0x7fa574078060 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:125 4.2d 4:b76421e3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60960a10 con 0x7fa574078060 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:126 4.31 4:8eec1cf1:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60955240 con 0x564a608f0960 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:127 4.22 4:47c53df3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6094f6c0 con 0x564a608f0960 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:128 4.2a 4:5723e6cf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095ae00 con 0x564a608f0960 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:129 4.f 4:f3be7caf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60960a10 con 0x564a608f0960 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:130 4.12 4:4b0c7d20:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60949f20 con 0x564a608f0960 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:131 4.13 4:cb5f32dd:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095ae00 con 0x564a608f4ed0 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:132 4.4 4:2360ff2d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609524d0 con 0x7fa574078060 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:133 4.3e 4:7d84c993:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095ae00 con 0x564a608f4ed0 2024-03-20T13:36:23.579 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(124 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(125 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(132 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9 [call out=85b] v0'0 uv15 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(123 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0 [call out=85b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(131 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 40 ==== osd_op_reply(126 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 41 ==== osd_op_reply(127 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 [call out=124b] v0'0 uv9 ondisk = 0) v8 ==== 194+0+124 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 42 ==== osd_op_reply(129 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(133 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10 [call out=85b] v0'0 uv7 ondisk = 0) v8 ==== 195+0+85 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.567+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 43 ==== osd_op_reply(128 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5 [call out=85b] v0'0 uv1 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.568+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 44 ==== osd_op_reply(130 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7 [call out=85b] v0'0 uv3 ondisk = 0) v8 ==== 194+0+85 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.568+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609524d0 con 0x564a608f4ed0 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(134 foo.buckets [call] v32'46 uv46 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.580 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a60960270 con 0x564a608f4ed0 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) v8 ==== 191+0+213 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 20 rados_obj.operate() r=0 bl.length=165 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 10 removing default.rgw.meta+root+myfoo from cache 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:136 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94877447988912 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb520 con 0x7fa574078060 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== watch-notify(notify (1) cookie 94877447631488 notify 137438953509 ret 0) v3 ==== 191+0+0 (crc 0 0 0) 0x7fa57c04c1c0 con 0x7fa574078060 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94877447631488 notifier 4766 bl.length()=149 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(136 notify.6 [notify cookie 94877447988912 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.581 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.569+0000 7fa465ffb640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa448003d50 con 0x7fa574078060 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.570+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(137 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.570+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== watch-notify(notify_complete (2) cookie 94877447988912 notify 137438953509 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa57c063040 con 0x7fa574078060 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.570+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:138 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb520 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(138 myfoo [call,call,delete] v32'47 uv47 ondisk = 0) v8 ==== 233+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa584a44800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 from cache 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7, ofs0, ns] 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:139 7.e 7:7759931f:::notify.3:head [notify cookie 94877447875152 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb500 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== watch-notify(notify (1) cookie 94877447619728 notify 137438953507 ret 0) v3 ==== 248+0+0 (crc 0 0 0) 0x564a608dedf0 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa4657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953507 cookie 94877447619728 notifier 4766 bl.length()=206 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(139 notify.3 [notify cookie 94877447875152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.571+0000 7fa4657fa640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:140 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa3b80032b0 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.572+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== watch-notify(notify_complete (2) cookie 94877447875152 notify 137438953507 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564a608d1c90 con 0x564a608f4ed0 2024-03-20T13:36:23.582 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.572+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(140 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.572+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:141 8.11 8:898d4ac1:root::.bucket.meta.myfoo%3a3852dce3-594b-4724-bee1-f3dae77b7611.4225.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f9b90 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.572+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(141 .bucket.meta.myfoo:3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 [call,call,delete] v32'2 uv2 ondisk = 0) v8 ==== 290+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:142 4.29 4:977382e8:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f9b90 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:143 4.39 4:9cc2aeee:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095d490 con 0x7fa574078060 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:144 4.2d 4:b76421e3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095e040 con 0x7fa574078060 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:145 4.31 4:8eec1cf1:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095e8c0 con 0x564a608f0960 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:146 4.22 4:47c53df3:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095ece0 con 0x564a608f0960 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:147 4.2a 4:5723e6cf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f0960 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:148 4.f 4:f3be7caf:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095d490 con 0x564a608f0960 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:149 4.12 4:4b0c7d20:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095e040 con 0x564a608f0960 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:150 4.13 4:cb5f32dd:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095e8c0 con 0x564a608f4ed0 2024-03-20T13:36:23.583 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:151 4.4 4:2360ff2d:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x7fa574078060 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.573+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:152 4.3e 4:7d84c993:::.dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095e040 con 0x564a608f4ed0 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.574+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(150 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.8 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.574+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(151 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.9 [delete] v32'18 uv18 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(142 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.0 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 45 ==== osd_op_reply(147 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.5 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== osd_op_reply(152 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.10 [delete] v32'8 uv8 ondisk = 0) v8 ==== 195+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 46 ==== osd_op_reply(145 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.3 [delete] v32'2 uv2 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 47 ==== osd_op_reply(146 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.4 [delete] v32'10 uv10 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 48 ==== osd_op_reply(148 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.6 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.575+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(144 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.2 [delete] v32'8 uv8 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 49 ==== osd_op_reply(149 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.7 [delete] v32'4 uv4 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(143 .dir.3852dce3-594b-4724-bee1-f3dae77b7611.4225.7.1 [delete] v32'6 uv6 ondisk = 0) v8 ==== 194+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 : miss 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:153 6.b 6:d2670e45:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095d490 con 0x564a608f9b90 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(153 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 info.flags=0x0 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 10 adding default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 to cache LRU end 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 10 removing default.rgw.log++pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 from cache 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.log:pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7, ofs0, ns] 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:154 7.15 7:a93a5511:::notify.2:head [notify cookie 94877447988912 in=215b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f9b90 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== watch-notify(notify (1) cookie 94877447615184 notify 137438953484 ret 0) v3 ==== 245+0+0 (crc 0 0 0) 0x564a60704cd0 con 0x564a608f9b90 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953484 cookie 94877447615184 notifier 4766 bl.length()=203 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(154 notify.2 [notify cookie 94877447988912 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.577+0000 7fa465ffb640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:155 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa448003d50 con 0x564a608f9b90 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.578+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== watch-notify(notify_complete (2) cookie 94877447988912 notify 137438953484 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa56c04c020 con 0x564a608f9b90 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.578+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(155 notify.2 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.591 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.578+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:156 6.b 6:d2670e45:::pubsub..bucket.myfoo%2f3852dce3-594b-4724-bee1-f3dae77b7611.4225.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f9b90 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.579+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(156 pubsub..bucket.myfoo/3852dce3-594b-4724-bee1-f3dae77b7611.4225.7 [delete] v32'29 uv21 ondisk = -2 ((2) No such file or directory)) v8 ==== 208+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.579+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:157 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=58b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 38 ==== osd_op_reply(157 foo.buckets [call] v32'48 uv48 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa584a44800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify cookie 94877447988912 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 39 ==== watch-notify(notify (1) cookie 94877447619728 notify 137438953508 ret 0) v3 ==== 212+0+0 (crc 0 0 0) 0x564a608d1c90 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa4657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953508 cookie 94877447619728 notifier 4766 bl.length()=170 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa4657fa640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:159 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa3b8003290 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 40 ==== osd_op_reply(158 notify.3 [notify cookie 94877447988912 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 41 ==== osd_op_reply(159 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 42 ==== watch-notify(notify_complete (2) cookie 94877447988912 notify 137438953508 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564a607b8b20 con 0x564a608f4ed0 2024-03-20T13:36:23.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.580+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:160 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x7fa574078060 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(160 9te6NH5mcdcq0Tc5i8i1 [delete] v32'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa584a44800 10 removing email index: foo@foo.com 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify cookie 94877447875152 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f4ed0 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 43 ==== watch-notify(notify (1) cookie 94877447619728 notify 137438953509 ret 0) v3 ==== 204+0+0 (crc 0 0 0) 0x564a607b8b20 con 0x564a608f4ed0 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953509 cookie 94877447619728 notifier 4766 bl.length()=162 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 44 ==== osd_op_reply(161 notify.3 [notify cookie 94877447875152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa465ffb640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:162 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa448003d50 con 0x564a608f4ed0 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 45 ==== watch-notify(notify_complete (2) cookie 94877447875152 notify 137438953509 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x564a607b8640 con 0x564a608f4ed0 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 46 ==== osd_op_reply(162 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.582+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:163 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f0960 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.583+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 50 ==== osd_op_reply(163 foo@foo.com [delete] v32'2 uv2 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.583+0000 7fa584a44800 10 removing user buckets index 2024-03-20T13:36:23.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.583+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.583+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify cookie 94877447988912 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x7fa574078060 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== watch-notify(notify (1) cookie 94877447628864 notify 137438953510 ret 0) v3 ==== 202+0+0 (crc 0 0 0) 0x7fa57c063040 con 0x7fa574078060 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa4657fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953510 cookie 94877447628864 notifier 4766 bl.length()=160 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa4657fa640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:165 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa3b8003290 con 0x7fa574078060 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(164 notify.5 [notify cookie 94877447988912 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(165 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== watch-notify(notify_complete (2) cookie 94877447988912 notify 137438953510 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa57c03d040 con 0x7fa574078060 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.584+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:166 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a609bb4c0 con 0x564a608f4ed0 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 47 ==== osd_op_reply(166 foo.buckets [delete] v32'49 uv49 ondisk = 0) v8 ==== 155+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa584a44800 10 removing user index: foo 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa584a44800 10 removing default.rgw.meta+users.uid+foo from cache 2024-03-20T13:36:23.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa584a44800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify cookie 94877447875152 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095d490 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 51 ==== watch-notify(notify (1) cookie 94877447625376 notify 137438953490 ret 0) v3 ==== 194+0+0 (crc 0 0 0) 0x7fa57c03d040 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa465ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 137438953490 cookie 94877447625376 notifier 4766 bl.length()=152 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa465ffb640 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:168 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x7fa448003d50 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.585+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 52 ==== osd_op_reply(167 notify.4 [notify cookie 94877447875152 out=8b] v0'0 uv234 ondisk = 0) v8 ==== 152+0+8 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.586+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 53 ==== osd_op_reply(168 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.586+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 54 ==== watch-notify(notify_complete (2) cookie 94877447875152 notify 137438953490 ret 0) v3 ==== 42+0+48 (crc 0 0 0) 0x7fa57c005040 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.586+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:169 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.set in=58b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6095a5e0 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.587+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 55 ==== osd_op_reply(169 foo [call,call,delete] v32'17 uv17 ondisk = 0) v8 ==== 231+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.587+0000 7fa438fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.587+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94877447623328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.589+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 56 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94877447623328] v32'236 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.589+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94877447608704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x564a608f4ed0 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.589+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 48 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94877447608704] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.590+0000 7fa584a44800 20 remove_watcher() i=0 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.590+0000 7fa584a44800 2 removed watcher, disabling cache 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.590+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94877447614128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x564a608f0960 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.591+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 57 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94877447614128] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.591+0000 7fa584a44800 20 remove_watcher() i=1 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.591+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94877447615184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x564a608f9b90 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.592+0000 7fa57bfff640 1 -- 172.21.15.177:0/2310876578 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94877447615184] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa56c006070 con 0x564a608f9b90 2024-03-20T13:36:23.598 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.592+0000 7fa584a44800 20 remove_watcher() i=2 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.592+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94877447619728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x564a608f4ed0 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.593+0000 7fa582543640 1 -- 172.21.15.177:0/2310876578 <== osd.2 v2:172.21.15.177:6800/3663022842 49 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94877447619728] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa5740b8070 con 0x564a608f4ed0 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.593+0000 7fa584a44800 20 remove_watcher() i=3 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.593+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94877447625376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x564a608f0960 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.594+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.1 v2:172.21.15.177:6808/2492741617 58 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94877447625376] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x564a608f0960 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.594+0000 7fa584a44800 20 remove_watcher() i=4 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.594+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94877447628864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x7fa574078060 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.595+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94877447628864] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.595+0000 7fa584a44800 20 remove_watcher() i=5 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.595+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94877447631488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x7fa574078060 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.596+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94877447631488] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.596+0000 7fa584a44800 20 remove_watcher() i=6 2024-03-20T13:36:23.599 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.596+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94877447633968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x564a6090c2b0 con 0x7fa574078060 2024-03-20T13:36:23.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.597+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94877447633968] v32'236 uv234 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7fa57c00a4a0 con 0x7fa574078060 2024-03-20T13:36:23.602 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.597+0000 7fa584a44800 20 remove_watcher() i=7 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa574078060 msgr2=0x7fa5740596f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7fa574078060 0x7fa5740596f0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a608f0960 msgr2=0x564a608f2e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a608f0960 0x564a608f2e20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608f4ed0 msgr2=0x564a608f72c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608f4ed0 0x564a608f72c0 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a608f9b90 msgr2=0x564a608fc050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x564a608f9b90 0x564a608fc050 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa44c036790 msgr2=0x7fa44c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa44c036790 0x7fa44c038c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fa56c001b60 tx=0x7fa56c010000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 msgr2=0x564a608e5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608e5200 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa574097fd0 tx=0x7fa574075e70 comp rx=0 tx=0).stop 2024-03-20T13:36:23.603 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa582d44640 1 -- 172.21.15.177:0/2310876578 reap_dead start 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 shutdown_connections 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/2310876578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608de400 0x564a608e5200 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 >> 172.21.15.177:0/2310876578 conn(0x564a608da760 msgr2=0x564a608d7dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 shutdown_connections 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/2310876578 wait complete. 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa45c036790 msgr2=0x7fa45c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa45c036790 0x7fa45c038c50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00bf50 tx=0x7fa56c00f000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 msgr2=0x564a608d1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 0x564a608d1750 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fa57408bf70 tx=0x7fa574077b00 comp rx=0 tx=0).stop 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 shutdown_connections 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa45c036790 0x7fa45c038c50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 --2- 172.21.15.177:0/1091662601 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a608d1330 0x564a608d1750 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.604 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 >> 172.21.15.177:0/1091662601 conn(0x564a608c53d0 msgr2=0x564a608c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 shutdown_connections 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.598+0000 7fa584a44800 1 -- 172.21.15.177:0/1091662601 wait complete. 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a608c0670 msgr2=0x564a608c2a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x564a608c0670 0x564a608c2a60 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a607bcf20 msgr2=0x564a608ba350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x564a607bcf20 0x564a608ba350 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608bc630 msgr2=0x564a608beac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x564a608bc630 0x564a608beac0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa468036790 msgr2=0x7fa468038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa468036790 0x7fa468038c50 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa56c000f60 tx=0x7fa56c0012b0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 msgr2=0x564a607b9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 --2- 172.21.15.177:0/349198619 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x564a607ba5f0 0x564a607b9f50 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fa57405f040 tx=0x7fa574002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.605 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa582d44640 1 -- 172.21.15.177:0/349198619 reap_dead start 2024-03-20T13:36:23.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 shutdown_connections 2024-03-20T13:36:23.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 >> 172.21.15.177:0/349198619 conn(0x564a607b4040 msgr2=0x564a608a83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 shutdown_connections 2024-03-20T13:36:23.606 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.599+0000 7fa584a44800 1 -- 172.21.15.177:0/349198619 wait complete. 2024-03-20T13:36:23.608 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-03-20T13:36:23.608 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-03-20T13:36:23.608 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-03-20T13:36:23.690 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:23.690 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb9c24800 1 Processor -- start 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb9c24800 1 -- start start 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb9c24800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x558923e81080 0x558923e83470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb9c24800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x558923dc7cd0 con 0x558923e7d570 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb9c24800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x558923d7e500 con 0x558923e81080 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb6f22640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x558923e81080 0x558923e83470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb7723640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x558923e7d570 0x558923e7f960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51620/0 (socket says 172.21.15.177:51620) 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.690+0000 7f9bb7723640 1 -- 172.21.15.177:0/3714289224 learned_addr learned my addr 172.21.15.177:0/3714289224 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.691+0000 7f9bb6f22640 1 -- 172.21.15.177:0/3714289224 >> v1:172.21.15.28:6789/0 conn(0x558923e7d570 legacy=0x558923e7f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.692 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.691+0000 7f9bb6f22640 1 -- 172.21.15.177:0/3714289224 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558923e849c0 con 0x558923e81080 2024-03-20T13:36:23.693 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.692+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/3714289224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e81080 0x558923e83470 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00a470 tx=0x7f9bac01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7279e31bf674b7c3 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb6721640 1 -- 172.21.15.177:0/3714289224 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9bac052570 con 0x558923e81080 2024-03-20T13:36:23.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb6721640 1 -- 172.21.15.177:0/3714289224 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bac0526d0 con 0x558923e81080 2024-03-20T13:36:23.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb6721640 1 -- 172.21.15.177:0/3714289224 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9bac052990 con 0x558923e81080 2024-03-20T13:36:23.694 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3714289224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e81080 msgr2=0x558923e83470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/3714289224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e81080 0x558923e83470 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f9bac00a470 tx=0x7f9bac01cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:23.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3714289224 shutdown_connections 2024-03-20T13:36:23.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/3714289224 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e81080 0x558923e83470 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3714289224 >> 172.21.15.177:0/3714289224 conn(0x558923e77040 msgr2=0x558923e79460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3714289224 shutdown_connections 2024-03-20T13:36:23.695 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.693+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3714289224 wait complete. 2024-03-20T13:36:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb9c24800 1 Processor -- start 2024-03-20T13:36:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb9c24800 1 -- start start 2024-03-20T13:36:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb9c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923e7ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb9c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558923d7ba30 con 0x558923e7d570 2024-03-20T13:36:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923e7ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.706 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923e7ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43956/0 (socket says 172.21.15.177:43956) 2024-03-20T13:36:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb7723640 1 -- 172.21.15.177:0/1056519248 learned_addr learned my addr 172.21.15.177:0/1056519248 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.707 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.705+0000 7f9bb7723640 1 -- 172.21.15.177:0/1056519248 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bac005d20 con 0x558923e7d570 2024-03-20T13:36:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb7723640 1 --2- 172.21.15.177:0/1056519248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923e7ceb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8001c50 tx=0x7f9ba800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df25b3b4cbf8ab9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9aa560a640 1 -- 172.21.15.177:0/1056519248 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba800e470 con 0x558923e7d570 2024-03-20T13:36:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9aa560a640 1 -- 172.21.15.177:0/1056519248 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba800e5d0 con 0x558923e7d570 2024-03-20T13:36:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9aa560a640 1 -- 172.21.15.177:0/1056519248 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba800e8d0 con 0x558923e7d570 2024-03-20T13:36:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 -- 172.21.15.177:0/1056519248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 msgr2=0x558923e7ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.709 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/1056519248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923e7ceb0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8001c50 tx=0x7f9ba800b6c0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 -- 172.21.15.177:0/1056519248 shutdown_connections 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/1056519248 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923e7ceb0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 -- 172.21.15.177:0/1056519248 >> 172.21.15.177:0/1056519248 conn(0x558923e77040 msgr2=0x558923f68390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 -- 172.21.15.177:0/1056519248 shutdown_connections 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.706+0000 7f9bb9c24800 1 -- 172.21.15.177:0/1056519248 wait complete. 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb9c24800 1 Processor -- start 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb9c24800 1 -- start start 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb9c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923f76300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb9c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558923d77210 con 0x558923e7d570 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923f76300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923f76300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43962/0 (socket says 172.21.15.177:43962) 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.707+0000 7f9bb7723640 1 -- 172.21.15.177:0/4273162428 learned_addr learned my addr 172.21.15.177:0/4273162428 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.710 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9bb7723640 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558923dc7cd0 con 0x558923e7d570 2024-03-20T13:36:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9bb7723640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923f76300 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8001c50 tx=0x7f9ba8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9aa3e07640 1 -- 172.21.15.177:0/4273162428 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba801f070 con 0x558923e7d570 2024-03-20T13:36:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9aa3e07640 1 -- 172.21.15.177:0/4273162428 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba8018850 con 0x558923e7d570 2024-03-20T13:36:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9aa3e07640 1 -- 172.21.15.177:0/4273162428 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba8018b30 con 0x558923e7d570 2024-03-20T13:36:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558923f76840 con 0x558923e7d570 2024-03-20T13:36:23.711 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.708+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558923f76d20 con 0x558923e7d570 2024-03-20T13:36:23.714 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9aa3e07640 1 -- 172.21.15.177:0/4273162428 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9ba8018d20 con 0x558923e7d570 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9aa3e07640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a9c036790 0x7f9a9c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9aa3e07640 1 -- 172.21.15.177:0/4273162428 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9ba804c5b0 con 0x558923e7d570 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a9c036790 0x7f9a9c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923e81080 0x558923f7cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923f7d5c0 con 0x558923e81080 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.709+0000 7f9bb7f24640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923e81080 0x558923f7cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a9c036790 0x7f9a9c038c50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bac054000 tx=0x7f9bac04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb7f24640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923e81080 0x558923f7cff0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb7f24640 1 -- 172.21.15.177:0/4273162428 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923e81080 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923f7a700 con 0x558923e81080 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb7f24640 1 -- 172.21.15.177:0/4273162428 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923e81080 2024-03-20T13:36:23.715 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923f7f830 0x558923f81c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923f82310 con 0x558923f7f830 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.710+0000 7f9bb7723640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923f7f830 0x558923f81c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.711+0000 7f9bb7723640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923f7f830 0x558923f81c20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.711+0000 7f9bb7723640 1 -- 172.21.15.177:0/4273162428 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9ba8014070 con 0x558923f7f830 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.711+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923f7e7b0 con 0x558923e81080 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.711+0000 7f9bb7f24640 1 -- 172.21.15.177:0/4273162428 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923e81080 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.711+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558923f83730 0x558923f85b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.711+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923f86260 con 0x558923f83730 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.712+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558923f83730 0x558923f85b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.712+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558923f83730 0x558923f85b20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb6f22640 1 -- 172.21.15.177:0/4273162428 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f9bac059040 con 0x558923f83730 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb9c24800 1 Processor -- start 2024-03-20T13:36:23.716 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb9c24800 1 -- start start 2024-03-20T13:36:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb9c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 0x558923f94810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb9c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558923d19c70 con 0x558923f943f0 2024-03-20T13:36:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 0x558923f94810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 0x558923f94810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43964/0 (socket says 172.21.15.177:43964) 2024-03-20T13:36:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.713+0000 7f9bb7723640 1 -- 172.21.15.177:0/4104728639 learned_addr learned my addr 172.21.15.177:0/4104728639 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.717 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9bb7723640 1 -- 172.21.15.177:0/4104728639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558923f94d50 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9bb7723640 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 0x558923f94810 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9ba804a840 tx=0x7f9ba8023870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9aa1602640 1 -- 172.21.15.177:0/4104728639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba802d650 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9aa1602640 1 -- 172.21.15.177:0/4104728639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba802d7b0 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9aa1602640 1 -- 172.21.15.177:0/4104728639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba80440e0 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558923f957c0 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.714+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558923f95c80 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9aa1602640 1 -- 172.21.15.177:0/4104728639 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9ba8044240 con 0x558923f943f0 2024-03-20T13:36:23.731 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9aa1602640 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a90036790 0x7f9a90038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9aa1602640 1 -- 172.21.15.177:0/4104728639 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9ba8045040 con 0x558923f943f0 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a90036790 0x7f9a90038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9bb9c24800 1 Processor -- start 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9bb9c24800 1 -- start start 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.715+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a90036790 0x7f9a90038c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x558923f7a620 tx=0x7f9bac005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb9c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb9c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558923cef5d0 con 0x558923fa1510 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43972/0 (socket says 172.21.15.177:43972) 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb7723640 1 -- 172.21.15.177:0/3757951769 learned_addr learned my addr 172.21.15.177:0/3757951769 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb7723640 1 -- 172.21.15.177:0/3757951769 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558923fa1f00 con 0x558923fa1510 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9bb7723640 1 --2- 172.21.15.177:0/3757951769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa1930 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8018cf0 tx=0x7f9ba80244e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8237a1e41c266ec server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.732 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9a9affd640 1 -- 172.21.15.177:0/3757951769 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba8016810 con 0x558923fa1510 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9a9affd640 1 -- 172.21.15.177:0/3757951769 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba800dd90 con 0x558923fa1510 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.716+0000 7f9a9affd640 1 -- 172.21.15.177:0/3757951769 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba8044840 con 0x558923fa1510 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3757951769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 msgr2=0x558923fa1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/3757951769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa1930 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8018cf0 tx=0x7f9ba80244e0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3757951769 shutdown_connections 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/3757951769 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa1930 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3757951769 >> 172.21.15.177:0/3757951769 conn(0x558923f9d7e0 msgr2=0x558923f9b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3757951769 shutdown_connections 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- 172.21.15.177:0/3757951769 wait complete. 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 Processor -- start 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- start start 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.733 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb9c24800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x558923fa89a0 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.717+0000 7f9bb7723640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43978/0 (socket says 172.21.15.177:43978) 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 learned_addr learned my addr 172.21.15.177:0/2451086759 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558923f957c0 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9bb7723640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa8460 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8049640 tx=0x7f9ba802bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9a997fa640 1 -- 172.21.15.177:0/2451086759 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba8016810 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9a997fa640 1 -- 172.21.15.177:0/2451086759 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ba801a070 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9a997fa640 1 -- 172.21.15.177:0/2451086759 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9ba8044840 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558923f957c0 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.718+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558923f957c0 con 0x558923fa1510 2024-03-20T13:36:23.734 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9a997fa640 1 -- 172.21.15.177:0/2451086759 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9ba803e570 con 0x558923fa1510 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9a997fa640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9a997fa640 1 -- 172.21.15.177:0/2451086759 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9ba806dd70 con 0x558923fa1510 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923fb3d20 0x558923fb61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.719+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb6930 con 0x558923fb3d20 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb7f24640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923fb3d20 0x558923fb61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9bac055040 tx=0x7f9bac04f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb7f24640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923fb3d20 0x558923fb61e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 20 realm 2024-03-20T13:36:23.735 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb6d00 con 0x558923fb3d20 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.720+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb78b0 con 0x558923fb3d20 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.736 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923fb8260 0x558923fba650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbabd0 con 0x558923fb8260 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb7723640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923fb8260 0x558923fba650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb7723640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923fb8260 0x558923fba650 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 190+0+874 (crc 0 0 0) 0x7f9ba805d020 con 0x558923fb8260 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 20 rados_obj.operate() r=0 bl.length=874 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 20 searching for the correct realm 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558923fbcb50 0x558923fbf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.721+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbf6e0 con 0x558923fbcb50 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558923fbcb50 0x558923fbf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb6f22640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558923fbcb50 0x558923fbf010 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.737 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbf6e0 con 0x558923fb8260 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9ba805d020 con 0x558923fb8260 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb7723640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9ba804c050 0x7f9ba8037020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.722+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbf6e0 con 0x7f9ba804c050 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.723+0000 7f9bb7f24640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9ba804c050 0x7f9ba8037020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.723+0000 7f9bb7f24640 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9ba804c050 0x7f9ba8037020 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.723+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.723+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.723+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.723+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.724+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.724+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.738 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.724+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.724+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.724+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.724+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb8260 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9ba805d020 con 0x558923fb8260 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.725+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb8260 2024-03-20T13:36:23.739 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f9ba805d020 con 0x558923fb8260 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.726+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.727+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.740 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb8260 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.728+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.729+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.729+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.729+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.729+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb8260 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.729+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.741 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.729+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb8260 2024-03-20T13:36:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fbcb50 2024-03-20T13:36:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.742 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x7f9ba804c050 2024-03-20T13:36:23.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.730+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb3d20 2024-03-20T13:36:23.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.750 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fb7550 con 0x558923fb8260 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbb4a0 con 0x558923fb3d20 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.751 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbb4a0 con 0x558923fb3d20 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.731+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbb4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 195+0+398 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 20 rados_obj.operate() r=0 bl.length=398 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 20 zone default found 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 4 Realm: () 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:23.752 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 20 zonegroup default 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbbd40 con 0x7f9ba804c050 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.732+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fbc140 con 0x558923fbcb50 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc1500 con 0x558923fbcb50 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 20 started sync module instance, tier type = 2024-03-20T13:36:23.753 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.733+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc0990 con 0x558923fb8260 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.734+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.734+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047502601536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc1160 con 0x558923fb8260 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.734+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc21e0 con 0x558923fb3d20 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.735+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047502601536] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.735+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.735+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047502604384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc2590 con 0x558923fb3d20 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.735+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc2fb0 con 0x558923fbcb50 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.736+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047502604384] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.736+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.736+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047502609040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc3360 con 0x558923fbcb50 2024-03-20T13:36:23.754 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.736+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc3db0 con 0x558923fb8260 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.737+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047502609040] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.737+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.737+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047502605440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4600 con 0x558923fb8260 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.737+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4f70 con 0x558923fb3d20 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.738+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047502605440] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.739+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.739+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047502615360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4f70 con 0x558923fb3d20 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.739+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc5920 con 0x7f9ba804c050 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.740+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047502615360] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.740+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.740+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047502619712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4f70 con 0x7f9ba804c050 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.740+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc6320 con 0x7f9ba804c050 2024-03-20T13:36:23.755 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.741+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047502619712] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.741+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.741+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047502622272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc6500 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.741+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc6d00 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'237 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047502624480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc7140 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=0 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=1 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=2 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=3 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=4 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=5 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047502622272] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.756 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.742+0000 7f9bb9c24800 20 add_watcher() i=6 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.743+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047502624480] v32'238 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.743+0000 7f9bb9c24800 20 add_watcher() i=7 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.743+0000 7f9bb9c24800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.743+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4ad0 con 0x558923fb3d20 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.743+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.743+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047502625760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4ad0 con 0x558923fb3d20 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.744+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047502625760] v32'237 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 5 note: GC not initialized 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9a6cfe1640 20 reqs_thread_entry: start 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:23.757 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 20 Filter name: none 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f99e67fc640 20 reqs_thread_entry: start 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 20 rados->read ofs=0 len=0 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923ffbba0 con 0x558923fb3d20 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 231+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.745+0000 7f9bb9c24800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:could not fetch user info: no user info saved 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.746+0000 7f9a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.746+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047502625760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923ffbb60 con 0x558923fb3d20 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.747+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94047502625760] v32'238 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.747+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047502601536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923ffbb60 con 0x558923fb8260 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.748+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94047502601536] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.748+0000 7f9bb9c24800 20 remove_watcher() i=0 2024-03-20T13:36:23.758 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.748+0000 7f9bb9c24800 2 removed watcher, disabling cache 2024-03-20T13:36:23.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.748+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047502604384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923ffbb60 con 0x558923fb3d20 2024-03-20T13:36:23.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.749+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94047502604384] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.749+0000 7f9bb9c24800 20 remove_watcher() i=1 2024-03-20T13:36:23.759 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.749+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047502609040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923ffbb60 con 0x558923fbcb50 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.750+0000 7f9bb6f22640 1 -- 172.21.15.177:0/2451086759 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94047502609040] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bac059040 con 0x558923fbcb50 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.750+0000 7f9bb9c24800 20 remove_watcher() i=2 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.750+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047502605440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc1860 con 0x558923fb8260 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.751+0000 7f9bb7723640 1 -- 172.21.15.177:0/2451086759 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94047502605440] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9ba8084080 con 0x558923fb8260 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.751+0000 7f9bb9c24800 20 remove_watcher() i=3 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.751+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047502615360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc2a90 con 0x558923fb3d20 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.752+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94047502615360] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x558923fb3d20 2024-03-20T13:36:23.763 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.752+0000 7f9bb9c24800 20 remove_watcher() i=4 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.752+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047502619712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc4340 con 0x7f9ba804c050 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.753+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94047502619712] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.753+0000 7f9bb9c24800 20 remove_watcher() i=5 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.753+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047502622272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc2a90 con 0x7f9ba804c050 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.754+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94047502622272] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.754+0000 7f9bb9c24800 20 remove_watcher() i=6 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.754+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047502624480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x558923fc5e40 con 0x7f9ba804c050 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94047502624480] v32'239 uv237 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f9bb000a4a0 con 0x7f9ba804c050 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 20 remove_watcher() i=7 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9ba804c050 msgr2=0x7f9ba8037020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f9ba804c050 0x7f9ba8037020 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923fb3d20 msgr2=0x558923fb61e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.764 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923fb3d20 0x558923fb61e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923fb8260 msgr2=0x558923fba650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923fb8260 0x558923fba650 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558923fbcb50 msgr2=0x558923fbf010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x558923fbcb50 0x558923fbf010 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 msgr2=0x7f9a80038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a80036790 0x7f9a80038c50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9bac055040 tx=0x7f9bac04f000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 msgr2=0x558923fa8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa8460 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8049640 tx=0x7f9ba802bf70 comp rx=0 tx=0).stop 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb7f24640 1 -- 172.21.15.177:0/2451086759 reap_dead start 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 shutdown_connections 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/2451086759 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923fa1510 0x558923fa8460 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 >> 172.21.15.177:0/2451086759 conn(0x558923f9d7e0 msgr2=0x558923f9ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.765 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 shutdown_connections 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/2451086759 wait complete. 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a90036790 msgr2=0x7f9a90038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a90036790 0x7f9a90038c50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x558923f7a620 tx=0x7f9bac005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 msgr2=0x558923f94810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 0x558923f94810 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9ba804a840 tx=0x7f9ba8023870 comp rx=0 tx=0).stop 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 shutdown_connections 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a90036790 0x7f9a90038c50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4104728639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923f943f0 0x558923f94810 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 >> 172.21.15.177:0/4104728639 conn(0x558923f88490 msgr2=0x558923f88890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.756+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 shutdown_connections 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4104728639 wait complete. 2024-03-20T13:36:23.766 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558923f83730 msgr2=0x558923f85b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x558923f83730 0x558923f85b20 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923e81080 msgr2=0x558923f7cff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x558923e81080 0x558923f7cff0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923f7f830 msgr2=0x558923f81c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x558923f7f830 0x558923f81c20 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a9c036790 msgr2=0x7f9a9c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9a9c036790 0x7f9a9c038c50 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9bac054000 tx=0x7f9bac04e000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 msgr2=0x558923f76300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 --2- 172.21.15.177:0/4273162428 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x558923e7d570 0x558923f76300 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8001c50 tx=0x7f9ba8000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb7f24640 1 -- 172.21.15.177:0/4273162428 reap_dead start 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 shutdown_connections 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 >> 172.21.15.177:0/4273162428 conn(0x558923e77040 msgr2=0x558923e7b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.767 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 shutdown_connections 2024-03-20T13:36:23.768 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.757+0000 7f9bb9c24800 1 -- 172.21.15.177:0/4273162428 wait complete. 2024-03-20T13:36:23.768 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-03-20T13:36:23.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-03-20T13:36:23.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-03-20T13:36:23.769 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-03-20T13:36:23.850 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:23.851 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.850+0000 7f9c7c521800 1 Processor -- start 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.850+0000 7f9c7c521800 1 -- start start 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.850+0000 7f9c7c521800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561177c5b4c0 0x561177c5b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.850+0000 7f9c7c521800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x561177ba7cd0 con 0x561177c5be20 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.850+0000 7f9c7c521800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x561177b5e500 con 0x561177c5b4c0 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.851+0000 7f9c7811b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x561177c5b4c0 0x561177c5b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.851+0000 7f9c6f91a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x561177c5be20 0x561177c5c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51630/0 (socket says 172.21.15.177:51630) 2024-03-20T13:36:23.852 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.851+0000 7f9c6f91a640 1 -- 172.21.15.177:0/1862255939 learned_addr learned my addr 172.21.15.177:0/1862255939 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:23.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.851+0000 7f9c7811b640 1 -- 172.21.15.177:0/1862255939 >> v1:172.21.15.28:6789/0 conn(0x561177c5be20 legacy=0x561177c5c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.853 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.851+0000 7f9c7811b640 1 -- 172.21.15.177:0/1862255939 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561177bd0180 con 0x561177c5b4c0 2024-03-20T13:36:23.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.853+0000 7f9c7811b640 1 --2- 172.21.15.177:0/1862255939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177c5b8e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800a470 tx=0x7f9c6801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d7e81a80316084 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.854 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.853+0000 7f9c7791a640 1 -- 172.21.15.177:0/1862255939 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c68052570 con 0x561177c5b4c0 2024-03-20T13:36:23.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.853+0000 7f9c7791a640 1 -- 172.21.15.177:0/1862255939 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c680526d0 con 0x561177c5b4c0 2024-03-20T13:36:23.858 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.853+0000 7f9c7791a640 1 -- 172.21.15.177:0/1862255939 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c68052990 con 0x561177c5b4c0 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 -- 172.21.15.177:0/1862255939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 msgr2=0x561177c5b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1862255939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177c5b8e0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800a470 tx=0x7f9c6801cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 -- 172.21.15.177:0/1862255939 shutdown_connections 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1862255939 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177c5b8e0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 -- 172.21.15.177:0/1862255939 >> 172.21.15.177:0/1862255939 conn(0x561177c570e0 msgr2=0x561177c59500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 -- 172.21.15.177:0/1862255939 shutdown_connections 2024-03-20T13:36:23.859 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.854+0000 7f9c7c521800 1 -- 172.21.15.177:0/1862255939 wait complete. 2024-03-20T13:36:23.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7c521800 1 Processor -- start 2024-03-20T13:36:23.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7c521800 1 -- start start 2024-03-20T13:36:23.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7c521800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d4eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7c521800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561177b5ba30 con 0x561177c5b4c0 2024-03-20T13:36:23.867 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7811b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d4eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7811b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d4eec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43988/0 (socket says 172.21.15.177:43988) 2024-03-20T13:36:23.871 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7811b640 1 -- 172.21.15.177:0/3143120013 learned_addr learned my addr 172.21.15.177:0/3143120013 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.866+0000 7f9c7811b640 1 -- 172.21.15.177:0/3143120013 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c68005d20 con 0x561177c5b4c0 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.867+0000 7f9c7811b640 1 --2- 172.21.15.177:0/3143120013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d4eec0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9c68055040 tx=0x7f9c6804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597d173c610e0f61 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.867+0000 7f9b6660c640 1 -- 172.21.15.177:0/3143120013 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6800a180 con 0x561177c5b4c0 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.867+0000 7f9b6660c640 1 -- 172.21.15.177:0/3143120013 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6800a2e0 con 0x561177c5b4c0 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.867+0000 7f9b6660c640 1 -- 172.21.15.177:0/3143120013 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c680529b0 con 0x561177c5b4c0 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 -- 172.21.15.177:0/3143120013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 msgr2=0x561177d4eec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3143120013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d4eec0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f9c68055040 tx=0x7f9c6804c000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 -- 172.21.15.177:0/3143120013 shutdown_connections 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3143120013 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d4eec0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 -- 172.21.15.177:0/3143120013 >> 172.21.15.177:0/3143120013 conn(0x561177c570e0 msgr2=0x561177d4a660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 -- 172.21.15.177:0/3143120013 shutdown_connections 2024-03-20T13:36:23.872 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.868+0000 7f9c7c521800 1 -- 172.21.15.177:0/3143120013 wait complete. 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7c521800 1 Processor -- start 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7c521800 1 -- start start 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7c521800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d56340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7c521800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561177b57210 con 0x561177c5b4c0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7811b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d56340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7811b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d56340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:43998/0 (socket says 172.21.15.177:43998) 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.869+0000 7f9c7811b640 1 -- 172.21.15.177:0/3980803456 learned_addr learned my addr 172.21.15.177:0/3980803456 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9c7811b640 1 -- 172.21.15.177:0/3980803456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561177bd0180 con 0x561177c5b4c0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9c7811b640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d56340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800a470 tx=0x7f9c68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9b64e09640 1 -- 172.21.15.177:0/3980803456 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6806a070 con 0x561177c5b4c0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9b64e09640 1 -- 172.21.15.177:0/3980803456 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6805d420 con 0x561177c5b4c0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561177d56880 con 0x561177c5b4c0 2024-03-20T13:36:23.873 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9b64e09640 1 -- 172.21.15.177:0/3980803456 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c6805d5d0 con 0x561177c5b4c0 2024-03-20T13:36:23.874 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.870+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561177d56d60 con 0x561177c5b4c0 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7c521800 1 Processor -- start 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7c521800 1 -- start start 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9b64e09640 1 -- 172.21.15.177:0/3980803456 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c6805d730 con 0x561177c5b4c0 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7c521800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d63ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7c521800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561177af9c70 con 0x561177d63690 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9b64e09640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b600367e0 0x7f9b60038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7891c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d63ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7891c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d63ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44010/0 (socket says 172.21.15.177:44010) 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7891c640 1 -- 172.21.15.177:0/1978131382 learned_addr learned my addr 172.21.15.177:0/1978131382 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9b64e09640 1 -- 172.21.15.177:0/3980803456 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9c6808db60 con 0x561177c5b4c0 2024-03-20T13:36:23.883 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.871+0000 7f9c7811b640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b600367e0 0x7f9b60038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7891c640 1 -- 172.21.15.177:0/1978131382 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561177d63ff0 con 0x561177d63690 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7811b640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b600367e0 0x7f9b60038ca0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9c6805dfd0 tx=0x7f9c68066eb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7891c640 1 --2- 172.21.15.177:0/1978131382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d63ab0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000a430 tx=0x7f9c7000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5348fedeed87257d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9b5e7fc640 1 -- 172.21.15.177:0/1978131382 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c70001650 con 0x561177d63690 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9b5e7fc640 1 -- 172.21.15.177:0/1978131382 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c700017d0 con 0x561177d63690 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9b5e7fc640 1 -- 172.21.15.177:0/1978131382 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c70001ab0 con 0x561177d63690 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 -- 172.21.15.177:0/1978131382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 msgr2=0x561177d63ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1978131382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d63ab0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f9c7000a430 tx=0x7f9c7000a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 -- 172.21.15.177:0/1978131382 shutdown_connections 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1978131382 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d63ab0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 -- 172.21.15.177:0/1978131382 >> 172.21.15.177:0/1978131382 conn(0x561177c5be20 msgr2=0x561177d60130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 -- 172.21.15.177:0/1978131382 shutdown_connections 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.872+0000 7f9c7c521800 1 -- 172.21.15.177:0/1978131382 wait complete. 2024-03-20T13:36:23.884 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7c521800 1 Processor -- start 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7c521800 1 -- start start 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7c521800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d6a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7c521800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561177acf5d0 con 0x561177d63690 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7891c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d6a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7891c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d6a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44014/0 (socket says 172.21.15.177:44014) 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.873+0000 7f9c7891c640 1 -- 172.21.15.177:0/4093397018 learned_addr learned my addr 172.21.15.177:0/4093397018 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9c7891c640 1 -- 172.21.15.177:0/4093397018 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7000a0e0 con 0x561177d63690 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9c7891c640 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d6a700 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9c70013040 tx=0x7f9c70003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9b5cff9640 1 -- 172.21.15.177:0/4093397018 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c70010b10 con 0x561177d63690 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9b5cff9640 1 -- 172.21.15.177:0/4093397018 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c70010c70 con 0x561177d63690 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561177d6ac40 con 0x561177d63690 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9b5cff9640 1 -- 172.21.15.177:0/4093397018 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c7001c400 con 0x561177d63690 2024-03-20T13:36:23.885 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.874+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561177d6b0a0 con 0x561177d63690 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9b5cff9640 1 -- 172.21.15.177:0/4093397018 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c70017070 con 0x561177d63690 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9b5cff9640 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b50036790 0x7f9b50038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c7c521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c7c521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9b5cff9640 1 -- 172.21.15.177:0/4093397018 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9c7004c000 con 0x561177d63690 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c6f91a640 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b50036790 0x7f9b50038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c7c521800 1 Processor -- start 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c7c521800 1 -- start start 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c6f91a640 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b50036790 0x7f9b50038c50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f60 tx=0x7f9c60001230 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.886 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.875+0000 7f9c7c521800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 0x561177d84fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7c521800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x561177d854e0 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7811b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 0x561177d84fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7811b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 0x561177d84fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44030/0 (socket says 172.21.15.177:44030) 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7811b640 1 -- 172.21.15.177:0/1220614829 learned_addr learned my addr 172.21.15.177:0/1220614829 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7811b640 1 -- 172.21.15.177:0/1220614829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561177d85620 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7811b640 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 0x561177d84fa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9c6808be80 tx=0x7f9c6805cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9b3cfe1640 1 -- 172.21.15.177:0/1220614829 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c680775f0 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9b3cfe1640 1 -- 172.21.15.177:0/1220614829 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c68065b60 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561177d85f50 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9b3cfe1640 1 -- 172.21.15.177:0/1220614829 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9c68065e00 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.876+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561177d86410 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.877+0000 7f9b3cfe1640 1 -- 172.21.15.177:0/1220614829 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f9c6808cfd0 con 0x561177d84b80 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.877+0000 7f9b3cfe1640 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9ab8036790 0x7f9ab8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.887 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.877+0000 7f9b3cfe1640 1 -- 172.21.15.177:0/1220614829 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f9c68097d80 con 0x561177d84b80 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.877+0000 7f9c6f91a640 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9ab8036790 0x7f9ab8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9ae67fc640 20 reqs_thread_entry: start 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561177d91ac0 0x561177d93eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561177d94480 con 0x561177d91ac0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c6f91a640 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9ab8036790 0x7f9ab8038c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c60001ed0 tx=0x7f9c6000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7891c640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561177d91ac0 0x561177d93eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7891c640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561177d91ac0 0x561177d93eb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7891c640 1 -- 172.21.15.177:0/3980803456 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f9c7001c9f0 con 0x561177d91ac0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561177d961f0 0x561177d985e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:2 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x561177d98cb0 con 0x561177d961f0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.878+0000 7f9c7811b640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561177d961f0 0x561177d985e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.879+0000 7f9c7811b640 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561177d961f0 0x561177d985e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.888 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.879+0000 7f9c7811b640 1 -- 172.21.15.177:0/3980803456 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(2 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f9c6807e040 con 0x561177d961f0 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b50036790 msgr2=0x7f9b50038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b50036790 0x7f9b50038c50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f9c60000f60 tx=0x7f9c60001230 comp rx=0 tx=0).stop 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 msgr2=0x561177d6a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d6a700 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f9c70013040 tx=0x7f9c70003370 comp rx=0 tx=0).stop 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 shutdown_connections 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b50036790 0x7f9b50038c50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/4093397018 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d63690 0x561177d6a700 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 >> 172.21.15.177:0/4093397018 conn(0x561177c5be20 msgr2=0x561177d5d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 shutdown_connections 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/4093397018 wait complete. 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9ab8036790 msgr2=0x7f9ab8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9ab8036790 0x7f9ab8038c50 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9c60001ed0 tx=0x7f9c6000f000 comp rx=0 tx=0).stop 2024-03-20T13:36:23.889 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 msgr2=0x561177d84fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 0x561177d84fa0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f9c6808be80 tx=0x7f9c6805cb40 comp rx=0 tx=0).stop 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 shutdown_connections 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9ab8036790 0x7f9ab8038c50 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/1220614829 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177d84b80 0x561177d84fa0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 >> 172.21.15.177:0/1220614829 conn(0x561177d797d0 msgr2=0x561177d7a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 shutdown_connections 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/1220614829 wait complete. 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561177d91ac0 msgr2=0x561177d93eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561177d91ac0 0x561177d93eb0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561177d961f0 msgr2=0x561177d985e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.880+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561177d961f0 0x561177d985e0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b600367e0 msgr2=0x7f9b60038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.890 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b600367e0 0x7f9b60038ca0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9c6805dfd0 tx=0x7f9c68066eb0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 msgr2=0x561177d56340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d56340 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f9c6800a470 tx=0x7f9c68002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 shutdown_connections 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x561177d961f0 0x561177d985e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x561177d91ac0 0x561177d93eb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f9b600367e0 0x7f9b60038ca0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 --2- 172.21.15.177:0/3980803456 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x561177c5b4c0 0x561177d56340 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 >> 172.21.15.177:0/3980803456 conn(0x561177c570e0 msgr2=0x561177d48ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 shutdown_connections 2024-03-20T13:36:23.891 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.881+0000 7f9c7c521800 1 -- 172.21.15.177:0/3980803456 wait complete. 2024-03-20T13:36:23.892 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:36:23.892 DEBUG:tasks.util.rgw: json result: {'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:36:23.893 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-03-20T13:36:23.893 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-03-20T13:36:23.893 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-03-20T13:36:23.974 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:23.975 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.974+0000 7f564254b800 1 Processor -- start 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.974+0000 7f564254b800 1 -- start start 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.974+0000 7f564254b800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d3eee7a0f0 0x55d3eee7c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.974+0000 7f564254b800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55d3eedc0cc0 con 0x55d3eee765e0 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.974+0000 7f564254b800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55d3eed77500 con 0x55d3eee7a0f0 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.975+0000 7f5637850640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55d3eee7a0f0 0x55d3eee7c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.975+0000 7f5640051640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55d3eee765e0 0x55d3eee789d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51644/0 (socket says 172.21.15.177:51644) 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.975+0000 7f5640051640 1 -- 172.21.15.177:0/1889246223 learned_addr learned my addr 172.21.15.177:0/1889246223 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.975+0000 7f5637850640 1 -- 172.21.15.177:0/1889246223 >> v1:172.21.15.28:6789/0 conn(0x55d3eee765e0 legacy=0x55d3eee789d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.976 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.975+0000 7f5637850640 1 -- 172.21.15.177:0/1889246223 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3eee7da30 con 0x55d3eee7a0f0 2024-03-20T13:36:23.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f5637850640 1 --2- 172.21.15.177:0/1889246223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee7a0f0 0x55d3eee7c4e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f562800a470 tx=0x7f562801cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f8d653b19af356 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f563f850640 1 -- 172.21.15.177:0/1889246223 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5628052570 con 0x55d3eee7a0f0 2024-03-20T13:36:23.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f563f850640 1 -- 172.21.15.177:0/1889246223 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56280526d0 con 0x55d3eee7a0f0 2024-03-20T13:36:23.978 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f563f850640 1 -- 172.21.15.177:0/1889246223 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5628052990 con 0x55d3eee7a0f0 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 -- 172.21.15.177:0/1889246223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee7a0f0 msgr2=0x55d3eee7c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 --2- 172.21.15.177:0/1889246223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee7a0f0 0x55d3eee7c4e0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f562800a470 tx=0x7f562801cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 -- 172.21.15.177:0/1889246223 shutdown_connections 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 --2- 172.21.15.177:0/1889246223 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee7a0f0 0x55d3eee7c4e0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 -- 172.21.15.177:0/1889246223 >> 172.21.15.177:0/1889246223 conn(0x55d3eee70030 msgr2=0x55d3eee72450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 -- 172.21.15.177:0/1889246223 shutdown_connections 2024-03-20T13:36:23.979 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.977+0000 7f564254b800 1 -- 172.21.15.177:0/1889246223 wait complete. 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.989+0000 7f564254b800 1 Processor -- start 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.989+0000 7f564254b800 1 -- start start 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.989+0000 7f564254b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eee75f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.989+0000 7f564254b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3eed74a30 con 0x55d3eee765e0 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f5640051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eee75f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f5640051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eee75f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44040/0 (socket says 172.21.15.177:44040) 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f5640051640 1 -- 172.21.15.177:0/3177441232 learned_addr learned my addr 172.21.15.177:0/3177441232 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.991 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f5640051640 1 -- 172.21.15.177:0/3177441232 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5628005d20 con 0x55d3eee765e0 2024-03-20T13:36:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f5640051640 1 --2- 172.21.15.177:0/3177441232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eee75f20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5630001c50 tx=0x7f563000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b43abd2827ecd27 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f552e60c640 1 -- 172.21.15.177:0/3177441232 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563000e470 con 0x55d3eee765e0 2024-03-20T13:36:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f552e60c640 1 -- 172.21.15.177:0/3177441232 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f563000e5d0 con 0x55d3eee765e0 2024-03-20T13:36:23.995 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.990+0000 7f552e60c640 1 -- 172.21.15.177:0/3177441232 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563000e8d0 con 0x55d3eee765e0 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- 172.21.15.177:0/3177441232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 msgr2=0x55d3eee75f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 --2- 172.21.15.177:0/3177441232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eee75f20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5630001c50 tx=0x7f563000b6c0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- 172.21.15.177:0/3177441232 shutdown_connections 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 --2- 172.21.15.177:0/3177441232 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eee75f20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- 172.21.15.177:0/3177441232 >> 172.21.15.177:0/3177441232 conn(0x55d3eee70030 msgr2=0x55d3eef61380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- 172.21.15.177:0/3177441232 shutdown_connections 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- 172.21.15.177:0/3177441232 wait complete. 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 Processor -- start 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- start start 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eef6f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.991+0000 7f564254b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3eed70210 con 0x55d3eee765e0 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f5640051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eef6f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f5640051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eef6f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44050/0 (socket says 172.21.15.177:44050) 2024-03-20T13:36:23.996 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 learned_addr learned my addr 172.21.15.177:0/1228158928 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3eedc0cc0 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f5640051640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eef6f2d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5630000c00 tx=0x7f5630000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f552ce09640 1 -- 172.21.15.177:0/1228158928 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f563001f070 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f552ce09640 1 -- 172.21.15.177:0/1228158928 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630018770 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f552ce09640 1 -- 172.21.15.177:0/1228158928 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5630018a30 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d3eef6f810 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.992+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3eef6fcf0 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.993+0000 7f564254b800 1 Processor -- start 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.993+0000 7f564254b800 1 -- start start 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.993+0000 7f552ce09640 1 -- 172.21.15.177:0/1228158928 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5630018c20 con 0x55d3eee765e0 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.993+0000 7f564254b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef7caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.993+0000 7f564254b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3eed12c70 con 0x55d3eef7c680 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f552ce09640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5528036790 0x7f5528038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:23.997 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f552ce09640 1 -- 172.21.15.177:0/1228158928 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f563004c350 con 0x55d3eee765e0 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640852640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef7caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640852640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef7caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44060/0 (socket says 172.21.15.177:44060) 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640051640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5528036790 0x7f5528038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640852640 1 -- 172.21.15.177:0/2644262435 learned_addr learned my addr 172.21.15.177:0/2644262435 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640852640 1 -- 172.21.15.177:0/2644262435 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3eef7cfe0 con 0x55d3eef7c680 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640051640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5528036790 0x7f5528038c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f56300015f0 tx=0x7f5630001520 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f5640852640 1 --2- 172.21.15.177:0/2644262435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef7caa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f563800a430 tx=0x7f563800a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e469f47a3eca5fe server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f55267fc640 1 -- 172.21.15.177:0/2644262435 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638001650 con 0x55d3eef7c680 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f55267fc640 1 -- 172.21.15.177:0/2644262435 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56380017d0 con 0x55d3eef7c680 2024-03-20T13:36:23.998 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.994+0000 7f55267fc640 1 -- 172.21.15.177:0/2644262435 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638001ab0 con 0x55d3eef7c680 2024-03-20T13:36:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- 172.21.15.177:0/2644262435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 msgr2=0x55d3eef7caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 --2- 172.21.15.177:0/2644262435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef7caa0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f563800a430 tx=0x7f563800a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- 172.21.15.177:0/2644262435 shutdown_connections 2024-03-20T13:36:24.008 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 --2- 172.21.15.177:0/2644262435 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef7caa0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- 172.21.15.177:0/2644262435 >> 172.21.15.177:0/2644262435 conn(0x55d3eee7a0f0 msgr2=0x55d3eef79120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- 172.21.15.177:0/2644262435 shutdown_connections 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- 172.21.15.177:0/2644262435 wait complete. 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 Processor -- start 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- start start 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef836e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f564254b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3eece85d0 con 0x55d3eef7c680 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f5640852640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef836e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f5640852640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef836e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44064/0 (socket says 172.21.15.177:44064) 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.995+0000 7f5640852640 1 -- 172.21.15.177:0/1931837944 learned_addr learned my addr 172.21.15.177:0/1931837944 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f5640852640 1 -- 172.21.15.177:0/1931837944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f563800a0e0 con 0x55d3eef7c680 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f5640852640 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef836e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5638000f80 tx=0x7f5638003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f5524ff9640 1 -- 172.21.15.177:0/1931837944 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638010a40 con 0x55d3eef7c680 2024-03-20T13:36:24.009 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f5524ff9640 1 -- 172.21.15.177:0/1931837944 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5638010ba0 con 0x55d3eef7c680 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f5524ff9640 1 -- 172.21.15.177:0/1931837944 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5638010e80 con 0x55d3eef7c680 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d3eef83c20 con 0x55d3eef7c680 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.996+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3eef84080 con 0x55d3eef7c680 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f5524ff9640 1 -- 172.21.15.177:0/1931837944 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f5638017070 con 0x55d3eef7c680 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f564254b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f564254b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f5524ff9640 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f55180367e0 0x7f5518038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f5524ff9640 1 -- 172.21.15.177:0/1931837944 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f563804bfa0 con 0x55d3eef7c680 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f5637850640 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f55180367e0 0x7f5518038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f564254b800 1 Processor -- start 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.997+0000 7f564254b800 1 -- start start 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5637850640 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f55180367e0 0x7f5518038ca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5628054000 tx=0x7f562804e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f564254b800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 0x55d3eef9df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.010 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f564254b800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d3eef9e4a0 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5640051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 0x55d3eef9df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5640051640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 0x55d3eef9df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44074/0 (socket says 172.21.15.177:44074) 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5640051640 1 -- 172.21.15.177:0/1178232655 learned_addr learned my addr 172.21.15.177:0/1178232655 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5640051640 1 -- 172.21.15.177:0/1178232655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d3eef9e5e0 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5640051640 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 0x55d3eef9df60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f563000ef00 tx=0x7f56300234f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5504fe1640 1 -- 172.21.15.177:0/1178232655 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5630022550 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f5504fe1640 1 -- 172.21.15.177:0/1178232655 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5630033040 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.998+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d3eef9ef60 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.999+0000 7f5504fe1640 1 -- 172.21.15.177:0/1178232655 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5630016c90 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.999+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d3eef9f420 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.999+0000 7f5504fe1640 1 -- 172.21.15.177:0/1178232655 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f563004a2c0 con 0x55d3eef9db40 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.999+0000 7f5504fe1640 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5480036790 0x7f5480038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.011 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:23.999+0000 7f5504fe1640 1 -- 172.21.15.177:0/1178232655 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f5630039040 con 0x55d3eef9db40 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f5637850640 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5480036790 0x7f5480038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f549e7fc640 20 reqs_thread_entry: start 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d3eefaaad0 0x55d3eefacec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefad400 con 0x55d3eefaaad0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f5637850640 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5480036790 0x7f5480038c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f562801cda0 tx=0x7f5628005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f5640852640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d3eefaaad0 0x55d3eefacec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.000+0000 7f5640852640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d3eefaaad0 0x55d3eefacec0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.001+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.001+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefad870 con 0x55d3eefaaad0 2024-03-20T13:36:24.012 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.001+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.001+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d3eefaf630 0x55d3eefb1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.001+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb20c0 con 0x55d3eefaf630 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.001+0000 7f5640051640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d3eefaf630 0x55d3eefb1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f5640051640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d3eefaf630 0x55d3eefb1a20 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb83d0 con 0x55d3eefaaad0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:NOTICE: set zone's realm_id= 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d3eefbe530 0x55d3eefb99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.002+0000 7f5637850640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d3eefbe530 0x55d3eefb99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5637850640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d3eefbe530 0x55d3eefb99d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.013 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(5 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5640051640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5630017050 0x7f563002b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.003+0000 7f5640852640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5630017050 0x7f563002b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.004+0000 7f5640852640 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5630017050 0x7f563002b340 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.004+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.004+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.004+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.004+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.014 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.005+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.015 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.006+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(17 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(18 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.016 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.007+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.022 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=74b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.008+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(25 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(27 [pgnls start_epoch 32 out=107b] v30'2 uv2 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(28 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x55d3eefaaad0 2024-03-20T13:36:24.023 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.009+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.010+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(29 [pgnls start_epoch 32 out=112b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.010+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.010+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(30 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.010+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.010+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.010+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefbe530 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5628070040 con 0x55d3eefbe530 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5637850640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x7f5630017050 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f563801b390 con 0x7f5630017050 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaaad0 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(35 [pgnls start_epoch 32 out=115b] v23'2 uv2 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f5638035080 con 0x55d3eefaaad0 2024-03-20T13:36:24.024 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.011+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb2c00 con 0x55d3eefaf630 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.012+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(36 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.012+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefbc400 con 0x55d3eefaaad0 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.012+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f5638035080 con 0x55d3eefaaad0 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.012+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:38 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb24b0 con 0x55d3eefaf630 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.012+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(38 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv2 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.012+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:39 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [create,call version.set in=58b,writefull 0~1036 in=1036b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb7790 con 0x55d3eefaf630 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.013+0000 7f5640051640 1 -- 172.21.15.177:0/1228158928 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(39 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [create,call,writefull 0~1036] v32'3 uv3 ondisk = 0) v8 ==== 274+0+0 (crc 0 0 0) 0x7f5630035070 con 0x55d3eefaf630 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.013+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefbddd0 con 0x55d3eefaaad0 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.015+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v32'3 uv3 ondisk = 0) v8 ==== 246+0+0 (crc 0 0 0) 0x7f5638035080 con 0x55d3eefaaad0 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.015+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55d3eefb5020 con 0x55d3eefaaad0 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v32'2 uv1 ondisk = -17 ((17) File exists)) v8 ==== 199+0+0 (crc 0 0 0) 0x7f5638035080 con 0x55d3eefaaad0 2024-03-20T13:36:24.025 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f55180367e0 msgr2=0x7f5518038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f55180367e0 0x7f5518038ca0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5628054000 tx=0x7f562804e000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 msgr2=0x55d3eef836e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef836e0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f5638000f80 tx=0x7f5638003370 comp rx=0 tx=0).stop 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 shutdown_connections 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f55180367e0 0x7f5518038ca0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 --2- 172.21.15.177:0/1931837944 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef7c680 0x55d3eef836e0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 >> 172.21.15.177:0/1931837944 conn(0x55d3eee7a0f0 msgr2=0x55d3eef76760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 shutdown_connections 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.016+0000 7f564254b800 1 -- 172.21.15.177:0/1931837944 wait complete. 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5480036790 msgr2=0x7f5480038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5480036790 0x7f5480038c50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f562801cda0 tx=0x7f5628005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 msgr2=0x55d3eef9df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.026 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 0x55d3eef9df60 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f563000ef00 tx=0x7f56300234f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 shutdown_connections 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5480036790 0x7f5480038c50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1178232655 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eef9db40 0x55d3eef9df60 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 >> 172.21.15.177:0/1178232655 conn(0x55d3eef92810 msgr2=0x55d3eef93220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 shutdown_connections 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1178232655 wait complete. 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5630017050 msgr2=0x7f563002b340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f5630017050 0x7f563002b340 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d3eefaaad0 msgr2=0x55d3eefacec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55d3eefaaad0 0x55d3eefacec0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d3eefaf630 msgr2=0x55d3eefb1a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55d3eefaf630 0x55d3eefb1a20 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d3eefbe530 msgr2=0x55d3eefb99d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.027 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55d3eefbe530 0x55d3eefb99d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5528036790 msgr2=0x7f5528038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f5528036790 0x7f5528038c50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f56300015f0 tx=0x7f5630001520 comp rx=0 tx=0).stop 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 msgr2=0x55d3eef6f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 --2- 172.21.15.177:0/1228158928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55d3eee765e0 0x55d3eef6f2d0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f5630000c00 tx=0x7f5630000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f5640852640 1 -- 172.21.15.177:0/1228158928 reap_dead start 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 shutdown_connections 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 >> 172.21.15.177:0/1228158928 conn(0x55d3eee70030 msgr2=0x55d3eee74980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 shutdown_connections 2024-03-20T13:36:24.028 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.017+0000 7f564254b800 1 -- 172.21.15.177:0/1228158928 wait complete. 2024-03-20T13:36:24.029 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:36:24.029 DEBUG:tasks.util.rgw: json result: {'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:36:24.030 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-03-20T13:36:24.030 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-03-20T13:36:24.030 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-03-20T13:36:24.110 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:24.111 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.110+0000 7f011d91f800 1 Processor -- start 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.110+0000 7f011d91f800 1 -- start start 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.110+0000 7f011d91f800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55742c3e3430 0x55742c3e3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.110+0000 7f011d91f800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55742c32fcc0 con 0x55742c3e3d90 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.110+0000 7f011d91f800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55742c2e6500 con 0x55742c3e3430 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f011951b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55742c3e3430 0x55742c3e3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.112 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f0113fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55742c3e3d90 0x55742c3e4240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51658/0 (socket says 172.21.15.177:51658) 2024-03-20T13:36:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f0113fff640 1 -- 172.21.15.177:0/1082222269 learned_addr learned my addr 172.21.15.177:0/1082222269 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f0118d1a640 1 -- 172.21.15.177:0/1082222269 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260491307 0 0) 0x55742c32fcc0 con 0x55742c3e3d90 2024-03-20T13:36:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f0118d1a640 1 -- 172.21.15.177:0/1082222269 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0108001e10 con 0x55742c3e3d90 2024-03-20T13:36:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f011951b640 1 -- 172.21.15.177:0/1082222269 >> v1:172.21.15.28:6789/0 conn(0x55742c3e3d90 legacy=0x55742c3e4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.113 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.111+0000 7f011951b640 1 -- 172.21.15.177:0/1082222269 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742c358040 con 0x55742c3e3430 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011951b640 1 --2- 172.21.15.177:0/1082222269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c3e3850 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f010c00a470 tx=0x7f010c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b76c59cb7747e0a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f0118d1a640 1 -- 172.21.15.177:0/1082222269 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c04ad60 con 0x55742c3e3430 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f0118d1a640 1 -- 172.21.15.177:0/1082222269 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c052440 con 0x55742c3e3430 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f0118d1a640 1 -- 172.21.15.177:0/1082222269 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c0526e0 con 0x55742c3e3430 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 -- 172.21.15.177:0/1082222269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 msgr2=0x55742c3e3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 --2- 172.21.15.177:0/1082222269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c3e3850 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f010c00a470 tx=0x7f010c01cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 -- 172.21.15.177:0/1082222269 shutdown_connections 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 --2- 172.21.15.177:0/1082222269 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c3e3850 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 -- 172.21.15.177:0/1082222269 >> 172.21.15.177:0/1082222269 conn(0x55742c3df030 msgr2=0x55742c3e1450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 -- 172.21.15.177:0/1082222269 shutdown_connections 2024-03-20T13:36:24.115 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.113+0000 7f011d91f800 1 -- 172.21.15.177:0/1082222269 wait complete. 2024-03-20T13:36:24.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.125+0000 7f011d91f800 1 Processor -- start 2024-03-20T13:36:24.126 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.125+0000 7f011d91f800 1 -- start start 2024-03-20T13:36:24.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.125+0000 7f011d91f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.125+0000 7f011d91f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742c2e3a30 con 0x55742c3e3430 2024-03-20T13:36:24.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f011951b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f011951b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4d6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44102/0 (socket says 172.21.15.177:44102) 2024-03-20T13:36:24.127 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f011951b640 1 -- 172.21.15.177:0/2120788191 learned_addr learned my addr 172.21.15.177:0/2120788191 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f011951b640 1 -- 172.21.15.177:0/2120788191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010c005d20 con 0x55742c3e3430 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f011951b640 1 --2- 172.21.15.177:0/2120788191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4d6a10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f010c01ccc0 tx=0x7f010c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62763586f39490c server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f0007606640 1 -- 172.21.15.177:0/2120788191 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c00a040 con 0x55742c3e3430 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f0007606640 1 -- 172.21.15.177:0/2120788191 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c00a1a0 con 0x55742c3e3430 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.126+0000 7f0007606640 1 -- 172.21.15.177:0/2120788191 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c0525b0 con 0x55742c3e3430 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 -- 172.21.15.177:0/2120788191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 msgr2=0x55742c4d6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 --2- 172.21.15.177:0/2120788191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4d6a10 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f010c01ccc0 tx=0x7f010c04c000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 -- 172.21.15.177:0/2120788191 shutdown_connections 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 --2- 172.21.15.177:0/2120788191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4d6a10 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.129 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 -- 172.21.15.177:0/2120788191 >> 172.21.15.177:0/2120788191 conn(0x55742c3df030 msgr2=0x55742c4d2330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 -- 172.21.15.177:0/2120788191 shutdown_connections 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 -- 172.21.15.177:0/2120788191 wait complete. 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.127+0000 7f011d91f800 1 Processor -- start 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011d91f800 1 -- start start 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011d91f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4ddfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011d91f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742c2df210 con 0x55742c3e3430 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011951b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4ddfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011951b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4ddfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44112/0 (socket says 172.21.15.177:44112) 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011951b640 1 -- 172.21.15.177:0/1695442984 learned_addr learned my addr 172.21.15.177:0/1695442984 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.130 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011951b640 1 -- 172.21.15.177:0/1695442984 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742c358040 con 0x55742c3e3430 2024-03-20T13:36:24.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f011951b640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4ddfb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f010c01d3b0 tx=0x7f010c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.139 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f0005e03640 1 -- 172.21.15.177:0/1695442984 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c06b070 con 0x55742c3e3430 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.128+0000 7f0005e03640 1 -- 172.21.15.177:0/1695442984 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c052c60 con 0x55742c3e3430 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55742c4de4f0 con 0x55742c3e3430 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f0005e03640 1 -- 172.21.15.177:0/1695442984 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c06f410 con 0x55742c3e3430 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55742c4dea30 con 0x55742c3e3430 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f011d91f800 1 Processor -- start 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f011d91f800 1 -- start start 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f011d91f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4eb7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f011d91f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742c281c70 con 0x55742c4eb380 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f0005e03640 1 -- 172.21.15.177:0/1695442984 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f010c059050 con 0x55742c3e3430 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f0119d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4eb7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.140 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f0119d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4eb7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44124/0 (socket says 172.21.15.177:44124) 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.129+0000 7f0119d1c640 1 -- 172.21.15.177:0/3457779511 learned_addr learned my addr 172.21.15.177:0/3457779511 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7f0005e03640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0000036790 0x7f0000038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7f0005e03640 1 -- 172.21.15.177:0/1695442984 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f010c08d300 con 0x55742c3e3430 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7f0119d1c640 1 -- 172.21.15.177:0/3457779511 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742c4ebce0 con 0x55742c4eb380 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7f011951b640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0000036790 0x7f0000038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7f0119d1c640 1 --2- 172.21.15.177:0/3457779511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4eb7a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f011400a430 tx=0x7f011400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389692b36898ffbb server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7f011951b640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0000036790 0x7f0000038c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f010c052f60 tx=0x7f010c07b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7effff7fe640 1 -- 172.21.15.177:0/3457779511 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0114001650 con 0x55742c4eb380 2024-03-20T13:36:24.141 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7effff7fe640 1 -- 172.21.15.177:0/3457779511 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01140017d0 con 0x55742c4eb380 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.130+0000 7effff7fe640 1 -- 172.21.15.177:0/3457779511 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0114001ab0 con 0x55742c4eb380 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- 172.21.15.177:0/3457779511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 msgr2=0x55742c4eb7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 --2- 172.21.15.177:0/3457779511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4eb7a0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f011400a430 tx=0x7f011400a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- 172.21.15.177:0/3457779511 shutdown_connections 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 --2- 172.21.15.177:0/3457779511 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4eb7a0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- 172.21.15.177:0/3457779511 >> 172.21.15.177:0/3457779511 conn(0x55742c3e3d90 msgr2=0x55742c4e7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- 172.21.15.177:0/3457779511 shutdown_connections 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- 172.21.15.177:0/3457779511 wait complete. 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 Processor -- start 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- start start 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.142 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f011d91f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742c2575d0 con 0x55742c4eb380 2024-03-20T13:36:24.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f0119d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f0119d1c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44130/0 (socket says 172.21.15.177:44130) 2024-03-20T13:36:24.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.131+0000 7f0119d1c640 1 -- 172.21.15.177:0/2527332482 learned_addr learned my addr 172.21.15.177:0/2527332482 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7f0119d1c640 1 -- 172.21.15.177:0/2527332482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f011400a0e0 con 0x55742c4eb380 2024-03-20T13:36:24.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7f0119d1c640 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4f2360 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0114013040 tx=0x7f0114003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.143 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7efffdffb640 1 -- 172.21.15.177:0/2527332482 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0114010b10 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7efffdffb640 1 -- 172.21.15.177:0/2527332482 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0114010c70 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55742c4f28a0 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7efffdffb640 1 -- 172.21.15.177:0/2527332482 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f011401c400 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.132+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55742c4f2d00 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.133+0000 7efffdffb640 1 -- 172.21.15.177:0/2527332482 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f0114017070 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.133+0000 7efffdffb640 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efff00367e0 0x7efff0038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.133+0000 7efffdffb640 1 -- 172.21.15.177:0/2527332482 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f011404bf70 con 0x55742c4eb380 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.133+0000 7f0113fff640 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efff00367e0 0x7efff0038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.133+0000 7f011d91f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.133+0000 7f011d91f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011d91f800 1 Processor -- start 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f0113fff640 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efff00367e0 0x7efff0038ca0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0104000f60 tx=0x7f01040010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.144 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011d91f800 1 -- start start 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011d91f800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 0x55742c50cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011d91f800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55742c50d160 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011951b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 0x55742c50cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011951b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 0x55742c50cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44140/0 (socket says 172.21.15.177:44140) 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.134+0000 7f011951b640 1 -- 172.21.15.177:0/3912610164 learned_addr learned my addr 172.21.15.177:0/3912610164 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7f011951b640 1 -- 172.21.15.177:0/3912610164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55742c50d2a0 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7f011951b640 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 0x55742c50cc20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f010c08b710 tx=0x7f010c05bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7effddfe3640 1 -- 172.21.15.177:0/3912610164 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c06e8e0 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7effddfe3640 1 -- 172.21.15.177:0/3912610164 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010c06ea40 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55742c50dbd0 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7effddfe3640 1 -- 172.21.15.177:0/3912610164 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f010c08b390 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.135+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55742c50e090 con 0x55742c50c800 2024-03-20T13:36:24.145 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7effddfe3640 1 -- 172.21.15.177:0/3912610164 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f010c06f9c0 con 0x55742c50c800 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7effddfe3640 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7eff5c036790 0x7eff5c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7effddfe3640 1 -- 172.21.15.177:0/3912610164 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f010c096d20 con 0x55742c50c800 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7f0113fff640 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7eff5c036790 0x7eff5c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7eff577fe640 20 reqs_thread_entry: start 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7f0113fff640 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7eff5c036790 0x7eff5c038c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0104004170 tx=0x7f010400f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55742c519740 0x55742c51bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55742c51c070 con 0x55742c519740 2024-03-20T13:36:24.146 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.136+0000 7f0119d1c640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55742c519740 0x55742c51bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f0119d1c640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55742c519740 0x55742c51bb30 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f0119d1c640 1 -- 172.21.15.177:0/1695442984 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f011401c930 con 0x55742c519740 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55742c51c500 con 0x55742c519740 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f0119d1c640 1 -- 172.21.15.177:0/1695442984 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f011401c930 con 0x55742c519740 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55742c51e2c0 0x55742c5206b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55742c520d50 con 0x55742c51e2c0 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.137+0000 7f011951b640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55742c51e2c0 0x55742c5206b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.138+0000 7f011951b640 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55742c51e2c0 0x55742c5206b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.147 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.138+0000 7f011951b640 1 -- 172.21.15.177:0/1695442984 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7f010c07f070 con 0x55742c51e2c0 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efff00367e0 msgr2=0x7efff0038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efff00367e0 0x7efff0038ca0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f0104000f60 tx=0x7f01040010a0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 msgr2=0x55742c4f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4f2360 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f0114013040 tx=0x7f0114003370 comp rx=0 tx=0).stop 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 shutdown_connections 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7efff00367e0 0x7efff0038ca0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/2527332482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c4eb380 0x55742c4f2360 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 >> 172.21.15.177:0/2527332482 conn(0x55742c3e3d90 msgr2=0x55742c4e5460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.150 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 shutdown_connections 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/2527332482 wait complete. 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7eff5c036790 msgr2=0x7eff5c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7eff5c036790 0x7eff5c038c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f0104004170 tx=0x7f010400f000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 msgr2=0x55742c50cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 0x55742c50cc20 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f010c08b710 tx=0x7f010c05bac0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 shutdown_connections 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7eff5c036790 0x7eff5c038c50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/3912610164 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c50c800 0x55742c50cc20 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 >> 172.21.15.177:0/3912610164 conn(0x55742c501440 msgr2=0x55742c501e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 shutdown_connections 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/3912610164 wait complete. 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55742c519740 msgr2=0x55742c51bb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55742c519740 0x55742c51bb30 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.151 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55742c51e2c0 msgr2=0x55742c5206b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55742c51e2c0 0x55742c5206b0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0000036790 msgr2=0x7f0000038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0000036790 0x7f0000038c50 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f010c052f60 tx=0x7f010c07b040 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 msgr2=0x55742c4ddfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4ddfb0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f010c01d3b0 tx=0x7f010c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 shutdown_connections 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.139+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55742c51e2c0 0x55742c5206b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.140+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55742c519740 0x55742c51bb30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.140+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f0000036790 0x7f0000038c50 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.140+0000 7f011d91f800 1 --2- 172.21.15.177:0/1695442984 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55742c3e3430 0x55742c4ddfb0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.140+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 >> 172.21.15.177:0/1695442984 conn(0x55742c3df030 msgr2=0x55742c4d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.140+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 shutdown_connections 2024-03-20T13:36:24.152 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.140+0000 7f011d91f800 1 -- 172.21.15.177:0/1695442984 wait complete. 2024-03-20T13:36:24.153 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:36:24.153 DEBUG:tasks.util.rgw: json result: {'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:36:24.154 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:36:24.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-03-20T13:36:24.154 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-03-20T13:36:24.239 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:24.240 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:24.240 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.239+0000 7f6627011800 1 Processor -- start 2024-03-20T13:36:24.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.239+0000 7f6627011800 1 -- start start 2024-03-20T13:36:24.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.239+0000 7f6627011800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55e831e61ba0 0x55e831e61fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.239+0000 7f6627011800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55e831dacd70 con 0x55e831e62e00 2024-03-20T13:36:24.241 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.239+0000 7f6627011800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55e831d63500 con 0x55e831e61ba0 2024-03-20T13:36:24.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.241+0000 7f6619f01640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55e831e62e00 0x55e831e63280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51674/0 (socket says 172.21.15.177:51674) 2024-03-20T13:36:24.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.241+0000 7f6619f01640 1 -- 172.21.15.177:0/923627536 learned_addr learned my addr 172.21.15.177:0/923627536 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:24.242 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.241+0000 7f6622702640 1 --2- 172.21.15.177:0/923627536 >> v2:172.21.15.28:3300/0 conn(0x55e831e61ba0 0x55e831e61fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.242+0000 7f6621f01640 1 -- 172.21.15.177:0/923627536 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3787498223 0 0) 0x55e831dacd70 con 0x55e831e62e00 2024-03-20T13:36:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.243+0000 7f6621f01640 1 -- 172.21.15.177:0/923627536 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6610001e10 con 0x55e831e62e00 2024-03-20T13:36:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.243+0000 7f6622702640 1 -- 172.21.15.177:0/923627536 >> v1:172.21.15.28:6789/0 conn(0x55e831e62e00 legacy=0x55e831e63280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.244 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.243+0000 7f6622702640 1 -- 172.21.15.177:0/923627536 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e831e62690 con 0x55e831e61ba0 2024-03-20T13:36:24.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.246+0000 7f6622702640 1 --2- 172.21.15.177:0/923627536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831e61fc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f661400a470 tx=0x7f661401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aad7e0a95a6069ee server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6621f01640 1 -- 172.21.15.177:0/923627536 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661404ad60 con 0x55e831e61ba0 2024-03-20T13:36:24.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6621f01640 1 -- 172.21.15.177:0/923627536 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6614052440 con 0x55e831e61ba0 2024-03-20T13:36:24.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6621f01640 1 -- 172.21.15.177:0/923627536 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6614052700 con 0x55e831e61ba0 2024-03-20T13:36:24.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 -- 172.21.15.177:0/923627536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 msgr2=0x55e831e61fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 --2- 172.21.15.177:0/923627536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831e61fc0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f661400a470 tx=0x7f661401cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:24.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 -- 172.21.15.177:0/923627536 shutdown_connections 2024-03-20T13:36:24.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 --2- 172.21.15.177:0/923627536 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831e61fc0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 -- 172.21.15.177:0/923627536 >> 172.21.15.177:0/923627536 conn(0x55e831e5d1c0 msgr2=0x55e831e5f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 -- 172.21.15.177:0/923627536 shutdown_connections 2024-03-20T13:36:24.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.247+0000 7f6627011800 1 -- 172.21.15.177:0/923627536 wait complete. 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.259+0000 7f6627011800 1 Processor -- start 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.259+0000 7f6627011800 1 -- start start 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.259+0000 7f6627011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f51f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.259+0000 7f6627011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e831d60a30 con 0x55e831e61ba0 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6622702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f51f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6622702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f51f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44152/0 (socket says 172.21.15.177:44152) 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6622702640 1 -- 172.21.15.177:0/2945126569 learned_addr learned my addr 172.21.15.177:0/2945126569 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6622702640 1 -- 172.21.15.177:0/2945126569 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6614005d20 con 0x55e831e61ba0 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6622702640 1 --2- 172.21.15.177:0/2945126569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f51f00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6614055040 tx=0x7f661404c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91454423efe67ef6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6510608640 1 -- 172.21.15.177:0/2945126569 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661400a040 con 0x55e831e61ba0 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6510608640 1 -- 172.21.15.177:0/2945126569 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661400a1a0 con 0x55e831e61ba0 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.260+0000 7f6510608640 1 -- 172.21.15.177:0/2945126569 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f66140525b0 con 0x55e831e61ba0 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 -- 172.21.15.177:0/2945126569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 msgr2=0x55e831f51f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 --2- 172.21.15.177:0/2945126569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f51f00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6614055040 tx=0x7f661404c000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 -- 172.21.15.177:0/2945126569 shutdown_connections 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 --2- 172.21.15.177:0/2945126569 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f51f00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 -- 172.21.15.177:0/2945126569 >> 172.21.15.177:0/2945126569 conn(0x55e831e5d1c0 msgr2=0x55e831f4d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 -- 172.21.15.177:0/2945126569 shutdown_connections 2024-03-20T13:36:24.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 -- 172.21.15.177:0/2945126569 wait complete. 2024-03-20T13:36:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 Processor -- start 2024-03-20T13:36:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.261+0000 7f6627011800 1 -- start start 2024-03-20T13:36:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.262+0000 7f6627011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f59310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.262+0000 7f6627011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e831d5c210 con 0x55e831e61ba0 2024-03-20T13:36:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.264+0000 7f6622702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f59310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.264+0000 7f6622702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f59310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44162/0 (socket says 172.21.15.177:44162) 2024-03-20T13:36:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.264+0000 7f6622702640 1 -- 172.21.15.177:0/1209435125 learned_addr learned my addr 172.21.15.177:0/1209435125 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.266+0000 7f6622702640 1 -- 172.21.15.177:0/1209435125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661404e070 con 0x55e831e61ba0 2024-03-20T13:36:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.267+0000 7f6622702640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f59310 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6614005870 tx=0x7f6614002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f650ee05640 1 -- 172.21.15.177:0/1209435125 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661406b070 con 0x55e831e61ba0 2024-03-20T13:36:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f650ee05640 1 -- 172.21.15.177:0/1209435125 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6614052ac0 con 0x55e831e61ba0 2024-03-20T13:36:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e831f59850 con 0x55e831e61ba0 2024-03-20T13:36:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f650ee05640 1 -- 172.21.15.177:0/1209435125 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6614052d80 con 0x55e831e61ba0 2024-03-20T13:36:24.269 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e831f59d90 con 0x55e831e61ba0 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f6627011800 1 Processor -- start 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.268+0000 7f6627011800 1 -- start start 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f6627011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f66a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f6627011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e831cfec70 con 0x55e831f66660 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f650ee05640 1 -- 172.21.15.177:0/1209435125 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f6614059050 con 0x55e831e61ba0 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f6622f03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f66a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f6622f03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f66a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44164/0 (socket says 172.21.15.177:44164) 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f6622f03640 1 -- 172.21.15.177:0/3744271026 learned_addr learned my addr 172.21.15.177:0/3744271026 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f650ee05640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65080367e0 0x7f6508038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f650ee05640 1 -- 172.21.15.177:0/1209435125 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f661408d0f0 con 0x55e831e61ba0 2024-03-20T13:36:24.271 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.269+0000 7f6622702640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65080367e0 0x7f6508038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.270+0000 7f6622702640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65080367e0 0x7f6508038ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f661405cfd0 tx=0x7f6614066e70 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.272 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.270+0000 7f6622f03640 1 -- 172.21.15.177:0/3744271026 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e831f66fc0 con 0x55e831f66660 2024-03-20T13:36:24.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.270+0000 7f6622f03640 1 --2- 172.21.15.177:0/3744271026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f66a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f661c00a430 tx=0x7f661c00a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60011096cbcd79b9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.270+0000 7f650ce01640 1 -- 172.21.15.177:0/3744271026 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661c001650 con 0x55e831f66660 2024-03-20T13:36:24.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f650ce01640 1 -- 172.21.15.177:0/3744271026 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c0017d0 con 0x55e831f66660 2024-03-20T13:36:24.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f650ce01640 1 -- 172.21.15.177:0/3744271026 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661c001ab0 con 0x55e831f66660 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 -- 172.21.15.177:0/3744271026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 msgr2=0x55e831f66a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 --2- 172.21.15.177:0/3744271026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f66a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f661c00a430 tx=0x7f661c00a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 -- 172.21.15.177:0/3744271026 shutdown_connections 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 --2- 172.21.15.177:0/3744271026 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f66a80 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 -- 172.21.15.177:0/3744271026 >> 172.21.15.177:0/3744271026 conn(0x55e831e62e00 msgr2=0x55e831f63100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 -- 172.21.15.177:0/3744271026 shutdown_connections 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 -- 172.21.15.177:0/3744271026 wait complete. 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 Processor -- start 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 -- start start 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.271+0000 7f6627011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f6d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6627011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e831cd45d0 con 0x55e831f66660 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6622f03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f6d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6622f03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f6d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44170/0 (socket says 172.21.15.177:44170) 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6622f03640 1 -- 172.21.15.177:0/1496839871 learned_addr learned my addr 172.21.15.177:0/1496839871 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6622f03640 1 -- 172.21.15.177:0/1496839871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c00a0e0 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6622f03640 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f6d550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f661c000f80 tx=0x7f661c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6506ffd640 1 -- 172.21.15.177:0/1496839871 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661c010a40 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6506ffd640 1 -- 172.21.15.177:0/1496839871 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661c010ba0 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6506ffd640 1 -- 172.21.15.177:0/1496839871 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661c010e80 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e831f6da90 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.272+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e831f6def0 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.273+0000 7f6506ffd640 1 -- 172.21.15.177:0/1496839871 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f661c017070 con 0x55e831f66660 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6627011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6627011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:24.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6506ffd640 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f64fc036790 0x7f64fc038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6506ffd640 1 -- 172.21.15.177:0/1496839871 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f661c04c070 con 0x55e831f66660 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6619f01640 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f64fc036790 0x7f64fc038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6627011800 1 Processor -- start 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6627011800 1 -- start start 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6627011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 0x55e831dd55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6619f01640 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f64fc036790 0x7f64fc038c50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f660c000f60 tx=0x7f660c0010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6627011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e831dd5af0 con 0x55e831dd7140 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6622702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 0x55e831dd55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6622702640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 0x55e831dd55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44180/0 (socket says 172.21.15.177:44180) 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.274+0000 7f6622702640 1 -- 172.21.15.177:0/2559128545 learned_addr learned my addr 172.21.15.177:0/2559128545 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f6622702640 1 -- 172.21.15.177:0/2559128545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e831dd5c30 con 0x55e831dd7140 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f6622702640 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 0x55e831dd55b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f661408b460 tx=0x7f6614077930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f64e6fe5640 1 -- 172.21.15.177:0/2559128545 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f661406eaf0 con 0x55e831dd7140 2024-03-20T13:36:24.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f64e6fe5640 1 -- 172.21.15.177:0/2559128545 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66140787c0 con 0x55e831dd7140 2024-03-20T13:36:24.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f64e6fe5640 1 -- 172.21.15.177:0/2559128545 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6614066a70 con 0x55e831dd7140 2024-03-20T13:36:24.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55e831dd5e80 con 0x55e831dd7140 2024-03-20T13:36:24.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.275+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e831dd6340 con 0x55e831dd7140 2024-03-20T13:36:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f64e6fe5640 1 -- 172.21.15.177:0/2559128545 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f661408c580 con 0x55e831dd7140 2024-03-20T13:36:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f64e6fe5640 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6464036790 0x7f6464038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f64e6fe5640 1 -- 172.21.15.177:0/2559128545 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f661408a040 con 0x55e831dd7140 2024-03-20T13:36:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f6619f01640 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6464036790 0x7f6464038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f64e4fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f6619f01640 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6464036790 0x7f6464038c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f660c004170 tx=0x7f660c00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55e831f96980 0x55e831f98df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.276+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e831f994c0 con 0x55e831f96980 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6622f03640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55e831f96980 0x55e831f98df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6622f03640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55e831f96980 0x55e831f98df0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6622f03640 1 -- 172.21.15.177:0/1209435125 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f661c01b390 con 0x55e831f96980 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55e831f9b280 0x55e831f9d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:2 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e831f9dd40 con 0x55e831f9b280 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6622702640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55e831f9b280 0x55e831f9d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.277+0000 7f6622702640 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55e831f9b280 0x55e831f9d670 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.278+0000 7f6622702640 1 -- 172.21.15.177:0/1209435125 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(2 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~1036 out=1036b] v0'0 uv3 ondisk = 0) v8 ==== 232+0+1084 (crc 0 0 0) 0x7f6614095020 con 0x55e831f9b280 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.278+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~874 in=874b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55e831f9a6c0 con 0x55e831f9b280 2024-03-20T13:36:24.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.279+0000 7f6622702640 1 -- 172.21.15.177:0/1209435125 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [stat,call,call,writefull 0~874] v32'4 uv4 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7f6614095020 con 0x55e831f9b280 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f64fc036790 msgr2=0x7f64fc038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f64fc036790 0x7f64fc038c50 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f660c000f60 tx=0x7f660c0010a0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 msgr2=0x55e831f6d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f6d550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f661c000f80 tx=0x7f661c003370 comp rx=0 tx=0).stop 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 shutdown_connections 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f64fc036790 0x7f64fc038c50 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/1496839871 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831f66660 0x55e831f6d550 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 >> 172.21.15.177:0/1496839871 conn(0x55e831e62e00 msgr2=0x55e831f60740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 shutdown_connections 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/1496839871 wait complete. 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6464036790 msgr2=0x7f6464038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6464036790 0x7f6464038c50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f660c004170 tx=0x7f660c00f000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 msgr2=0x55e831dd55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 0x55e831dd55b0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f661408b460 tx=0x7f6614077930 comp rx=0 tx=0).stop 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 shutdown_connections 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f6464036790 0x7f6464038c50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 --2- 172.21.15.177:0/2559128545 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831dd7140 0x55e831dd55b0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 >> 172.21.15.177:0/2559128545 conn(0x55e831f7c680 msgr2=0x55e831f7d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 shutdown_connections 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.280+0000 7f6627011800 1 -- 172.21.15.177:0/2559128545 wait complete. 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55e831f96980 msgr2=0x55e831f98df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55e831f96980 0x55e831f98df0 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55e831f9b280 msgr2=0x55e831f9d670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.287 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55e831f9b280 0x55e831f9d670 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65080367e0 msgr2=0x7f6508038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65080367e0 0x7f6508038ca0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f661405cfd0 tx=0x7f6614066e70 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 msgr2=0x55e831f59310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f59310 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f6614005870 tx=0x7f6614002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 shutdown_connections 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55e831f9b280 0x55e831f9d670 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55e831f96980 0x55e831f98df0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f65080367e0 0x7f6508038ca0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 --2- 172.21.15.177:0/1209435125 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55e831e61ba0 0x55e831f59310 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 >> 172.21.15.177:0/1209435125 conn(0x55e831e5d1c0 msgr2=0x55e831f50770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 shutdown_connections 2024-03-20T13:36:24.288 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.281+0000 7f6627011800 1 -- 172.21.15.177:0/1209435125 wait complete. 2024-03-20T13:36:24.290 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:36:24.290 DEBUG:tasks.util.rgw: json result: {'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:36:24.290 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-03-20T13:36:24.290 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-03-20T13:36:24.290 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-03-20T13:36:24.330 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:24.331 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.330+0000 7f19f8011800 1 Processor -- start 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.330+0000 7f19f8011800 1 -- start start 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.330+0000 7f19f8011800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556319bcc5e0 0x556319bce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.330+0000 7f19f8011800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x556319b16cc0 con 0x556319bcef10 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.330+0000 7f19f8011800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x556319acd500 con 0x556319bcc5e0 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f3709640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x556319bcc5e0 0x556319bce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f2f08640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x556319bcef10 0x556319bd1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51688/0 (socket says 172.21.15.177:51688) 2024-03-20T13:36:24.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f2f08640 1 -- 172.21.15.177:0/3590311385 learned_addr learned my addr 172.21.15.177:0/3590311385 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:24.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f2707640 1 -- 172.21.15.177:0/3590311385 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122781520 0 0) 0x556319b16cc0 con 0x556319bcef10 2024-03-20T13:36:24.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f2707640 1 -- 172.21.15.177:0/3590311385 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f19e0001e10 con 0x556319bcef10 2024-03-20T13:36:24.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f3709640 1 -- 172.21.15.177:0/3590311385 >> v1:172.21.15.28:6789/0 conn(0x556319bcef10 legacy=0x556319bd1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.331+0000 7f19f3709640 1 -- 172.21.15.177:0/3590311385 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556319bd3a30 con 0x556319bcc5e0 2024-03-20T13:36:24.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.333+0000 7f19f3709640 1 --2- 172.21.15.177:0/3590311385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bce9d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00a470 tx=0x7f19ec01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e04c0d59c0ea6e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.333+0000 7f19f2707640 1 -- 172.21.15.177:0/3590311385 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec04ad60 con 0x556319bcc5e0 2024-03-20T13:36:24.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.333+0000 7f19f2707640 1 -- 172.21.15.177:0/3590311385 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec052440 con 0x556319bcc5e0 2024-03-20T13:36:24.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.333+0000 7f19f2707640 1 -- 172.21.15.177:0/3590311385 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec052700 con 0x556319bcc5e0 2024-03-20T13:36:24.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 -- 172.21.15.177:0/3590311385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 msgr2=0x556319bce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 --2- 172.21.15.177:0/3590311385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bce9d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00a470 tx=0x7f19ec01cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:24.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 -- 172.21.15.177:0/3590311385 shutdown_connections 2024-03-20T13:36:24.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 --2- 172.21.15.177:0/3590311385 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bce9d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 -- 172.21.15.177:0/3590311385 >> 172.21.15.177:0/3590311385 conn(0x556319bc6030 msgr2=0x556319bc8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 -- 172.21.15.177:0/3590311385 shutdown_connections 2024-03-20T13:36:24.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.334+0000 7f19f8011800 1 -- 172.21.15.177:0/3590311385 wait complete. 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.345+0000 7f19f8011800 1 Processor -- start 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.345+0000 7f19f8011800 1 -- start start 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f8011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bcbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f8011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556319acaa30 con 0x556319bcc5e0 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f3709640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bcbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f3709640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bcbf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44202/0 (socket says 172.21.15.177:44202) 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f3709640 1 -- 172.21.15.177:0/1802395198 learned_addr learned my addr 172.21.15.177:0/1802395198 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.347 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f3709640 1 -- 172.21.15.177:0/1802395198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec005d20 con 0x556319bcc5e0 2024-03-20T13:36:24.353 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.346+0000 7f19f3709640 1 --2- 172.21.15.177:0/1802395198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bcbf20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f19ec055040 tx=0x7f19ec04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b994abd5b8eaf969 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f18e160a640 1 -- 172.21.15.177:0/1802395198 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec00a040 con 0x556319bcc5e0 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f18e160a640 1 -- 172.21.15.177:0/1802395198 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec00a1a0 con 0x556319bcc5e0 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f18e160a640 1 -- 172.21.15.177:0/1802395198 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec0525b0 con 0x556319bcc5e0 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 -- 172.21.15.177:0/1802395198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 msgr2=0x556319bcbf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 --2- 172.21.15.177:0/1802395198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bcbf20 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f19ec055040 tx=0x7f19ec04c000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 -- 172.21.15.177:0/1802395198 shutdown_connections 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 --2- 172.21.15.177:0/1802395198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319bcbf20 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 -- 172.21.15.177:0/1802395198 >> 172.21.15.177:0/1802395198 conn(0x556319bc6030 msgr2=0x556319cb71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 -- 172.21.15.177:0/1802395198 shutdown_connections 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.347+0000 7f19f8011800 1 -- 172.21.15.177:0/1802395198 wait complete. 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f8011800 1 Processor -- start 2024-03-20T13:36:24.354 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f8011800 1 -- start start 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f8011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319cc4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f8011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556319ac6210 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f3709640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319cc4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f3709640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319cc4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44214/0 (socket says 172.21.15.177:44214) 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f3709640 1 -- 172.21.15.177:0/3809504517 learned_addr learned my addr 172.21.15.177:0/3809504517 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.348+0000 7f19f3709640 1 -- 172.21.15.177:0/3809504517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556319bd3a30 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f19f3709640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319cc4fb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f19ec005870 tx=0x7f19ec002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f18dfe07640 1 -- 172.21.15.177:0/3809504517 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec06b070 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f18dfe07640 1 -- 172.21.15.177:0/3809504517 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec052d90 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556319cc54f0 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f18dfe07640 1 -- 172.21.15.177:0/3809504517 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec06f560 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556319cc5a30 con 0x556319bcc5e0 2024-03-20T13:36:24.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f19f8011800 1 Processor -- start 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.349+0000 7f19f8011800 1 -- start start 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f8011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f8011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556319a68c70 con 0x556319cd2350 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f18dfe07640 1 -- 172.21.15.177:0/3809504517 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f19ec059050 con 0x556319bcc5e0 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3f0a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3f0a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44226/0 (socket says 172.21.15.177:44226) 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3f0a640 1 -- 172.21.15.177:0/3612029239 learned_addr learned my addr 172.21.15.177:0/3612029239 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f18dfe07640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d8036790 0x7f18d8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f18dfe07640 1 -- 172.21.15.177:0/3809504517 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f19ec08d3e0 con 0x556319bcc5e0 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3709640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d8036790 0x7f18d8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3f0a640 1 -- 172.21.15.177:0/3612029239 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556319cd2cb0 con 0x556319cd2350 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3f0a640 1 --2- 172.21.15.177:0/3612029239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd2770 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f19e400a430 tx=0x7f19e400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e51d5d68414cf536 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f19f3709640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d8036790 0x7f18d8038c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00a470 tx=0x7f19ec00a400 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.350+0000 7f18dde03640 1 -- 172.21.15.177:0/3612029239 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e4001650 con 0x556319cd2350 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f18dde03640 1 -- 172.21.15.177:0/3612029239 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e40017d0 con 0x556319cd2350 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f18dde03640 1 -- 172.21.15.177:0/3612029239 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e4001ab0 con 0x556319cd2350 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- 172.21.15.177:0/3612029239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 msgr2=0x556319cd2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 --2- 172.21.15.177:0/3612029239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd2770 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f19e400a430 tx=0x7f19e400a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- 172.21.15.177:0/3612029239 shutdown_connections 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 --2- 172.21.15.177:0/3612029239 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd2770 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- 172.21.15.177:0/3612029239 >> 172.21.15.177:0/3612029239 conn(0x556319bcef10 msgr2=0x556319ccedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- 172.21.15.177:0/3612029239 shutdown_connections 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- 172.21.15.177:0/3612029239 wait complete. 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 Processor -- start 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- start start 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.351+0000 7f19f8011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556319a3e5d0 con 0x556319cd2350 2024-03-20T13:36:24.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f3f0a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f3f0a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44232/0 (socket says 172.21.15.177:44232) 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f3f0a640 1 -- 172.21.15.177:0/3914412850 learned_addr learned my addr 172.21.15.177:0/3914412850 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f3f0a640 1 -- 172.21.15.177:0/3914412850 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e400a0e0 con 0x556319cd2350 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f3f0a640 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd9320 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f19e4013040 tx=0x7f19e4003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f18cffff640 1 -- 172.21.15.177:0/3914412850 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e4010b10 con 0x556319cd2350 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f18cffff640 1 -- 172.21.15.177:0/3914412850 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e4010c70 con 0x556319cd2350 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f18cffff640 1 -- 172.21.15.177:0/3914412850 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19e401c400 con 0x556319cd2350 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556319cd9860 con 0x556319cd2350 2024-03-20T13:36:24.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.352+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556319cd9cc0 con 0x556319cd2350 2024-03-20T13:36:24.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.353+0000 7f18cffff640 1 -- 172.21.15.177:0/3914412850 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f19e4017070 con 0x556319cd2350 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.353+0000 7f18cffff640 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d4036790 0x7f18d4038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.353+0000 7f18cffff640 1 -- 172.21.15.177:0/3914412850 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f19e404c080 con 0x556319cd2350 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.353+0000 7f19f8011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.353+0000 7f19f8011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f2f08640 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d4036790 0x7f18d4038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f8011800 1 Processor -- start 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f8011800 1 -- start start 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f2f08640 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d4036790 0x7f18d4038c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556319cce270 tx=0x7f19dc0012d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f8011800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 0x556319cf3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f8011800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x556319cf4190 con 0x556319cf3830 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f3709640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 0x556319cf3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f3709640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 0x556319cf3c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44246/0 (socket says 172.21.15.177:44246) 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.354+0000 7f19f3709640 1 -- 172.21.15.177:0/1420269258 learned_addr learned my addr 172.21.15.177:0/1420269258 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f19f3709640 1 -- 172.21.15.177:0/1420269258 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556319cf42d0 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f19f3709640 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 0x556319cf3c50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f19ec078dc0 tx=0x7f19ec078780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f184bfff640 1 -- 172.21.15.177:0/1420269258 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec05b370 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f184bfff640 1 -- 172.21.15.177:0/1420269258 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19ec05b4d0 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x556319cf4c00 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f184bfff640 1 -- 172.21.15.177:0/1420269258 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f19ec06ea30 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.355+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556319cf50c0 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f184bfff640 1 -- 172.21.15.177:0/1420269258 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f19ec08bc30 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f184bfff640 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f182c036790 0x7f182c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f184bfff640 1 -- 172.21.15.177:0/1420269258 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f19ec097d80 con 0x556319cf3830 2024-03-20T13:36:24.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f19f2f08640 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f182c036790 0x7f182c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f1849ffb640 20 reqs_thread_entry: start 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556319d00770 0x556319d02b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556319d030a0 con 0x556319d00770 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f19f2f08640 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f182c036790 0x7f182c038c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0011e0 tx=0x7f19dc00f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.356+0000 7f19f3f0a640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556319d00770 0x556319d02b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f3f0a640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556319d00770 0x556319d02b60 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f3f0a640 1 -- 172.21.15.177:0/3809504517 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f19e401c9f0 con 0x556319d00770 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556319d034c0 con 0x556319d00770 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f3f0a640 1 -- 172.21.15.177:0/3809504517 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f19e401c9f0 con 0x556319d00770 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556319d05260 0x556319d07650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:3 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x556319d07cf0 con 0x556319d05260 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.357+0000 7f19f3709640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556319d05260 0x556319d07650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.358+0000 7f19f3709640 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556319d05260 0x556319d07650 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.358+0000 7f19f3709640 1 -- 172.21.15.177:0/3809504517 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(3 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7f19ec06fd40 con 0x556319d05260 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d4036790 msgr2=0x7f18d4038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d4036790 0x7f18d4038c50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x556319cce270 tx=0x7f19dc0012d0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 msgr2=0x556319cd9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd9320 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f19e4013040 tx=0x7f19e4003370 comp rx=0 tx=0).stop 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 shutdown_connections 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d4036790 0x7f18d4038c50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/3914412850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cd2350 0x556319cd9320 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 >> 172.21.15.177:0/3914412850 conn(0x556319bcef10 msgr2=0x556319ccc430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 shutdown_connections 2024-03-20T13:36:24.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/3914412850 wait complete. 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f182c036790 msgr2=0x7f182c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f182c036790 0x7f182c038c50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f19dc0011e0 tx=0x7f19dc00f000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 msgr2=0x556319cf3c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 0x556319cf3c50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f19ec078dc0 tx=0x7f19ec078780 comp rx=0 tx=0).stop 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 shutdown_connections 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f182c036790 0x7f182c038c50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 --2- 172.21.15.177:0/1420269258 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319cf3830 0x556319cf3c50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 >> 172.21.15.177:0/1420269258 conn(0x556319ce8480 msgr2=0x556319ce8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 shutdown_connections 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.359+0000 7f19f8011800 1 -- 172.21.15.177:0/1420269258 wait complete. 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556319d05260 msgr2=0x556319d07650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556319d05260 0x556319d07650 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556319d00770 msgr2=0x556319d02b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556319d00770 0x556319d02b60 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d8036790 msgr2=0x7f18d8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d8036790 0x7f18d8038c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19ec00a470 tx=0x7f19ec00a400 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 msgr2=0x556319cc4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319cc4fb0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f19ec005870 tx=0x7f19ec002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 shutdown_connections 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x556319d05260 0x556319d07650 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x556319d00770 0x556319d02b60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f18d8036790 0x7f18d8038c50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 --2- 172.21.15.177:0/3809504517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x556319bcc5e0 0x556319cc4fb0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 >> 172.21.15.177:0/3809504517 conn(0x556319bc6030 msgr2=0x556319bca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 shutdown_connections 2024-03-20T13:36:24.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.360+0000 7f19f8011800 1 -- 172.21.15.177:0/3809504517 wait complete. 2024-03-20T13:36:24.371 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"7b38e3a9-8d74-4698-af71-c25b0690d394","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"3852dce3-594b-4724-bee1-f3dae77b7611","zones":[{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["resharding"]} 2024-03-20T13:36:24.372 DEBUG:tasks.util.rgw: json result: {'id': '7b38e3a9-8d74-4698-af71-c25b0690d394', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '3852dce3-594b-4724-bee1-f3dae77b7611', 'zones': [{'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['resharding']} 2024-03-20T13:36:24.372 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-03-20T13:36:24.372 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zonegroup', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER'] 2024-03-20T13:36:24.372 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zonegroup default --placement-id default-placement --storage-class GLACIER 2024-03-20T13:36:24.458 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:24.459 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.458+0000 7fe76af25800 1 Processor -- start 2024-03-20T13:36:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.458+0000 7fe76af25800 1 -- start start 2024-03-20T13:36:24.460 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.458+0000 7fe76af25800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55ca807c7050 0x55ca807c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.458+0000 7fe76af25800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55ca8070dcf0 con 0x55ca807c2bc0 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.458+0000 7fe76af25800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55ca806c4500 con 0x55ca807c7050 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.459+0000 7fe76631a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55ca807c7050 0x55ca807c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.459+0000 7fe766b1b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55ca807c2bc0 0x55ca807c2fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51704/0 (socket says 172.21.15.177:51704) 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.459+0000 7fe766b1b640 1 -- 172.21.15.177:0/4266958825 learned_addr learned my addr 172.21.15.177:0/4266958825 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.459+0000 7fe76631a640 1 -- 172.21.15.177:0/4266958825 >> v1:172.21.15.28:6789/0 conn(0x55ca807c2bc0 legacy=0x55ca807c2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.461 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.459+0000 7fe76631a640 1 -- 172.21.15.177:0/4266958825 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca807caa70 con 0x55ca807c7050 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76631a640 1 --2- 172.21.15.177:0/4266958825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c7050 0x55ca807c9440 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a470 tx=0x7fe75c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcd5f198907cf6b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe765b19640 1 -- 172.21.15.177:0/4266958825 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe75c052570 con 0x55ca807c7050 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe765b19640 1 -- 172.21.15.177:0/4266958825 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75c0526d0 con 0x55ca807c7050 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe765b19640 1 -- 172.21.15.177:0/4266958825 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe75c052990 con 0x55ca807c7050 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 -- 172.21.15.177:0/4266958825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c7050 msgr2=0x55ca807c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 --2- 172.21.15.177:0/4266958825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c7050 0x55ca807c9440 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fe75c00a470 tx=0x7fe75c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 -- 172.21.15.177:0/4266958825 shutdown_connections 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 --2- 172.21.15.177:0/4266958825 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c7050 0x55ca807c9440 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 -- 172.21.15.177:0/4266958825 >> 172.21.15.177:0/4266958825 conn(0x55ca807be180 msgr2=0x55ca807c05a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.463 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 -- 172.21.15.177:0/4266958825 shutdown_connections 2024-03-20T13:36:24.464 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.461+0000 7fe76af25800 1 -- 172.21.15.177:0/4266958825 wait complete. 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.473+0000 7fe76af25800 1 Processor -- start 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.473+0000 7fe76af25800 1 -- start start 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.473+0000 7fe76af25800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca80737ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.473+0000 7fe76af25800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca806c1a30 con 0x55ca807c2bc0 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe766b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca80737ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe766b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca80737ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44272/0 (socket says 172.21.15.177:44272) 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe766b1b640 1 -- 172.21.15.177:0/3473243331 learned_addr learned my addr 172.21.15.177:0/3473243331 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.478 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe766b1b640 1 -- 172.21.15.177:0/3473243331 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe75c005d20 con 0x55ca807c2bc0 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe766b1b640 1 --2- 172.21.15.177:0/3473243331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca80737ee0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe758001c80 tx=0x7fe75800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c712bb3a2152374 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe654e09640 1 -- 172.21.15.177:0/3473243331 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe75800e470 con 0x55ca807c2bc0 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe654e09640 1 -- 172.21.15.177:0/3473243331 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe75800e5d0 con 0x55ca807c2bc0 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.474+0000 7fe654e09640 1 -- 172.21.15.177:0/3473243331 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe75800e8d0 con 0x55ca807c2bc0 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 -- 172.21.15.177:0/3473243331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 msgr2=0x55ca80737ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 --2- 172.21.15.177:0/3473243331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca80737ee0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fe758001c80 tx=0x7fe75800b6c0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 -- 172.21.15.177:0/3473243331 shutdown_connections 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 --2- 172.21.15.177:0/3473243331 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca80737ee0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 -- 172.21.15.177:0/3473243331 >> 172.21.15.177:0/3473243331 conn(0x55ca807be180 msgr2=0x55ca808ae510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 -- 172.21.15.177:0/3473243331 shutdown_connections 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.475+0000 7fe76af25800 1 -- 172.21.15.177:0/3473243331 wait complete. 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe76af25800 1 Processor -- start 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe76af25800 1 -- start start 2024-03-20T13:36:24.479 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe76af25800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca808bc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe76af25800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca806bd210 con 0x55ca807c2bc0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe766b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca808bc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe766b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca808bc470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44278/0 (socket says 172.21.15.177:44278) 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe766b1b640 1 -- 172.21.15.177:0/4016539383 learned_addr learned my addr 172.21.15.177:0/4016539383 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe766b1b640 1 -- 172.21.15.177:0/4016539383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca8070dcf0 con 0x55ca807c2bc0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.476+0000 7fe766b1b640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca808bc470 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe758001c80 tx=0x7fe758000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe653606640 1 -- 172.21.15.177:0/4016539383 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe75801f070 con 0x55ca807c2bc0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe653606640 1 -- 172.21.15.177:0/4016539383 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758018640 con 0x55ca807c2bc0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca808bc9b0 con 0x55ca807c2bc0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe653606640 1 -- 172.21.15.177:0/4016539383 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7580188e0 con 0x55ca807c2bc0 2024-03-20T13:36:24.480 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca808bce90 con 0x55ca807c2bc0 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe76af25800 1 Processor -- start 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.477+0000 7fe76af25800 1 -- start start 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe76af25800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe76af25800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca8065fc70 con 0x55ca808c9810 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe653606640 1 -- 172.21.15.177:0/4016539383 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe758018a40 con 0x55ca807c2bc0 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe653606640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe64c0367e0 0x7fe64c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe653606640 1 -- 172.21.15.177:0/4016539383 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe75804c2f0 con 0x55ca807c2bc0 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe766b1b640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe64c0367e0 0x7fe64c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.489 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe76731c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe76731c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44294/0 (socket says 172.21.15.177:44294) 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe76731c640 1 -- 172.21.15.177:0/2720164145 learned_addr learned my addr 172.21.15.177:0/2720164145 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.478+0000 7fe766b1b640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe64c0367e0 0x7fe64c038ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe75800dfd0 tx=0x7fe7580223f0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76731c640 1 -- 172.21.15.177:0/2720164145 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca808ca170 con 0x55ca808c9810 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76731c640 1 --2- 172.21.15.177:0/2720164145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808c9c30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe76000a430 tx=0x7fe76000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf7c5881fb5ba5d server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe651602640 1 -- 172.21.15.177:0/2720164145 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe760001650 con 0x55ca808c9810 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe651602640 1 -- 172.21.15.177:0/2720164145 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7600017d0 con 0x55ca808c9810 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe651602640 1 -- 172.21.15.177:0/2720164145 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe760001ab0 con 0x55ca808c9810 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 -- 172.21.15.177:0/2720164145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 msgr2=0x55ca808c9c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.490 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 --2- 172.21.15.177:0/2720164145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808c9c30 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe76000a430 tx=0x7fe76000a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 -- 172.21.15.177:0/2720164145 shutdown_connections 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 --2- 172.21.15.177:0/2720164145 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808c9c30 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 -- 172.21.15.177:0/2720164145 >> 172.21.15.177:0/2720164145 conn(0x55ca807c7050 msgr2=0x55ca808c62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 -- 172.21.15.177:0/2720164145 shutdown_connections 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.479+0000 7fe76af25800 1 -- 172.21.15.177:0/2720164145 wait complete. 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76af25800 1 Processor -- start 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76af25800 1 -- start start 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76af25800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76af25800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca806355d0 con 0x55ca808c9810 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76731c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.491 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76731c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44306/0 (socket says 172.21.15.177:44306) 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76731c640 1 -- 172.21.15.177:0/1872653533 learned_addr learned my addr 172.21.15.177:0/1872653533 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.480+0000 7fe76731c640 1 -- 172.21.15.177:0/1872653533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76000a0e0 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.481+0000 7fe76731c640 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808d07a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe760013040 tx=0x7fe760003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.481+0000 7fe64b7fe640 1 -- 172.21.15.177:0/1872653533 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe760010b10 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.481+0000 7fe64b7fe640 1 -- 172.21.15.177:0/1872653533 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe760010c70 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.481+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca808d0ce0 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.481+0000 7fe64b7fe640 1 -- 172.21.15.177:0/1872653533 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe76001c400 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.481+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca808d1140 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe64b7fe640 1 -- 172.21.15.177:0/1872653533 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe760017070 con 0x55ca808c9810 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe64b7fe640 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe640036790 0x7fe640038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe76af25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:24.492 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe76af25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe64b7fe640 1 -- 172.21.15.177:0/1872653533 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe76004c000 con 0x55ca808c9810 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe76631a640 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe640036790 0x7fe640038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe76af25800 1 Processor -- start 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.482+0000 7fe76af25800 1 -- start start 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe76631a640 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe640036790 0x7fe640038c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe75c054000 tx=0x7fe75c04e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe76af25800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 0x55ca808eb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe76af25800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca808eb610 con 0x55ca808eacb0 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe766b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 0x55ca808eb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe766b1b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 0x55ca808eb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44312/0 (socket says 172.21.15.177:44312) 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe766b1b640 1 -- 172.21.15.177:0/1253395543 learned_addr learned my addr 172.21.15.177:0/1253395543 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.493 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe766b1b640 1 -- 172.21.15.177:0/1253395543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca808eb750 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.483+0000 7fe766b1b640 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 0x55ca808eb0d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e570 tx=0x7fe758006f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.484+0000 7fe626ffd640 1 -- 172.21.15.177:0/1253395543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe7580233c0 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.484+0000 7fe626ffd640 1 -- 172.21.15.177:0/1253395543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe758023520 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.484+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55ca808ec080 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.484+0000 7fe626ffd640 1 -- 172.21.15.177:0/1253395543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe758017c50 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.484+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca808ec080 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.484+0000 7fe626ffd640 1 -- 172.21.15.177:0/1253395543 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe758016cb0 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe626ffd640 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe5a0036790 0x7fe5a0038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe626ffd640 1 -- 172.21.15.177:0/1253395543 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe75804de30 con 0x55ca808eacb0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe76631a640 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe5a0036790 0x7fe5a0038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe624ff9640 20 reqs_thread_entry: start 2024-03-20T13:36:24.494 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe76631a640 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe5a0036790 0x7fe5a0038c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe75c01cda0 tx=0x7fe75c005a00 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ca808f7a80 0x55ca808f9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ca808fa3b0 con 0x55ca808f7a80 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe76731c640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ca808f7a80 0x55ca808f9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.485+0000 7fe76731c640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ca808f7a80 0x55ca808f9e70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.486+0000 7fe76731c640 1 -- 172.21.15.177:0/4016539383 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fe76001c9f0 con 0x55ca808f7a80 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.486+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ca808fc0d0 0x55ca808fe4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.486+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:2 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ca808febc0 con 0x55ca808fc0d0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.486+0000 7fe766b1b640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ca808fc0d0 0x55ca808fe4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.487+0000 7fe766b1b640 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ca808fc0d0 0x55ca808fe4c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.487+0000 7fe766b1b640 1 -- 172.21.15.177:0/4016539383 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(2 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~398 out=398b] v0'0 uv1 ondisk = 0) v8 ==== 237+0+446 (crc 0 0 0) 0x7fe758014070 con 0x55ca808fc0d0 2024-03-20T13:36:24.495 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.487+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:3 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~421 in=421b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55ca80903690 con 0x55ca808fc0d0 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe766b1b640 1 -- 172.21.15.177:0/4016539383 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(3 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [stat,call,call,writefull 0~421] v32'2 uv2 ondisk = 0) v8 ==== 321+0+0 (crc 0 0 0) 0x7fe758014070 con 0x55ca808fc0d0 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe640036790 msgr2=0x7fe640038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe640036790 0x7fe640038c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe75c054000 tx=0x7fe75c04e000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 msgr2=0x55ca808d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808d07a0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fe760013040 tx=0x7fe760003370 comp rx=0 tx=0).stop 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 shutdown_connections 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe640036790 0x7fe640038c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.499 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 --2- 172.21.15.177:0/1872653533 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808c9810 0x55ca808d07a0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 >> 172.21.15.177:0/1872653533 conn(0x55ca807c7050 msgr2=0x55ca808c38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 shutdown_connections 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.489+0000 7fe76af25800 1 -- 172.21.15.177:0/1872653533 wait complete. 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe5a0036790 msgr2=0x7fe5a0038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe5a0036790 0x7fe5a0038c50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe75c01cda0 tx=0x7fe75c005a00 comp rx=0 tx=0).stop 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 msgr2=0x55ca808eb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 0x55ca808eb0d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fe75800e570 tx=0x7fe758006f00 comp rx=0 tx=0).stop 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 shutdown_connections 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe5a0036790 0x7fe5a0038c50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/1253395543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca808eacb0 0x55ca808eb0d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 >> 172.21.15.177:0/1253395543 conn(0x55ca808df900 msgr2=0x55ca808e0320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.500 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 shutdown_connections 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/1253395543 wait complete. 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ca808fc0d0 msgr2=0x55ca808fe4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ca808fc0d0 0x55ca808fe4c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ca808f7a80 msgr2=0x55ca808f9e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ca808f7a80 0x55ca808f9e70 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe64c0367e0 msgr2=0x7fe64c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe64c0367e0 0x7fe64c038ca0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe75800dfd0 tx=0x7fe7580223f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 msgr2=0x55ca808bc470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca808bc470 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fe758001c80 tx=0x7fe758000ed0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 shutdown_connections 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x55ca808fc0d0 0x55ca808fe4c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55ca808f7a80 0x55ca808f9e70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.501 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe64c0367e0 0x7fe64c038ca0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 --2- 172.21.15.177:0/4016539383 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55ca807c2bc0 0x55ca808bc470 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 >> 172.21.15.177:0/4016539383 conn(0x55ca807be180 msgr2=0x55ca80736940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 shutdown_connections 2024-03-20T13:36:24.502 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.490+0000 7fe76af25800 1 -- 172.21.15.177:0/4016539383 wait complete. 2024-03-20T13:36:24.503 INFO:teuthology.orchestra.run.smithi177.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["GLACIER","STANDARD"]}}] 2024-03-20T13:36:24.503 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['GLACIER', 'STANDARD']}}] 2024-03-20T13:36:24.503 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-03-20T13:36:24.504 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'GLACIER', '--data-pool', '.rgw.buckets.2'] 2024-03-20T13:36:24.504 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class GLACIER --data-pool .rgw.buckets.2 2024-03-20T13:36:24.552 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:24.552 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:24.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.552+0000 7fbd2ae10800 1 Processor -- start 2024-03-20T13:36:24.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.552+0000 7fbd2ae10800 1 -- start start 2024-03-20T13:36:24.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.552+0000 7fbd2ae10800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563835934640 0x563835936a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.552+0000 7fbd2ae10800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x56383587ed00 con 0x563835936f70 2024-03-20T13:36:24.554 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.552+0000 7fbd2ae10800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x563835835500 con 0x563835934640 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd265be640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x563835934640 0x563835936a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd1ddbd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x563835936f70 0x563835939360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51710/0 (socket says 172.21.15.177:51710) 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd1ddbd640 1 -- 172.21.15.177:0/4135679099 learned_addr learned my addr 172.21.15.177:0/4135679099 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd25dbd640 1 -- 172.21.15.177:0/4135679099 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656038326 0 0) 0x56383587ed00 con 0x563835936f70 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd25dbd640 1 -- 172.21.15.177:0/4135679099 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd14001e10 con 0x563835936f70 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd265be640 1 -- 172.21.15.177:0/4135679099 >> v1:172.21.15.28:6789/0 conn(0x563835936f70 legacy=0x563835939360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.555 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.553+0000 7fbd265be640 1 -- 172.21.15.177:0/4135679099 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56383593ba90 con 0x563835934640 2024-03-20T13:36:24.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.555+0000 7fbd265be640 1 --2- 172.21.15.177:0/4135679099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835936a30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800a470 tx=0x7fbd1801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93d2c8f597f1b2e server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.555+0000 7fbd25dbd640 1 -- 172.21.15.177:0/4135679099 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1804ad60 con 0x563835934640 2024-03-20T13:36:24.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.555+0000 7fbd25dbd640 1 -- 172.21.15.177:0/4135679099 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18052440 con 0x563835934640 2024-03-20T13:36:24.556 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.555+0000 7fbd25dbd640 1 -- 172.21.15.177:0/4135679099 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd180526e0 con 0x563835934640 2024-03-20T13:36:24.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.555+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4135679099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 msgr2=0x563835936a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.555+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4135679099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835936a30 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fbd1800a470 tx=0x7fbd1801cc80 comp rx=0 tx=0).stop 2024-03-20T13:36:24.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.556+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4135679099 shutdown_connections 2024-03-20T13:36:24.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.556+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4135679099 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835936a30 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.557 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.556+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4135679099 >> 172.21.15.177:0/4135679099 conn(0x56383592e110 msgr2=0x563835930530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.556+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4135679099 shutdown_connections 2024-03-20T13:36:24.558 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.556+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4135679099 wait complete. 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.567+0000 7fbd2ae10800 1 Processor -- start 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.567+0000 7fbd2ae10800 1 -- start start 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.567+0000 7fbd2ae10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a23970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.567+0000 7fbd2ae10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563835832a30 con 0x563835934640 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbd265be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a23970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbd265be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a23970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44332/0 (socket says 172.21.15.177:44332) 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbd265be640 1 -- 172.21.15.177:0/1740639238 learned_addr learned my addr 172.21.15.177:0/1740639238 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.569 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbd265be640 1 -- 172.21.15.177:0/1740639238 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18005d20 con 0x563835934640 2024-03-20T13:36:24.570 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbd265be640 1 --2- 172.21.15.177:0/1740639238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a23970 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbd1801ccc0 tx=0x7fbd1804c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5c4bb7316ccbf78 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbc14608640 1 -- 172.21.15.177:0/1740639238 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1800a040 con 0x563835934640 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbc14608640 1 -- 172.21.15.177:0/1740639238 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1800a1a0 con 0x563835934640 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.568+0000 7fbc14608640 1 -- 172.21.15.177:0/1740639238 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd180525b0 con 0x563835934640 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1740639238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 msgr2=0x563835a23970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/1740639238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a23970 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fbd1801ccc0 tx=0x7fbd1804c000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1740639238 shutdown_connections 2024-03-20T13:36:24.574 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/1740639238 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a23970 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1740639238 >> 172.21.15.177:0/1740639238 conn(0x56383592e110 msgr2=0x563835a1f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1740639238 shutdown_connections 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1740639238 wait complete. 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.569+0000 7fbd2ae10800 1 Processor -- start 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd2ae10800 1 -- start start 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd2ae10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a2af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd2ae10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x56383582e210 con 0x563835934640 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd265be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a2af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd265be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a2af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44340/0 (socket says 172.21.15.177:44340) 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd265be640 1 -- 172.21.15.177:0/4268104771 learned_addr learned my addr 172.21.15.177:0/4268104771 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd265be640 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56383593ba90 con 0x563835934640 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.570+0000 7fbd265be640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a2af00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fbd1801d3b0 tx=0x7fbd18002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbc12e05640 1 -- 172.21.15.177:0/4268104771 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1806b070 con 0x563835934640 2024-03-20T13:36:24.575 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbc12e05640 1 -- 172.21.15.177:0/4268104771 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18052cb0 con 0x563835934640 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563835a2b440 con 0x563835934640 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbc12e05640 1 -- 172.21.15.177:0/4268104771 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1806f410 con 0x563835934640 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563835a2b980 con 0x563835934640 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbd2ae10800 1 Processor -- start 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.571+0000 7fbd2ae10800 1 -- start start 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbc12e05640 1 -- 172.21.15.177:0/4268104771 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd18059050 con 0x563835934640 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd2ae10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a38690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd2ae10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638357d0c70 con 0x563835a38270 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbc12e05640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc0c036790 0x7fbc0c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbc12e05640 1 -- 172.21.15.177:0/4268104771 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fbd1808d450 con 0x563835934640 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd265be640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc0c036790 0x7fbc0c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd26dbf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a38690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.576 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd26dbf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a38690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44342/0 (socket says 172.21.15.177:44342) 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd26dbf640 1 -- 172.21.15.177:0/3406659928 learned_addr learned my addr 172.21.15.177:0/3406659928 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.572+0000 7fbd265be640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc0c036790 0x7fbc0c038c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd1806efb0 tx=0x7fbd1806ee80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd26dbf640 1 -- 172.21.15.177:0/3406659928 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563835a38bd0 con 0x563835a38270 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd26dbf640 1 --2- 172.21.15.177:0/3406659928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a38690 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000a430 tx=0x7fbd2000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cefd505f75801d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbc10e01640 1 -- 172.21.15.177:0/3406659928 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd20001650 con 0x563835a38270 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbc10e01640 1 -- 172.21.15.177:0/3406659928 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd200017d0 con 0x563835a38270 2024-03-20T13:36:24.577 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbc10e01640 1 -- 172.21.15.177:0/3406659928 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd20001ab0 con 0x563835a38270 2024-03-20T13:36:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 -- 172.21.15.177:0/3406659928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 msgr2=0x563835a38690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/3406659928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a38690 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000a430 tx=0x7fbd2000a8f0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 -- 172.21.15.177:0/3406659928 shutdown_connections 2024-03-20T13:36:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/3406659928 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a38690 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 -- 172.21.15.177:0/3406659928 >> 172.21.15.177:0/3406659928 conn(0x563835936f70 msgr2=0x563835a34d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.584 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 -- 172.21.15.177:0/3406659928 shutdown_connections 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.573+0000 7fbd2ae10800 1 -- 172.21.15.177:0/3406659928 wait complete. 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd2ae10800 1 Processor -- start 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd2ae10800 1 -- start start 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd2ae10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a3f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd2ae10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5638357a65d0 con 0x563835a38270 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd26dbf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a3f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd26dbf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a3f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44352/0 (socket says 172.21.15.177:44352) 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.574+0000 7fbd26dbf640 1 -- 172.21.15.177:0/2563430090 learned_addr learned my addr 172.21.15.177:0/2563430090 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbd26dbf640 1 -- 172.21.15.177:0/2563430090 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2000a0e0 con 0x563835a38270 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbd26dbf640 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a3f2c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbd20000f80 tx=0x7fbd20003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbc0affd640 1 -- 172.21.15.177:0/2563430090 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd20010a40 con 0x563835a38270 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbc0affd640 1 -- 172.21.15.177:0/2563430090 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd20010ba0 con 0x563835a38270 2024-03-20T13:36:24.585 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563835a3f800 con 0x563835a38270 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbc0affd640 1 -- 172.21.15.177:0/2563430090 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd20010e80 con 0x563835a38270 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.575+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563835a3fc60 con 0x563835a38270 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbc0affd640 1 -- 172.21.15.177:0/2563430090 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd20017070 con 0x563835a38270 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbc0affd640 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc00036790 0x7fbc00038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbc0affd640 1 -- 172.21.15.177:0/2563430090 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fbd2004c0f0 con 0x563835a38270 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbd2ae10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbd2ae10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbd1ddbd640 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc00036790 0x7fbc00038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbd2ae10800 1 Processor -- start 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbd2ae10800 1 -- start start 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.576+0000 7fbd1ddbd640 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc00036790 0x7fbc00038c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbd10000f60 tx=0x7fbd100010a0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.586 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd2ae10800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 0x563835a59b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd2ae10800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x563835a5a0d0 con 0x563835a59770 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd265be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 0x563835a59b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd265be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 0x563835a59b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44368/0 (socket says 172.21.15.177:44368) 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd265be640 1 -- 172.21.15.177:0/1122789924 learned_addr learned my addr 172.21.15.177:0/1122789924 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd265be640 1 -- 172.21.15.177:0/1122789924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563835a5a210 con 0x563835a59770 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbd265be640 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 0x563835a59b90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbd18052800 tx=0x7fbd1806e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.577+0000 7fbbeafe5640 1 -- 172.21.15.177:0/1122789924 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1805b9e0 con 0x563835a59770 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.578+0000 7fbbeafe5640 1 -- 172.21.15.177:0/1122789924 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd1808a040 con 0x563835a59770 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.578+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563835a5ab40 con 0x563835a59770 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.578+0000 7fbbeafe5640 1 -- 172.21.15.177:0/1122789924 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd1808b380 con 0x563835a59770 2024-03-20T13:36:24.587 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.578+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563835a5b000 con 0x563835a59770 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbbeafe5640 1 -- 172.21.15.177:0/1122789924 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fbd1808d720 con 0x563835a59770 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbbeafe5640 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbb680367e0 0x7fbb68038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbbeafe5640 1 -- 172.21.15.177:0/1122789924 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fbd18097d40 con 0x563835a59770 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbd1ddbd640 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbb680367e0 0x7fbb68038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbbe8fe1640 20 reqs_thread_entry: start 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563835a666b0 0x563835a68aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563835a68fe0 con 0x563835a666b0 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbd1ddbd640 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbb680367e0 0x7fbb68038ca0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd10004170 tx=0x7fbd1000f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.579+0000 7fbd26dbf640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563835a666b0 0x563835a68aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.580+0000 7fbd26dbf640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563835a666b0 0x563835a68aa0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.580+0000 7fbd26dbf640 1 -- 172.21.15.177:0/4268104771 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7fbd2001c820 con 0x563835a666b0 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.580+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563835a6ad50 0x563835a6d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.588 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.580+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:2 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563835a6d810 con 0x563835a6ad50 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.580+0000 7fbd265be640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563835a6ad50 0x563835a6d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.580+0000 7fbd265be640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563835a6ad50 0x563835a6d140 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd265be640 1 -- 172.21.15.177:0/4268104771 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(2 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~874 out=874b] v0'0 uv4 ondisk = 0) v8 ==== 232+0+922 (crc 0 0 0) 0x7fbd1807f040 con 0x563835a6ad50 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563835a69cd0 con 0x563835a666b0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd26dbf640 1 -- 172.21.15.177:0/4268104771 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7fbd2001c820 con 0x563835a666b0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563835a6a080 con 0x563835a666b0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd26dbf640 1 -- 172.21.15.177:0/4268104771 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7fbd2001c820 con 0x563835a666b0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563835a6f140 0x563835a71530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.581+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x563835a71bd0 con 0x563835a6f140 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.582+0000 7fbd1ddbd640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563835a6f140 0x563835a71530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.582+0000 7fbd1ddbd640 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563835a6f140 0x563835a71530 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.582+0000 7fbd1ddbd640 1 -- 172.21.15.177:0/4268104771 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7fbd10006070 con 0x563835a6f140 2024-03-20T13:36:24.589 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.582+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x563835a2ef00 con 0x563835a38270 2024-03-20T13:36:24.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.583+0000 7fbc0affd640 1 -- 172.21.15.177:0/2563430090 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd2001bc20 con 0x563835a38270 2024-03-20T13:36:24.590 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.583+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:6 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~921 in=921b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x563835a766a0 con 0x563835a6ad50 2024-03-20T13:36:24.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.584+0000 7fbd265be640 1 -- 172.21.15.177:0/4268104771 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(6 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [stat,call,call,writefull 0~921] v32'5 uv5 ondisk = 0) v8 ==== 316+0+0 (crc 0 0 0) 0x7fbd1807f040 con 0x563835a6ad50 2024-03-20T13:36:24.592 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc00036790 msgr2=0x7fbc00038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc00036790 0x7fbc00038c50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbd10000f60 tx=0x7fbd100010a0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 msgr2=0x563835a3f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a3f2c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fbd20000f80 tx=0x7fbd20003370 comp rx=0 tx=0).stop 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 shutdown_connections 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc00036790 0x7fbc00038c50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/2563430090 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a38270 0x563835a3f2c0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 >> 172.21.15.177:0/2563430090 conn(0x563835936f70 msgr2=0x563835a32350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 shutdown_connections 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/2563430090 wait complete. 2024-03-20T13:36:24.593 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbb680367e0 msgr2=0x7fbb68038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbb680367e0 0x7fbb68038ca0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fbd10004170 tx=0x7fbd1000f000 comp rx=0 tx=0).stop 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 msgr2=0x563835a59b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 0x563835a59b90 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fbd18052800 tx=0x7fbd1806e740 comp rx=0 tx=0).stop 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 shutdown_connections 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbb680367e0 0x7fbb68038ca0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/1122789924 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835a59770 0x563835a59b90 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 >> 172.21.15.177:0/1122789924 conn(0x563835a4e3c0 msgr2=0x563835a4ede0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 shutdown_connections 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.585+0000 7fbd2ae10800 1 -- 172.21.15.177:0/1122789924 wait complete. 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563835a6f140 msgr2=0x563835a71530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.594 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x563835a6f140 0x563835a71530 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563835a666b0 msgr2=0x563835a68aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x563835a666b0 0x563835a68aa0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563835a6ad50 msgr2=0x563835a6d140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x563835a6ad50 0x563835a6d140 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc0c036790 msgr2=0x7fbc0c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fbc0c036790 0x7fbc0c038c50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbd1806efb0 tx=0x7fbd1806ee80 comp rx=0 tx=0).stop 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 msgr2=0x563835a2af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 --2- 172.21.15.177:0/4268104771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x563835934640 0x563835a2af00 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fbd1801d3b0 tx=0x7fbd18002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd26dbf640 1 -- 172.21.15.177:0/4268104771 reap_dead start 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 shutdown_connections 2024-03-20T13:36:24.595 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 >> 172.21.15.177:0/4268104771 conn(0x56383592e110 msgr2=0x563835a1dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:24.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 shutdown_connections 2024-03-20T13:36:24.596 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:24.586+0000 7fbd2ae10800 1 -- 172.21.15.177:0/4268104771 wait complete. 2024-03-20T13:36:24.597 INFO:teuthology.orchestra.run.smithi177.stdout:{"id":"3852dce3-594b-4724-bee1-f3dae77b7611","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"GLACIER":{"data_pool":".rgw.buckets.2"},"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":"","notif_pool":"default.rgw.log:notif"} 2024-03-20T13:36:24.597 DEBUG:tasks.util.rgw: json result: {'id': '3852dce3-594b-4724-bee1-f3dae77b7611', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'GLACIER': {'data_pool': '.rgw.buckets.2'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': '', 'notif_pool': 'default.rgw.log:notif'} 2024-03-20T13:36:24.600 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000bd8ca4dfc309185e-0065fae658-4225-default4225-default-default 2024-03-20T13:36:24.867 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=31766002c32e4effa9fa824c264024ab Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/github.com_ceph_ceph-c_12fa452f60a20733b42c92efd8302af373c366e6/qa/tasks/radosgw_admin.py", line 1110, in task bucket = connection.create_bucket(bucket_name) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/virtualenv/lib/python3.8/site-packages/boto/s3/connection.py", line 627, in create_bucket raise self.provider.storage_response_error( boto.exception.S3ResponseError: S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000bd8ca4dfc309185e-0065fae658-4225-default4225-default-default 2024-03-20T13:36:24.869 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-03-20T13:36:24.879 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-03-20T13:36:24.879 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:36:24.883 INFO:tasks.rgw.client.0.smithi177.stdout:2024-03-20T13:36:24.879+0000 7ffb938e8640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 37127) UID: 0 2024-03-20T13:36:24.883 INFO:tasks.rgw.client.0.smithi177.stdout:2024-03-20T13:36:24.879+0000 7ffb97141880 -1 shutting down 2024-03-20T13:36:25.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-03-20T13:36:30.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~6s 2024-03-20T13:36:30.980 INFO:tasks.rgw.client.0:Stopped 2024-03-20T13:36:30.981 DEBUG:teuthology.orchestra.run.smithi177:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-03-20T13:36:31.000 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f /etc/ceph/vault-root-token 2024-03-20T13:36:31.072 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-03-20T13:36:31.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-03-20T13:36:31.072 DEBUG:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-03-20T13:36:31.159 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setuser ceph since I am not root 2024-03-20T13:36:31.159 INFO:teuthology.orchestra.run.smithi177.stderr:ignoring --setgroup ceph since I am not root 2024-03-20T13:36:31.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.157+0000 7f7777ce4800 1 Processor -- start 2024-03-20T13:36:31.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f7777ce4800 1 -- start start 2024-03-20T13:36:31.159 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f7777ce4800 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b5ac3e99e0 0x55b5ac3e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f7777ce4800 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- 0x55b5ac335cd0 con 0x55b5ac3eac40 2024-03-20T13:36:31.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f7777ce4800 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x55b5ac2ec500 con 0x55b5ac3e99e0 2024-03-20T13:36:31.160 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f77757e3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x55b5ac3e99e0 0x55b5ac3e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f7774fe2640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x55b5ac3eac40 0x55b5ac3eb0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.177:51714/0 (socket says 172.21.15.177:51714) 2024-03-20T13:36:31.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f7774fe2640 1 -- 172.21.15.177:0/3810025352 learned_addr learned my addr 172.21.15.177:0/3810025352 (peer_addr_for_me v1:172.21.15.177:0/0) 2024-03-20T13:36:31.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f77757e3640 1 --2- 172.21.15.177:0/3810025352 >> v2:172.21.15.28:3300/0 conn(0x55b5ac3e99e0 0x55b5ac3e9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44384/0 (socket says 172.21.15.177:44384) 2024-03-20T13:36:31.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f77757e3640 1 -- 172.21.15.177:0/3810025352 >> v1:172.21.15.28:6789/0 conn(0x55b5ac3eac40 legacy=0x55b5ac3eb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.161 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.158+0000 7f77757e3640 1 -- 172.21.15.177:0/3810025352 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ac3ea4d0 con 0x55b5ac3e99e0 2024-03-20T13:36:31.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.160+0000 7f77757e3640 1 --2- 172.21.15.177:0/3810025352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac3e9e00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f776c00a470 tx=0x7f776c01cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa25ce04075c54e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7767fff640 1 -- 172.21.15.177:0/3810025352 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c052570 con 0x55b5ac3e99e0 2024-03-20T13:36:31.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7767fff640 1 -- 172.21.15.177:0/3810025352 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0526d0 con 0x55b5ac3e99e0 2024-03-20T13:36:31.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7767fff640 1 -- 172.21.15.177:0/3810025352 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c052990 con 0x55b5ac3e99e0 2024-03-20T13:36:31.163 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 -- 172.21.15.177:0/3810025352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 msgr2=0x55b5ac3e9e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3810025352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac3e9e00 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f776c00a470 tx=0x7f776c01cd60 comp rx=0 tx=0).stop 2024-03-20T13:36:31.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 -- 172.21.15.177:0/3810025352 shutdown_connections 2024-03-20T13:36:31.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3810025352 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac3e9e00 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 -- 172.21.15.177:0/3810025352 >> 172.21.15.177:0/3810025352 conn(0x55b5ac3e5040 msgr2=0x55b5ac3e7460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 -- 172.21.15.177:0/3810025352 shutdown_connections 2024-03-20T13:36:31.164 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.161+0000 7f7777ce4800 1 -- 172.21.15.177:0/3810025352 wait complete. 2024-03-20T13:36:31.176 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f7777ce4800 1 Processor -- start 2024-03-20T13:36:31.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f7777ce4800 1 -- start start 2024-03-20T13:36:31.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f7777ce4800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4d9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f7777ce4800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ac2e9a30 con 0x55b5ac3e99e0 2024-03-20T13:36:31.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4d9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4d9ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44396/0 (socket says 172.21.15.177:44396) 2024-03-20T13:36:31.177 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.175+0000 7f77757e3640 1 -- 172.21.15.177:0/3011607278 learned_addr learned my addr 172.21.15.177:0/3011607278 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:31.179 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.176+0000 7f77757e3640 1 -- 172.21.15.177:0/3011607278 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c005d20 con 0x55b5ac3e99e0 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.176+0000 7f77757e3640 1 --2- 172.21.15.177:0/3011607278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4d9ea0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f776c055040 tx=0x7f776c04c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786d27e62afa3fe7 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.176+0000 7f7663606640 1 -- 172.21.15.177:0/3011607278 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c00a180 con 0x55b5ac3e99e0 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.176+0000 7f7663606640 1 -- 172.21.15.177:0/3011607278 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c00a2e0 con 0x55b5ac3e99e0 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.176+0000 7f7663606640 1 -- 172.21.15.177:0/3011607278 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c0529b0 con 0x55b5ac3e99e0 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 -- 172.21.15.177:0/3011607278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 msgr2=0x55b5ac4d9ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3011607278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4d9ea0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f776c055040 tx=0x7f776c04c000 comp rx=0 tx=0).stop 2024-03-20T13:36:31.180 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 -- 172.21.15.177:0/3011607278 shutdown_connections 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3011607278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4d9ea0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 -- 172.21.15.177:0/3011607278 >> 172.21.15.177:0/3011607278 conn(0x55b5ac3e5040 msgr2=0x55b5ac4d5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 -- 172.21.15.177:0/3011607278 shutdown_connections 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 -- 172.21.15.177:0/3011607278 wait complete. 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 Processor -- start 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.177+0000 7f7777ce4800 1 -- start start 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.178+0000 7f7777ce4800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4e1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.181 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.178+0000 7f7777ce4800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ac2e5210 con 0x55b5ac3e99e0 2024-03-20T13:36:31.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.178+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4e1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.178+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4e1300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44410/0 (socket says 172.21.15.177:44410) 2024-03-20T13:36:31.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.178+0000 7f77757e3640 1 -- 172.21.15.177:0/658071581 learned_addr learned my addr 172.21.15.177:0/658071581 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:31.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.178+0000 7f77757e3640 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776c04e070 con 0x55b5ac3e99e0 2024-03-20T13:36:31.182 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.179+0000 7f77757e3640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4e1300 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f776c00a470 tx=0x7f776c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.186 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.179+0000 7f7661e03640 1 -- 172.21.15.177:0/658071581 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c06c070 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.179+0000 7f7661e03640 1 -- 172.21.15.177:0/658071581 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c052cc0 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.179+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5ac4e1840 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.179+0000 7f7661e03640 1 -- 172.21.15.177:0/658071581 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c067600 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.179+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5ac4e1d20 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.180+0000 7f7661e03640 1 -- 172.21.15.177:0/658071581 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f776c067760 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.180+0000 7f7661e03640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f765c036790 0x7f765c038c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.180+0000 7f7661e03640 1 -- 172.21.15.177:0/658071581 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f776c08fa50 con 0x55b5ac3e99e0 2024-03-20T13:36:31.187 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.180+0000 7f7774fe2640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f765c036790 0x7f765c038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.180+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac3eac40 0x55b5ac4e70f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.180+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac4e7630 con 0x55b5ac3eac40 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7775fe4640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac3eac40 0x55b5ac4e70f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7774fe2640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f765c036790 0x7f765c038c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7768000f60 tx=0x7f77680012b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7775fe4640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac3eac40 0x55b5ac4e70f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7775fe4640 1 -- 172.21.15.177:0/658071581 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac3eac40 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac4e7990 con 0x55b5ac3eac40 2024-03-20T13:36:31.188 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7775fe4640 1 -- 172.21.15.177:0/658071581 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac3eac40 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac4e9410 0x55b5ac4eb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.181+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:3 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac4ec030 con 0x55b5ac4e9410 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.182+0000 7f77757e3640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac4e9410 0x55b5ac4eb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.182+0000 7f77757e3640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac4e9410 0x55b5ac4eb8a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.182+0000 7f77757e3640 1 -- 172.21.15.177:0/658071581 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(3 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [call out=48b,read 0~921 out=921b] v0'0 uv5 ondisk = 0) v8 ==== 232+0+969 (crc 0 0 0) 0x7f776c080040 con 0x55b5ac4e9410 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.182+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac4e8250 con 0x55b5ac3eac40 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.183+0000 7f7775fe4640 1 -- 172.21.15.177:0/658071581 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac3eac40 2024-03-20T13:36:31.189 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.183+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c082000 0x55b5ac4ef530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.183+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:5 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac4efc90 con 0x7f776c082000 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.183+0000 7f7774fe2640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c082000 0x55b5ac4ef530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.183+0000 7f7774fe2640 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c082000 0x55b5ac4ef530 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f7774fe2640 1 -- 172.21.15.177:0/658071581 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(5 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [call out=48b,read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 237+0+469 (crc 0 0 0) 0x7f7768006070 con 0x7f776c082000 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f7777ce4800 1 Processor -- start 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f7777ce4800 1 -- start start 2024-03-20T13:36:31.190 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f7777ce4800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 0x55b5ac4fe310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f7777ce4800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ac287c70 con 0x55b5ac4fdef0 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 0x55b5ac4fe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 0x55b5ac4fe310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44424/0 (socket says 172.21.15.177:44424) 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.184+0000 7f77757e3640 1 -- 172.21.15.177:0/3698147111 learned_addr learned my addr 172.21.15.177:0/3698147111 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f77757e3640 1 -- 172.21.15.177:0/3698147111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ac4fe850 con 0x55b5ac4fdef0 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f77757e3640 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 0x55b5ac4fe310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f776c08dd50 tx=0x7f776c079d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f765affd640 1 -- 172.21.15.177:0/3698147111 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c08c6e0 con 0x55b5ac4fdef0 2024-03-20T13:36:31.191 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f765affd640 1 -- 172.21.15.177:0/3698147111 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c08c860 con 0x55b5ac4fdef0 2024-03-20T13:36:31.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5ac4ff2c0 con 0x55b5ac4fdef0 2024-03-20T13:36:31.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f765affd640 1 -- 172.21.15.177:0/3698147111 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c08f130 con 0x55b5ac4fdef0 2024-03-20T13:36:31.192 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.185+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5ac4ff780 con 0x55b5ac4fdef0 2024-03-20T13:36:31.210 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.186+0000 7f765affd640 1 -- 172.21.15.177:0/3698147111 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f776c08f2b0 con 0x55b5ac4fdef0 2024-03-20T13:36:31.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.186+0000 7f765affd640 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f764c0367e0 0x7f764c038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.186+0000 7f765affd640 1 -- 172.21.15.177:0/3698147111 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f776c09ad70 con 0x55b5ac4fdef0 2024-03-20T13:36:31.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.186+0000 7f7774fe2640 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f764c0367e0 0x7f764c038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.211 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f7777ce4800 1 Processor -- start 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f7777ce4800 1 -- start start 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f7774fe2640 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f764c0367e0 0x7f764c038ca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f776800bf50 tx=0x7f776800f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f7777ce4800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac50b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f7777ce4800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ac25d5d0 con 0x55b5ac50b140 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac50b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac50b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44430/0 (socket says 172.21.15.177:44430) 2024-03-20T13:36:31.212 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.187+0000 7f77757e3640 1 -- 172.21.15.177:0/3174105110 learned_addr learned my addr 172.21.15.177:0/3174105110 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f77757e3640 1 -- 172.21.15.177:0/3174105110 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ac50bb30 con 0x55b5ac50b140 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f77757e3640 1 --2- 172.21.15.177:0/3174105110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac50b560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f776c06f4e0 tx=0x7f776c098b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=977d3a035ee4f672 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7658ff9640 1 -- 172.21.15.177:0/3174105110 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c082840 con 0x55b5ac50b140 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7658ff9640 1 -- 172.21.15.177:0/3174105110 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c0983b0 con 0x55b5ac50b140 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7658ff9640 1 -- 172.21.15.177:0/3174105110 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c009c90 con 0x55b5ac50b140 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7777ce4800 1 -- 172.21.15.177:0/3174105110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 msgr2=0x55b5ac50b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3174105110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac50b560 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f776c06f4e0 tx=0x7f776c098b00 comp rx=0 tx=0).stop 2024-03-20T13:36:31.213 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7777ce4800 1 -- 172.21.15.177:0/3174105110 shutdown_connections 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3174105110 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac50b560 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.188+0000 7f7777ce4800 1 -- 172.21.15.177:0/3174105110 >> 172.21.15.177:0/3174105110 conn(0x55b5ac507410 msgr2=0x55b5ac505470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f7777ce4800 1 -- 172.21.15.177:0/3174105110 shutdown_connections 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f7777ce4800 1 -- 172.21.15.177:0/3174105110 wait complete. 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f7777ce4800 1 Processor -- start 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f7777ce4800 1 -- start start 2024-03-20T13:36:31.214 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f7777ce4800 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac516490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f7777ce4800 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ac5169d0 con 0x55b5ac50b140 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac516490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f77757e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac516490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.177:44438/0 (socket says 172.21.15.177:44438) 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.189+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 learned_addr learned my addr 172.21.15.177:0/2791793375 (peer_addr_for_me v2:172.21.15.177:0/0) 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ac4ff780 con 0x55b5ac50b140 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f77757e3640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac516490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f776c06ac70 tx=0x7f776c095f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f764affd640 1 -- 172.21.15.177:0/2791793375 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c0b6070 con 0x55b5ac50b140 2024-03-20T13:36:31.215 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f764affd640 1 -- 172.21.15.177:0/2791793375 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f776c088360 con 0x55b5ac50b140 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b5ac4ff780 con 0x55b5ac50b140 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f764affd640 1 -- 172.21.15.177:0/2791793375 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f776c088640 con 0x55b5ac50b140 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.190+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5ac4ff780 con 0x55b5ac50b140 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.191+0000 7f764affd640 1 -- 172.21.15.177:0/2791793375 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f776c0887a0 con 0x55b5ac50b140 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.191+0000 7f764affd640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f76400367e0 0x7f7640038ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.191+0000 7f764affd640 1 -- 172.21.15.177:0/2791793375 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f776c0bfa40 con 0x55b5ac50b140 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.191+0000 7f7774fe2640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f76400367e0 0x7f7640038ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.216 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac521b60 0x55b5ac524020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac524770 con 0x55b5ac521b60 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7774fe2640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f76400367e0 0x7f7640038ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7768001b60 tx=0x7f7768010000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7775fe4640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac521b60 0x55b5ac524020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7775fe4640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac521b60 0x55b5ac524020 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.217 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 20 realm 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac524b40 con 0x55b5ac521b60 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.192+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.218 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac525720 con 0x55b5ac521b60 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+46 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac5260d0 0x55b5ac5284c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.219 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:5 5.d 5:b6ecf956:::zone_info.3852dce3-594b-4724-bee1-f3dae77b7611:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac528ad0 con 0x55b5ac5260d0 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f77757e3640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac5260d0 0x55b5ac5284c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.193+0000 7f77757e3640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac5260d0 0x55b5ac5284c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== osd_op_reply(5 zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 [read 0~921 out=921b] v0'0 uv5 ondisk = 0) v8 ==== 190+0+921 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7777ce4800 20 rados_obj.operate() r=0 bl.length=921 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7777ce4800 20 searching for the correct realm 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b5ac52ae70 0x55b5ac52d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52d9b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.220 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7774fe2640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b5ac52ae70 0x55b5ac52d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7774fe2640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b5ac52ae70 0x55b5ac52d330 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== osd_op_reply(6 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.194+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52d9b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.195+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== osd_op_reply(7 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.195+0000 7f77757e3640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c099060 0x7f776c099660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.195+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52d9b0 con 0x7f776c099060 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.195+0000 7f7775fe4640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c099060 0x7f776c099660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.221 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.195+0000 7f7775fe4640 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c099060 0x7f776c099660 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.196+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== osd_op_reply(8 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.196+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.196+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 5 ==== osd_op_reply(9 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.196+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.196+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 6 ==== osd_op_reply(10 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.196+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== osd_op_reply(11 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.222 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 3 ==== osd_op_reply(12 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac5260d0 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 3 ==== osd_op_reply(13 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== osd_op_reply(14 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.197+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 7 ==== osd_op_reply(15 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.223 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 4 ==== osd_op_reply(16 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 8 ==== osd_op_reply(17 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac5260d0 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 4 ==== osd_op_reply(18 [pgnls start_epoch 32 out=79b] v23'1 uv1 ondisk = 1) v8 ==== 144+0+79 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.198+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 3 ==== osd_op_reply(19 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.224 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 4 ==== osd_op_reply(20 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 5 ==== osd_op_reply(21 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 5 ==== osd_op_reply(22 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.199+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 6 ==== osd_op_reply(23 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.225 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 9 ==== osd_op_reply(24 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 10 ==== osd_op_reply(25 [pgnls start_epoch 32 out=74b] v32'2 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 6 ==== osd_op_reply(26 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.200+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.201+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 7 ==== osd_op_reply(27 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.226 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.201+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac5260d0 2024-03-20T13:36:31.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.201+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 5 ==== osd_op_reply(28 [pgnls start_epoch 32 out=107b] v32'5 uv5 ondisk = 1) v8 ==== 144+0+107 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.201+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.201+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 11 ==== osd_op_reply(29 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.201+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.227 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 7 ==== osd_op_reply(30 [pgnls start_epoch 32 out=112b] v32'2 uv2 ondisk = 1) v8 ==== 144+0+112 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac5260d0 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 6 ==== osd_op_reply(31 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 8 ==== osd_op_reply(32 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac5260d0 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 7 ==== osd_op_reply(33 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.202+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac52ae70 2024-03-20T13:36:31.228 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 8 ==== osd_op_reply(34 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x7f776c099060 2024-03-20T13:36:31.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 9 ==== osd_op_reply(35 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac521b60 2024-03-20T13:36:31.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 12 ==== osd_op_reply(36 [pgnls start_epoch 32 out=115b] v32'3 uv3 ondisk = 1) v8 ==== 144+0+115 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 32 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5253c0 con 0x55b5ac5260d0 2024-03-20T13:36:31.229 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 8 ==== osd_op_reply(37 [pgnls start_epoch 32 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.203+0000 7f7777ce4800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 RGWRados::pool_iterate: got default.zone. 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 RGWRados::pool_iterate: got zone_info.3852dce3-594b-4724-bee1-f3dae77b7611 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 RGWRados::pool_iterate: got zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 RGWRados::pool_iterate: got zone_names.default 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5292b0 con 0x55b5ac521b60 2024-03-20T13:36:31.230 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 157+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5292b0 con 0x55b5ac521b60 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) v8 ==== 168+0+46 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados_obj.operate() r=0 bl.length=46 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:40 5.3 5:c00882f2:::zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac529280 con 0x7f776c099060 2024-03-20T13:36:31.231 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 10 ==== osd_op_reply(40 zonegroup_info.7b38e3a9-8d74-4698-af71-c25b0690d394 [read 0~421 out=421b] v0'0 uv2 ondisk = 0) v8 ==== 195+0+421 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados_obj.operate() r=0 bl.length=421 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 zone default found 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 4 Realm: () 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 4 ZoneGroup: default (7b38e3a9-8d74-4698-af71-c25b0690d394) 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 4 Zone: default (3852dce3-594b-4724-bee1-f3dae77b7611) 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 10 cannot find current period zonegroup using local zonegroup configuration 2024-03-20T13:36:31.232 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 zonegroup default 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.204+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac529b00 con 0x7f776c099060 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 165+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac529f00 con 0x55b5ac52ae70 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 9 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.233 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 rados->read ofs=0 len=0 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52f7d0 con 0x55b5ac52ae70 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 10 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 211+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 rados_obj.operate() r=-2 bl.length=0 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 started sync module instance, tier type = 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 20 started zone id=3852dce3-594b-4724-bee1-f3dae77b7611 (name=default) with tier type = 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.205+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52f0b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.206+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 9 ==== osd_op_reply(44 notify.0 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.234 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.206+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94238768557072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52ffd0 con 0x55b5ac5260d0 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.206+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5307d0 con 0x55b5ac521b60 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.207+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 10 ==== osd_op_reply(45 notify.0 [watch watch cookie 94238768557072] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.208+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 15 ==== osd_op_reply(46 notify.1 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.208+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94238768560944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac530810 con 0x55b5ac521b60 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.208+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5312d0 con 0x55b5ac52ae70 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.209+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94238768560944] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.209+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 11 ==== osd_op_reply(48 notify.2 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.235 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.209+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94238768565648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac531680 con 0x55b5ac52ae70 2024-03-20T13:36:31.236 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.209+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5320d0 con 0x55b5ac5260d0 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.210+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 11 ==== osd_op_reply(50 notify.3 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.210+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94238768571520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac532d40 con 0x55b5ac5260d0 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.210+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac533730 con 0x55b5ac521b60 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.210+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 12 ==== osd_op_reply(49 notify.2 [watch watch cookie 94238768565648] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.211+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 17 ==== osd_op_reply(52 notify.4 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.211+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94238768574992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac533ae0 con 0x55b5ac521b60 2024-03-20T13:36:31.245 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.211+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 12 ==== osd_op_reply(51 notify.3 [watch watch cookie 94238768571520] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.211+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5328a0 con 0x7f776c099060 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.212+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94238768574992] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.212+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 12 ==== osd_op_reply(54 notify.5 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.212+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94238768562992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5328a0 con 0x7f776c099060 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.212+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5349d0 con 0x7f776c099060 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.214+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94238768562992] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.246 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.214+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 14 ==== osd_op_reply(56 notify.6 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.214+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94238768578576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac534990 con 0x7f776c099060 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.214+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac535390 con 0x7f776c099060 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 15 ==== osd_op_reply(58 notify.7 [create] v32'241 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94238768578576] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94238768582288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5357f0 con 0x7f776c099060 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=0 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=1 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=2 2024-03-20T13:36:31.247 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=3 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=4 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=5 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.215+0000 7f7777ce4800 20 add_watcher() i=6 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.216+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94238768582288] v32'242 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.216+0000 7f7777ce4800 20 add_watcher() i=7 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.216+0000 7f7777ce4800 2 all 8 watchers are set, enabling cache 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.216+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5357f0 con 0x55b5ac521b60 2024-03-20T13:36:31.248 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.216+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) v8 ==== 256+0+76 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.216+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94238768583504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5357a0 con 0x55b5ac521b60 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.217+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94238768583504] v32'240 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.217+0000 7f762b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.218+0000 7f7777ce4800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.218+0000 7f7777ce4800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.218+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac541120 con 0x55b5ac521b60 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.219+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.249 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.219+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5411a0 con 0x7f776c099060 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.220+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.220+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5417d0 con 0x55b5ac52ae70 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.221+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 13 ==== osd_op_reply(64 gc.2 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.221+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac541d00 con 0x55b5ac521b60 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.222+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v32'241 uv162 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.222+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac542230 con 0x55b5ac5260d0 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.223+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 13 ==== osd_op_reply(66 gc.4 [create,call,call,call] v32'78 uv52 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.250 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.223+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac542760 con 0x55b5ac52ae70 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.224+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 14 ==== osd_op_reply(67 gc.5 [create,call,call,call] v32'51 uv34 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.224+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac542c90 con 0x55b5ac521b60 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.225+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.225+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543130 con 0x7f776c099060 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.226+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v32'53 uv35 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.226+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac542760 con 0x55b5ac5260d0 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.227+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 14 ==== osd_op_reply(70 gc.8 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.251 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.227+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543300 con 0x55b5ac52ae70 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.228+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 15 ==== osd_op_reply(71 gc.9 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 274+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.228+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543830 con 0x55b5ac5260d0 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.229+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 15 ==== osd_op_reply(72 gc.10 [create,call,call,call] v32'79 uv54 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.229+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543d60 con 0x7f776c099060 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.231+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v32'36 uv25 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.231+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac544200 con 0x55b5ac5260d0 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.231+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 16 ==== osd_op_reply(74 gc.12 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.252 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.232+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543ea0 con 0x7f776c099060 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.233+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v32'57 uv40 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.233+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543cd0 con 0x55b5ac521b60 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.234+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v32'242 uv164 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.234+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac543cd0 con 0x55b5ac52ae70 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.235+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 16 ==== osd_op_reply(77 gc.15 [create,call,call,call] v32'72 uv45 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.236+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac53f1d0 con 0x55b5ac5260d0 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.236+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 17 ==== osd_op_reply(78 gc.16 [create,call,call,call] v32'80 uv56 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.253 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.236+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac53f7a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.237+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 17 ==== osd_op_reply(79 gc.17 [create,call,call,call] v32'29 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.237+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac53f7a0 con 0x55b5ac521b60 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.239+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v32'37 uv29 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.239+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac53f7a0 con 0x55b5ac521b60 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.240+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v32'243 uv166 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.240+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.241+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 18 ==== osd_op_reply(82 gc.20 [create,call,call,call] v32'73 uv47 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.254 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.241+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.242+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 18 ==== osd_op_reply(83 gc.21 [create,call,call,call] v32'39 uv31 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.242+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.243+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 19 ==== osd_op_reply(84 gc.22 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.243+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.243+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 20 ==== osd_op_reply(85 gc.23 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.255 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.244+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.244+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 21 ==== osd_op_reply(86 gc.24 [create,call,call,call] v32'25 uv17 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.244+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.245+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 22 ==== osd_op_reply(87 gc.25 [create,call,call,call] v32'52 uv36 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.245+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x7f776c099060 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.247+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v32'31 uv23 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.247+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.261 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.248+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 23 ==== osd_op_reply(89 gc.27 [create,call,call,call] v32'30 uv21 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.248+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x7f776c099060 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.249+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v32'54 uv38 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.249+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.250+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 24 ==== osd_op_reply(91 gc.29 [create,call,call,call] v32'74 uv49 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.251+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5407b0 con 0x7f776c099060 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.252+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v32'58 uv42 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.252+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5444e0 con 0x55b5ac5260d0 2024-03-20T13:36:31.262 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 19 ==== osd_op_reply(93 gc.31 [create,call,call,call] v32'35 uv27 ondisk = -125 ((125) Operation canceled)) v8 ==== 275+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f762a7e4640 20 reqs_thread_entry: start 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f7777ce4800 20 init_complete bucket index max shards: 11 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f7777ce4800 20 Filter name: none 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f759bfff640 20 reqs_thread_entry: start 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.253+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:94 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.254+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 27 ==== osd_op_reply(94 gc.14 [call] v32'244 uv244 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.263 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.254+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:95 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 28 ==== osd_op_reply(95 gc.14 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:96 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac521b60 2024-03-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 29 ==== osd_op_reply(96 gc.14 [call out=24b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:97 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.264 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 30 ==== osd_op_reply(97 gc.14 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:98 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 31 ==== osd_op_reply(98 gc.14 [call out=15b] v0'0 uv244 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.265 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.255+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:99 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.256+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 32 ==== osd_op_reply(99 gc.14 [call] v32'245 uv245 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.256+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-03-20T13:36:31.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.256+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:100 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.257+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 25 ==== osd_op_reply(100 gc.15 [call] v32'75 uv75 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.266 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.257+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:101 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 26 ==== osd_op_reply(101 gc.15 [call out=15b] v0'0 uv75 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:102 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 27 ==== osd_op_reply(102 gc.15 [call out=24b] v0'0 uv75 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:103 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.267 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 28 ==== osd_op_reply(103 gc.15 [call out=15b] v0'0 uv75 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:104 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 29 ==== osd_op_reply(104 gc.15 [call out=15b] v0'0 uv75 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.258+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:105 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.259+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 30 ==== osd_op_reply(105 gc.15 [call] v32'76 uv76 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.259+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-03-20T13:36:31.268 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.259+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:106 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.260+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 20 ==== osd_op_reply(106 gc.16 [call] v32'81 uv81 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.260+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:107 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 21 ==== osd_op_reply(107 gc.16 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.276 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:108 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 22 ==== osd_op_reply(108 gc.16 [call out=24b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:109 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 23 ==== osd_op_reply(109 gc.16 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:110 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 24 ==== osd_op_reply(110 gc.16 [call out=15b] v0'0 uv81 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.277 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.261+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:111 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.262+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 25 ==== osd_op_reply(111 gc.16 [call] v32'82 uv82 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.262+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.262+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:112 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.263+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 31 ==== osd_op_reply(112 gc.17 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.263+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:113 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.263+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 32 ==== osd_op_reply(113 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.278 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.263+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.263+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:114 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 33 ==== osd_op_reply(114 gc.17 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:115 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 34 ==== osd_op_reply(115 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:116 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 35 ==== osd_op_reply(116 gc.17 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.279 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.264+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:117 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.265+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 36 ==== osd_op_reply(117 gc.17 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.265+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.265+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:118 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 33 ==== osd_op_reply(118 gc.18 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:119 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.280 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 34 ==== osd_op_reply(119 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:120 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac521b60 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 35 ==== osd_op_reply(120 gc.18 [call out=24b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.266+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:121 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.267+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 36 ==== osd_op_reply(121 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.267+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.267+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:122 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.281 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.267+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 37 ==== osd_op_reply(122 gc.18 [call out=15b] v0'0 uv38 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.267+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.267+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:123 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.268+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 38 ==== osd_op_reply(123 gc.18 [call] v32'39 uv39 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.268+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.268+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:124 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 39 ==== osd_op_reply(124 gc.19 [call] v32'246 uv246 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.282 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:125 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 40 ==== osd_op_reply(125 gc.19 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:126 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac521b60 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 41 ==== osd_op_reply(126 gc.19 [call out=24b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:127 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 42 ==== osd_op_reply(127 gc.19 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.283 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.269+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:128 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.270+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 43 ==== osd_op_reply(128 gc.19 [call out=15b] v0'0 uv246 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.270+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.270+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:129 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.271+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 44 ==== osd_op_reply(129 gc.19 [call] v32'247 uv247 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.271+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.271+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:130 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.272+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 37 ==== osd_op_reply(130 gc.20 [call] v32'77 uv77 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.272+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:131 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.284 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.272+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 38 ==== osd_op_reply(131 gc.20 [call out=15b] v0'0 uv77 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.272+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.272+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:132 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 39 ==== osd_op_reply(132 gc.20 [call out=24b] v0'0 uv77 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:133 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 40 ==== osd_op_reply(133 gc.20 [call out=15b] v0'0 uv77 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.285 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:134 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 41 ==== osd_op_reply(134 gc.20 [call out=15b] v0'0 uv77 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.273+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:135 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.274+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 42 ==== osd_op_reply(135 gc.20 [call] v32'78 uv78 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.274+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-03-20T13:36:31.286 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.274+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:136 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.275+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 26 ==== osd_op_reply(136 gc.21 [call] v32'40 uv40 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.275+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:137 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.296 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 27 ==== osd_op_reply(137 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:138 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 28 ==== osd_op_reply(138 gc.21 [call out=24b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:139 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 29 ==== osd_op_reply(139 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.297 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:140 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 30 ==== osd_op_reply(140 gc.21 [call out=15b] v0'0 uv40 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.276+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:141 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.277+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 31 ==== osd_op_reply(141 gc.21 [call] v32'41 uv41 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.277+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.277+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:142 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.278+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 43 ==== osd_op_reply(142 gc.22 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.298 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.278+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:143 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.278+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 44 ==== osd_op_reply(143 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.278+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.278+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:144 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 45 ==== osd_op_reply(144 gc.22 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:145 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 46 ==== osd_op_reply(145 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.299 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:146 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 47 ==== osd_op_reply(146 gc.22 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.279+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:147 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.280+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 48 ==== osd_op_reply(147 gc.22 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.280+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.280+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:148 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 49 ==== osd_op_reply(148 gc.23 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:149 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.300 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 50 ==== osd_op_reply(149 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:150 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 51 ==== osd_op_reply(150 gc.23 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.281+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:151 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.282+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 52 ==== osd_op_reply(151 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.282+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.282+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:152 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.301 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.282+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 53 ==== osd_op_reply(152 gc.23 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.282+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.282+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:153 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.283+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 54 ==== osd_op_reply(153 gc.23 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.283+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.283+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:154 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 55 ==== osd_op_reply(154 gc.24 [call] v32'26 uv26 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:155 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.302 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 56 ==== osd_op_reply(155 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:156 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 57 ==== osd_op_reply(156 gc.24 [call out=24b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:157 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 58 ==== osd_op_reply(157 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:158 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.303 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 59 ==== osd_op_reply(158 gc.24 [call out=15b] v0'0 uv26 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.284+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:159 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.285+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 60 ==== osd_op_reply(159 gc.24 [call] v32'27 uv27 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.285+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.285+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:160 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.286+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 61 ==== osd_op_reply(160 gc.25 [call] v32'53 uv53 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.286+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:161 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.304 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 62 ==== osd_op_reply(161 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:162 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 63 ==== osd_op_reply(162 gc.25 [call out=24b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:163 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 64 ==== osd_op_reply(163 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:164 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.305 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 65 ==== osd_op_reply(164 gc.25 [call out=15b] v0'0 uv53 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.287+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:165 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.289+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 66 ==== osd_op_reply(165 gc.25 [call] v32'54 uv54 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.289+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.289+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:166 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.290+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 25 ==== osd_op_reply(166 gc.26 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.290+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:167 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.306 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.290+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 26 ==== osd_op_reply(167 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.290+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.290+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:168 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 27 ==== osd_op_reply(168 gc.26 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:169 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 28 ==== osd_op_reply(169 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:170 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.307 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 29 ==== osd_op_reply(170 gc.26 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.291+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:171 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.293+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 30 ==== osd_op_reply(171 gc.26 [call] v32'33 uv33 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.293+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.293+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:172 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 67 ==== osd_op_reply(172 gc.27 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:173 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.308 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 68 ==== osd_op_reply(173 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:174 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 69 ==== osd_op_reply(174 gc.27 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 70 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.309 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 71 ==== osd_op_reply(176 gc.27 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.294+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.295+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 72 ==== osd_op_reply(177 gc.27 [call] v32'32 uv32 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.295+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-03-20T13:36:31.310 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.295+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.323 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.296+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 31 ==== osd_op_reply(178 gc.28 [call] v32'55 uv55 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.296+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 32 ==== osd_op_reply(179 gc.28 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 33 ==== osd_op_reply(180 gc.28 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:181 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 34 ==== osd_op_reply(181 gc.28 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.324 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.297+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:182 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.298+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 35 ==== osd_op_reply(182 gc.28 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.298+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.298+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:183 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.299+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 36 ==== osd_op_reply(183 gc.28 [call] v32'56 uv56 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.299+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.299+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:184 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.325 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 73 ==== osd_op_reply(184 gc.29 [call] v32'79 uv79 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:185 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 74 ==== osd_op_reply(185 gc.29 [call out=15b] v0'0 uv79 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:186 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 75 ==== osd_op_reply(186 gc.29 [call out=24b] v0'0 uv79 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:187 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 76 ==== osd_op_reply(187 gc.29 [call out=15b] v0'0 uv79 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.326 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:188 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 77 ==== osd_op_reply(188 gc.29 [call out=15b] v0'0 uv79 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.300+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:189 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.301+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 78 ==== osd_op_reply(189 gc.29 [call] v32'80 uv80 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.301+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.301+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:190 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.327 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.302+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 37 ==== osd_op_reply(190 gc.30 [call] v32'59 uv59 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:191 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 38 ==== osd_op_reply(191 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:192 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 39 ==== osd_op_reply(192 gc.30 [call out=24b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:193 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 40 ==== osd_op_reply(193 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.328 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.303+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:194 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.304+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 41 ==== osd_op_reply(194 gc.30 [call out=15b] v0'0 uv59 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.304+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.304+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:195 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.305+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 42 ==== osd_op_reply(195 gc.30 [call] v32'60 uv60 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.305+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.305+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:196 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 32 ==== osd_op_reply(196 gc.31 [call] v32'36 uv36 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.329 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:197 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 33 ==== osd_op_reply(197 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:198 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 34 ==== osd_op_reply(198 gc.31 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.306+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:199 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.307+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 35 ==== osd_op_reply(199 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.307+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.330 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.307+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:200 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.307+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 36 ==== osd_op_reply(200 gc.31 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.307+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.307+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:201 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.308+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 37 ==== osd_op_reply(201 gc.31 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.308+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.308+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:202 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 45 ==== osd_op_reply(202 gc.0 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.331 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:203 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 46 ==== osd_op_reply(203 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:204 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac521b60 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 47 ==== osd_op_reply(204 gc.0 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 48 ==== osd_op_reply(205 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.332 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.309+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:206 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.310+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 49 ==== osd_op_reply(206 gc.0 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.310+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.310+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:207 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.311+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 50 ==== osd_op_reply(207 gc.0 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.311+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.311+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:208 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 43 ==== osd_op_reply(208 gc.1 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.333 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:209 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 44 ==== osd_op_reply(209 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:210 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 45 ==== osd_op_reply(210 gc.1 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:211 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 46 ==== osd_op_reply(211 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.334 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.312+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:212 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.313+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 47 ==== osd_op_reply(212 gc.1 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.313+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.313+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:213 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.314+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 48 ==== osd_op_reply(213 gc.1 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.314+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.314+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:214 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.335 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 79 ==== osd_op_reply(214 gc.2 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:215 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 80 ==== osd_op_reply(215 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:216 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 81 ==== osd_op_reply(216 gc.2 [call out=24b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:217 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 82 ==== osd_op_reply(217 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.336 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.315+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:218 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.316+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 83 ==== osd_op_reply(218 gc.2 [call out=15b] v0'0 uv31 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.316+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.316+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:219 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.317+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 84 ==== osd_op_reply(219 gc.2 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.317+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.317+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:220 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.337 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 51 ==== osd_op_reply(220 gc.3 [call] v32'248 uv248 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:221 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 52 ==== osd_op_reply(221 gc.3 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:222 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 53 ==== osd_op_reply(222 gc.3 [call out=24b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:223 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 54 ==== osd_op_reply(223 gc.3 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.338 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.318+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:224 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.319+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 55 ==== osd_op_reply(224 gc.3 [call out=15b] v0'0 uv248 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.319+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.319+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:225 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.320+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 56 ==== osd_op_reply(225 gc.3 [call] v32'249 uv249 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.320+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.320+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:226 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.339 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 38 ==== osd_op_reply(226 gc.4 [call] v32'83 uv83 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:227 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 39 ==== osd_op_reply(227 gc.4 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:228 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 40 ==== osd_op_reply(228 gc.4 [call out=24b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:229 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 41 ==== osd_op_reply(229 gc.4 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.340 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.321+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:230 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.322+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 42 ==== osd_op_reply(230 gc.4 [call out=15b] v0'0 uv83 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.322+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.322+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:231 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.322+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 43 ==== osd_op_reply(231 gc.4 [call] v32'84 uv84 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.322+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-03-20T13:36:31.341 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.322+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:232 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.355 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.323+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 85 ==== osd_op_reply(232 gc.5 [call] v32'55 uv55 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.323+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:233 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 86 ==== osd_op_reply(233 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:234 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 87 ==== osd_op_reply(234 gc.5 [call out=24b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:235 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.356 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 88 ==== osd_op_reply(235 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:236 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 89 ==== osd_op_reply(236 gc.5 [call out=15b] v0'0 uv55 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.324+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:237 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.325+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 90 ==== osd_op_reply(237 gc.5 [call] v32'56 uv56 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.325+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-03-20T13:36:31.357 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.325+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:238 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 57 ==== osd_op_reply(238 gc.6 [call] v32'32 uv32 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:239 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 58 ==== osd_op_reply(239 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:240 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 59 ==== osd_op_reply(240 gc.6 [call out=24b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:241 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.358 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 60 ==== osd_op_reply(241 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:242 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 61 ==== osd_op_reply(242 gc.6 [call out=15b] v0'0 uv32 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.327+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:243 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac521b60 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.328+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 62 ==== osd_op_reply(243 gc.6 [call] v32'33 uv33 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.359 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.328+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.328+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:244 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.330+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 49 ==== osd_op_reply(244 gc.7 [call] v32'57 uv57 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.330+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:245 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.330+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 50 ==== osd_op_reply(245 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.330+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.330+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:246 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 51 ==== osd_op_reply(246 gc.7 [call out=24b] v0'0 uv57 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.360 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:247 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 52 ==== osd_op_reply(247 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:248 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 53 ==== osd_op_reply(248 gc.7 [call out=15b] v0'0 uv57 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.331+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:249 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.332+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 54 ==== osd_op_reply(249 gc.7 [call] v32'58 uv58 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.361 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.332+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.332+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:250 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.333+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 44 ==== osd_op_reply(250 gc.8 [call] v32'30 uv30 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.333+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:251 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.333+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 45 ==== osd_op_reply(251 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.333+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.333+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:252 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 46 ==== osd_op_reply(252 gc.8 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.362 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:253 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 47 ==== osd_op_reply(253 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:254 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 48 ==== osd_op_reply(254 gc.8 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.334+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:255 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.335+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 49 ==== osd_op_reply(255 gc.8 [call] v32'31 uv31 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.335+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-03-20T13:36:31.363 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.335+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:256 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 91 ==== osd_op_reply(256 gc.9 [call] v32'36 uv36 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:257 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 92 ==== osd_op_reply(257 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:258 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 93 ==== osd_op_reply(258 gc.9 [call out=24b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+24 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.336+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:259 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.364 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.337+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 94 ==== osd_op_reply(259 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.337+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.337+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:260 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.337+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 95 ==== osd_op_reply(260 gc.9 [call out=15b] v0'0 uv36 ondisk = 0) v8 ==== 148+0+15 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.337+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.337+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:261 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac52ae70 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.338+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 96 ==== osd_op_reply(261 gc.9 [call] v32'37 uv37 ondisk = 0) v8 ==== 148+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.338+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-03-20T13:36:31.365 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.338+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:262 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 50 ==== osd_op_reply(262 gc.10 [call] v32'85 uv85 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:263 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 51 ==== osd_op_reply(263 gc.10 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:264 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 52 ==== osd_op_reply(264 gc.10 [call out=24b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:265 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 53 ==== osd_op_reply(265 gc.10 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.366 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.339+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:266 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.340+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 54 ==== osd_op_reply(266 gc.10 [call out=15b] v0'0 uv85 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.340+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.340+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:267 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.340+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 55 ==== osd_op_reply(267 gc.10 [call] v32'86 uv86 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.340+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.340+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:268 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.367 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 55 ==== osd_op_reply(268 gc.11 [call] v32'37 uv37 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:269 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 56 ==== osd_op_reply(269 gc.11 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:270 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 57 ==== osd_op_reply(270 gc.11 [call out=24b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.342+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:271 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.343+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 58 ==== osd_op_reply(271 gc.11 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.368 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.343+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.343+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:272 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.343+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 59 ==== osd_op_reply(272 gc.11 [call out=15b] v0'0 uv37 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.343+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.343+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:273 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.344+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 60 ==== osd_op_reply(273 gc.11 [call] v32'38 uv38 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.344+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.344+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:274 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.369 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.345+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 56 ==== osd_op_reply(274 gc.12 [call] v32'30 uv30 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:275 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 57 ==== osd_op_reply(275 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:276 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 58 ==== osd_op_reply(276 gc.12 [call out=24b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:277 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 59 ==== osd_op_reply(277 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.370 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.346+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:278 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.347+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 60 ==== osd_op_reply(278 gc.12 [call out=15b] v0'0 uv30 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.347+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.347+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:279 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x55b5ac5260d0 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.348+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 61 ==== osd_op_reply(279 gc.12 [call] v32'31 uv31 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.348+0000 7f7777ce4800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.348+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:280 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.371 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.349+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 61 ==== osd_op_reply(280 gc.13 [call] v32'61 uv61 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.349+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:281 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.349+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 62 ==== osd_op_reply(281 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.349+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.349+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:282 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56e3a0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 63 ==== osd_op_reply(282 gc.13 [call out=24b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+24 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:283 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 64 ==== osd_op_reply(283 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.372 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:284 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 65 ==== osd_op_reply(284 gc.13 [call out=15b] v0'0 uv61 ondisk = 0) v8 ==== 149+0+15 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7777ce4800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.350+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:285 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac56f3b0 con 0x7f776c099060 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.351+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 66 ==== osd_op_reply(285 gc.13 [call] v32'62 uv62 ondisk = 0) v8 ==== 149+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.352+0000 7f762b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.352+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:286 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94238768583504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac5383f0 con 0x55b5ac521b60 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.353+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 63 ==== osd_op_reply(286 data_loggenerations_metadata [watch unwatch cookie 94238768583504] v32'250 uv1 ondisk = 0) v8 ==== 172+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.373 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.353+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:287 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94238768557072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac535350 con 0x55b5ac5260d0 2024-03-20T13:36:31.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.354+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 62 ==== osd_op_reply(287 notify.0 [watch unwatch cookie 94238768557072] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.354+0000 7f7777ce4800 20 remove_watcher() i=0 2024-03-20T13:36:31.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.354+0000 7f7777ce4800 2 removed watcher, disabling cache 2024-03-20T13:36:31.374 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.354+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:288 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94238768560944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac535350 con 0x55b5ac521b60 2024-03-20T13:36:31.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.355+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 64 ==== osd_op_reply(288 notify.1 [watch unwatch cookie 94238768560944] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.355+0000 7f7777ce4800 20 remove_watcher() i=1 2024-03-20T13:36:31.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.355+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- osd_op(unknown.0.0:289 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94238768565648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52fb30 con 0x55b5ac52ae70 2024-03-20T13:36:31.375 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.356+0000 7f7774fe2640 1 -- 172.21.15.177:0/2791793375 <== osd.3 v2:172.21.15.177:6809/1493521224 97 ==== osd_op_reply(289 notify.2 [watch unwatch cookie 94238768565648] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f7768006070 con 0x55b5ac52ae70 2024-03-20T13:36:31.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.356+0000 7f7777ce4800 20 remove_watcher() i=2 2024-03-20T13:36:31.376 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.356+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- osd_op(unknown.0.0:290 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94238768571520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac535350 con 0x55b5ac5260d0 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.387+0000 7f77757e3640 1 -- 172.21.15.177:0/2791793375 <== osd.2 v2:172.21.15.177:6800/3663022842 63 ==== osd_op_reply(290 notify.3 [watch unwatch cookie 94238768571520] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f776c0b8070 con 0x55b5ac5260d0 2024-03-20T13:36:31.388 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.387+0000 7f7777ce4800 20 remove_watcher() i=3 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.387+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- osd_op(unknown.0.0:291 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94238768574992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac530d90 con 0x55b5ac521b60 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.388+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.1 v2:172.21.15.177:6808/2492741617 65 ==== osd_op_reply(291 notify.4 [watch unwatch cookie 94238768574992] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x55b5ac521b60 2024-03-20T13:36:31.389 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.388+0000 7f7777ce4800 20 remove_watcher() i=4 2024-03-20T13:36:31.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.388+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:292 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94238768562992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac52fb30 con 0x7f776c099060 2024-03-20T13:36:31.390 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.389+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 67 ==== osd_op_reply(292 notify.5 [watch unwatch cookie 94238768562992] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.389+0000 7f7777ce4800 20 remove_watcher() i=5 2024-03-20T13:36:31.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.389+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:293 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94238768578576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac532480 con 0x7f776c099060 2024-03-20T13:36:31.391 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.390+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 68 ==== osd_op_reply(293 notify.6 [watch unwatch cookie 94238768578576] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.390+0000 7f7777ce4800 20 remove_watcher() i=6 2024-03-20T13:36:31.392 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.390+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- osd_op(unknown.0.0:294 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94238768582288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32) v8 -- 0x55b5ac535350 con 0x7f776c099060 2024-03-20T13:36:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 <== osd.0 v2:172.21.15.28:6800/801909073 69 ==== osd_op_reply(294 notify.7 [watch unwatch cookie 94238768582288] v32'243 uv241 ondisk = 0) v8 ==== 152+0+0 (crc 0 0 0) 0x7f777000a4a0 con 0x7f776c099060 2024-03-20T13:36:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 20 remove_watcher() i=7 2024-03-20T13:36:31.396 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c099060 msgr2=0x7f776c099660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c099060 0x7f776c099660 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac521b60 msgr2=0x55b5ac524020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac521b60 0x55b5ac524020 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac5260d0 msgr2=0x55b5ac5284c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac5260d0 0x55b5ac5284c0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b5ac52ae70 msgr2=0x55b5ac52d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x55b5ac52ae70 0x55b5ac52d330 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.397 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f76400367e0 msgr2=0x7f7640038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f76400367e0 0x7f7640038ca0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7768001b60 tx=0x7f7768010000 comp rx=0 tx=0).stop 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 msgr2=0x55b5ac516490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 --2- 172.21.15.177:0/2791793375 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac50b140 0x55b5ac516490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f776c06ac70 tx=0x7f776c095f40 comp rx=0 tx=0).stop 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7775fe4640 1 -- 172.21.15.177:0/2791793375 reap_dead start 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 shutdown_connections 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 >> 172.21.15.177:0/2791793375 conn(0x55b5ac507410 msgr2=0x55b5ac504a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.398 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 shutdown_connections 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.392+0000 7f7777ce4800 1 -- 172.21.15.177:0/2791793375 wait complete. 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f764c0367e0 msgr2=0x7f764c038ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f764c0367e0 0x7f764c038ca0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f776800bf50 tx=0x7f776800f000 comp rx=0 tx=0).stop 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 msgr2=0x55b5ac4fe310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 0x55b5ac4fe310 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f776c08dd50 tx=0x7f776c079d40 comp rx=0 tx=0).stop 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 shutdown_connections 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f764c0367e0 0x7f764c038ca0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.399 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/3698147111 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac4fdef0 0x55b5ac4fe310 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 >> 172.21.15.177:0/3698147111 conn(0x55b5ac4f1f90 msgr2=0x55b5ac4f2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 shutdown_connections 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/3698147111 wait complete. 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c082000 msgr2=0x55b5ac4ef530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f776c082000 0x55b5ac4ef530 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac3eac40 msgr2=0x55b5ac4e70f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.400 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x55b5ac3eac40 0x55b5ac4e70f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac4e9410 msgr2=0x55b5ac4eb8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x55b5ac4e9410 0x55b5ac4eb8a0 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f765c036790 msgr2=0x7f765c038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f765c036790 0x7f765c038c50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7768000f60 tx=0x7f77680012b0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 msgr2=0x55b5ac4e1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 --2- 172.21.15.177:0/658071581 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x55b5ac3e99e0 0x55b5ac4e1300 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f776c00a470 tx=0x7f776c002fb0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7775fe4640 1 -- 172.21.15.177:0/658071581 reap_dead start 2024-03-20T13:36:31.401 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 shutdown_connections 2024-03-20T13:36:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 >> 172.21.15.177:0/658071581 conn(0x55b5ac3e5040 msgr2=0x55b5ac4d3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 shutdown_connections 2024-03-20T13:36:31.402 INFO:teuthology.orchestra.run.smithi177.stderr:2024-03-20T13:36:31.393+0000 7f7777ce4800 1 -- 172.21.15.177:0/658071581 wait complete. 2024-03-20T13:36:31.403 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-20T13:36:31.413 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-20T13:36:31.413 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0c286640 1 Processor -- start 2024-03-20T13:36:31.518 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0c286640 1 -- start start 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0c286640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fba04094ec0 0x7fba0412f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0c286640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba04095990 con 0x7fba040943d0 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0c286640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba04095ef0 con 0x7fba04094ec0 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0a022640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fba040943d0 0x7fba040947b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42924/0 (socket says 172.21.15.28:42924) 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba09821640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fba04094ec0 0x7fba0412f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.517+0000 7fba0a022640 1 -- 172.21.15.28:0/1052593364 learned_addr learned my addr 172.21.15.28:0/1052593364 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09821640 1 -- 172.21.15.28:0/1052593364 >> v1:172.21.15.28:6789/0 conn(0x7fba040943d0 legacy=0x7fba040947b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.520 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09020640 1 -- 172.21.15.28:0/1052593364 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080555333 0 0) 0x7fba04095990 con 0x7fba040943d0 2024-03-20T13:36:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09821640 1 -- 172.21.15.28:0/1052593364 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0406c400 con 0x7fba04094ec0 2024-03-20T13:36:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09821640 1 --2- 172.21.15.28:0/1052593364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba04094ec0 0x7fba0412f5c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009720 tx=0x7fb9f402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a6f440a94041f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09020640 1 -- 172.21.15.28:0/1052593364 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f402e070 con 0x7fba04094ec0 2024-03-20T13:36:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09020640 1 -- 172.21.15.28:0/1052593364 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f40316d0 con 0x7fba04094ec0 2024-03-20T13:36:31.521 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.518+0000 7fba09020640 1 -- 172.21.15.28:0/1052593364 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb9f4031990 con 0x7fba04094ec0 2024-03-20T13:36:31.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 -- 172.21.15.28:0/1052593364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba04094ec0 msgr2=0x7fba0412f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.524 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 --2- 172.21.15.28:0/1052593364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba04094ec0 0x7fba0412f5c0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009720 tx=0x7fb9f402b840 comp rx=0 tx=0).stop 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 -- 172.21.15.28:0/1052593364 shutdown_connections 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 --2- 172.21.15.28:0/1052593364 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba04094ec0 0x7fba0412f5c0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 -- 172.21.15.28:0/1052593364 >> 172.21.15.28:0/1052593364 conn(0x7fba0409a300 msgr2=0x7fba0409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 -- 172.21.15.28:0/1052593364 shutdown_connections 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.519+0000 7fba0c286640 1 -- 172.21.15.28:0/1052593364 wait complete. 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0c286640 1 Processor -- start 2024-03-20T13:36:31.525 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0c286640 1 -- start start 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0c286640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 0x7fba041c24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0c286640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba04127ad0 con 0x7fba040943d0 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0a022640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 0x7fba041c24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0a022640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 0x7fba041c24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48914/0 (socket says 172.21.15.28:48914) 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.520+0000 7fba0a022640 1 -- 172.21.15.28:0/425031104 learned_addr learned my addr 172.21.15.28:0/425031104 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fba0a022640 1 -- 172.21.15.28:0/425031104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4009400 con 0x7fba040943d0 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fba0a022640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 0x7fba041c24f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c420 tx=0x7fba0000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.526 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba000074d0 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00007630 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0412ce70 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fba00004950 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.521+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba04128b20 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.522+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fba00004b70 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.522+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba040627b0 con 0x7fba040943d0 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.522+0000 7fb9faffd640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9e8037ea0 0x7fb9e803a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.522+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fba0004a9e0 con 0x7fba040943d0 2024-03-20T13:36:31.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.522+0000 7fba09821640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9e8037ea0 0x7fb9e803a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.523+0000 7fba09821640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9e8037ea0 0x7fb9e803a360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009720 tx=0x7fb9f4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.527+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fba0001abe0 con 0x7fba040943d0 2024-03-20T13:36:31.706 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.705+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fba040960d0 con 0x7fb9e8037ea0 2024-03-20T13:36:31.723 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.722+0000 7fb9faffd640 1 -- 172.21.15.28:0/425031104 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673678 (secure 0 0 0) 0x7fb9f4031ba0 con 0x7fb9e8037ea0 2024-03-20T13:36:31.731 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:36:31.737 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:36:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9e8037ea0 msgr2=0x7fb9e803a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9e8037ea0 0x7fb9e803a360 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4009720 tx=0x7fb9f4008030 comp rx=0 tx=0).stop 2024-03-20T13:36:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 msgr2=0x7fba041c24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 0x7fba041c24f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fba0000c420 tx=0x7fba0000c8e0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 shutdown_connections 2024-03-20T13:36:31.740 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb9e8037ea0 0x7fb9e803a360 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 --2- 172.21.15.28:0/425031104 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fba040943d0 0x7fba041c24f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 >> 172.21.15.28:0/425031104 conn(0x7fba0409a300 msgr2=0x7fba0412e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 shutdown_connections 2024-03-20T13:36:31.741 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.727+0000 7fba0c286640 1 -- 172.21.15.28:0/425031104 wait complete. 2024-03-20T13:36:31.741 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-03-20T13:36:31.169793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3797,"num_read_kb":3440,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":281,"num_read_kb":273,"num_write":79,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988720+0000","last_change":"2024-03-20T13:34:49.945378+0000","last_active":"2024-03-20T13:35:30.988720+0000","last_peered":"2024-03-20T13:35:30.988720+0000","last_clean":"2024-03-20T13:35:30.988720+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:35:30.988720+0000","last_undegraded":"2024-03-20T13:35:30.988720+0000","last_fullsized":"2024-03-20T13:35:30.988720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925322+0000","last_change":"2024-03-20T13:34:51.948629+0000","last_active":"2024-03-20T13:35:35.925322+0000","last_peered":"2024-03-20T13:35:35.925322+0000","last_clean":"2024-03-20T13:35:35.925322+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:35:35.925322+0000","last_undegraded":"2024-03-20T13:35:35.925322+0000","last_fullsized":"2024-03-20T13:35:35.925322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984600+0000","last_change":"2024-03-20T13:34:49.933462+0000","last_active":"2024-03-20T13:35:30.984600+0000","last_peered":"2024-03-20T13:35:30.984600+0000","last_clean":"2024-03-20T13:35:30.984600+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:35:30.984600+0000","last_undegraded":"2024-03-20T13:35:30.984600+0000","last_fullsized":"2024-03-20T13:35:30.984600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:34.991691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568207+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.568207+0000","last_peered":"2024-03-20T13:36:23.568207+0000","last_clean":"2024-03-20T13:36:23.568207+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.568207+0000","last_undegraded":"2024-03-20T13:36:23.568207+0000","last_fullsized":"2024-03-20T13:36:23.568207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:53.377689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.796505+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:35:34.796505+0000","last_peered":"2024-03-20T13:35:34.796505+0000","last_clean":"2024-03-20T13:35:34.796505+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:35:34.796505+0000","last_undegraded":"2024-03-20T13:35:34.796505+0000","last_fullsized":"2024-03-20T13:35:34.796505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:36.437918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986674+0000","last_change":"2024-03-20T13:34:51.947769+0000","last_active":"2024-03-20T13:35:30.986674+0000","last_peered":"2024-03-20T13:35:30.986674+0000","last_clean":"2024-03-20T13:35:30.986674+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:35:30.986674+0000","last_undegraded":"2024-03-20T13:35:30.986674+0000","last_fullsized":"2024-03-20T13:35:30.986674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:10.763673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.407859+0000","last_change":"2024-03-20T13:34:49.952708+0000","last_active":"2024-03-20T13:35:35.407859+0000","last_peered":"2024-03-20T13:35:35.407859+0000","last_clean":"2024-03-20T13:35:35.407859+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:35:35.407859+0000","last_undegraded":"2024-03-20T13:35:35.407859+0000","last_fullsized":"2024-03-20T13:35:35.407859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309640+0000","last_change":"2024-03-20T13:35:30.996431+0000","last_active":"2024-03-20T13:36:17.309640+0000","last_peered":"2024-03-20T13:36:17.309640+0000","last_clean":"2024-03-20T13:36:17.309640+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:36:17.309640+0000","last_undegraded":"2024-03-20T13:36:17.309640+0000","last_fullsized":"2024-03-20T13:36:17.309640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:29.110394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987551+0000","last_change":"2024-03-20T13:34:49.959192+0000","last_active":"2024-03-20T13:35:30.987551+0000","last_peered":"2024-03-20T13:35:30.987551+0000","last_clean":"2024-03-20T13:35:30.987551+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:35:30.987551+0000","last_undegraded":"2024-03-20T13:35:30.987551+0000","last_fullsized":"2024-03-20T13:35:30.987551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:53.061218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309603+0000","last_change":"2024-03-20T13:34:51.946953+0000","last_active":"2024-03-20T13:36:17.309603+0000","last_peered":"2024-03-20T13:36:17.309603+0000","last_clean":"2024-03-20T13:36:17.309603+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:36:17.309603+0000","last_undegraded":"2024-03-20T13:36:17.309603+0000","last_fullsized":"2024-03-20T13:36:17.309603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985613+0000","last_change":"2024-03-20T13:34:49.954949+0000","last_active":"2024-03-20T13:35:30.985613+0000","last_peered":"2024-03-20T13:35:30.985613+0000","last_clean":"2024-03-20T13:35:30.985613+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:35:30.985613+0000","last_undegraded":"2024-03-20T13:35:30.985613+0000","last_fullsized":"2024-03-20T13:35:30.985613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988705+0000","last_change":"2024-03-20T13:34:51.952540+0000","last_active":"2024-03-20T13:35:30.988705+0000","last_peered":"2024-03-20T13:35:30.988705+0000","last_clean":"2024-03-20T13:35:30.988705+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:35:30.988705+0000","last_undegraded":"2024-03-20T13:35:30.988705+0000","last_fullsized":"2024-03-20T13:35:30.988705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:28.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986108+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:35:30.986108+0000","last_peered":"2024-03-20T13:35:30.986108+0000","last_clean":"2024-03-20T13:35:30.986108+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:35:30.986108+0000","last_undegraded":"2024-03-20T13:35:30.986108+0000","last_fullsized":"2024-03-20T13:35:30.986108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:09:20.487446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568527+0000","last_change":"2024-03-20T13:34:51.948321+0000","last_active":"2024-03-20T13:36:23.568527+0000","last_peered":"2024-03-20T13:36:23.568527+0000","last_clean":"2024-03-20T13:36:23.568527+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:23.568527+0000","last_undegraded":"2024-03-20T13:36:23.568527+0000","last_fullsized":"2024-03-20T13:36:23.568527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982427+0000","last_change":"2024-03-20T13:34:49.940856+0000","last_active":"2024-03-20T13:35:30.982427+0000","last_peered":"2024-03-20T13:35:30.982427+0000","last_clean":"2024-03-20T13:35:30.982427+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:35:30.982427+0000","last_undegraded":"2024-03-20T13:35:30.982427+0000","last_fullsized":"2024-03-20T13:35:30.982427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309552+0000","last_change":"2024-03-20T13:34:51.945268+0000","last_active":"2024-03-20T13:36:17.309552+0000","last_peered":"2024-03-20T13:36:17.309552+0000","last_clean":"2024-03-20T13:36:17.309552+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:36:17.309552+0000","last_undegraded":"2024-03-20T13:36:17.309552+0000","last_fullsized":"2024-03-20T13:36:17.309552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969415+0000","last_change":"2024-03-20T13:34:51.949454+0000","last_active":"2024-03-20T13:36:17.969415+0000","last_peered":"2024-03-20T13:36:17.969415+0000","last_clean":"2024-03-20T13:36:17.969415+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:36:17.969415+0000","last_undegraded":"2024-03-20T13:36:17.969415+0000","last_fullsized":"2024-03-20T13:36:17.969415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:22.583858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983023+0000","last_change":"2024-03-20T13:34:49.945284+0000","last_active":"2024-03-20T13:35:30.983023+0000","last_peered":"2024-03-20T13:35:30.983023+0000","last_clean":"2024-03-20T13:35:30.983023+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:35:30.983023+0000","last_undegraded":"2024-03-20T13:35:30.983023+0000","last_fullsized":"2024-03-20T13:35:30.983023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568361+0000","last_change":"2024-03-20T13:34:51.948725+0000","last_active":"2024-03-20T13:36:23.568361+0000","last_peered":"2024-03-20T13:36:23.568361+0000","last_clean":"2024-03-20T13:36:23.568361+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:23.568361+0000","last_undegraded":"2024-03-20T13:36:23.568361+0000","last_fullsized":"2024-03-20T13:36:23.568361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990655+0000","last_change":"2024-03-20T13:34:49.950644+0000","last_active":"2024-03-20T13:35:30.990655+0000","last_peered":"2024-03-20T13:35:30.990655+0000","last_clean":"2024-03-20T13:35:30.990655+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:35:30.990655+0000","last_undegraded":"2024-03-20T13:35:30.990655+0000","last_fullsized":"2024-03-20T13:35:30.990655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.165007+0000","last_change":"2024-03-20T13:34:51.947958+0000","last_active":"2024-03-20T13:35:35.165007+0000","last_peered":"2024-03-20T13:35:35.165007+0000","last_clean":"2024-03-20T13:35:35.165007+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:35:35.165007+0000","last_undegraded":"2024-03-20T13:35:35.165007+0000","last_fullsized":"2024-03-20T13:35:35.165007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:26.305545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.410831+0000","last_change":"2024-03-20T13:34:49.946510+0000","last_active":"2024-03-20T13:35:35.410831+0000","last_peered":"2024-03-20T13:35:35.410831+0000","last_clean":"2024-03-20T13:35:35.410831+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:35:35.410831+0000","last_undegraded":"2024-03-20T13:35:35.410831+0000","last_fullsized":"2024-03-20T13:35:35.410831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815929+0000","last_change":"2024-03-20T13:34:51.937387+0000","last_active":"2024-03-20T13:35:34.815929+0000","last_peered":"2024-03-20T13:35:34.815929+0000","last_clean":"2024-03-20T13:35:34.815929+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:35:34.815929+0000","last_undegraded":"2024-03-20T13:35:34.815929+0000","last_fullsized":"2024-03-20T13:35:34.815929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982385+0000","last_change":"2024-03-20T13:34:49.949930+0000","last_active":"2024-03-20T13:35:30.982385+0000","last_peered":"2024-03-20T13:35:30.982385+0000","last_clean":"2024-03-20T13:35:30.982385+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:35:30.982385+0000","last_undegraded":"2024-03-20T13:35:30.982385+0000","last_fullsized":"2024-03-20T13:35:30.982385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976899+0000","last_change":"2024-03-20T13:34:51.941800+0000","last_active":"2024-03-20T13:36:17.976899+0000","last_peered":"2024-03-20T13:36:17.976899+0000","last_clean":"2024-03-20T13:36:17.976899+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:36:17.976899+0000","last_undegraded":"2024-03-20T13:36:17.976899+0000","last_fullsized":"2024-03-20T13:36:17.976899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984331+0000","last_change":"2024-03-20T13:34:49.934846+0000","last_active":"2024-03-20T13:35:30.984331+0000","last_peered":"2024-03-20T13:35:30.984331+0000","last_clean":"2024-03-20T13:35:30.984331+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:35:30.984331+0000","last_undegraded":"2024-03-20T13:35:30.984331+0000","last_fullsized":"2024-03-20T13:35:30.984331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309570+0000","last_change":"2024-03-20T13:34:51.948384+0000","last_active":"2024-03-20T13:36:17.309570+0000","last_peered":"2024-03-20T13:36:17.309570+0000","last_clean":"2024-03-20T13:36:17.309570+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:36:17.309570+0000","last_undegraded":"2024-03-20T13:36:17.309570+0000","last_fullsized":"2024-03-20T13:36:17.309570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:39.648807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986253+0000","last_change":"2024-03-20T13:34:49.959590+0000","last_active":"2024-03-20T13:35:30.986253+0000","last_peered":"2024-03-20T13:35:30.986253+0000","last_clean":"2024-03-20T13:35:30.986253+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:35:30.986253+0000","last_undegraded":"2024-03-20T13:35:30.986253+0000","last_fullsized":"2024-03-20T13:35:30.986253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:00.815146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559090+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:23.559090+0000","last_peered":"2024-03-20T13:36:23.559090+0000","last_clean":"2024-03-20T13:36:23.559090+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:23.559090+0000","last_undegraded":"2024-03-20T13:36:23.559090+0000","last_fullsized":"2024-03-20T13:36:23.559090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:37.139674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.994987+0000","last_change":"2024-03-20T13:35:30.994560+0000","last_active":"2024-03-20T13:35:30.994987+0000","last_peered":"2024-03-20T13:35:30.994987+0000","last_clean":"2024-03-20T13:35:30.994987+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:35:30.994987+0000","last_undegraded":"2024-03-20T13:35:30.994987+0000","last_fullsized":"2024-03-20T13:35:30.994987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:54.906208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987284+0000","last_change":"2024-03-20T13:34:49.959439+0000","last_active":"2024-03-20T13:35:30.987284+0000","last_peered":"2024-03-20T13:35:30.987284+0000","last_clean":"2024-03-20T13:35:30.987284+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:35:30.987284+0000","last_undegraded":"2024-03-20T13:35:30.987284+0000","last_fullsized":"2024-03-20T13:35:30.987284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:00.516394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988549+0000","last_change":"2024-03-20T13:34:53.942393+0000","last_active":"2024-03-20T13:35:30.988549+0000","last_peered":"2024-03-20T13:35:30.988549+0000","last_clean":"2024-03-20T13:35:30.988549+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:35:30.988549+0000","last_undegraded":"2024-03-20T13:35:30.988549+0000","last_fullsized":"2024-03-20T13:35:30.988549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:23.709018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.940990+0000","last_change":"2024-03-20T13:34:55.955194+0000","last_active":"2024-03-20T13:36:17.940990+0000","last_peered":"2024-03-20T13:36:17.940990+0000","last_clean":"2024-03-20T13:36:17.940990+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:36:17.940990+0000","last_undegraded":"2024-03-20T13:36:17.940990+0000","last_fullsized":"2024-03-20T13:36:17.940990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:57.391498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982874+0000","last_change":"2024-03-20T13:34:57.964242+0000","last_active":"2024-03-20T13:35:30.982874+0000","last_peered":"2024-03-20T13:35:30.982874+0000","last_clean":"2024-03-20T13:35:30.982874+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:35:30.982874+0000","last_undegraded":"2024-03-20T13:35:30.982874+0000","last_fullsized":"2024-03-20T13:35:30.982874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.266272+0000","last_change":"2024-03-20T13:34:59.969467+0000","last_active":"2024-03-20T13:36:12.266272+0000","last_peered":"2024-03-20T13:36:12.266272+0000","last_clean":"2024-03-20T13:36:12.266272+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:36:12.266272+0000","last_undegraded":"2024-03-20T13:36:12.266272+0000","last_fullsized":"2024-03-20T13:36:12.266272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:06:17.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309566+0000","last_change":"2024-03-20T13:34:51.943450+0000","last_active":"2024-03-20T13:36:17.309566+0000","last_peered":"2024-03-20T13:36:17.309566+0000","last_clean":"2024-03-20T13:36:17.309566+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:36:17.309566+0000","last_undegraded":"2024-03-20T13:36:17.309566+0000","last_fullsized":"2024-03-20T13:36:17.309566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:12:33.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985408+0000","last_change":"2024-03-20T13:34:49.955248+0000","last_active":"2024-03-20T13:35:30.985408+0000","last_peered":"2024-03-20T13:35:30.985408+0000","last_clean":"2024-03-20T13:35:30.985408+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:35:30.985408+0000","last_undegraded":"2024-03-20T13:35:30.985408+0000","last_fullsized":"2024-03-20T13:35:30.985408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983126+0000","last_change":"2024-03-20T13:34:53.944586+0000","last_active":"2024-03-20T13:35:30.983126+0000","last_peered":"2024-03-20T13:35:30.983126+0000","last_clean":"2024-03-20T13:35:30.983126+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:35:30.983126+0000","last_undegraded":"2024-03-20T13:35:30.983126+0000","last_fullsized":"2024-03-20T13:35:30.983126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:55.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981904+0000","last_change":"2024-03-20T13:34:55.953888+0000","last_active":"2024-03-20T13:35:30.981904+0000","last_peered":"2024-03-20T13:35:30.981904+0000","last_clean":"2024-03-20T13:35:30.981904+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:35:30.981904+0000","last_undegraded":"2024-03-20T13:35:30.981904+0000","last_fullsized":"2024-03-20T13:35:30.981904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:49:02.706193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981211+0000","last_change":"2024-03-20T13:34:57.966274+0000","last_active":"2024-03-20T13:35:30.981211+0000","last_peered":"2024-03-20T13:35:30.981211+0000","last_clean":"2024-03-20T13:35:30.981211+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:35:30.981211+0000","last_undegraded":"2024-03-20T13:35:30.981211+0000","last_fullsized":"2024-03-20T13:35:30.981211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.957308+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:17.957308+0000","last_peered":"2024-03-20T13:36:17.957308+0000","last_clean":"2024-03-20T13:36:17.957308+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:17.957308+0000","last_undegraded":"2024-03-20T13:36:17.957308+0000","last_fullsized":"2024-03-20T13:36:17.957308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969171+0000","last_change":"2024-03-20T13:34:51.940751+0000","last_active":"2024-03-20T13:36:17.969171+0000","last_peered":"2024-03-20T13:36:17.969171+0000","last_clean":"2024-03-20T13:36:17.969171+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:36:17.969171+0000","last_undegraded":"2024-03-20T13:36:17.969171+0000","last_fullsized":"2024-03-20T13:36:17.969171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:12.037950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985656+0000","last_change":"2024-03-20T13:34:49.959865+0000","last_active":"2024-03-20T13:35:30.985656+0000","last_peered":"2024-03-20T13:35:30.985656+0000","last_clean":"2024-03-20T13:35:30.985656+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:35:30.985656+0000","last_undegraded":"2024-03-20T13:35:30.985656+0000","last_fullsized":"2024-03-20T13:35:30.985656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:21.968097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985039+0000","last_change":"2024-03-20T13:34:53.944429+0000","last_active":"2024-03-20T13:35:30.985039+0000","last_peered":"2024-03-20T13:35:30.985039+0000","last_clean":"2024-03-20T13:35:30.985039+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:35:30.985039+0000","last_undegraded":"2024-03-20T13:35:30.985039+0000","last_fullsized":"2024-03-20T13:35:30.985039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:58.423104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986686+0000","last_change":"2024-03-20T13:34:55.951242+0000","last_active":"2024-03-20T13:35:30.986686+0000","last_peered":"2024-03-20T13:35:30.986686+0000","last_clean":"2024-03-20T13:35:30.986686+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:35:30.986686+0000","last_undegraded":"2024-03-20T13:35:30.986686+0000","last_fullsized":"2024-03-20T13:35:30.986686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:19.540711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002439+0000","last_change":"2024-03-20T13:34:57.969943+0000","last_active":"2024-03-20T13:36:24.002439+0000","last_peered":"2024-03-20T13:36:24.002439+0000","last_clean":"2024-03-20T13:36:24.002439+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:36:24.002439+0000","last_undegraded":"2024-03-20T13:36:24.002439+0000","last_fullsized":"2024-03-20T13:36:24.002439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:23.726307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985453+0000","last_change":"2024-03-20T13:34:59.971383+0000","last_active":"2024-03-20T13:35:30.985453+0000","last_peered":"2024-03-20T13:35:30.985453+0000","last_clean":"2024-03-20T13:35:30.985453+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:35:30.985453+0000","last_undegraded":"2024-03-20T13:35:30.985453+0000","last_fullsized":"2024-03-20T13:35:30.985453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:10.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.813600+0000","last_change":"2024-03-20T13:34:51.947848+0000","last_active":"2024-03-20T13:35:34.813600+0000","last_peered":"2024-03-20T13:35:34.813600+0000","last_clean":"2024-03-20T13:35:34.813600+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:35:34.813600+0000","last_undegraded":"2024-03-20T13:35:34.813600+0000","last_fullsized":"2024-03-20T13:35:34.813600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980679+0000","last_change":"2024-03-20T13:34:49.943444+0000","last_active":"2024-03-20T13:35:30.980679+0000","last_peered":"2024-03-20T13:35:30.980679+0000","last_clean":"2024-03-20T13:35:30.980679+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:35:30.980679+0000","last_undegraded":"2024-03-20T13:35:30.980679+0000","last_fullsized":"2024-03-20T13:35:30.980679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989445+0000","last_change":"2024-03-20T13:34:53.939852+0000","last_active":"2024-03-20T13:35:30.989445+0000","last_peered":"2024-03-20T13:35:30.989445+0000","last_clean":"2024-03-20T13:35:30.989445+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:35:30.989445+0000","last_undegraded":"2024-03-20T13:35:30.989445+0000","last_fullsized":"2024-03-20T13:35:30.989445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:56.912941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.935322+0000","last_change":"2024-03-20T13:34:55.957753+0000","last_active":"2024-03-20T13:36:17.935322+0000","last_peered":"2024-03-20T13:36:17.935322+0000","last_clean":"2024-03-20T13:36:17.935322+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:17.935322+0000","last_undegraded":"2024-03-20T13:36:17.935322+0000","last_fullsized":"2024-03-20T13:36:17.935322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:14.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":336,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002289+0000","last_change":"2024-03-20T13:34:57.968163+0000","last_active":"2024-03-20T13:36:24.002289+0000","last_peered":"2024-03-20T13:36:24.002289+0000","last_clean":"2024-03-20T13:36:24.002289+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:24.002289+0000","last_undegraded":"2024-03-20T13:36:24.002289+0000","last_fullsized":"2024-03-20T13:36:24.002289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:49.987254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969225+0000","last_change":"2024-03-20T13:34:51.953602+0000","last_active":"2024-03-20T13:36:17.969225+0000","last_peered":"2024-03-20T13:36:17.969225+0000","last_clean":"2024-03-20T13:36:17.969225+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:36:17.969225+0000","last_undegraded":"2024-03-20T13:36:17.969225+0000","last_fullsized":"2024-03-20T13:36:17.969225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:54.019802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988845+0000","last_change":"2024-03-20T13:34:49.944500+0000","last_active":"2024-03-20T13:35:30.988845+0000","last_peered":"2024-03-20T13:35:30.988845+0000","last_clean":"2024-03-20T13:35:30.988845+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:35:30.988845+0000","last_undegraded":"2024-03-20T13:35:30.988845+0000","last_fullsized":"2024-03-20T13:35:30.988845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980677+0000","last_change":"2024-03-20T13:34:53.945355+0000","last_active":"2024-03-20T13:35:30.980677+0000","last_peered":"2024-03-20T13:35:30.980677+0000","last_clean":"2024-03-20T13:35:30.980677+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:35:30.980677+0000","last_undegraded":"2024-03-20T13:35:30.980677+0000","last_fullsized":"2024-03-20T13:35:30.980677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.945229+0000","last_change":"2024-03-20T13:34:55.952069+0000","last_active":"2024-03-20T13:36:17.945229+0000","last_peered":"2024-03-20T13:36:17.945229+0000","last_clean":"2024-03-20T13:36:17.945229+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:17.945229+0000","last_undegraded":"2024-03-20T13:36:17.945229+0000","last_fullsized":"2024-03-20T13:36:17.945229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:43.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983837+0000","last_change":"2024-03-20T13:34:57.967957+0000","last_active":"2024-03-20T13:35:30.983837+0000","last_peered":"2024-03-20T13:35:30.983837+0000","last_clean":"2024-03-20T13:35:30.983837+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:35:30.983837+0000","last_undegraded":"2024-03-20T13:35:30.983837+0000","last_fullsized":"2024-03-20T13:35:30.983837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:03:03.819479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.754329+0000","last_change":"2024-03-20T13:34:59.974067+0000","last_active":"2024-03-20T13:36:17.754329+0000","last_peered":"2024-03-20T13:36:17.754329+0000","last_clean":"2024-03-20T13:36:17.754329+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:36:17.754329+0000","last_undegraded":"2024-03-20T13:36:17.754329+0000","last_fullsized":"2024-03-20T13:36:17.754329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:57.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164674+0000","last_change":"2024-03-20T13:34:51.941910+0000","last_active":"2024-03-20T13:35:35.164674+0000","last_peered":"2024-03-20T13:35:35.164674+0000","last_clean":"2024-03-20T13:35:35.164674+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:35:35.164674+0000","last_undegraded":"2024-03-20T13:35:35.164674+0000","last_fullsized":"2024-03-20T13:35:35.164674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.418375+0000","last_change":"2024-03-20T13:34:49.939109+0000","last_active":"2024-03-20T13:35:35.418375+0000","last_peered":"2024-03-20T13:35:35.418375+0000","last_clean":"2024-03-20T13:35:35.418375+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:35:35.418375+0000","last_undegraded":"2024-03-20T13:35:35.418375+0000","last_fullsized":"2024-03-20T13:35:35.418375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982623+0000","last_change":"2024-03-20T13:34:53.943905+0000","last_active":"2024-03-20T13:35:30.982623+0000","last_peered":"2024-03-20T13:35:30.982623+0000","last_clean":"2024-03-20T13:35:30.982623+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:35:30.982623+0000","last_undegraded":"2024-03-20T13:35:30.982623+0000","last_fullsized":"2024-03-20T13:35:30.982623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:30:51.851311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.527633+0000","last_change":"2024-03-20T13:34:55.954351+0000","last_active":"2024-03-20T13:36:23.527633+0000","last_peered":"2024-03-20T13:36:23.527633+0000","last_clean":"2024-03-20T13:36:23.527633+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:23.527633+0000","last_undegraded":"2024-03-20T13:36:23.527633+0000","last_fullsized":"2024-03-20T13:36:23.527633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:27:04.344480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982540+0000","last_change":"2024-03-20T13:34:57.962956+0000","last_active":"2024-03-20T13:35:30.982540+0000","last_peered":"2024-03-20T13:35:30.982540+0000","last_clean":"2024-03-20T13:35:30.982540+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:35:30.982540+0000","last_undegraded":"2024-03-20T13:35:30.982540+0000","last_fullsized":"2024-03-20T13:35:30.982540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.151593+0000","last_change":"2024-03-20T13:34:59.972444+0000","last_active":"2024-03-20T13:36:12.151593+0000","last_peered":"2024-03-20T13:36:12.151593+0000","last_clean":"2024-03-20T13:36:12.151593+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:36:12.151593+0000","last_undegraded":"2024-03-20T13:36:12.151593+0000","last_fullsized":"2024-03-20T13:36:12.151593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309560+0000","last_change":"2024-03-20T13:34:51.941838+0000","last_active":"2024-03-20T13:36:17.309560+0000","last_peered":"2024-03-20T13:36:17.309560+0000","last_clean":"2024-03-20T13:36:17.309560+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:36:17.309560+0000","last_undegraded":"2024-03-20T13:36:17.309560+0000","last_fullsized":"2024-03-20T13:36:17.309560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:08.971370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990186+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:35:30.990186+0000","last_peered":"2024-03-20T13:35:30.990186+0000","last_clean":"2024-03-20T13:35:30.990186+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:35:30.990186+0000","last_undegraded":"2024-03-20T13:35:30.990186+0000","last_fullsized":"2024-03-20T13:35:30.990186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:10.797692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984920+0000","last_change":"2024-03-20T13:34:53.942038+0000","last_active":"2024-03-20T13:35:30.984920+0000","last_peered":"2024-03-20T13:35:30.984920+0000","last_clean":"2024-03-20T13:35:30.984920+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:35:30.984920+0000","last_undegraded":"2024-03-20T13:35:30.984920+0000","last_fullsized":"2024-03-20T13:35:30.984920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:28.393295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.947391+0000","last_change":"2024-03-20T13:34:55.954800+0000","last_active":"2024-03-20T13:36:17.947391+0000","last_peered":"2024-03-20T13:36:17.947391+0000","last_clean":"2024-03-20T13:36:17.947391+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:17.947391+0000","last_undegraded":"2024-03-20T13:36:17.947391+0000","last_fullsized":"2024-03-20T13:36:17.947391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:36:42.942474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002273+0000","last_change":"2024-03-20T13:34:57.969445+0000","last_active":"2024-03-20T13:36:24.002273+0000","last_peered":"2024-03-20T13:36:24.002273+0000","last_clean":"2024-03-20T13:36:24.002273+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:24.002273+0000","last_undegraded":"2024-03-20T13:36:24.002273+0000","last_fullsized":"2024-03-20T13:36:24.002273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983928+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:35:30.983928+0000","last_peered":"2024-03-20T13:35:30.983928+0000","last_clean":"2024-03-20T13:35:30.983928+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:35:30.983928+0000","last_undegraded":"2024-03-20T13:35:30.983928+0000","last_fullsized":"2024-03-20T13:35:30.983928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:24:13.286967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986688+0000","last_change":"2024-03-20T13:34:51.935109+0000","last_active":"2024-03-20T13:35:30.986688+0000","last_peered":"2024-03-20T13:35:30.986688+0000","last_clean":"2024-03-20T13:35:30.986688+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:35:30.986688+0000","last_undegraded":"2024-03-20T13:35:30.986688+0000","last_fullsized":"2024-03-20T13:35:30.986688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988096+0000","last_change":"2024-03-20T13:34:49.962872+0000","last_active":"2024-03-20T13:35:30.988096+0000","last_peered":"2024-03-20T13:35:30.988096+0000","last_clean":"2024-03-20T13:35:30.988096+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:35:30.988096+0000","last_undegraded":"2024-03-20T13:35:30.988096+0000","last_fullsized":"2024-03-20T13:35:30.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:07.620568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982955+0000","last_change":"2024-03-20T13:34:53.943850+0000","last_active":"2024-03-20T13:35:30.982955+0000","last_peered":"2024-03-20T13:35:30.982955+0000","last_clean":"2024-03-20T13:35:30.982955+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:35:30.982955+0000","last_undegraded":"2024-03-20T13:35:30.982955+0000","last_fullsized":"2024-03-20T13:35:30.982955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:11.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.530542+0000","last_change":"2024-03-20T13:34:55.951028+0000","last_active":"2024-03-20T13:36:23.530542+0000","last_peered":"2024-03-20T13:36:23.530542+0000","last_clean":"2024-03-20T13:36:23.530542+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:23.530542+0000","last_undegraded":"2024-03-20T13:36:23.530542+0000","last_fullsized":"2024-03-20T13:36:23.530542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:57.615475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982468+0000","last_change":"2024-03-20T13:34:57.962288+0000","last_active":"2024-03-20T13:35:30.982468+0000","last_peered":"2024-03-20T13:35:30.982468+0000","last_clean":"2024-03-20T13:35:30.982468+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:35:30.982468+0000","last_undegraded":"2024-03-20T13:35:30.982468+0000","last_fullsized":"2024-03-20T13:35:30.982468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985030+0000","last_change":"2024-03-20T13:34:59.966660+0000","last_active":"2024-03-20T13:35:30.985030+0000","last_peered":"2024-03-20T13:35:30.985030+0000","last_clean":"2024-03-20T13:35:30.985030+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:35:30.985030+0000","last_undegraded":"2024-03-20T13:35:30.985030+0000","last_fullsized":"2024-03-20T13:35:30.985030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:19.864210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.812450+0000","last_change":"2024-03-20T13:34:51.943562+0000","last_active":"2024-03-20T13:35:34.812450+0000","last_peered":"2024-03-20T13:35:34.812450+0000","last_clean":"2024-03-20T13:35:34.812450+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:35:34.812450+0000","last_undegraded":"2024-03-20T13:35:34.812450+0000","last_fullsized":"2024-03-20T13:35:34.812450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983744+0000","last_change":"2024-03-20T13:34:49.933792+0000","last_active":"2024-03-20T13:35:30.983744+0000","last_peered":"2024-03-20T13:35:30.983744+0000","last_clean":"2024-03-20T13:35:30.983744+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:35:30.983744+0000","last_undegraded":"2024-03-20T13:35:30.983744+0000","last_fullsized":"2024-03-20T13:35:30.983744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.581973+0000","last_change":"2024-03-20T13:34:53.944673+0000","last_active":"2024-03-20T13:36:24.581973+0000","last_peered":"2024-03-20T13:36:24.581973+0000","last_clean":"2024-03-20T13:36:24.581973+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:24.581973+0000","last_undegraded":"2024-03-20T13:36:24.581973+0000","last_fullsized":"2024-03-20T13:36:24.581973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:36.699424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.929174+0000","last_change":"2024-03-20T13:34:55.952299+0000","last_active":"2024-03-20T13:36:17.929174+0000","last_peered":"2024-03-20T13:36:17.929174+0000","last_clean":"2024-03-20T13:36:17.929174+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:17.929174+0000","last_undegraded":"2024-03-20T13:36:17.929174+0000","last_fullsized":"2024-03-20T13:36:17.929174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:26:51.439053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989229+0000","last_change":"2024-03-20T13:34:57.962715+0000","last_active":"2024-03-20T13:35:30.989229+0000","last_peered":"2024-03-20T13:35:30.989229+0000","last_clean":"2024-03-20T13:35:30.989229+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:35:30.989229+0000","last_undegraded":"2024-03-20T13:35:30.989229+0000","last_fullsized":"2024-03-20T13:35:30.989229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:03.988490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.263192+0000","last_change":"2024-03-20T13:34:59.971713+0000","last_active":"2024-03-20T13:36:12.263192+0000","last_peered":"2024-03-20T13:36:12.263192+0000","last_clean":"2024-03-20T13:36:12.263192+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:36:12.263192+0000","last_undegraded":"2024-03-20T13:36:12.263192+0000","last_fullsized":"2024-03-20T13:36:12.263192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:17.405294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969186+0000","last_change":"2024-03-20T13:35:30.988681+0000","last_active":"2024-03-20T13:36:17.969186+0000","last_peered":"2024-03-20T13:36:17.969186+0000","last_clean":"2024-03-20T13:36:17.969186+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:36:17.969186+0000","last_undegraded":"2024-03-20T13:36:17.969186+0000","last_fullsized":"2024-03-20T13:36:17.969186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:48.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986833+0000","last_change":"2024-03-20T13:34:49.958288+0000","last_active":"2024-03-20T13:35:30.986833+0000","last_peered":"2024-03-20T13:35:30.986833+0000","last_clean":"2024-03-20T13:35:30.986833+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:35:30.986833+0000","last_undegraded":"2024-03-20T13:35:30.986833+0000","last_fullsized":"2024-03-20T13:35:30.986833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:55.228134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983298+0000","last_change":"2024-03-20T13:34:53.943738+0000","last_active":"2024-03-20T13:35:30.983298+0000","last_peered":"2024-03-20T13:35:30.983298+0000","last_clean":"2024-03-20T13:35:30.983298+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:35:30.983298+0000","last_undegraded":"2024-03-20T13:35:30.983298+0000","last_fullsized":"2024-03-20T13:35:30.983298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:23.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.955427+0000","last_change":"2024-03-20T13:34:55.948943+0000","last_active":"2024-03-20T13:36:17.955427+0000","last_peered":"2024-03-20T13:36:17.955427+0000","last_clean":"2024-03-20T13:36:17.955427+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:17.955427+0000","last_undegraded":"2024-03-20T13:36:17.955427+0000","last_fullsized":"2024-03-20T13:36:17.955427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002429+0000","last_change":"2024-03-20T13:34:57.967289+0000","last_active":"2024-03-20T13:36:24.002429+0000","last_peered":"2024-03-20T13:36:24.002429+0000","last_clean":"2024-03-20T13:36:24.002429+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:24.002429+0000","last_undegraded":"2024-03-20T13:36:24.002429+0000","last_fullsized":"2024-03-20T13:36:24.002429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:24.412437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.980936+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:17.980936+0000","last_peered":"2024-03-20T13:36:17.980936+0000","last_clean":"2024-03-20T13:36:17.980936+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:17.980936+0000","last_undegraded":"2024-03-20T13:36:17.980936+0000","last_fullsized":"2024-03-20T13:36:17.980936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989507+0000","last_change":"2024-03-20T13:34:51.942028+0000","last_active":"2024-03-20T13:35:30.989507+0000","last_peered":"2024-03-20T13:35:30.989507+0000","last_clean":"2024-03-20T13:35:30.989507+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:35:30.989507+0000","last_undegraded":"2024-03-20T13:35:30.989507+0000","last_fullsized":"2024-03-20T13:35:30.989507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986721+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:35:30.986721+0000","last_peered":"2024-03-20T13:35:30.986721+0000","last_clean":"2024-03-20T13:35:30.986721+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:35:30.986721+0000","last_undegraded":"2024-03-20T13:35:30.986721+0000","last_fullsized":"2024-03-20T13:35:30.986721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:29.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.581184+0000","last_change":"2024-03-20T13:34:53.942494+0000","last_active":"2024-03-20T13:36:24.581184+0000","last_peered":"2024-03-20T13:36:24.581184+0000","last_clean":"2024-03-20T13:36:24.581184+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:24.581184+0000","last_undegraded":"2024-03-20T13:36:24.581184+0000","last_fullsized":"2024-03-20T13:36:24.581184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:46.477351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989550+0000","last_change":"2024-03-20T13:34:55.953548+0000","last_active":"2024-03-20T13:35:30.989550+0000","last_peered":"2024-03-20T13:35:30.989550+0000","last_clean":"2024-03-20T13:35:30.989550+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:35:30.989550+0000","last_undegraded":"2024-03-20T13:35:30.989550+0000","last_fullsized":"2024-03-20T13:35:30.989550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:54:51.879036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":335,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002383+0000","last_change":"2024-03-20T13:34:57.961142+0000","last_active":"2024-03-20T13:36:24.002383+0000","last_peered":"2024-03-20T13:36:24.002383+0000","last_clean":"2024-03-20T13:36:24.002383+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:24.002383+0000","last_undegraded":"2024-03-20T13:36:24.002383+0000","last_fullsized":"2024-03-20T13:36:24.002383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984851+0000","last_change":"2024-03-20T13:34:59.973435+0000","last_active":"2024-03-20T13:35:30.984851+0000","last_peered":"2024-03-20T13:35:30.984851+0000","last_clean":"2024-03-20T13:35:30.984851+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:35:30.984851+0000","last_undegraded":"2024-03-20T13:35:30.984851+0000","last_fullsized":"2024-03-20T13:35:30.984851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:02.537560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.957248+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984276+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:35:30.984276+0000","last_peered":"2024-03-20T13:35:30.984276+0000","last_clean":"2024-03-20T13:35:30.984276+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:35:30.984276+0000","last_undegraded":"2024-03-20T13:35:30.984276+0000","last_fullsized":"2024-03-20T13:35:30.984276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:13:57.917330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988824+0000","last_change":"2024-03-20T13:34:53.944868+0000","last_active":"2024-03-20T13:35:30.988824+0000","last_peered":"2024-03-20T13:35:30.988824+0000","last_clean":"2024-03-20T13:35:30.988824+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:35:30.988824+0000","last_undegraded":"2024-03-20T13:35:30.988824+0000","last_fullsized":"2024-03-20T13:35:30.988824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.941994+0000","last_change":"2024-03-20T13:34:55.953350+0000","last_active":"2024-03-20T13:36:17.941994+0000","last_peered":"2024-03-20T13:36:17.941994+0000","last_clean":"2024-03-20T13:36:17.941994+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:17.941994+0000","last_undegraded":"2024-03-20T13:36:17.941994+0000","last_fullsized":"2024-03-20T13:36:17.941994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:50.265808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986529+0000","last_change":"2024-03-20T13:34:57.966451+0000","last_active":"2024-03-20T13:35:30.986529+0000","last_peered":"2024-03-20T13:35:30.986529+0000","last_clean":"2024-03-20T13:35:30.986529+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:35:30.986529+0000","last_undegraded":"2024-03-20T13:35:30.986529+0000","last_fullsized":"2024-03-20T13:35:30.986529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:08.191295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981156+0000","last_change":"2024-03-20T13:34:59.968783+0000","last_active":"2024-03-20T13:35:30.981156+0000","last_peered":"2024-03-20T13:35:30.981156+0000","last_clean":"2024-03-20T13:35:30.981156+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:35:30.981156+0000","last_undegraded":"2024-03-20T13:35:30.981156+0000","last_fullsized":"2024-03-20T13:35:30.981156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.660196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990368+0000","last_change":"2024-03-20T13:34:51.954171+0000","last_active":"2024-03-20T13:35:30.990368+0000","last_peered":"2024-03-20T13:35:30.990368+0000","last_clean":"2024-03-20T13:35:30.990368+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:35:30.990368+0000","last_undegraded":"2024-03-20T13:35:30.990368+0000","last_fullsized":"2024-03-20T13:35:30.990368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:02.169329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980412+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:35:30.980412+0000","last_peered":"2024-03-20T13:35:30.980412+0000","last_clean":"2024-03-20T13:35:30.980412+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:35:30.980412+0000","last_undegraded":"2024-03-20T13:35:30.980412+0000","last_fullsized":"2024-03-20T13:35:30.980412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:19.105808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987720+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:35:30.987720+0000","last_peered":"2024-03-20T13:35:30.987720+0000","last_clean":"2024-03-20T13:35:30.987720+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:35:30.987720+0000","last_undegraded":"2024-03-20T13:35:30.987720+0000","last_fullsized":"2024-03-20T13:35:30.987720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:56.825560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985917+0000","last_change":"2024-03-20T13:34:49.963030+0000","last_active":"2024-03-20T13:35:30.985917+0000","last_peered":"2024-03-20T13:35:30.985917+0000","last_clean":"2024-03-20T13:35:30.985917+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:35:30.985917+0000","last_undegraded":"2024-03-20T13:35:30.985917+0000","last_fullsized":"2024-03-20T13:35:30.985917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:06.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981550+0000","last_change":"2024-03-20T13:34:53.940877+0000","last_active":"2024-03-20T13:35:30.981550+0000","last_peered":"2024-03-20T13:35:30.981550+0000","last_clean":"2024-03-20T13:35:30.981550+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:35:30.981550+0000","last_undegraded":"2024-03-20T13:35:30.981550+0000","last_fullsized":"2024-03-20T13:35:30.981550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:43.553501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'71","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.547108+0000","last_change":"2024-03-20T13:34:55.954716+0000","last_active":"2024-03-20T13:36:23.547108+0000","last_peered":"2024-03-20T13:36:23.547108+0000","last_clean":"2024-03-20T13:36:23.547108+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:23.547108+0000","last_undegraded":"2024-03-20T13:36:23.547108+0000","last_fullsized":"2024-03-20T13:36:23.547108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:21:49.386776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984143+0000","last_change":"2024-03-20T13:34:57.961066+0000","last_active":"2024-03-20T13:35:30.984143+0000","last_peered":"2024-03-20T13:35:30.984143+0000","last_clean":"2024-03-20T13:35:30.984143+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:35:30.984143+0000","last_undegraded":"2024-03-20T13:35:30.984143+0000","last_fullsized":"2024-03-20T13:35:30.984143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:54.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.580959+0000","last_change":"2024-03-20T13:34:59.973427+0000","last_active":"2024-03-20T13:36:23.580959+0000","last_peered":"2024-03-20T13:36:23.580959+0000","last_clean":"2024-03-20T13:36:23.580959+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:23.580959+0000","last_undegraded":"2024-03-20T13:36:23.580959+0000","last_fullsized":"2024-03-20T13:36:23.580959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:32.618548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989266+0000","last_change":"2024-03-20T13:34:51.941170+0000","last_active":"2024-03-20T13:35:30.989266+0000","last_peered":"2024-03-20T13:35:30.989266+0000","last_clean":"2024-03-20T13:35:30.989266+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:35:30.989266+0000","last_undegraded":"2024-03-20T13:35:30.989266+0000","last_fullsized":"2024-03-20T13:35:30.989266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:10.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983697+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:35:30.983697+0000","last_peered":"2024-03-20T13:35:30.983697+0000","last_clean":"2024-03-20T13:35:30.983697+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:35:30.983697+0000","last_undegraded":"2024-03-20T13:35:30.983697+0000","last_fullsized":"2024-03-20T13:35:30.983697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:50:32.764565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982480+0000","last_change":"2024-03-20T13:34:49.941798+0000","last_active":"2024-03-20T13:35:30.982480+0000","last_peered":"2024-03-20T13:35:30.982480+0000","last_clean":"2024-03-20T13:35:30.982480+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:35:30.982480+0000","last_undegraded":"2024-03-20T13:35:30.982480+0000","last_fullsized":"2024-03-20T13:35:30.982480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990445+0000","last_change":"2024-03-20T13:34:53.941487+0000","last_active":"2024-03-20T13:35:30.990445+0000","last_peered":"2024-03-20T13:35:30.990445+0000","last_clean":"2024-03-20T13:35:30.990445+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:35:30.990445+0000","last_undegraded":"2024-03-20T13:35:30.990445+0000","last_fullsized":"2024-03-20T13:35:30.990445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002647+0000","last_change":"2024-03-20T13:34:55.956289+0000","last_active":"2024-03-20T13:36:24.002647+0000","last_peered":"2024-03-20T13:36:24.002647+0000","last_clean":"2024-03-20T13:36:24.002647+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:24.002647+0000","last_undegraded":"2024-03-20T13:36:24.002647+0000","last_fullsized":"2024-03-20T13:36:24.002647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:14.758225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987849+0000","last_change":"2024-03-20T13:34:57.964648+0000","last_active":"2024-03-20T13:35:30.987849+0000","last_peered":"2024-03-20T13:35:30.987849+0000","last_clean":"2024-03-20T13:35:30.987849+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:35:30.987849+0000","last_undegraded":"2024-03-20T13:35:30.987849+0000","last_fullsized":"2024-03-20T13:35:30.987849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:41.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.276503+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:12.276503+0000","last_peered":"2024-03-20T13:36:12.276503+0000","last_clean":"2024-03-20T13:36:12.276503+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:12.276503+0000","last_undegraded":"2024-03-20T13:36:12.276503+0000","last_fullsized":"2024-03-20T13:36:12.276503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969323+0000","last_change":"2024-03-20T13:34:51.947812+0000","last_active":"2024-03-20T13:36:17.969323+0000","last_peered":"2024-03-20T13:36:17.969323+0000","last_clean":"2024-03-20T13:36:17.969323+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:36:17.969323+0000","last_undegraded":"2024-03-20T13:36:17.969323+0000","last_fullsized":"2024-03-20T13:36:17.969323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985007+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:35:30.985007+0000","last_peered":"2024-03-20T13:35:30.985007+0000","last_clean":"2024-03-20T13:35:30.985007+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:35:30.985007+0000","last_undegraded":"2024-03-20T13:35:30.985007+0000","last_fullsized":"2024-03-20T13:35:30.985007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982056+0000","last_change":"2024-03-20T13:34:49.934321+0000","last_active":"2024-03-20T13:35:30.982056+0000","last_peered":"2024-03-20T13:35:30.982056+0000","last_clean":"2024-03-20T13:35:30.982056+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:35:30.982056+0000","last_undegraded":"2024-03-20T13:35:30.982056+0000","last_fullsized":"2024-03-20T13:35:30.982056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988938+0000","last_change":"2024-03-20T13:34:53.943172+0000","last_active":"2024-03-20T13:35:30.988938+0000","last_peered":"2024-03-20T13:35:30.988938+0000","last_clean":"2024-03-20T13:35:30.988938+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:35:30.988938+0000","last_undegraded":"2024-03-20T13:35:30.988938+0000","last_fullsized":"2024-03-20T13:35:30.988938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:28.432587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002508+0000","last_change":"2024-03-20T13:34:55.954133+0000","last_active":"2024-03-20T13:36:24.002508+0000","last_peered":"2024-03-20T13:36:24.002508+0000","last_clean":"2024-03-20T13:36:24.002508+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:24.002508+0000","last_undegraded":"2024-03-20T13:36:24.002508+0000","last_fullsized":"2024-03-20T13:36:24.002508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:47.638285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983783+0000","last_change":"2024-03-20T13:34:57.961111+0000","last_active":"2024-03-20T13:35:30.983783+0000","last_peered":"2024-03-20T13:35:30.983783+0000","last_clean":"2024-03-20T13:35:30.983783+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:35:30.983783+0000","last_undegraded":"2024-03-20T13:35:30.983783+0000","last_fullsized":"2024-03-20T13:35:30.983783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:59.940736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986127+0000","last_change":"2024-03-20T13:34:59.970194+0000","last_active":"2024-03-20T13:35:30.986127+0000","last_peered":"2024-03-20T13:35:30.986127+0000","last_clean":"2024-03-20T13:35:30.986127+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:35:30.986127+0000","last_undegraded":"2024-03-20T13:35:30.986127+0000","last_fullsized":"2024-03-20T13:35:30.986127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:45:19.139667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568296+0000","last_change":"2024-03-20T13:34:51.937043+0000","last_active":"2024-03-20T13:36:23.568296+0000","last_peered":"2024-03-20T13:36:23.568296+0000","last_clean":"2024-03-20T13:36:23.568296+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:36:23.568296+0000","last_undegraded":"2024-03-20T13:36:23.568296+0000","last_fullsized":"2024-03-20T13:36:23.568296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985645+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:35:30.985645+0000","last_peered":"2024-03-20T13:35:30.985645+0000","last_clean":"2024-03-20T13:35:30.985645+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:35:30.985645+0000","last_undegraded":"2024-03-20T13:35:30.985645+0000","last_fullsized":"2024-03-20T13:35:30.985645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:55:41.281803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987595+0000","last_change":"2024-03-20T13:34:49.938266+0000","last_active":"2024-03-20T13:35:30.987595+0000","last_peered":"2024-03-20T13:35:30.987595+0000","last_clean":"2024-03-20T13:35:30.987595+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:35:30.987595+0000","last_undegraded":"2024-03-20T13:35:30.987595+0000","last_fullsized":"2024-03-20T13:35:30.987595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983933+0000","last_change":"2024-03-20T13:34:53.942835+0000","last_active":"2024-03-20T13:35:30.983933+0000","last_peered":"2024-03-20T13:35:30.983933+0000","last_clean":"2024-03-20T13:35:30.983933+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:35:30.983933+0000","last_undegraded":"2024-03-20T13:35:30.983933+0000","last_fullsized":"2024-03-20T13:35:30.983933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:41.480924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988052+0000","last_change":"2024-03-20T13:34:55.955766+0000","last_active":"2024-03-20T13:35:30.988052+0000","last_peered":"2024-03-20T13:35:30.988052+0000","last_clean":"2024-03-20T13:35:30.988052+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:35:30.988052+0000","last_undegraded":"2024-03-20T13:35:30.988052+0000","last_fullsized":"2024-03-20T13:35:30.988052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:28.399469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989373+0000","last_change":"2024-03-20T13:34:57.962510+0000","last_active":"2024-03-20T13:35:30.989373+0000","last_peered":"2024-03-20T13:35:30.989373+0000","last_clean":"2024-03-20T13:35:30.989373+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:35:30.989373+0000","last_undegraded":"2024-03-20T13:35:30.989373+0000","last_fullsized":"2024-03-20T13:35:30.989373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.491130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982121+0000","last_change":"2024-03-20T13:34:59.972480+0000","last_active":"2024-03-20T13:35:30.982121+0000","last_peered":"2024-03-20T13:35:30.982121+0000","last_clean":"2024-03-20T13:35:30.982121+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:35:30.982121+0000","last_undegraded":"2024-03-20T13:35:30.982121+0000","last_fullsized":"2024-03-20T13:35:30.982121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:37.262606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612699+0000","last_change":"2024-03-20T13:34:51.950770+0000","last_active":"2024-03-20T13:36:17.612699+0000","last_peered":"2024-03-20T13:36:17.612699+0000","last_clean":"2024-03-20T13:36:17.612699+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:17.612699+0000","last_undegraded":"2024-03-20T13:36:17.612699+0000","last_fullsized":"2024-03-20T13:36:17.612699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:26.425854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986795+0000","last_change":"2024-03-20T13:34:49.936614+0000","last_active":"2024-03-20T13:35:30.986795+0000","last_peered":"2024-03-20T13:35:30.986795+0000","last_clean":"2024-03-20T13:35:30.986795+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:35:30.986795+0000","last_undegraded":"2024-03-20T13:35:30.986795+0000","last_fullsized":"2024-03-20T13:35:30.986795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983575+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:35:30.983575+0000","last_peered":"2024-03-20T13:35:30.983575+0000","last_clean":"2024-03-20T13:35:30.983575+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:35:30.983575+0000","last_undegraded":"2024-03-20T13:35:30.983575+0000","last_fullsized":"2024-03-20T13:35:30.983575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:35.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.489699+0000","last_change":"2024-03-20T13:34:53.942462+0000","last_active":"2024-03-20T13:36:24.489699+0000","last_peered":"2024-03-20T13:36:24.489699+0000","last_clean":"2024-03-20T13:36:24.489699+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:24.489699+0000","last_undegraded":"2024-03-20T13:36:24.489699+0000","last_fullsized":"2024-03-20T13:36:24.489699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:17.533635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.539599+0000","last_change":"2024-03-20T13:34:55.955509+0000","last_active":"2024-03-20T13:36:23.539599+0000","last_peered":"2024-03-20T13:36:23.539599+0000","last_clean":"2024-03-20T13:36:23.539599+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:23.539599+0000","last_undegraded":"2024-03-20T13:36:23.539599+0000","last_fullsized":"2024-03-20T13:36:23.539599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:22.404279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985626+0000","last_change":"2024-03-20T13:34:57.966334+0000","last_active":"2024-03-20T13:35:30.985626+0000","last_peered":"2024-03-20T13:35:30.985626+0000","last_clean":"2024-03-20T13:35:30.985626+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:35:30.985626+0000","last_undegraded":"2024-03-20T13:35:30.985626+0000","last_fullsized":"2024-03-20T13:35:30.985626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:16.766382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.956419+0000","last_change":"2024-03-20T13:34:59.968897+0000","last_active":"2024-03-20T13:36:17.956419+0000","last_peered":"2024-03-20T13:36:17.956419+0000","last_clean":"2024-03-20T13:36:17.956419+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:36:17.956419+0000","last_undegraded":"2024-03-20T13:36:17.956419+0000","last_fullsized":"2024-03-20T13:36:17.956419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:14.952118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980915+0000","last_change":"2024-03-20T13:34:51.941739+0000","last_active":"2024-03-20T13:35:30.980915+0000","last_peered":"2024-03-20T13:35:30.980915+0000","last_clean":"2024-03-20T13:35:30.980915+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:35:30.980915+0000","last_undegraded":"2024-03-20T13:35:30.980915+0000","last_fullsized":"2024-03-20T13:35:30.980915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:50.899013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984034+0000","last_change":"2024-03-20T13:34:49.946734+0000","last_active":"2024-03-20T13:35:30.984034+0000","last_peered":"2024-03-20T13:35:30.984034+0000","last_clean":"2024-03-20T13:35:30.984034+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:35:30.984034+0000","last_undegraded":"2024-03-20T13:35:30.984034+0000","last_fullsized":"2024-03-20T13:35:30.984034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988794+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:35:30.988794+0000","last_peered":"2024-03-20T13:35:30.988794+0000","last_clean":"2024-03-20T13:35:30.988794+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:35:30.988794+0000","last_undegraded":"2024-03-20T13:35:30.988794+0000","last_fullsized":"2024-03-20T13:35:30.988794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:29.981275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985463+0000","last_change":"2024-03-20T13:34:53.941252+0000","last_active":"2024-03-20T13:35:30.985463+0000","last_peered":"2024-03-20T13:35:30.985463+0000","last_clean":"2024-03-20T13:35:30.985463+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:35:30.985463+0000","last_undegraded":"2024-03-20T13:35:30.985463+0000","last_fullsized":"2024-03-20T13:35:30.985463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:45.972021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980973+0000","last_change":"2024-03-20T13:34:55.956604+0000","last_active":"2024-03-20T13:35:30.980973+0000","last_peered":"2024-03-20T13:35:30.980973+0000","last_clean":"2024-03-20T13:35:30.980973+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:35:30.980973+0000","last_undegraded":"2024-03-20T13:35:30.980973+0000","last_fullsized":"2024-03-20T13:35:30.980973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:06.183137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":278,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002369+0000","last_change":"2024-03-20T13:34:57.962603+0000","last_active":"2024-03-20T13:36:24.002369+0000","last_peered":"2024-03-20T13:36:24.002369+0000","last_clean":"2024-03-20T13:36:24.002369+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:24.002369+0000","last_undegraded":"2024-03-20T13:36:24.002369+0000","last_fullsized":"2024-03-20T13:36:24.002369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.166687+0000","last_change":"2024-03-20T13:34:59.965966+0000","last_active":"2024-03-20T13:35:35.166687+0000","last_peered":"2024-03-20T13:35:35.166687+0000","last_clean":"2024-03-20T13:35:35.166687+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:35:35.166687+0000","last_undegraded":"2024-03-20T13:35:35.166687+0000","last_fullsized":"2024-03-20T13:35:35.166687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:32:13.594344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984374+0000","last_change":"2024-03-20T13:34:51.955616+0000","last_active":"2024-03-20T13:35:30.984374+0000","last_peered":"2024-03-20T13:35:30.984374+0000","last_clean":"2024-03-20T13:35:30.984374+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:35:30.984374+0000","last_undegraded":"2024-03-20T13:35:30.984374+0000","last_fullsized":"2024-03-20T13:35:30.984374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:30.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990294+0000","last_change":"2024-03-20T13:34:49.957658+0000","last_active":"2024-03-20T13:35:30.990294+0000","last_peered":"2024-03-20T13:35:30.990294+0000","last_clean":"2024-03-20T13:35:30.990294+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:35:30.990294+0000","last_undegraded":"2024-03-20T13:35:30.990294+0000","last_fullsized":"2024-03-20T13:35:30.990294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:35.010181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984370+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:35:30.984370+0000","last_peered":"2024-03-20T13:35:30.984370+0000","last_clean":"2024-03-20T13:35:30.984370+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:35:30.984370+0000","last_undegraded":"2024-03-20T13:35:30.984370+0000","last_fullsized":"2024-03-20T13:35:30.984370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:29:46.424197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990699+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:35:30.990699+0000","last_peered":"2024-03-20T13:35:30.990699+0000","last_clean":"2024-03-20T13:35:30.990699+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:35:30.990699+0000","last_undegraded":"2024-03-20T13:35:30.990699+0000","last_fullsized":"2024-03-20T13:35:30.990699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:35.641007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986513+0000","last_change":"2024-03-20T13:34:55.955147+0000","last_active":"2024-03-20T13:35:30.986513+0000","last_peered":"2024-03-20T13:35:30.986513+0000","last_clean":"2024-03-20T13:35:30.986513+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:35:30.986513+0000","last_undegraded":"2024-03-20T13:35:30.986513+0000","last_fullsized":"2024-03-20T13:35:30.986513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:58.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002217+0000","last_change":"2024-03-20T13:34:57.967987+0000","last_active":"2024-03-20T13:36:24.002217+0000","last_peered":"2024-03-20T13:36:24.002217+0000","last_clean":"2024-03-20T13:36:24.002217+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:24.002217+0000","last_undegraded":"2024-03-20T13:36:24.002217+0000","last_fullsized":"2024-03-20T13:36:24.002217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981031+0000","last_change":"2024-03-20T13:34:59.968359+0000","last_active":"2024-03-20T13:35:30.981031+0000","last_peered":"2024-03-20T13:35:30.981031+0000","last_clean":"2024-03-20T13:35:30.981031+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:35:30.981031+0000","last_undegraded":"2024-03-20T13:35:30.981031+0000","last_fullsized":"2024-03-20T13:35:30.981031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:40.280747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164886+0000","last_change":"2024-03-20T13:34:51.944433+0000","last_active":"2024-03-20T13:35:35.164886+0000","last_peered":"2024-03-20T13:35:35.164886+0000","last_clean":"2024-03-20T13:35:35.164886+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:35:35.164886+0000","last_undegraded":"2024-03-20T13:35:35.164886+0000","last_fullsized":"2024-03-20T13:35:35.164886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:57.235472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982049+0000","last_change":"2024-03-20T13:34:49.947597+0000","last_active":"2024-03-20T13:35:30.982049+0000","last_peered":"2024-03-20T13:35:30.982049+0000","last_clean":"2024-03-20T13:35:30.982049+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:35:30.982049+0000","last_undegraded":"2024-03-20T13:35:30.982049+0000","last_fullsized":"2024-03-20T13:35:30.982049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:23.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989275+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:35:30.989275+0000","last_peered":"2024-03-20T13:35:30.989275+0000","last_clean":"2024-03-20T13:35:30.989275+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:35:30.989275+0000","last_undegraded":"2024-03-20T13:35:30.989275+0000","last_fullsized":"2024-03-20T13:35:30.989275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:53.016765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984914+0000","last_change":"2024-03-20T13:34:53.941526+0000","last_active":"2024-03-20T13:35:30.984914+0000","last_peered":"2024-03-20T13:35:30.984914+0000","last_clean":"2024-03-20T13:35:30.984914+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:35:30.984914+0000","last_undegraded":"2024-03-20T13:35:30.984914+0000","last_fullsized":"2024-03-20T13:35:30.984914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:50.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'77","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.536166+0000","last_change":"2024-03-20T13:34:55.956339+0000","last_active":"2024-03-20T13:36:23.536166+0000","last_peered":"2024-03-20T13:36:23.536166+0000","last_clean":"2024-03-20T13:36:23.536166+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:23.536166+0000","last_undegraded":"2024-03-20T13:36:23.536166+0000","last_fullsized":"2024-03-20T13:36:23.536166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:00.430180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983193+0000","last_change":"2024-03-20T13:34:57.962327+0000","last_active":"2024-03-20T13:35:30.983193+0000","last_peered":"2024-03-20T13:35:30.983193+0000","last_clean":"2024-03-20T13:35:30.983193+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:35:30.983193+0000","last_undegraded":"2024-03-20T13:35:30.983193+0000","last_fullsized":"2024-03-20T13:35:30.983193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988480+0000","last_change":"2024-03-20T13:34:59.972683+0000","last_active":"2024-03-20T13:35:30.988480+0000","last_peered":"2024-03-20T13:35:30.988480+0000","last_clean":"2024-03-20T13:35:30.988480+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:35:30.988480+0000","last_undegraded":"2024-03-20T13:35:30.988480+0000","last_fullsized":"2024-03-20T13:35:30.988480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:59.288382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988291+0000","last_change":"2024-03-20T13:34:59.970132+0000","last_active":"2024-03-20T13:35:30.988291+0000","last_peered":"2024-03-20T13:35:30.988291+0000","last_clean":"2024-03-20T13:35:30.988291+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:35:30.988291+0000","last_undegraded":"2024-03-20T13:35:30.988291+0000","last_fullsized":"2024-03-20T13:35:30.988291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:38.005851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568412+0000","last_change":"2024-03-20T13:34:51.943309+0000","last_active":"2024-03-20T13:36:23.568412+0000","last_peered":"2024-03-20T13:36:23.568412+0000","last_clean":"2024-03-20T13:36:23.568412+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:36:23.568412+0000","last_undegraded":"2024-03-20T13:36:23.568412+0000","last_fullsized":"2024-03-20T13:36:23.568412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988151+0000","last_change":"2024-03-20T13:34:49.960700+0000","last_active":"2024-03-20T13:35:30.988151+0000","last_peered":"2024-03-20T13:35:30.988151+0000","last_clean":"2024-03-20T13:35:30.988151+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:35:30.988151+0000","last_undegraded":"2024-03-20T13:35:30.988151+0000","last_fullsized":"2024-03-20T13:35:30.988151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:08.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983120+0000","last_change":"2024-03-20T13:34:53.941620+0000","last_active":"2024-03-20T13:35:30.983120+0000","last_peered":"2024-03-20T13:35:30.983120+0000","last_clean":"2024-03-20T13:35:30.983120+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:35:30.983120+0000","last_undegraded":"2024-03-20T13:35:30.983120+0000","last_fullsized":"2024-03-20T13:35:30.983120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:02.878465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.946353+0000","last_change":"2024-03-20T13:34:55.955235+0000","last_active":"2024-03-20T13:36:17.946353+0000","last_peered":"2024-03-20T13:36:17.946353+0000","last_clean":"2024-03-20T13:36:17.946353+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:36:17.946353+0000","last_undegraded":"2024-03-20T13:36:17.946353+0000","last_fullsized":"2024-03-20T13:36:17.946353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:19.438768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984712+0000","last_change":"2024-03-20T13:34:57.968867+0000","last_active":"2024-03-20T13:35:30.984712+0000","last_peered":"2024-03-20T13:35:30.984712+0000","last_clean":"2024-03-20T13:35:30.984712+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:35:30.984712+0000","last_undegraded":"2024-03-20T13:35:30.984712+0000","last_fullsized":"2024-03-20T13:35:30.984712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:46.842366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983754+0000","last_change":"2024-03-20T13:34:59.966513+0000","last_active":"2024-03-20T13:35:30.983754+0000","last_peered":"2024-03-20T13:35:30.983754+0000","last_clean":"2024-03-20T13:35:30.983754+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:35:30.983754+0000","last_undegraded":"2024-03-20T13:35:30.983754+0000","last_fullsized":"2024-03-20T13:35:30.983754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:18.685347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568783+0000","last_change":"2024-03-20T13:34:51.944041+0000","last_active":"2024-03-20T13:36:23.568783+0000","last_peered":"2024-03-20T13:36:23.568783+0000","last_clean":"2024-03-20T13:36:23.568783+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:36:23.568783+0000","last_undegraded":"2024-03-20T13:36:23.568783+0000","last_fullsized":"2024-03-20T13:36:23.568783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:34.692691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.563792+0000","last_change":"2024-03-20T13:34:49.950884+0000","last_active":"2024-03-20T13:36:23.563792+0000","last_peered":"2024-03-20T13:36:23.563792+0000","last_clean":"2024-03-20T13:36:23.563792+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:36:23.563792+0000","last_undegraded":"2024-03-20T13:36:23.563792+0000","last_fullsized":"2024-03-20T13:36:23.563792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991514+0000","last_change":"2024-03-20T13:35:30.990765+0000","last_active":"2024-03-20T13:35:30.991514+0000","last_peered":"2024-03-20T13:35:30.991514+0000","last_clean":"2024-03-20T13:35:30.991514+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:35:30.991514+0000","last_undegraded":"2024-03-20T13:35:30.991514+0000","last_fullsized":"2024-03-20T13:35:30.991514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:11.082910+0000","last_change":"2024-03-20T13:34:55.949038+0000","last_active":"2024-03-20T13:36:11.082910+0000","last_peered":"2024-03-20T13:36:11.082910+0000","last_clean":"2024-03-20T13:36:11.082910+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:11.082910+0000","last_undegraded":"2024-03-20T13:36:11.082910+0000","last_fullsized":"2024-03-20T13:36:11.082910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:02.651523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985168+0000","last_change":"2024-03-20T13:34:57.970496+0000","last_active":"2024-03-20T13:35:30.985168+0000","last_peered":"2024-03-20T13:35:30.985168+0000","last_clean":"2024-03-20T13:35:30.985168+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:35:30.985168+0000","last_undegraded":"2024-03-20T13:35:30.985168+0000","last_fullsized":"2024-03-20T13:35:30.985168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:16.785640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983405+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:35:30.983405+0000","last_peered":"2024-03-20T13:35:30.983405+0000","last_clean":"2024-03-20T13:35:30.983405+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:35:30.983405+0000","last_undegraded":"2024-03-20T13:35:30.983405+0000","last_fullsized":"2024-03-20T13:35:30.983405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:16:57.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982873+0000","last_change":"2024-03-20T13:34:51.935236+0000","last_active":"2024-03-20T13:35:30.982873+0000","last_peered":"2024-03-20T13:35:30.982873+0000","last_clean":"2024-03-20T13:35:30.982873+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:35:30.982873+0000","last_undegraded":"2024-03-20T13:35:30.982873+0000","last_fullsized":"2024-03-20T13:35:30.982873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989247+0000","last_change":"2024-03-20T13:34:49.946529+0000","last_active":"2024-03-20T13:35:30.989247+0000","last_peered":"2024-03-20T13:35:30.989247+0000","last_clean":"2024-03-20T13:35:30.989247+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:35:30.989247+0000","last_undegraded":"2024-03-20T13:35:30.989247+0000","last_fullsized":"2024-03-20T13:35:30.989247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985010+0000","last_change":"2024-03-20T13:34:53.944081+0000","last_active":"2024-03-20T13:35:30.985010+0000","last_peered":"2024-03-20T13:35:30.985010+0000","last_clean":"2024-03-20T13:35:30.985010+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:35:30.985010+0000","last_undegraded":"2024-03-20T13:35:30.985010+0000","last_fullsized":"2024-03-20T13:35:30.985010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:52.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'35","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.362876+0000","last_change":"2024-03-20T13:34:55.953409+0000","last_active":"2024-03-20T13:36:23.362876+0000","last_peered":"2024-03-20T13:36:23.362876+0000","last_clean":"2024-03-20T13:36:23.362876+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:23.362876+0000","last_undegraded":"2024-03-20T13:36:23.362876+0000","last_fullsized":"2024-03-20T13:36:23.362876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:34.583675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980762+0000","last_change":"2024-03-20T13:34:57.962112+0000","last_active":"2024-03-20T13:35:30.980762+0000","last_peered":"2024-03-20T13:35:30.980762+0000","last_clean":"2024-03-20T13:35:30.980762+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:35:30.980762+0000","last_undegraded":"2024-03-20T13:35:30.980762+0000","last_fullsized":"2024-03-20T13:35:30.980762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988695+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:35:30.988695+0000","last_peered":"2024-03-20T13:35:30.988695+0000","last_clean":"2024-03-20T13:35:30.988695+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:35:30.988695+0000","last_undegraded":"2024-03-20T13:35:30.988695+0000","last_fullsized":"2024-03-20T13:35:30.988695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.676415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925369+0000","last_change":"2024-03-20T13:34:51.955727+0000","last_active":"2024-03-20T13:35:35.925369+0000","last_peered":"2024-03-20T13:35:35.925369+0000","last_clean":"2024-03-20T13:35:35.925369+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:35:35.925369+0000","last_undegraded":"2024-03-20T13:35:35.925369+0000","last_fullsized":"2024-03-20T13:35:35.925369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:18.390471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982684+0000","last_change":"2024-03-20T13:34:49.937900+0000","last_active":"2024-03-20T13:35:30.982684+0000","last_peered":"2024-03-20T13:35:30.982684+0000","last_clean":"2024-03-20T13:35:30.982684+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:35:30.982684+0000","last_undegraded":"2024-03-20T13:35:30.982684+0000","last_fullsized":"2024-03-20T13:35:30.982684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985583+0000","last_change":"2024-03-20T13:34:53.945375+0000","last_active":"2024-03-20T13:35:30.985583+0000","last_peered":"2024-03-20T13:35:30.985583+0000","last_clean":"2024-03-20T13:35:30.985583+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:35:30.985583+0000","last_undegraded":"2024-03-20T13:35:30.985583+0000","last_fullsized":"2024-03-20T13:35:30.985583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:02:59.804246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.931325+0000","last_change":"2024-03-20T13:34:55.950108+0000","last_active":"2024-03-20T13:36:17.931325+0000","last_peered":"2024-03-20T13:36:17.931325+0000","last_clean":"2024-03-20T13:36:17.931325+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:17.931325+0000","last_undegraded":"2024-03-20T13:36:17.931325+0000","last_fullsized":"2024-03-20T13:36:17.931325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:30.400371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986035+0000","last_change":"2024-03-20T13:34:57.962527+0000","last_active":"2024-03-20T13:35:30.986035+0000","last_peered":"2024-03-20T13:35:30.986035+0000","last_clean":"2024-03-20T13:35:30.986035+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:35:30.986035+0000","last_undegraded":"2024-03-20T13:35:30.986035+0000","last_fullsized":"2024-03-20T13:35:30.986035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:19.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.935434+0000","last_change":"2024-03-20T13:34:51.944100+0000","last_active":"2024-03-20T13:35:35.935434+0000","last_peered":"2024-03-20T13:35:35.935434+0000","last_clean":"2024-03-20T13:35:35.935434+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:35:35.935434+0000","last_undegraded":"2024-03-20T13:35:35.935434+0000","last_fullsized":"2024-03-20T13:35:35.935434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:42:06.297838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983864+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:35:30.983864+0000","last_peered":"2024-03-20T13:35:30.983864+0000","last_clean":"2024-03-20T13:35:30.983864+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:35:30.983864+0000","last_undegraded":"2024-03-20T13:35:30.983864+0000","last_fullsized":"2024-03-20T13:35:30.983864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:45.792646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985035+0000","last_change":"2024-03-20T13:34:53.942580+0000","last_active":"2024-03-20T13:35:30.985035+0000","last_peered":"2024-03-20T13:35:30.985035+0000","last_clean":"2024-03-20T13:35:30.985035+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:35:30.985035+0000","last_undegraded":"2024-03-20T13:35:30.985035+0000","last_fullsized":"2024-03-20T13:35:30.985035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'52","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.532779+0000","last_change":"2024-03-20T13:34:55.951412+0000","last_active":"2024-03-20T13:36:23.532779+0000","last_peered":"2024-03-20T13:36:23.532779+0000","last_clean":"2024-03-20T13:36:23.532779+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:23.532779+0000","last_undegraded":"2024-03-20T13:36:23.532779+0000","last_fullsized":"2024-03-20T13:36:23.532779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:14.777482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985864+0000","last_change":"2024-03-20T13:34:57.965582+0000","last_active":"2024-03-20T13:35:30.985864+0000","last_peered":"2024-03-20T13:35:30.985864+0000","last_clean":"2024-03-20T13:35:30.985864+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:35:30.985864+0000","last_undegraded":"2024-03-20T13:35:30.985864+0000","last_fullsized":"2024-03-20T13:35:30.985864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:34.285516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.435716+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:17.435716+0000","last_peered":"2024-03-20T13:36:17.435716+0000","last_clean":"2024-03-20T13:36:17.435716+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:17.435716+0000","last_undegraded":"2024-03-20T13:36:17.435716+0000","last_fullsized":"2024-03-20T13:36:17.435716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.947516+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980586+0000","last_change":"2024-03-20T13:34:49.946304+0000","last_active":"2024-03-20T13:35:30.980586+0000","last_peered":"2024-03-20T13:35:30.980586+0000","last_clean":"2024-03-20T13:35:30.980586+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:35:30.980586+0000","last_undegraded":"2024-03-20T13:35:30.980586+0000","last_fullsized":"2024-03-20T13:35:30.980586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:06:00.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.992863+0000","last_change":"2024-03-20T13:35:30.992863+0000","last_active":"2024-03-20T13:35:30.992863+0000","last_peered":"2024-03-20T13:35:30.992863+0000","last_clean":"2024-03-20T13:35:30.992863+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:35:30.992863+0000","last_undegraded":"2024-03-20T13:35:30.992863+0000","last_fullsized":"2024-03-20T13:35:30.992863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.932248+0000","last_change":"2024-03-20T13:34:55.955358+0000","last_active":"2024-03-20T13:36:17.932248+0000","last_peered":"2024-03-20T13:36:17.932248+0000","last_clean":"2024-03-20T13:36:17.932248+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:36:17.932248+0000","last_undegraded":"2024-03-20T13:36:17.932248+0000","last_fullsized":"2024-03-20T13:36:17.932248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:26:44.999814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981139+0000","last_change":"2024-03-20T13:34:57.964942+0000","last_active":"2024-03-20T13:35:30.981139+0000","last_peered":"2024-03-20T13:35:30.981139+0000","last_clean":"2024-03-20T13:35:30.981139+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:35:30.981139+0000","last_undegraded":"2024-03-20T13:35:30.981139+0000","last_fullsized":"2024-03-20T13:35:30.981139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985284+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:35:30.985284+0000","last_peered":"2024-03-20T13:35:30.985284+0000","last_clean":"2024-03-20T13:35:30.985284+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:35:30.985284+0000","last_undegraded":"2024-03-20T13:35:30.985284+0000","last_fullsized":"2024-03-20T13:35:30.985284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:56.733038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426416+0000","last_change":"2024-03-20T13:34:51.955633+0000","last_active":"2024-03-20T13:35:35.426416+0000","last_peered":"2024-03-20T13:35:35.426416+0000","last_clean":"2024-03-20T13:35:35.426416+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:35:35.426416+0000","last_undegraded":"2024-03-20T13:35:35.426416+0000","last_fullsized":"2024-03-20T13:35:35.426416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:58.692384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981144+0000","last_change":"2024-03-20T13:34:49.948392+0000","last_active":"2024-03-20T13:35:30.981144+0000","last_peered":"2024-03-20T13:35:30.981144+0000","last_clean":"2024-03-20T13:35:30.981144+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:35:30.981144+0000","last_undegraded":"2024-03-20T13:35:30.981144+0000","last_fullsized":"2024-03-20T13:35:30.981144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991895+0000","last_change":"2024-03-20T13:35:30.991895+0000","last_active":"2024-03-20T13:35:30.991895+0000","last_peered":"2024-03-20T13:35:30.991895+0000","last_clean":"2024-03-20T13:35:30.991895+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:35:30.991895+0000","last_undegraded":"2024-03-20T13:35:30.991895+0000","last_fullsized":"2024-03-20T13:35:30.991895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:03.644927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.950509+0000","last_change":"2024-03-20T13:34:55.946279+0000","last_active":"2024-03-20T13:36:17.950509+0000","last_peered":"2024-03-20T13:36:17.950509+0000","last_clean":"2024-03-20T13:36:17.950509+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:17.950509+0000","last_undegraded":"2024-03-20T13:36:17.950509+0000","last_fullsized":"2024-03-20T13:36:17.950509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:32.277358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984087+0000","last_change":"2024-03-20T13:34:57.968260+0000","last_active":"2024-03-20T13:35:30.984087+0000","last_peered":"2024-03-20T13:35:30.984087+0000","last_clean":"2024-03-20T13:35:30.984087+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:35:30.984087+0000","last_undegraded":"2024-03-20T13:35:30.984087+0000","last_fullsized":"2024-03-20T13:35:30.984087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:27.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559906+0000","last_change":"2024-03-20T13:34:59.970646+0000","last_active":"2024-03-20T13:36:23.559906+0000","last_peered":"2024-03-20T13:36:23.559906+0000","last_clean":"2024-03-20T13:36:23.559906+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:36:23.559906+0000","last_undegraded":"2024-03-20T13:36:23.559906+0000","last_fullsized":"2024-03-20T13:36:23.559906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:06.692527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432770+0000","last_change":"2024-03-20T13:34:51.943110+0000","last_active":"2024-03-20T13:35:35.432770+0000","last_peered":"2024-03-20T13:35:35.432770+0000","last_clean":"2024-03-20T13:35:35.432770+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:35:35.432770+0000","last_undegraded":"2024-03-20T13:35:35.432770+0000","last_fullsized":"2024-03-20T13:35:35.432770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987393+0000","last_change":"2024-03-20T13:34:49.960382+0000","last_active":"2024-03-20T13:35:30.987393+0000","last_peered":"2024-03-20T13:35:30.987393+0000","last_clean":"2024-03-20T13:35:30.987393+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:35:30.987393+0000","last_undegraded":"2024-03-20T13:35:30.987393+0000","last_fullsized":"2024-03-20T13:35:30.987393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:46.514364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982984+0000","last_change":"2024-03-20T13:34:53.940730+0000","last_active":"2024-03-20T13:35:30.982984+0000","last_peered":"2024-03-20T13:35:30.982984+0000","last_clean":"2024-03-20T13:35:30.982984+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:35:30.982984+0000","last_undegraded":"2024-03-20T13:35:30.982984+0000","last_fullsized":"2024-03-20T13:35:30.982984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:00.644448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988396+0000","last_change":"2024-03-20T13:34:55.962070+0000","last_active":"2024-03-20T13:35:30.988396+0000","last_peered":"2024-03-20T13:35:30.988396+0000","last_clean":"2024-03-20T13:35:30.988396+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:35:30.988396+0000","last_undegraded":"2024-03-20T13:35:30.988396+0000","last_fullsized":"2024-03-20T13:35:30.988396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:10:00.391997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":293,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002421+0000","last_change":"2024-03-20T13:34:57.966599+0000","last_active":"2024-03-20T13:36:24.002421+0000","last_peered":"2024-03-20T13:36:24.002421+0000","last_clean":"2024-03-20T13:36:24.002421+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:24.002421+0000","last_undegraded":"2024-03-20T13:36:24.002421+0000","last_fullsized":"2024-03-20T13:36:24.002421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:18.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983175+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:35:30.983175+0000","last_peered":"2024-03-20T13:35:30.983175+0000","last_clean":"2024-03-20T13:35:30.983175+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:35:30.983175+0000","last_undegraded":"2024-03-20T13:35:30.983175+0000","last_fullsized":"2024-03-20T13:35:30.983175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.814709+0000","last_change":"2024-03-20T13:34:51.935075+0000","last_active":"2024-03-20T13:35:34.814709+0000","last_peered":"2024-03-20T13:35:34.814709+0000","last_clean":"2024-03-20T13:35:34.814709+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:35:34.814709+0000","last_undegraded":"2024-03-20T13:35:34.814709+0000","last_fullsized":"2024-03-20T13:35:34.814709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982426+0000","last_change":"2024-03-20T13:34:49.939827+0000","last_active":"2024-03-20T13:35:30.982426+0000","last_peered":"2024-03-20T13:35:30.982426+0000","last_clean":"2024-03-20T13:35:30.982426+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:35:30.982426+0000","last_undegraded":"2024-03-20T13:35:30.982426+0000","last_fullsized":"2024-03-20T13:35:30.982426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982868+0000","last_change":"2024-03-20T13:34:53.942928+0000","last_active":"2024-03-20T13:35:30.982868+0000","last_peered":"2024-03-20T13:35:30.982868+0000","last_clean":"2024-03-20T13:35:30.982868+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:35:30.982868+0000","last_undegraded":"2024-03-20T13:35:30.982868+0000","last_fullsized":"2024-03-20T13:35:30.982868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:24.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.922811+0000","last_change":"2024-03-20T13:34:55.950261+0000","last_active":"2024-03-20T13:36:17.922811+0000","last_peered":"2024-03-20T13:36:17.922811+0000","last_clean":"2024-03-20T13:36:17.922811+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:17.922811+0000","last_undegraded":"2024-03-20T13:36:17.922811+0000","last_fullsized":"2024-03-20T13:36:17.922811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:16.051759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982076+0000","last_change":"2024-03-20T13:34:57.966567+0000","last_active":"2024-03-20T13:35:30.982076+0000","last_peered":"2024-03-20T13:35:30.982076+0000","last_clean":"2024-03-20T13:35:30.982076+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:35:30.982076+0000","last_undegraded":"2024-03-20T13:35:30.982076+0000","last_fullsized":"2024-03-20T13:35:30.982076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:00.530246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983022+0000","last_change":"2024-03-20T13:34:59.974362+0000","last_active":"2024-03-20T13:35:30.983022+0000","last_peered":"2024-03-20T13:35:30.983022+0000","last_clean":"2024-03-20T13:35:30.983022+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:35:30.983022+0000","last_undegraded":"2024-03-20T13:35:30.983022+0000","last_fullsized":"2024-03-20T13:35:30.983022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815573+0000","last_change":"2024-03-20T13:34:51.933525+0000","last_active":"2024-03-20T13:35:34.815573+0000","last_peered":"2024-03-20T13:35:34.815573+0000","last_clean":"2024-03-20T13:35:34.815573+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:35:34.815573+0000","last_undegraded":"2024-03-20T13:35:34.815573+0000","last_fullsized":"2024-03-20T13:35:34.815573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:31.807759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990071+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:35:30.990071+0000","last_peered":"2024-03-20T13:35:30.990071+0000","last_clean":"2024-03-20T13:35:30.990071+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:35:30.990071+0000","last_undegraded":"2024-03-20T13:35:30.990071+0000","last_fullsized":"2024-03-20T13:35:30.990071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:46.676895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987770+0000","last_change":"2024-03-20T13:34:53.944574+0000","last_active":"2024-03-20T13:35:30.987770+0000","last_peered":"2024-03-20T13:35:30.987770+0000","last_clean":"2024-03-20T13:35:30.987770+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:35:30.987770+0000","last_undegraded":"2024-03-20T13:35:30.987770+0000","last_fullsized":"2024-03-20T13:35:30.987770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:47.973325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.979760+0000","last_change":"2024-03-20T13:34:55.949632+0000","last_active":"2024-03-20T13:36:17.979760+0000","last_peered":"2024-03-20T13:36:17.979760+0000","last_clean":"2024-03-20T13:36:17.979760+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:17.979760+0000","last_undegraded":"2024-03-20T13:36:17.979760+0000","last_fullsized":"2024-03-20T13:36:17.979760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:56.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985258+0000","last_change":"2024-03-20T13:34:57.968928+0000","last_active":"2024-03-20T13:35:30.985258+0000","last_peered":"2024-03-20T13:35:30.985258+0000","last_clean":"2024-03-20T13:35:30.985258+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:35:30.985258+0000","last_undegraded":"2024-03-20T13:35:30.985258+0000","last_fullsized":"2024-03-20T13:35:30.985258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:19:52.024807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.930985+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:35:35.930985+0000","last_peered":"2024-03-20T13:35:35.930985+0000","last_clean":"2024-03-20T13:35:35.930985+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:35:35.930985+0000","last_undegraded":"2024-03-20T13:35:35.930985+0000","last_fullsized":"2024-03-20T13:35:35.930985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:22:02.192935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985680+0000","last_change":"2024-03-20T13:34:51.945209+0000","last_active":"2024-03-20T13:35:30.985680+0000","last_peered":"2024-03-20T13:35:30.985680+0000","last_clean":"2024-03-20T13:35:30.985680+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:35:30.985680+0000","last_undegraded":"2024-03-20T13:35:30.985680+0000","last_fullsized":"2024-03-20T13:35:30.985680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:44.470618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984496+0000","last_change":"2024-03-20T13:34:49.939306+0000","last_active":"2024-03-20T13:35:30.984496+0000","last_peered":"2024-03-20T13:35:30.984496+0000","last_clean":"2024-03-20T13:35:30.984496+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:35:30.984496+0000","last_undegraded":"2024-03-20T13:35:30.984496+0000","last_fullsized":"2024-03-20T13:35:30.984496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:42.593147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983070+0000","last_change":"2024-03-20T13:34:53.944784+0000","last_active":"2024-03-20T13:35:30.983070+0000","last_peered":"2024-03-20T13:35:30.983070+0000","last_clean":"2024-03-20T13:35:30.983070+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:35:30.983070+0000","last_undegraded":"2024-03-20T13:35:30.983070+0000","last_fullsized":"2024-03-20T13:35:30.983070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:45.631209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.948542+0000","last_change":"2024-03-20T13:34:55.953980+0000","last_active":"2024-03-20T13:36:17.948542+0000","last_peered":"2024-03-20T13:36:17.948542+0000","last_clean":"2024-03-20T13:36:17.948542+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:17.948542+0000","last_undegraded":"2024-03-20T13:36:17.948542+0000","last_fullsized":"2024-03-20T13:36:17.948542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:04.003649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985553+0000","last_change":"2024-03-20T13:34:57.968516+0000","last_active":"2024-03-20T13:35:30.985553+0000","last_peered":"2024-03-20T13:35:30.985553+0000","last_clean":"2024-03-20T13:35:30.985553+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:35:30.985553+0000","last_undegraded":"2024-03-20T13:35:30.985553+0000","last_fullsized":"2024-03-20T13:35:30.985553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:42.517997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988393+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:35:30.988393+0000","last_peered":"2024-03-20T13:35:30.988393+0000","last_clean":"2024-03-20T13:35:30.988393+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:35:30.988393+0000","last_undegraded":"2024-03-20T13:35:30.988393+0000","last_fullsized":"2024-03-20T13:35:30.988393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:18.372757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164827+0000","last_change":"2024-03-20T13:34:51.933565+0000","last_active":"2024-03-20T13:35:35.164827+0000","last_peered":"2024-03-20T13:35:35.164827+0000","last_clean":"2024-03-20T13:35:35.164827+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:35:35.164827+0000","last_undegraded":"2024-03-20T13:35:35.164827+0000","last_fullsized":"2024-03-20T13:35:35.164827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:23.975435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982828+0000","last_change":"2024-03-20T13:34:49.937954+0000","last_active":"2024-03-20T13:35:30.982828+0000","last_peered":"2024-03-20T13:35:30.982828+0000","last_clean":"2024-03-20T13:35:30.982828+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:35:30.982828+0000","last_undegraded":"2024-03-20T13:35:30.982828+0000","last_fullsized":"2024-03-20T13:35:30.982828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982077+0000","last_change":"2024-03-20T13:34:53.945758+0000","last_active":"2024-03-20T13:35:30.982077+0000","last_peered":"2024-03-20T13:35:30.982077+0000","last_clean":"2024-03-20T13:35:30.982077+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:35:30.982077+0000","last_undegraded":"2024-03-20T13:35:30.982077+0000","last_fullsized":"2024-03-20T13:35:30.982077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:56.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.554040+0000","last_change":"2024-03-20T13:34:55.955035+0000","last_active":"2024-03-20T13:36:23.554040+0000","last_peered":"2024-03-20T13:36:23.554040+0000","last_clean":"2024-03-20T13:36:23.554040+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:23.554040+0000","last_undegraded":"2024-03-20T13:36:23.554040+0000","last_fullsized":"2024-03-20T13:36:23.554040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:00:41.222083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983213+0000","last_change":"2024-03-20T13:34:57.961099+0000","last_active":"2024-03-20T13:35:30.983213+0000","last_peered":"2024-03-20T13:35:30.983213+0000","last_clean":"2024-03-20T13:35:30.983213+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:35:30.983213+0000","last_undegraded":"2024-03-20T13:35:30.983213+0000","last_fullsized":"2024-03-20T13:35:30.983213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987647+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:35:30.987647+0000","last_peered":"2024-03-20T13:35:30.987647+0000","last_clean":"2024-03-20T13:35:30.987647+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:35:30.987647+0000","last_undegraded":"2024-03-20T13:35:30.987647+0000","last_fullsized":"2024-03-20T13:35:30.987647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:50:50.872683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.927590+0000","last_change":"2024-03-20T13:34:51.957194+0000","last_active":"2024-03-20T13:35:35.927590+0000","last_peered":"2024-03-20T13:35:35.927590+0000","last_clean":"2024-03-20T13:35:35.927590+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:35:35.927590+0000","last_undegraded":"2024-03-20T13:35:35.927590+0000","last_fullsized":"2024-03-20T13:35:35.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984223+0000","last_change":"2024-03-20T13:34:49.949098+0000","last_active":"2024-03-20T13:35:30.984223+0000","last_peered":"2024-03-20T13:35:30.984223+0000","last_clean":"2024-03-20T13:35:30.984223+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:35:30.984223+0000","last_undegraded":"2024-03-20T13:35:30.984223+0000","last_fullsized":"2024-03-20T13:35:30.984223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984638+0000","last_change":"2024-03-20T13:34:51.943051+0000","last_active":"2024-03-20T13:35:30.984638+0000","last_peered":"2024-03-20T13:35:30.984638+0000","last_clean":"2024-03-20T13:35:30.984638+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:35:30.984638+0000","last_undegraded":"2024-03-20T13:35:30.984638+0000","last_fullsized":"2024-03-20T13:35:30.984638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982413+0000","last_change":"2024-03-20T13:34:49.933350+0000","last_active":"2024-03-20T13:35:30.982413+0000","last_peered":"2024-03-20T13:35:30.982413+0000","last_clean":"2024-03-20T13:35:30.982413+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:35:30.982413+0000","last_undegraded":"2024-03-20T13:35:30.982413+0000","last_fullsized":"2024-03-20T13:35:30.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426226+0000","last_change":"2024-03-20T13:34:51.945886+0000","last_active":"2024-03-20T13:35:35.426226+0000","last_peered":"2024-03-20T13:35:35.426226+0000","last_clean":"2024-03-20T13:35:35.426226+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:35:35.426226+0000","last_undegraded":"2024-03-20T13:35:35.426226+0000","last_fullsized":"2024-03-20T13:35:35.426226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:13.438792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985818+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:35:30.985818+0000","last_peered":"2024-03-20T13:35:30.985818+0000","last_clean":"2024-03-20T13:35:30.985818+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:35:30.985818+0000","last_undegraded":"2024-03-20T13:35:30.985818+0000","last_fullsized":"2024-03-20T13:35:30.985818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:48.329750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.942923+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984213+0000","last_change":"2024-03-20T13:34:49.933497+0000","last_active":"2024-03-20T13:35:30.984213+0000","last_peered":"2024-03-20T13:35:30.984213+0000","last_clean":"2024-03-20T13:35:30.984213+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:35:30.984213+0000","last_undegraded":"2024-03-20T13:35:30.984213+0000","last_fullsized":"2024-03-20T13:35:30.984213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983804+0000","last_change":"2024-03-20T13:34:51.937130+0000","last_active":"2024-03-20T13:35:30.983804+0000","last_peered":"2024-03-20T13:35:30.983804+0000","last_clean":"2024-03-20T13:35:30.983804+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:35:30.983804+0000","last_undegraded":"2024-03-20T13:35:30.983804+0000","last_fullsized":"2024-03-20T13:35:30.983804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984038+0000","last_change":"2024-03-20T13:34:49.946558+0000","last_active":"2024-03-20T13:35:30.984038+0000","last_peered":"2024-03-20T13:35:30.984038+0000","last_clean":"2024-03-20T13:35:30.984038+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:35:30.984038+0000","last_undegraded":"2024-03-20T13:35:30.984038+0000","last_fullsized":"2024-03-20T13:35:30.984038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.953134+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:01:47.441326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981395+0000","last_change":"2024-03-20T13:34:49.945395+0000","last_active":"2024-03-20T13:35:30.981395+0000","last_peered":"2024-03-20T13:35:30.981395+0000","last_clean":"2024-03-20T13:35:30.981395+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:35:30.981395+0000","last_undegraded":"2024-03-20T13:35:30.981395+0000","last_fullsized":"2024-03-20T13:35:30.981395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969303+0000","last_change":"2024-03-20T13:34:51.947021+0000","last_active":"2024-03-20T13:36:17.969303+0000","last_peered":"2024-03-20T13:36:17.969303+0000","last_clean":"2024-03-20T13:36:17.969303+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:36:17.969303+0000","last_undegraded":"2024-03-20T13:36:17.969303+0000","last_fullsized":"2024-03-20T13:36:17.969303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.962603+0000","last_change":"2024-03-20T13:34:49.946770+0000","last_active":"2024-03-20T13:36:17.962603+0000","last_peered":"2024-03-20T13:36:17.962603+0000","last_clean":"2024-03-20T13:36:17.962603+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:36:17.962603+0000","last_undegraded":"2024-03-20T13:36:17.962603+0000","last_fullsized":"2024-03-20T13:36:17.962603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426260+0000","last_change":"2024-03-20T13:34:51.941533+0000","last_active":"2024-03-20T13:35:35.426260+0000","last_peered":"2024-03-20T13:35:35.426260+0000","last_clean":"2024-03-20T13:35:35.426260+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:35:35.426260+0000","last_undegraded":"2024-03-20T13:35:35.426260+0000","last_fullsized":"2024-03-20T13:35:35.426260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984680+0000","last_change":"2024-03-20T13:34:49.934739+0000","last_active":"2024-03-20T13:35:30.984680+0000","last_peered":"2024-03-20T13:35:30.984680+0000","last_clean":"2024-03-20T13:35:30.984680+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:35:30.984680+0000","last_undegraded":"2024-03-20T13:35:30.984680+0000","last_fullsized":"2024-03-20T13:35:30.984680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:24.437773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983296+0000","last_change":"2024-03-20T13:34:51.948058+0000","last_active":"2024-03-20T13:35:30.983296+0000","last_peered":"2024-03-20T13:35:30.983296+0000","last_clean":"2024-03-20T13:35:30.983296+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:35:30.983296+0000","last_undegraded":"2024-03-20T13:35:30.983296+0000","last_fullsized":"2024-03-20T13:35:30.983296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.421616+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:35:35.421616+0000","last_peered":"2024-03-20T13:35:35.421616+0000","last_clean":"2024-03-20T13:35:35.421616+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:35:35.421616+0000","last_undegraded":"2024-03-20T13:35:35.421616+0000","last_fullsized":"2024-03-20T13:35:35.421616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:33.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988240+0000","last_change":"2024-03-20T13:34:51.949486+0000","last_active":"2024-03-20T13:35:30.988240+0000","last_peered":"2024-03-20T13:35:30.988240+0000","last_clean":"2024-03-20T13:35:30.988240+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:35:30.988240+0000","last_undegraded":"2024-03-20T13:35:30.988240+0000","last_fullsized":"2024-03-20T13:35:30.988240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:46.252000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982607+0000","last_change":"2024-03-20T13:34:49.934646+0000","last_active":"2024-03-20T13:35:30.982607+0000","last_peered":"2024-03-20T13:35:30.982607+0000","last_clean":"2024-03-20T13:35:30.982607+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:35:30.982607+0000","last_undegraded":"2024-03-20T13:35:30.982607+0000","last_fullsized":"2024-03-20T13:35:30.982607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568234+0000","last_change":"2024-03-20T13:34:51.935272+0000","last_active":"2024-03-20T13:36:23.568234+0000","last_peered":"2024-03-20T13:36:23.568234+0000","last_clean":"2024-03-20T13:36:23.568234+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:36:23.568234+0000","last_undegraded":"2024-03-20T13:36:23.568234+0000","last_fullsized":"2024-03-20T13:36:23.568234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981576+0000","last_change":"2024-03-20T13:34:49.955817+0000","last_active":"2024-03-20T13:35:30.981576+0000","last_peered":"2024-03-20T13:35:30.981576+0000","last_clean":"2024-03-20T13:35:30.981576+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:35:30.981576+0000","last_undegraded":"2024-03-20T13:35:30.981576+0000","last_fullsized":"2024-03-20T13:35:30.981576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925361+0000","last_change":"2024-03-20T13:34:51.946963+0000","last_active":"2024-03-20T13:35:35.925361+0000","last_peered":"2024-03-20T13:35:35.925361+0000","last_clean":"2024-03-20T13:35:35.925361+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:35:35.925361+0000","last_undegraded":"2024-03-20T13:35:35.925361+0000","last_fullsized":"2024-03-20T13:35:35.925361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980780+0000","last_change":"2024-03-20T13:34:49.944556+0000","last_active":"2024-03-20T13:35:30.980780+0000","last_peered":"2024-03-20T13:35:30.980780+0000","last_clean":"2024-03-20T13:35:30.980780+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:35:30.980780+0000","last_undegraded":"2024-03-20T13:35:30.980780+0000","last_fullsized":"2024-03-20T13:35:30.980780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164645+0000","last_change":"2024-03-20T13:34:51.948336+0000","last_active":"2024-03-20T13:35:35.164645+0000","last_peered":"2024-03-20T13:35:35.164645+0000","last_clean":"2024-03-20T13:35:35.164645+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:35:35.164645+0000","last_undegraded":"2024-03-20T13:35:35.164645+0000","last_fullsized":"2024-03-20T13:35:35.164645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:45.966592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988635+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:35:30.988635+0000","last_peered":"2024-03-20T13:35:30.988635+0000","last_clean":"2024-03-20T13:35:30.988635+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:35:30.988635+0000","last_undegraded":"2024-03-20T13:35:30.988635+0000","last_fullsized":"2024-03-20T13:35:30.988635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:46.604615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568629+0000","last_change":"2024-03-20T13:34:51.950006+0000","last_active":"2024-03-20T13:36:23.568629+0000","last_peered":"2024-03-20T13:36:23.568629+0000","last_clean":"2024-03-20T13:36:23.568629+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:23.568629+0000","last_undegraded":"2024-03-20T13:36:23.568629+0000","last_fullsized":"2024-03-20T13:36:23.568629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:54:37.940365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990260+0000","last_change":"2024-03-20T13:34:49.962883+0000","last_active":"2024-03-20T13:35:30.990260+0000","last_peered":"2024-03-20T13:35:30.990260+0000","last_clean":"2024-03-20T13:35:30.990260+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:35:30.990260+0000","last_undegraded":"2024-03-20T13:35:30.990260+0000","last_fullsized":"2024-03-20T13:35:30.990260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:06.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568300+0000","last_change":"2024-03-20T13:34:51.951979+0000","last_active":"2024-03-20T13:36:23.568300+0000","last_peered":"2024-03-20T13:36:23.568300+0000","last_clean":"2024-03-20T13:36:23.568300+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:36:23.568300+0000","last_undegraded":"2024-03-20T13:36:23.568300+0000","last_fullsized":"2024-03-20T13:36:23.568300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:41.546768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989598+0000","last_change":"2024-03-20T13:34:49.950220+0000","last_active":"2024-03-20T13:35:30.989598+0000","last_peered":"2024-03-20T13:35:30.989598+0000","last_clean":"2024-03-20T13:35:30.989598+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:35:30.989598+0000","last_undegraded":"2024-03-20T13:35:30.989598+0000","last_fullsized":"2024-03-20T13:35:30.989598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981812+0000","last_change":"2024-03-20T13:34:51.945790+0000","last_active":"2024-03-20T13:35:30.981812+0000","last_peered":"2024-03-20T13:35:30.981812+0000","last_clean":"2024-03-20T13:35:30.981812+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:35:30.981812+0000","last_undegraded":"2024-03-20T13:35:30.981812+0000","last_fullsized":"2024-03-20T13:35:30.981812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.312469+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:17.312469+0000","last_peered":"2024-03-20T13:36:17.312469+0000","last_clean":"2024-03-20T13:36:17.312469+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:17.312469+0000","last_undegraded":"2024-03-20T13:36:17.312469+0000","last_fullsized":"2024-03-20T13:36:17.312469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:59.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984472+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:35:30.984472+0000","last_peered":"2024-03-20T13:35:30.984472+0000","last_clean":"2024-03-20T13:35:30.984472+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:35:30.984472+0000","last_undegraded":"2024-03-20T13:35:30.984472+0000","last_fullsized":"2024-03-20T13:35:30.984472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:32.396271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984838+0000","last_change":"2024-03-20T13:34:51.947552+0000","last_active":"2024-03-20T13:35:30.984838+0000","last_peered":"2024-03-20T13:35:30.984838+0000","last_clean":"2024-03-20T13:35:30.984838+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:35:30.984838+0000","last_undegraded":"2024-03-20T13:35:30.984838+0000","last_fullsized":"2024-03-20T13:35:30.984838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982733+0000","last_change":"2024-03-20T13:34:49.941425+0000","last_active":"2024-03-20T13:35:30.982733+0000","last_peered":"2024-03-20T13:35:30.982733+0000","last_clean":"2024-03-20T13:35:30.982733+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:35:30.982733+0000","last_undegraded":"2024-03-20T13:35:30.982733+0000","last_fullsized":"2024-03-20T13:35:30.982733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969447+0000","last_change":"2024-03-20T13:34:51.944562+0000","last_active":"2024-03-20T13:36:17.969447+0000","last_peered":"2024-03-20T13:36:17.969447+0000","last_clean":"2024-03-20T13:36:17.969447+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:36:17.969447+0000","last_undegraded":"2024-03-20T13:36:17.969447+0000","last_fullsized":"2024-03-20T13:36:17.969447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.45000000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.308},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28399999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672987,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705689,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.14599999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.30299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:31.752 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:31.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.880+0000 7f2576825640 1 Processor -- start 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.880+0000 7f2576825640 1 -- start start 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f2576825640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2570098900 0x7f2570098ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f2576825640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f257009dc90 con 0x7f2570099220 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f2576825640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f257009a360 con 0x7f2570098900 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f256ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2570098900 0x7f2570098ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f256f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2570099220 0x7f2570096580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42928/0 (socket says 172.21.15.28:42928) 2024-03-20T13:36:31.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f256f7fe640 1 -- 172.21.15.28:0/1636488959 learned_addr learned my addr 172.21.15.28:0/1636488959 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:31.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f256ffff640 1 -- 172.21.15.28:0/1636488959 >> v1:172.21.15.28:6789/0 conn(0x7f2570099220 legacy=0x7f2570096580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.884 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.881+0000 7f256ffff640 1 -- 172.21.15.28:0/1636488959 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2570099d30 con 0x7f2570098900 2024-03-20T13:36:31.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f256ffff640 1 --2- 172.21.15.28:0/1636488959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570098ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2558009720 tx=0x7f255802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba444544c76d22f server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f256effd640 1 -- 172.21.15.28:0/1636488959 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f255802e070 con 0x7f2570098900 2024-03-20T13:36:31.886 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f256effd640 1 -- 172.21.15.28:0/1636488959 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25580316d0 con 0x7f2570098900 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f256effd640 1 -- 172.21.15.28:0/1636488959 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2558031990 con 0x7f2570098900 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f2576825640 1 -- 172.21.15.28:0/1636488959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 msgr2=0x7f2570098ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f2576825640 1 --2- 172.21.15.28:0/1636488959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570098ce0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f2558009720 tx=0x7f255802b840 comp rx=0 tx=0).stop 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f2576825640 1 -- 172.21.15.28:0/1636488959 shutdown_connections 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f2576825640 1 --2- 172.21.15.28:0/1636488959 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570098ce0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.882+0000 7f2576825640 1 -- 172.21.15.28:0/1636488959 >> 172.21.15.28:0/1636488959 conn(0x7f25700a0a20 msgr2=0x7f257009cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.883+0000 7f2576825640 1 -- 172.21.15.28:0/1636488959 shutdown_connections 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.883+0000 7f2576825640 1 -- 172.21.15.28:0/1636488959 wait complete. 2024-03-20T13:36:31.887 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.883+0000 7f2576825640 1 Processor -- start 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f2576825640 1 -- start start 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f2576825640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570129df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f2576825640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2570072150 con 0x7f2570098900 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f256ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570129df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f256ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570129df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48934/0 (socket says 172.21.15.28:48934) 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f256ffff640 1 -- 172.21.15.28:0/1192572867 learned_addr learned my addr 172.21.15.28:0/1192572867 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f256ffff640 1 -- 172.21.15.28:0/1192572867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2558009400 con 0x7f2570098900 2024-03-20T13:36:31.888 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.884+0000 7f256ffff640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570129df0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2558034040 tx=0x7f25580046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.885+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2558032830 con 0x7f2570098900 2024-03-20T13:36:31.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.885+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2558032990 con 0x7f2570098900 2024-03-20T13:36:31.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.885+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f257012b5f0 con 0x7f2570098900 2024-03-20T13:36:31.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.885+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2558032c50 con 0x7f2570098900 2024-03-20T13:36:31.889 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.885+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f257006c7d0 con 0x7f2570098900 2024-03-20T13:36:31.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.885+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f255804d3f0 con 0x7f2570098900 2024-03-20T13:36:31.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.886+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25700627b0 con 0x7f2570098900 2024-03-20T13:36:31.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.886+0000 7f256cff9640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2550037ef0 0x7f255003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:31.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.886+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f255806d3f0 con 0x7f2570098900 2024-03-20T13:36:31.890 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.886+0000 7f256f7fe640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2550037ef0 0x7f255003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:31.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.887+0000 7f256f7fe640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2550037ef0 0x7f255003a3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2560007fd0 tx=0x7f2560007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:31.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:31.890+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f2558032db0 con 0x7f2570098900 2024-03-20T13:36:32.070 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.069+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f257009d7e0 con 0x7f2550037ef0 2024-03-20T13:36:32.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.084+0000 7f256cff9640 1 -- 172.21.15.28:0/1192572867 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673678 (secure 0 0 0) 0x7f25600012f0 con 0x7f2550037ef0 2024-03-20T13:36:32.093 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:36:32.098 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:36:32.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2550037ef0 msgr2=0x7f255003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2550037ef0 0x7f255003a3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f2560007fd0 tx=0x7f2560007ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.100 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 msgr2=0x7f2570129df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570129df0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f2558034040 tx=0x7f25580046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 shutdown_connections 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f2550037ef0 0x7f255003a3b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 --2- 172.21.15.28:0/1192572867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2570098900 0x7f2570129df0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 >> 172.21.15.28:0/1192572867 conn(0x7f25700a0a20 msgr2=0x7f2570126510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 shutdown_connections 2024-03-20T13:36:32.101 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.089+0000 7f2576825640 1 -- 172.21.15.28:0/1192572867 wait complete. 2024-03-20T13:36:32.102 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-03-20T13:36:31.169793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3797,"num_read_kb":3440,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":281,"num_read_kb":273,"num_write":79,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988720+0000","last_change":"2024-03-20T13:34:49.945378+0000","last_active":"2024-03-20T13:35:30.988720+0000","last_peered":"2024-03-20T13:35:30.988720+0000","last_clean":"2024-03-20T13:35:30.988720+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:35:30.988720+0000","last_undegraded":"2024-03-20T13:35:30.988720+0000","last_fullsized":"2024-03-20T13:35:30.988720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925322+0000","last_change":"2024-03-20T13:34:51.948629+0000","last_active":"2024-03-20T13:35:35.925322+0000","last_peered":"2024-03-20T13:35:35.925322+0000","last_clean":"2024-03-20T13:35:35.925322+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:35:35.925322+0000","last_undegraded":"2024-03-20T13:35:35.925322+0000","last_fullsized":"2024-03-20T13:35:35.925322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984600+0000","last_change":"2024-03-20T13:34:49.933462+0000","last_active":"2024-03-20T13:35:30.984600+0000","last_peered":"2024-03-20T13:35:30.984600+0000","last_clean":"2024-03-20T13:35:30.984600+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:35:30.984600+0000","last_undegraded":"2024-03-20T13:35:30.984600+0000","last_fullsized":"2024-03-20T13:35:30.984600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:34.991691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568207+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.568207+0000","last_peered":"2024-03-20T13:36:23.568207+0000","last_clean":"2024-03-20T13:36:23.568207+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.568207+0000","last_undegraded":"2024-03-20T13:36:23.568207+0000","last_fullsized":"2024-03-20T13:36:23.568207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:53.377689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.796505+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:35:34.796505+0000","last_peered":"2024-03-20T13:35:34.796505+0000","last_clean":"2024-03-20T13:35:34.796505+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:35:34.796505+0000","last_undegraded":"2024-03-20T13:35:34.796505+0000","last_fullsized":"2024-03-20T13:35:34.796505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:36.437918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986674+0000","last_change":"2024-03-20T13:34:51.947769+0000","last_active":"2024-03-20T13:35:30.986674+0000","last_peered":"2024-03-20T13:35:30.986674+0000","last_clean":"2024-03-20T13:35:30.986674+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:35:30.986674+0000","last_undegraded":"2024-03-20T13:35:30.986674+0000","last_fullsized":"2024-03-20T13:35:30.986674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:10.763673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.407859+0000","last_change":"2024-03-20T13:34:49.952708+0000","last_active":"2024-03-20T13:35:35.407859+0000","last_peered":"2024-03-20T13:35:35.407859+0000","last_clean":"2024-03-20T13:35:35.407859+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:35:35.407859+0000","last_undegraded":"2024-03-20T13:35:35.407859+0000","last_fullsized":"2024-03-20T13:35:35.407859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309640+0000","last_change":"2024-03-20T13:35:30.996431+0000","last_active":"2024-03-20T13:36:17.309640+0000","last_peered":"2024-03-20T13:36:17.309640+0000","last_clean":"2024-03-20T13:36:17.309640+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:36:17.309640+0000","last_undegraded":"2024-03-20T13:36:17.309640+0000","last_fullsized":"2024-03-20T13:36:17.309640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:29.110394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987551+0000","last_change":"2024-03-20T13:34:49.959192+0000","last_active":"2024-03-20T13:35:30.987551+0000","last_peered":"2024-03-20T13:35:30.987551+0000","last_clean":"2024-03-20T13:35:30.987551+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:35:30.987551+0000","last_undegraded":"2024-03-20T13:35:30.987551+0000","last_fullsized":"2024-03-20T13:35:30.987551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:53.061218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309603+0000","last_change":"2024-03-20T13:34:51.946953+0000","last_active":"2024-03-20T13:36:17.309603+0000","last_peered":"2024-03-20T13:36:17.309603+0000","last_clean":"2024-03-20T13:36:17.309603+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:36:17.309603+0000","last_undegraded":"2024-03-20T13:36:17.309603+0000","last_fullsized":"2024-03-20T13:36:17.309603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985613+0000","last_change":"2024-03-20T13:34:49.954949+0000","last_active":"2024-03-20T13:35:30.985613+0000","last_peered":"2024-03-20T13:35:30.985613+0000","last_clean":"2024-03-20T13:35:30.985613+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:35:30.985613+0000","last_undegraded":"2024-03-20T13:35:30.985613+0000","last_fullsized":"2024-03-20T13:35:30.985613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988705+0000","last_change":"2024-03-20T13:34:51.952540+0000","last_active":"2024-03-20T13:35:30.988705+0000","last_peered":"2024-03-20T13:35:30.988705+0000","last_clean":"2024-03-20T13:35:30.988705+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:35:30.988705+0000","last_undegraded":"2024-03-20T13:35:30.988705+0000","last_fullsized":"2024-03-20T13:35:30.988705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:28.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986108+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:35:30.986108+0000","last_peered":"2024-03-20T13:35:30.986108+0000","last_clean":"2024-03-20T13:35:30.986108+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:35:30.986108+0000","last_undegraded":"2024-03-20T13:35:30.986108+0000","last_fullsized":"2024-03-20T13:35:30.986108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:09:20.487446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568527+0000","last_change":"2024-03-20T13:34:51.948321+0000","last_active":"2024-03-20T13:36:23.568527+0000","last_peered":"2024-03-20T13:36:23.568527+0000","last_clean":"2024-03-20T13:36:23.568527+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:23.568527+0000","last_undegraded":"2024-03-20T13:36:23.568527+0000","last_fullsized":"2024-03-20T13:36:23.568527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982427+0000","last_change":"2024-03-20T13:34:49.940856+0000","last_active":"2024-03-20T13:35:30.982427+0000","last_peered":"2024-03-20T13:35:30.982427+0000","last_clean":"2024-03-20T13:35:30.982427+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:35:30.982427+0000","last_undegraded":"2024-03-20T13:35:30.982427+0000","last_fullsized":"2024-03-20T13:35:30.982427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309552+0000","last_change":"2024-03-20T13:34:51.945268+0000","last_active":"2024-03-20T13:36:17.309552+0000","last_peered":"2024-03-20T13:36:17.309552+0000","last_clean":"2024-03-20T13:36:17.309552+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:36:17.309552+0000","last_undegraded":"2024-03-20T13:36:17.309552+0000","last_fullsized":"2024-03-20T13:36:17.309552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969415+0000","last_change":"2024-03-20T13:34:51.949454+0000","last_active":"2024-03-20T13:36:17.969415+0000","last_peered":"2024-03-20T13:36:17.969415+0000","last_clean":"2024-03-20T13:36:17.969415+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:36:17.969415+0000","last_undegraded":"2024-03-20T13:36:17.969415+0000","last_fullsized":"2024-03-20T13:36:17.969415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:22.583858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983023+0000","last_change":"2024-03-20T13:34:49.945284+0000","last_active":"2024-03-20T13:35:30.983023+0000","last_peered":"2024-03-20T13:35:30.983023+0000","last_clean":"2024-03-20T13:35:30.983023+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:35:30.983023+0000","last_undegraded":"2024-03-20T13:35:30.983023+0000","last_fullsized":"2024-03-20T13:35:30.983023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568361+0000","last_change":"2024-03-20T13:34:51.948725+0000","last_active":"2024-03-20T13:36:23.568361+0000","last_peered":"2024-03-20T13:36:23.568361+0000","last_clean":"2024-03-20T13:36:23.568361+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:23.568361+0000","last_undegraded":"2024-03-20T13:36:23.568361+0000","last_fullsized":"2024-03-20T13:36:23.568361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990655+0000","last_change":"2024-03-20T13:34:49.950644+0000","last_active":"2024-03-20T13:35:30.990655+0000","last_peered":"2024-03-20T13:35:30.990655+0000","last_clean":"2024-03-20T13:35:30.990655+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:35:30.990655+0000","last_undegraded":"2024-03-20T13:35:30.990655+0000","last_fullsized":"2024-03-20T13:35:30.990655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.165007+0000","last_change":"2024-03-20T13:34:51.947958+0000","last_active":"2024-03-20T13:35:35.165007+0000","last_peered":"2024-03-20T13:35:35.165007+0000","last_clean":"2024-03-20T13:35:35.165007+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:35:35.165007+0000","last_undegraded":"2024-03-20T13:35:35.165007+0000","last_fullsized":"2024-03-20T13:35:35.165007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:26.305545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.410831+0000","last_change":"2024-03-20T13:34:49.946510+0000","last_active":"2024-03-20T13:35:35.410831+0000","last_peered":"2024-03-20T13:35:35.410831+0000","last_clean":"2024-03-20T13:35:35.410831+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:35:35.410831+0000","last_undegraded":"2024-03-20T13:35:35.410831+0000","last_fullsized":"2024-03-20T13:35:35.410831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815929+0000","last_change":"2024-03-20T13:34:51.937387+0000","last_active":"2024-03-20T13:35:34.815929+0000","last_peered":"2024-03-20T13:35:34.815929+0000","last_clean":"2024-03-20T13:35:34.815929+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:35:34.815929+0000","last_undegraded":"2024-03-20T13:35:34.815929+0000","last_fullsized":"2024-03-20T13:35:34.815929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982385+0000","last_change":"2024-03-20T13:34:49.949930+0000","last_active":"2024-03-20T13:35:30.982385+0000","last_peered":"2024-03-20T13:35:30.982385+0000","last_clean":"2024-03-20T13:35:30.982385+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:35:30.982385+0000","last_undegraded":"2024-03-20T13:35:30.982385+0000","last_fullsized":"2024-03-20T13:35:30.982385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976899+0000","last_change":"2024-03-20T13:34:51.941800+0000","last_active":"2024-03-20T13:36:17.976899+0000","last_peered":"2024-03-20T13:36:17.976899+0000","last_clean":"2024-03-20T13:36:17.976899+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:36:17.976899+0000","last_undegraded":"2024-03-20T13:36:17.976899+0000","last_fullsized":"2024-03-20T13:36:17.976899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984331+0000","last_change":"2024-03-20T13:34:49.934846+0000","last_active":"2024-03-20T13:35:30.984331+0000","last_peered":"2024-03-20T13:35:30.984331+0000","last_clean":"2024-03-20T13:35:30.984331+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:35:30.984331+0000","last_undegraded":"2024-03-20T13:35:30.984331+0000","last_fullsized":"2024-03-20T13:35:30.984331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309570+0000","last_change":"2024-03-20T13:34:51.948384+0000","last_active":"2024-03-20T13:36:17.309570+0000","last_peered":"2024-03-20T13:36:17.309570+0000","last_clean":"2024-03-20T13:36:17.309570+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:36:17.309570+0000","last_undegraded":"2024-03-20T13:36:17.309570+0000","last_fullsized":"2024-03-20T13:36:17.309570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:39.648807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986253+0000","last_change":"2024-03-20T13:34:49.959590+0000","last_active":"2024-03-20T13:35:30.986253+0000","last_peered":"2024-03-20T13:35:30.986253+0000","last_clean":"2024-03-20T13:35:30.986253+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:35:30.986253+0000","last_undegraded":"2024-03-20T13:35:30.986253+0000","last_fullsized":"2024-03-20T13:35:30.986253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:00.815146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559090+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:23.559090+0000","last_peered":"2024-03-20T13:36:23.559090+0000","last_clean":"2024-03-20T13:36:23.559090+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:23.559090+0000","last_undegraded":"2024-03-20T13:36:23.559090+0000","last_fullsized":"2024-03-20T13:36:23.559090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:37.139674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.994987+0000","last_change":"2024-03-20T13:35:30.994560+0000","last_active":"2024-03-20T13:35:30.994987+0000","last_peered":"2024-03-20T13:35:30.994987+0000","last_clean":"2024-03-20T13:35:30.994987+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:35:30.994987+0000","last_undegraded":"2024-03-20T13:35:30.994987+0000","last_fullsized":"2024-03-20T13:35:30.994987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:54.906208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987284+0000","last_change":"2024-03-20T13:34:49.959439+0000","last_active":"2024-03-20T13:35:30.987284+0000","last_peered":"2024-03-20T13:35:30.987284+0000","last_clean":"2024-03-20T13:35:30.987284+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:35:30.987284+0000","last_undegraded":"2024-03-20T13:35:30.987284+0000","last_fullsized":"2024-03-20T13:35:30.987284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:00.516394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988549+0000","last_change":"2024-03-20T13:34:53.942393+0000","last_active":"2024-03-20T13:35:30.988549+0000","last_peered":"2024-03-20T13:35:30.988549+0000","last_clean":"2024-03-20T13:35:30.988549+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:35:30.988549+0000","last_undegraded":"2024-03-20T13:35:30.988549+0000","last_fullsized":"2024-03-20T13:35:30.988549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:23.709018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.940990+0000","last_change":"2024-03-20T13:34:55.955194+0000","last_active":"2024-03-20T13:36:17.940990+0000","last_peered":"2024-03-20T13:36:17.940990+0000","last_clean":"2024-03-20T13:36:17.940990+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:36:17.940990+0000","last_undegraded":"2024-03-20T13:36:17.940990+0000","last_fullsized":"2024-03-20T13:36:17.940990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:57.391498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982874+0000","last_change":"2024-03-20T13:34:57.964242+0000","last_active":"2024-03-20T13:35:30.982874+0000","last_peered":"2024-03-20T13:35:30.982874+0000","last_clean":"2024-03-20T13:35:30.982874+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:35:30.982874+0000","last_undegraded":"2024-03-20T13:35:30.982874+0000","last_fullsized":"2024-03-20T13:35:30.982874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.266272+0000","last_change":"2024-03-20T13:34:59.969467+0000","last_active":"2024-03-20T13:36:12.266272+0000","last_peered":"2024-03-20T13:36:12.266272+0000","last_clean":"2024-03-20T13:36:12.266272+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:36:12.266272+0000","last_undegraded":"2024-03-20T13:36:12.266272+0000","last_fullsized":"2024-03-20T13:36:12.266272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:06:17.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309566+0000","last_change":"2024-03-20T13:34:51.943450+0000","last_active":"2024-03-20T13:36:17.309566+0000","last_peered":"2024-03-20T13:36:17.309566+0000","last_clean":"2024-03-20T13:36:17.309566+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:36:17.309566+0000","last_undegraded":"2024-03-20T13:36:17.309566+0000","last_fullsized":"2024-03-20T13:36:17.309566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:12:33.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985408+0000","last_change":"2024-03-20T13:34:49.955248+0000","last_active":"2024-03-20T13:35:30.985408+0000","last_peered":"2024-03-20T13:35:30.985408+0000","last_clean":"2024-03-20T13:35:30.985408+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:35:30.985408+0000","last_undegraded":"2024-03-20T13:35:30.985408+0000","last_fullsized":"2024-03-20T13:35:30.985408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983126+0000","last_change":"2024-03-20T13:34:53.944586+0000","last_active":"2024-03-20T13:35:30.983126+0000","last_peered":"2024-03-20T13:35:30.983126+0000","last_clean":"2024-03-20T13:35:30.983126+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:35:30.983126+0000","last_undegraded":"2024-03-20T13:35:30.983126+0000","last_fullsized":"2024-03-20T13:35:30.983126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:55.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981904+0000","last_change":"2024-03-20T13:34:55.953888+0000","last_active":"2024-03-20T13:35:30.981904+0000","last_peered":"2024-03-20T13:35:30.981904+0000","last_clean":"2024-03-20T13:35:30.981904+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:35:30.981904+0000","last_undegraded":"2024-03-20T13:35:30.981904+0000","last_fullsized":"2024-03-20T13:35:30.981904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:49:02.706193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981211+0000","last_change":"2024-03-20T13:34:57.966274+0000","last_active":"2024-03-20T13:35:30.981211+0000","last_peered":"2024-03-20T13:35:30.981211+0000","last_clean":"2024-03-20T13:35:30.981211+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:35:30.981211+0000","last_undegraded":"2024-03-20T13:35:30.981211+0000","last_fullsized":"2024-03-20T13:35:30.981211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.957308+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:17.957308+0000","last_peered":"2024-03-20T13:36:17.957308+0000","last_clean":"2024-03-20T13:36:17.957308+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:17.957308+0000","last_undegraded":"2024-03-20T13:36:17.957308+0000","last_fullsized":"2024-03-20T13:36:17.957308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969171+0000","last_change":"2024-03-20T13:34:51.940751+0000","last_active":"2024-03-20T13:36:17.969171+0000","last_peered":"2024-03-20T13:36:17.969171+0000","last_clean":"2024-03-20T13:36:17.969171+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:36:17.969171+0000","last_undegraded":"2024-03-20T13:36:17.969171+0000","last_fullsized":"2024-03-20T13:36:17.969171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:12.037950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985656+0000","last_change":"2024-03-20T13:34:49.959865+0000","last_active":"2024-03-20T13:35:30.985656+0000","last_peered":"2024-03-20T13:35:30.985656+0000","last_clean":"2024-03-20T13:35:30.985656+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:35:30.985656+0000","last_undegraded":"2024-03-20T13:35:30.985656+0000","last_fullsized":"2024-03-20T13:35:30.985656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:21.968097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985039+0000","last_change":"2024-03-20T13:34:53.944429+0000","last_active":"2024-03-20T13:35:30.985039+0000","last_peered":"2024-03-20T13:35:30.985039+0000","last_clean":"2024-03-20T13:35:30.985039+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:35:30.985039+0000","last_undegraded":"2024-03-20T13:35:30.985039+0000","last_fullsized":"2024-03-20T13:35:30.985039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:58.423104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986686+0000","last_change":"2024-03-20T13:34:55.951242+0000","last_active":"2024-03-20T13:35:30.986686+0000","last_peered":"2024-03-20T13:35:30.986686+0000","last_clean":"2024-03-20T13:35:30.986686+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:35:30.986686+0000","last_undegraded":"2024-03-20T13:35:30.986686+0000","last_fullsized":"2024-03-20T13:35:30.986686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:19.540711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002439+0000","last_change":"2024-03-20T13:34:57.969943+0000","last_active":"2024-03-20T13:36:24.002439+0000","last_peered":"2024-03-20T13:36:24.002439+0000","last_clean":"2024-03-20T13:36:24.002439+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:36:24.002439+0000","last_undegraded":"2024-03-20T13:36:24.002439+0000","last_fullsized":"2024-03-20T13:36:24.002439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:23.726307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985453+0000","last_change":"2024-03-20T13:34:59.971383+0000","last_active":"2024-03-20T13:35:30.985453+0000","last_peered":"2024-03-20T13:35:30.985453+0000","last_clean":"2024-03-20T13:35:30.985453+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:35:30.985453+0000","last_undegraded":"2024-03-20T13:35:30.985453+0000","last_fullsized":"2024-03-20T13:35:30.985453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:10.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.813600+0000","last_change":"2024-03-20T13:34:51.947848+0000","last_active":"2024-03-20T13:35:34.813600+0000","last_peered":"2024-03-20T13:35:34.813600+0000","last_clean":"2024-03-20T13:35:34.813600+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:35:34.813600+0000","last_undegraded":"2024-03-20T13:35:34.813600+0000","last_fullsized":"2024-03-20T13:35:34.813600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980679+0000","last_change":"2024-03-20T13:34:49.943444+0000","last_active":"2024-03-20T13:35:30.980679+0000","last_peered":"2024-03-20T13:35:30.980679+0000","last_clean":"2024-03-20T13:35:30.980679+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:35:30.980679+0000","last_undegraded":"2024-03-20T13:35:30.980679+0000","last_fullsized":"2024-03-20T13:35:30.980679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989445+0000","last_change":"2024-03-20T13:34:53.939852+0000","last_active":"2024-03-20T13:35:30.989445+0000","last_peered":"2024-03-20T13:35:30.989445+0000","last_clean":"2024-03-20T13:35:30.989445+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:35:30.989445+0000","last_undegraded":"2024-03-20T13:35:30.989445+0000","last_fullsized":"2024-03-20T13:35:30.989445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:56.912941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.935322+0000","last_change":"2024-03-20T13:34:55.957753+0000","last_active":"2024-03-20T13:36:17.935322+0000","last_peered":"2024-03-20T13:36:17.935322+0000","last_clean":"2024-03-20T13:36:17.935322+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:17.935322+0000","last_undegraded":"2024-03-20T13:36:17.935322+0000","last_fullsized":"2024-03-20T13:36:17.935322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:14.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":336,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002289+0000","last_change":"2024-03-20T13:34:57.968163+0000","last_active":"2024-03-20T13:36:24.002289+0000","last_peered":"2024-03-20T13:36:24.002289+0000","last_clean":"2024-03-20T13:36:24.002289+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:24.002289+0000","last_undegraded":"2024-03-20T13:36:24.002289+0000","last_fullsized":"2024-03-20T13:36:24.002289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:49.987254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969225+0000","last_change":"2024-03-20T13:34:51.953602+0000","last_active":"2024-03-20T13:36:17.969225+0000","last_peered":"2024-03-20T13:36:17.969225+0000","last_clean":"2024-03-20T13:36:17.969225+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:36:17.969225+0000","last_undegraded":"2024-03-20T13:36:17.969225+0000","last_fullsized":"2024-03-20T13:36:17.969225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:54.019802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988845+0000","last_change":"2024-03-20T13:34:49.944500+0000","last_active":"2024-03-20T13:35:30.988845+0000","last_peered":"2024-03-20T13:35:30.988845+0000","last_clean":"2024-03-20T13:35:30.988845+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:35:30.988845+0000","last_undegraded":"2024-03-20T13:35:30.988845+0000","last_fullsized":"2024-03-20T13:35:30.988845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980677+0000","last_change":"2024-03-20T13:34:53.945355+0000","last_active":"2024-03-20T13:35:30.980677+0000","last_peered":"2024-03-20T13:35:30.980677+0000","last_clean":"2024-03-20T13:35:30.980677+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:35:30.980677+0000","last_undegraded":"2024-03-20T13:35:30.980677+0000","last_fullsized":"2024-03-20T13:35:30.980677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.945229+0000","last_change":"2024-03-20T13:34:55.952069+0000","last_active":"2024-03-20T13:36:17.945229+0000","last_peered":"2024-03-20T13:36:17.945229+0000","last_clean":"2024-03-20T13:36:17.945229+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:17.945229+0000","last_undegraded":"2024-03-20T13:36:17.945229+0000","last_fullsized":"2024-03-20T13:36:17.945229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:43.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983837+0000","last_change":"2024-03-20T13:34:57.967957+0000","last_active":"2024-03-20T13:35:30.983837+0000","last_peered":"2024-03-20T13:35:30.983837+0000","last_clean":"2024-03-20T13:35:30.983837+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:35:30.983837+0000","last_undegraded":"2024-03-20T13:35:30.983837+0000","last_fullsized":"2024-03-20T13:35:30.983837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:03:03.819479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.754329+0000","last_change":"2024-03-20T13:34:59.974067+0000","last_active":"2024-03-20T13:36:17.754329+0000","last_peered":"2024-03-20T13:36:17.754329+0000","last_clean":"2024-03-20T13:36:17.754329+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:36:17.754329+0000","last_undegraded":"2024-03-20T13:36:17.754329+0000","last_fullsized":"2024-03-20T13:36:17.754329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:57.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164674+0000","last_change":"2024-03-20T13:34:51.941910+0000","last_active":"2024-03-20T13:35:35.164674+0000","last_peered":"2024-03-20T13:35:35.164674+0000","last_clean":"2024-03-20T13:35:35.164674+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:35:35.164674+0000","last_undegraded":"2024-03-20T13:35:35.164674+0000","last_fullsized":"2024-03-20T13:35:35.164674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.418375+0000","last_change":"2024-03-20T13:34:49.939109+0000","last_active":"2024-03-20T13:35:35.418375+0000","last_peered":"2024-03-20T13:35:35.418375+0000","last_clean":"2024-03-20T13:35:35.418375+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:35:35.418375+0000","last_undegraded":"2024-03-20T13:35:35.418375+0000","last_fullsized":"2024-03-20T13:35:35.418375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982623+0000","last_change":"2024-03-20T13:34:53.943905+0000","last_active":"2024-03-20T13:35:30.982623+0000","last_peered":"2024-03-20T13:35:30.982623+0000","last_clean":"2024-03-20T13:35:30.982623+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:35:30.982623+0000","last_undegraded":"2024-03-20T13:35:30.982623+0000","last_fullsized":"2024-03-20T13:35:30.982623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:30:51.851311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.527633+0000","last_change":"2024-03-20T13:34:55.954351+0000","last_active":"2024-03-20T13:36:23.527633+0000","last_peered":"2024-03-20T13:36:23.527633+0000","last_clean":"2024-03-20T13:36:23.527633+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:23.527633+0000","last_undegraded":"2024-03-20T13:36:23.527633+0000","last_fullsized":"2024-03-20T13:36:23.527633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:27:04.344480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982540+0000","last_change":"2024-03-20T13:34:57.962956+0000","last_active":"2024-03-20T13:35:30.982540+0000","last_peered":"2024-03-20T13:35:30.982540+0000","last_clean":"2024-03-20T13:35:30.982540+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:35:30.982540+0000","last_undegraded":"2024-03-20T13:35:30.982540+0000","last_fullsized":"2024-03-20T13:35:30.982540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.151593+0000","last_change":"2024-03-20T13:34:59.972444+0000","last_active":"2024-03-20T13:36:12.151593+0000","last_peered":"2024-03-20T13:36:12.151593+0000","last_clean":"2024-03-20T13:36:12.151593+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:36:12.151593+0000","last_undegraded":"2024-03-20T13:36:12.151593+0000","last_fullsized":"2024-03-20T13:36:12.151593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309560+0000","last_change":"2024-03-20T13:34:51.941838+0000","last_active":"2024-03-20T13:36:17.309560+0000","last_peered":"2024-03-20T13:36:17.309560+0000","last_clean":"2024-03-20T13:36:17.309560+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:36:17.309560+0000","last_undegraded":"2024-03-20T13:36:17.309560+0000","last_fullsized":"2024-03-20T13:36:17.309560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:08.971370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990186+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:35:30.990186+0000","last_peered":"2024-03-20T13:35:30.990186+0000","last_clean":"2024-03-20T13:35:30.990186+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:35:30.990186+0000","last_undegraded":"2024-03-20T13:35:30.990186+0000","last_fullsized":"2024-03-20T13:35:30.990186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:10.797692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984920+0000","last_change":"2024-03-20T13:34:53.942038+0000","last_active":"2024-03-20T13:35:30.984920+0000","last_peered":"2024-03-20T13:35:30.984920+0000","last_clean":"2024-03-20T13:35:30.984920+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:35:30.984920+0000","last_undegraded":"2024-03-20T13:35:30.984920+0000","last_fullsized":"2024-03-20T13:35:30.984920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:28.393295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.947391+0000","last_change":"2024-03-20T13:34:55.954800+0000","last_active":"2024-03-20T13:36:17.947391+0000","last_peered":"2024-03-20T13:36:17.947391+0000","last_clean":"2024-03-20T13:36:17.947391+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:17.947391+0000","last_undegraded":"2024-03-20T13:36:17.947391+0000","last_fullsized":"2024-03-20T13:36:17.947391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:36:42.942474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002273+0000","last_change":"2024-03-20T13:34:57.969445+0000","last_active":"2024-03-20T13:36:24.002273+0000","last_peered":"2024-03-20T13:36:24.002273+0000","last_clean":"2024-03-20T13:36:24.002273+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:24.002273+0000","last_undegraded":"2024-03-20T13:36:24.002273+0000","last_fullsized":"2024-03-20T13:36:24.002273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983928+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:35:30.983928+0000","last_peered":"2024-03-20T13:35:30.983928+0000","last_clean":"2024-03-20T13:35:30.983928+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:35:30.983928+0000","last_undegraded":"2024-03-20T13:35:30.983928+0000","last_fullsized":"2024-03-20T13:35:30.983928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:24:13.286967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986688+0000","last_change":"2024-03-20T13:34:51.935109+0000","last_active":"2024-03-20T13:35:30.986688+0000","last_peered":"2024-03-20T13:35:30.986688+0000","last_clean":"2024-03-20T13:35:30.986688+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:35:30.986688+0000","last_undegraded":"2024-03-20T13:35:30.986688+0000","last_fullsized":"2024-03-20T13:35:30.986688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988096+0000","last_change":"2024-03-20T13:34:49.962872+0000","last_active":"2024-03-20T13:35:30.988096+0000","last_peered":"2024-03-20T13:35:30.988096+0000","last_clean":"2024-03-20T13:35:30.988096+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:35:30.988096+0000","last_undegraded":"2024-03-20T13:35:30.988096+0000","last_fullsized":"2024-03-20T13:35:30.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:07.620568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982955+0000","last_change":"2024-03-20T13:34:53.943850+0000","last_active":"2024-03-20T13:35:30.982955+0000","last_peered":"2024-03-20T13:35:30.982955+0000","last_clean":"2024-03-20T13:35:30.982955+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:35:30.982955+0000","last_undegraded":"2024-03-20T13:35:30.982955+0000","last_fullsized":"2024-03-20T13:35:30.982955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:11.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.530542+0000","last_change":"2024-03-20T13:34:55.951028+0000","last_active":"2024-03-20T13:36:23.530542+0000","last_peered":"2024-03-20T13:36:23.530542+0000","last_clean":"2024-03-20T13:36:23.530542+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:23.530542+0000","last_undegraded":"2024-03-20T13:36:23.530542+0000","last_fullsized":"2024-03-20T13:36:23.530542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:57.615475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982468+0000","last_change":"2024-03-20T13:34:57.962288+0000","last_active":"2024-03-20T13:35:30.982468+0000","last_peered":"2024-03-20T13:35:30.982468+0000","last_clean":"2024-03-20T13:35:30.982468+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:35:30.982468+0000","last_undegraded":"2024-03-20T13:35:30.982468+0000","last_fullsized":"2024-03-20T13:35:30.982468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985030+0000","last_change":"2024-03-20T13:34:59.966660+0000","last_active":"2024-03-20T13:35:30.985030+0000","last_peered":"2024-03-20T13:35:30.985030+0000","last_clean":"2024-03-20T13:35:30.985030+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:35:30.985030+0000","last_undegraded":"2024-03-20T13:35:30.985030+0000","last_fullsized":"2024-03-20T13:35:30.985030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:19.864210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.812450+0000","last_change":"2024-03-20T13:34:51.943562+0000","last_active":"2024-03-20T13:35:34.812450+0000","last_peered":"2024-03-20T13:35:34.812450+0000","last_clean":"2024-03-20T13:35:34.812450+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:35:34.812450+0000","last_undegraded":"2024-03-20T13:35:34.812450+0000","last_fullsized":"2024-03-20T13:35:34.812450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983744+0000","last_change":"2024-03-20T13:34:49.933792+0000","last_active":"2024-03-20T13:35:30.983744+0000","last_peered":"2024-03-20T13:35:30.983744+0000","last_clean":"2024-03-20T13:35:30.983744+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:35:30.983744+0000","last_undegraded":"2024-03-20T13:35:30.983744+0000","last_fullsized":"2024-03-20T13:35:30.983744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.581973+0000","last_change":"2024-03-20T13:34:53.944673+0000","last_active":"2024-03-20T13:36:24.581973+0000","last_peered":"2024-03-20T13:36:24.581973+0000","last_clean":"2024-03-20T13:36:24.581973+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:24.581973+0000","last_undegraded":"2024-03-20T13:36:24.581973+0000","last_fullsized":"2024-03-20T13:36:24.581973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:36.699424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.929174+0000","last_change":"2024-03-20T13:34:55.952299+0000","last_active":"2024-03-20T13:36:17.929174+0000","last_peered":"2024-03-20T13:36:17.929174+0000","last_clean":"2024-03-20T13:36:17.929174+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:17.929174+0000","last_undegraded":"2024-03-20T13:36:17.929174+0000","last_fullsized":"2024-03-20T13:36:17.929174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:26:51.439053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989229+0000","last_change":"2024-03-20T13:34:57.962715+0000","last_active":"2024-03-20T13:35:30.989229+0000","last_peered":"2024-03-20T13:35:30.989229+0000","last_clean":"2024-03-20T13:35:30.989229+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:35:30.989229+0000","last_undegraded":"2024-03-20T13:35:30.989229+0000","last_fullsized":"2024-03-20T13:35:30.989229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:03.988490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.263192+0000","last_change":"2024-03-20T13:34:59.971713+0000","last_active":"2024-03-20T13:36:12.263192+0000","last_peered":"2024-03-20T13:36:12.263192+0000","last_clean":"2024-03-20T13:36:12.263192+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:36:12.263192+0000","last_undegraded":"2024-03-20T13:36:12.263192+0000","last_fullsized":"2024-03-20T13:36:12.263192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:17.405294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969186+0000","last_change":"2024-03-20T13:35:30.988681+0000","last_active":"2024-03-20T13:36:17.969186+0000","last_peered":"2024-03-20T13:36:17.969186+0000","last_clean":"2024-03-20T13:36:17.969186+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:36:17.969186+0000","last_undegraded":"2024-03-20T13:36:17.969186+0000","last_fullsized":"2024-03-20T13:36:17.969186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:48.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986833+0000","last_change":"2024-03-20T13:34:49.958288+0000","last_active":"2024-03-20T13:35:30.986833+0000","last_peered":"2024-03-20T13:35:30.986833+0000","last_clean":"2024-03-20T13:35:30.986833+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:35:30.986833+0000","last_undegraded":"2024-03-20T13:35:30.986833+0000","last_fullsized":"2024-03-20T13:35:30.986833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:55.228134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983298+0000","last_change":"2024-03-20T13:34:53.943738+0000","last_active":"2024-03-20T13:35:30.983298+0000","last_peered":"2024-03-20T13:35:30.983298+0000","last_clean":"2024-03-20T13:35:30.983298+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:35:30.983298+0000","last_undegraded":"2024-03-20T13:35:30.983298+0000","last_fullsized":"2024-03-20T13:35:30.983298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:23.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.955427+0000","last_change":"2024-03-20T13:34:55.948943+0000","last_active":"2024-03-20T13:36:17.955427+0000","last_peered":"2024-03-20T13:36:17.955427+0000","last_clean":"2024-03-20T13:36:17.955427+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:17.955427+0000","last_undegraded":"2024-03-20T13:36:17.955427+0000","last_fullsized":"2024-03-20T13:36:17.955427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002429+0000","last_change":"2024-03-20T13:34:57.967289+0000","last_active":"2024-03-20T13:36:24.002429+0000","last_peered":"2024-03-20T13:36:24.002429+0000","last_clean":"2024-03-20T13:36:24.002429+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:24.002429+0000","last_undegraded":"2024-03-20T13:36:24.002429+0000","last_fullsized":"2024-03-20T13:36:24.002429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:24.412437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.980936+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:17.980936+0000","last_peered":"2024-03-20T13:36:17.980936+0000","last_clean":"2024-03-20T13:36:17.980936+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:17.980936+0000","last_undegraded":"2024-03-20T13:36:17.980936+0000","last_fullsized":"2024-03-20T13:36:17.980936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989507+0000","last_change":"2024-03-20T13:34:51.942028+0000","last_active":"2024-03-20T13:35:30.989507+0000","last_peered":"2024-03-20T13:35:30.989507+0000","last_clean":"2024-03-20T13:35:30.989507+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:35:30.989507+0000","last_undegraded":"2024-03-20T13:35:30.989507+0000","last_fullsized":"2024-03-20T13:35:30.989507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986721+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:35:30.986721+0000","last_peered":"2024-03-20T13:35:30.986721+0000","last_clean":"2024-03-20T13:35:30.986721+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:35:30.986721+0000","last_undegraded":"2024-03-20T13:35:30.986721+0000","last_fullsized":"2024-03-20T13:35:30.986721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:29.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.581184+0000","last_change":"2024-03-20T13:34:53.942494+0000","last_active":"2024-03-20T13:36:24.581184+0000","last_peered":"2024-03-20T13:36:24.581184+0000","last_clean":"2024-03-20T13:36:24.581184+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:24.581184+0000","last_undegraded":"2024-03-20T13:36:24.581184+0000","last_fullsized":"2024-03-20T13:36:24.581184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:46.477351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989550+0000","last_change":"2024-03-20T13:34:55.953548+0000","last_active":"2024-03-20T13:35:30.989550+0000","last_peered":"2024-03-20T13:35:30.989550+0000","last_clean":"2024-03-20T13:35:30.989550+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:35:30.989550+0000","last_undegraded":"2024-03-20T13:35:30.989550+0000","last_fullsized":"2024-03-20T13:35:30.989550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:54:51.879036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":335,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002383+0000","last_change":"2024-03-20T13:34:57.961142+0000","last_active":"2024-03-20T13:36:24.002383+0000","last_peered":"2024-03-20T13:36:24.002383+0000","last_clean":"2024-03-20T13:36:24.002383+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:24.002383+0000","last_undegraded":"2024-03-20T13:36:24.002383+0000","last_fullsized":"2024-03-20T13:36:24.002383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984851+0000","last_change":"2024-03-20T13:34:59.973435+0000","last_active":"2024-03-20T13:35:30.984851+0000","last_peered":"2024-03-20T13:35:30.984851+0000","last_clean":"2024-03-20T13:35:30.984851+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:35:30.984851+0000","last_undegraded":"2024-03-20T13:35:30.984851+0000","last_fullsized":"2024-03-20T13:35:30.984851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:02.537560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.957248+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984276+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:35:30.984276+0000","last_peered":"2024-03-20T13:35:30.984276+0000","last_clean":"2024-03-20T13:35:30.984276+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:35:30.984276+0000","last_undegraded":"2024-03-20T13:35:30.984276+0000","last_fullsized":"2024-03-20T13:35:30.984276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:13:57.917330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988824+0000","last_change":"2024-03-20T13:34:53.944868+0000","last_active":"2024-03-20T13:35:30.988824+0000","last_peered":"2024-03-20T13:35:30.988824+0000","last_clean":"2024-03-20T13:35:30.988824+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:35:30.988824+0000","last_undegraded":"2024-03-20T13:35:30.988824+0000","last_fullsized":"2024-03-20T13:35:30.988824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.941994+0000","last_change":"2024-03-20T13:34:55.953350+0000","last_active":"2024-03-20T13:36:17.941994+0000","last_peered":"2024-03-20T13:36:17.941994+0000","last_clean":"2024-03-20T13:36:17.941994+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:17.941994+0000","last_undegraded":"2024-03-20T13:36:17.941994+0000","last_fullsized":"2024-03-20T13:36:17.941994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:50.265808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986529+0000","last_change":"2024-03-20T13:34:57.966451+0000","last_active":"2024-03-20T13:35:30.986529+0000","last_peered":"2024-03-20T13:35:30.986529+0000","last_clean":"2024-03-20T13:35:30.986529+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:35:30.986529+0000","last_undegraded":"2024-03-20T13:35:30.986529+0000","last_fullsized":"2024-03-20T13:35:30.986529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:08.191295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981156+0000","last_change":"2024-03-20T13:34:59.968783+0000","last_active":"2024-03-20T13:35:30.981156+0000","last_peered":"2024-03-20T13:35:30.981156+0000","last_clean":"2024-03-20T13:35:30.981156+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:35:30.981156+0000","last_undegraded":"2024-03-20T13:35:30.981156+0000","last_fullsized":"2024-03-20T13:35:30.981156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.660196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990368+0000","last_change":"2024-03-20T13:34:51.954171+0000","last_active":"2024-03-20T13:35:30.990368+0000","last_peered":"2024-03-20T13:35:30.990368+0000","last_clean":"2024-03-20T13:35:30.990368+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:35:30.990368+0000","last_undegraded":"2024-03-20T13:35:30.990368+0000","last_fullsized":"2024-03-20T13:35:30.990368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:02.169329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980412+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:35:30.980412+0000","last_peered":"2024-03-20T13:35:30.980412+0000","last_clean":"2024-03-20T13:35:30.980412+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:35:30.980412+0000","last_undegraded":"2024-03-20T13:35:30.980412+0000","last_fullsized":"2024-03-20T13:35:30.980412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:19.105808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987720+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:35:30.987720+0000","last_peered":"2024-03-20T13:35:30.987720+0000","last_clean":"2024-03-20T13:35:30.987720+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:35:30.987720+0000","last_undegraded":"2024-03-20T13:35:30.987720+0000","last_fullsized":"2024-03-20T13:35:30.987720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:56.825560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985917+0000","last_change":"2024-03-20T13:34:49.963030+0000","last_active":"2024-03-20T13:35:30.985917+0000","last_peered":"2024-03-20T13:35:30.985917+0000","last_clean":"2024-03-20T13:35:30.985917+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:35:30.985917+0000","last_undegraded":"2024-03-20T13:35:30.985917+0000","last_fullsized":"2024-03-20T13:35:30.985917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:06.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981550+0000","last_change":"2024-03-20T13:34:53.940877+0000","last_active":"2024-03-20T13:35:30.981550+0000","last_peered":"2024-03-20T13:35:30.981550+0000","last_clean":"2024-03-20T13:35:30.981550+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:35:30.981550+0000","last_undegraded":"2024-03-20T13:35:30.981550+0000","last_fullsized":"2024-03-20T13:35:30.981550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:43.553501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'71","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.547108+0000","last_change":"2024-03-20T13:34:55.954716+0000","last_active":"2024-03-20T13:36:23.547108+0000","last_peered":"2024-03-20T13:36:23.547108+0000","last_clean":"2024-03-20T13:36:23.547108+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:23.547108+0000","last_undegraded":"2024-03-20T13:36:23.547108+0000","last_fullsized":"2024-03-20T13:36:23.547108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:21:49.386776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984143+0000","last_change":"2024-03-20T13:34:57.961066+0000","last_active":"2024-03-20T13:35:30.984143+0000","last_peered":"2024-03-20T13:35:30.984143+0000","last_clean":"2024-03-20T13:35:30.984143+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:35:30.984143+0000","last_undegraded":"2024-03-20T13:35:30.984143+0000","last_fullsized":"2024-03-20T13:35:30.984143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:54.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.580959+0000","last_change":"2024-03-20T13:34:59.973427+0000","last_active":"2024-03-20T13:36:23.580959+0000","last_peered":"2024-03-20T13:36:23.580959+0000","last_clean":"2024-03-20T13:36:23.580959+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:23.580959+0000","last_undegraded":"2024-03-20T13:36:23.580959+0000","last_fullsized":"2024-03-20T13:36:23.580959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:32.618548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989266+0000","last_change":"2024-03-20T13:34:51.941170+0000","last_active":"2024-03-20T13:35:30.989266+0000","last_peered":"2024-03-20T13:35:30.989266+0000","last_clean":"2024-03-20T13:35:30.989266+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:35:30.989266+0000","last_undegraded":"2024-03-20T13:35:30.989266+0000","last_fullsized":"2024-03-20T13:35:30.989266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:10.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983697+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:35:30.983697+0000","last_peered":"2024-03-20T13:35:30.983697+0000","last_clean":"2024-03-20T13:35:30.983697+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:35:30.983697+0000","last_undegraded":"2024-03-20T13:35:30.983697+0000","last_fullsized":"2024-03-20T13:35:30.983697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:50:32.764565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982480+0000","last_change":"2024-03-20T13:34:49.941798+0000","last_active":"2024-03-20T13:35:30.982480+0000","last_peered":"2024-03-20T13:35:30.982480+0000","last_clean":"2024-03-20T13:35:30.982480+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:35:30.982480+0000","last_undegraded":"2024-03-20T13:35:30.982480+0000","last_fullsized":"2024-03-20T13:35:30.982480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990445+0000","last_change":"2024-03-20T13:34:53.941487+0000","last_active":"2024-03-20T13:35:30.990445+0000","last_peered":"2024-03-20T13:35:30.990445+0000","last_clean":"2024-03-20T13:35:30.990445+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:35:30.990445+0000","last_undegraded":"2024-03-20T13:35:30.990445+0000","last_fullsized":"2024-03-20T13:35:30.990445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002647+0000","last_change":"2024-03-20T13:34:55.956289+0000","last_active":"2024-03-20T13:36:24.002647+0000","last_peered":"2024-03-20T13:36:24.002647+0000","last_clean":"2024-03-20T13:36:24.002647+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:24.002647+0000","last_undegraded":"2024-03-20T13:36:24.002647+0000","last_fullsized":"2024-03-20T13:36:24.002647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:14.758225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987849+0000","last_change":"2024-03-20T13:34:57.964648+0000","last_active":"2024-03-20T13:35:30.987849+0000","last_peered":"2024-03-20T13:35:30.987849+0000","last_clean":"2024-03-20T13:35:30.987849+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:35:30.987849+0000","last_undegraded":"2024-03-20T13:35:30.987849+0000","last_fullsized":"2024-03-20T13:35:30.987849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:41.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.276503+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:12.276503+0000","last_peered":"2024-03-20T13:36:12.276503+0000","last_clean":"2024-03-20T13:36:12.276503+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:12.276503+0000","last_undegraded":"2024-03-20T13:36:12.276503+0000","last_fullsized":"2024-03-20T13:36:12.276503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969323+0000","last_change":"2024-03-20T13:34:51.947812+0000","last_active":"2024-03-20T13:36:17.969323+0000","last_peered":"2024-03-20T13:36:17.969323+0000","last_clean":"2024-03-20T13:36:17.969323+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:36:17.969323+0000","last_undegraded":"2024-03-20T13:36:17.969323+0000","last_fullsized":"2024-03-20T13:36:17.969323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985007+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:35:30.985007+0000","last_peered":"2024-03-20T13:35:30.985007+0000","last_clean":"2024-03-20T13:35:30.985007+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:35:30.985007+0000","last_undegraded":"2024-03-20T13:35:30.985007+0000","last_fullsized":"2024-03-20T13:35:30.985007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982056+0000","last_change":"2024-03-20T13:34:49.934321+0000","last_active":"2024-03-20T13:35:30.982056+0000","last_peered":"2024-03-20T13:35:30.982056+0000","last_clean":"2024-03-20T13:35:30.982056+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:35:30.982056+0000","last_undegraded":"2024-03-20T13:35:30.982056+0000","last_fullsized":"2024-03-20T13:35:30.982056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988938+0000","last_change":"2024-03-20T13:34:53.943172+0000","last_active":"2024-03-20T13:35:30.988938+0000","last_peered":"2024-03-20T13:35:30.988938+0000","last_clean":"2024-03-20T13:35:30.988938+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:35:30.988938+0000","last_undegraded":"2024-03-20T13:35:30.988938+0000","last_fullsized":"2024-03-20T13:35:30.988938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:28.432587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002508+0000","last_change":"2024-03-20T13:34:55.954133+0000","last_active":"2024-03-20T13:36:24.002508+0000","last_peered":"2024-03-20T13:36:24.002508+0000","last_clean":"2024-03-20T13:36:24.002508+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:24.002508+0000","last_undegraded":"2024-03-20T13:36:24.002508+0000","last_fullsized":"2024-03-20T13:36:24.002508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:47.638285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983783+0000","last_change":"2024-03-20T13:34:57.961111+0000","last_active":"2024-03-20T13:35:30.983783+0000","last_peered":"2024-03-20T13:35:30.983783+0000","last_clean":"2024-03-20T13:35:30.983783+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:35:30.983783+0000","last_undegraded":"2024-03-20T13:35:30.983783+0000","last_fullsized":"2024-03-20T13:35:30.983783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:59.940736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986127+0000","last_change":"2024-03-20T13:34:59.970194+0000","last_active":"2024-03-20T13:35:30.986127+0000","last_peered":"2024-03-20T13:35:30.986127+0000","last_clean":"2024-03-20T13:35:30.986127+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:35:30.986127+0000","last_undegraded":"2024-03-20T13:35:30.986127+0000","last_fullsized":"2024-03-20T13:35:30.986127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:45:19.139667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568296+0000","last_change":"2024-03-20T13:34:51.937043+0000","last_active":"2024-03-20T13:36:23.568296+0000","last_peered":"2024-03-20T13:36:23.568296+0000","last_clean":"2024-03-20T13:36:23.568296+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:36:23.568296+0000","last_undegraded":"2024-03-20T13:36:23.568296+0000","last_fullsized":"2024-03-20T13:36:23.568296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985645+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:35:30.985645+0000","last_peered":"2024-03-20T13:35:30.985645+0000","last_clean":"2024-03-20T13:35:30.985645+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:35:30.985645+0000","last_undegraded":"2024-03-20T13:35:30.985645+0000","last_fullsized":"2024-03-20T13:35:30.985645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:55:41.281803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987595+0000","last_change":"2024-03-20T13:34:49.938266+0000","last_active":"2024-03-20T13:35:30.987595+0000","last_peered":"2024-03-20T13:35:30.987595+0000","last_clean":"2024-03-20T13:35:30.987595+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:35:30.987595+0000","last_undegraded":"2024-03-20T13:35:30.987595+0000","last_fullsized":"2024-03-20T13:35:30.987595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983933+0000","last_change":"2024-03-20T13:34:53.942835+0000","last_active":"2024-03-20T13:35:30.983933+0000","last_peered":"2024-03-20T13:35:30.983933+0000","last_clean":"2024-03-20T13:35:30.983933+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:35:30.983933+0000","last_undegraded":"2024-03-20T13:35:30.983933+0000","last_fullsized":"2024-03-20T13:35:30.983933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:41.480924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988052+0000","last_change":"2024-03-20T13:34:55.955766+0000","last_active":"2024-03-20T13:35:30.988052+0000","last_peered":"2024-03-20T13:35:30.988052+0000","last_clean":"2024-03-20T13:35:30.988052+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:35:30.988052+0000","last_undegraded":"2024-03-20T13:35:30.988052+0000","last_fullsized":"2024-03-20T13:35:30.988052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:28.399469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989373+0000","last_change":"2024-03-20T13:34:57.962510+0000","last_active":"2024-03-20T13:35:30.989373+0000","last_peered":"2024-03-20T13:35:30.989373+0000","last_clean":"2024-03-20T13:35:30.989373+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:35:30.989373+0000","last_undegraded":"2024-03-20T13:35:30.989373+0000","last_fullsized":"2024-03-20T13:35:30.989373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.491130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982121+0000","last_change":"2024-03-20T13:34:59.972480+0000","last_active":"2024-03-20T13:35:30.982121+0000","last_peered":"2024-03-20T13:35:30.982121+0000","last_clean":"2024-03-20T13:35:30.982121+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:35:30.982121+0000","last_undegraded":"2024-03-20T13:35:30.982121+0000","last_fullsized":"2024-03-20T13:35:30.982121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:37.262606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612699+0000","last_change":"2024-03-20T13:34:51.950770+0000","last_active":"2024-03-20T13:36:17.612699+0000","last_peered":"2024-03-20T13:36:17.612699+0000","last_clean":"2024-03-20T13:36:17.612699+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:17.612699+0000","last_undegraded":"2024-03-20T13:36:17.612699+0000","last_fullsized":"2024-03-20T13:36:17.612699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:26.425854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986795+0000","last_change":"2024-03-20T13:34:49.936614+0000","last_active":"2024-03-20T13:35:30.986795+0000","last_peered":"2024-03-20T13:35:30.986795+0000","last_clean":"2024-03-20T13:35:30.986795+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:35:30.986795+0000","last_undegraded":"2024-03-20T13:35:30.986795+0000","last_fullsized":"2024-03-20T13:35:30.986795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983575+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:35:30.983575+0000","last_peered":"2024-03-20T13:35:30.983575+0000","last_clean":"2024-03-20T13:35:30.983575+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:35:30.983575+0000","last_undegraded":"2024-03-20T13:35:30.983575+0000","last_fullsized":"2024-03-20T13:35:30.983575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:35.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.489699+0000","last_change":"2024-03-20T13:34:53.942462+0000","last_active":"2024-03-20T13:36:24.489699+0000","last_peered":"2024-03-20T13:36:24.489699+0000","last_clean":"2024-03-20T13:36:24.489699+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:24.489699+0000","last_undegraded":"2024-03-20T13:36:24.489699+0000","last_fullsized":"2024-03-20T13:36:24.489699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:17.533635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.539599+0000","last_change":"2024-03-20T13:34:55.955509+0000","last_active":"2024-03-20T13:36:23.539599+0000","last_peered":"2024-03-20T13:36:23.539599+0000","last_clean":"2024-03-20T13:36:23.539599+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:23.539599+0000","last_undegraded":"2024-03-20T13:36:23.539599+0000","last_fullsized":"2024-03-20T13:36:23.539599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:22.404279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985626+0000","last_change":"2024-03-20T13:34:57.966334+0000","last_active":"2024-03-20T13:35:30.985626+0000","last_peered":"2024-03-20T13:35:30.985626+0000","last_clean":"2024-03-20T13:35:30.985626+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:35:30.985626+0000","last_undegraded":"2024-03-20T13:35:30.985626+0000","last_fullsized":"2024-03-20T13:35:30.985626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:16.766382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.956419+0000","last_change":"2024-03-20T13:34:59.968897+0000","last_active":"2024-03-20T13:36:17.956419+0000","last_peered":"2024-03-20T13:36:17.956419+0000","last_clean":"2024-03-20T13:36:17.956419+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:36:17.956419+0000","last_undegraded":"2024-03-20T13:36:17.956419+0000","last_fullsized":"2024-03-20T13:36:17.956419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:14.952118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980915+0000","last_change":"2024-03-20T13:34:51.941739+0000","last_active":"2024-03-20T13:35:30.980915+0000","last_peered":"2024-03-20T13:35:30.980915+0000","last_clean":"2024-03-20T13:35:30.980915+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:35:30.980915+0000","last_undegraded":"2024-03-20T13:35:30.980915+0000","last_fullsized":"2024-03-20T13:35:30.980915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:50.899013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984034+0000","last_change":"2024-03-20T13:34:49.946734+0000","last_active":"2024-03-20T13:35:30.984034+0000","last_peered":"2024-03-20T13:35:30.984034+0000","last_clean":"2024-03-20T13:35:30.984034+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:35:30.984034+0000","last_undegraded":"2024-03-20T13:35:30.984034+0000","last_fullsized":"2024-03-20T13:35:30.984034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988794+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:35:30.988794+0000","last_peered":"2024-03-20T13:35:30.988794+0000","last_clean":"2024-03-20T13:35:30.988794+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:35:30.988794+0000","last_undegraded":"2024-03-20T13:35:30.988794+0000","last_fullsized":"2024-03-20T13:35:30.988794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:29.981275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985463+0000","last_change":"2024-03-20T13:34:53.941252+0000","last_active":"2024-03-20T13:35:30.985463+0000","last_peered":"2024-03-20T13:35:30.985463+0000","last_clean":"2024-03-20T13:35:30.985463+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:35:30.985463+0000","last_undegraded":"2024-03-20T13:35:30.985463+0000","last_fullsized":"2024-03-20T13:35:30.985463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:45.972021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980973+0000","last_change":"2024-03-20T13:34:55.956604+0000","last_active":"2024-03-20T13:35:30.980973+0000","last_peered":"2024-03-20T13:35:30.980973+0000","last_clean":"2024-03-20T13:35:30.980973+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:35:30.980973+0000","last_undegraded":"2024-03-20T13:35:30.980973+0000","last_fullsized":"2024-03-20T13:35:30.980973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:06.183137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":278,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002369+0000","last_change":"2024-03-20T13:34:57.962603+0000","last_active":"2024-03-20T13:36:24.002369+0000","last_peered":"2024-03-20T13:36:24.002369+0000","last_clean":"2024-03-20T13:36:24.002369+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:24.002369+0000","last_undegraded":"2024-03-20T13:36:24.002369+0000","last_fullsized":"2024-03-20T13:36:24.002369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.166687+0000","last_change":"2024-03-20T13:34:59.965966+0000","last_active":"2024-03-20T13:35:35.166687+0000","last_peered":"2024-03-20T13:35:35.166687+0000","last_clean":"2024-03-20T13:35:35.166687+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:35:35.166687+0000","last_undegraded":"2024-03-20T13:35:35.166687+0000","last_fullsized":"2024-03-20T13:35:35.166687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:32:13.594344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984374+0000","last_change":"2024-03-20T13:34:51.955616+0000","last_active":"2024-03-20T13:35:30.984374+0000","last_peered":"2024-03-20T13:35:30.984374+0000","last_clean":"2024-03-20T13:35:30.984374+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:35:30.984374+0000","last_undegraded":"2024-03-20T13:35:30.984374+0000","last_fullsized":"2024-03-20T13:35:30.984374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:30.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990294+0000","last_change":"2024-03-20T13:34:49.957658+0000","last_active":"2024-03-20T13:35:30.990294+0000","last_peered":"2024-03-20T13:35:30.990294+0000","last_clean":"2024-03-20T13:35:30.990294+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:35:30.990294+0000","last_undegraded":"2024-03-20T13:35:30.990294+0000","last_fullsized":"2024-03-20T13:35:30.990294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:35.010181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984370+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:35:30.984370+0000","last_peered":"2024-03-20T13:35:30.984370+0000","last_clean":"2024-03-20T13:35:30.984370+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:35:30.984370+0000","last_undegraded":"2024-03-20T13:35:30.984370+0000","last_fullsized":"2024-03-20T13:35:30.984370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:29:46.424197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990699+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:35:30.990699+0000","last_peered":"2024-03-20T13:35:30.990699+0000","last_clean":"2024-03-20T13:35:30.990699+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:35:30.990699+0000","last_undegraded":"2024-03-20T13:35:30.990699+0000","last_fullsized":"2024-03-20T13:35:30.990699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:35.641007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986513+0000","last_change":"2024-03-20T13:34:55.955147+0000","last_active":"2024-03-20T13:35:30.986513+0000","last_peered":"2024-03-20T13:35:30.986513+0000","last_clean":"2024-03-20T13:35:30.986513+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:35:30.986513+0000","last_undegraded":"2024-03-20T13:35:30.986513+0000","last_fullsized":"2024-03-20T13:35:30.986513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:58.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002217+0000","last_change":"2024-03-20T13:34:57.967987+0000","last_active":"2024-03-20T13:36:24.002217+0000","last_peered":"2024-03-20T13:36:24.002217+0000","last_clean":"2024-03-20T13:36:24.002217+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:24.002217+0000","last_undegraded":"2024-03-20T13:36:24.002217+0000","last_fullsized":"2024-03-20T13:36:24.002217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981031+0000","last_change":"2024-03-20T13:34:59.968359+0000","last_active":"2024-03-20T13:35:30.981031+0000","last_peered":"2024-03-20T13:35:30.981031+0000","last_clean":"2024-03-20T13:35:30.981031+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:35:30.981031+0000","last_undegraded":"2024-03-20T13:35:30.981031+0000","last_fullsized":"2024-03-20T13:35:30.981031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:40.280747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164886+0000","last_change":"2024-03-20T13:34:51.944433+0000","last_active":"2024-03-20T13:35:35.164886+0000","last_peered":"2024-03-20T13:35:35.164886+0000","last_clean":"2024-03-20T13:35:35.164886+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:35:35.164886+0000","last_undegraded":"2024-03-20T13:35:35.164886+0000","last_fullsized":"2024-03-20T13:35:35.164886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:57.235472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982049+0000","last_change":"2024-03-20T13:34:49.947597+0000","last_active":"2024-03-20T13:35:30.982049+0000","last_peered":"2024-03-20T13:35:30.982049+0000","last_clean":"2024-03-20T13:35:30.982049+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:35:30.982049+0000","last_undegraded":"2024-03-20T13:35:30.982049+0000","last_fullsized":"2024-03-20T13:35:30.982049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:23.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989275+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:35:30.989275+0000","last_peered":"2024-03-20T13:35:30.989275+0000","last_clean":"2024-03-20T13:35:30.989275+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:35:30.989275+0000","last_undegraded":"2024-03-20T13:35:30.989275+0000","last_fullsized":"2024-03-20T13:35:30.989275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:53.016765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984914+0000","last_change":"2024-03-20T13:34:53.941526+0000","last_active":"2024-03-20T13:35:30.984914+0000","last_peered":"2024-03-20T13:35:30.984914+0000","last_clean":"2024-03-20T13:35:30.984914+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:35:30.984914+0000","last_undegraded":"2024-03-20T13:35:30.984914+0000","last_fullsized":"2024-03-20T13:35:30.984914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:50.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'77","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.536166+0000","last_change":"2024-03-20T13:34:55.956339+0000","last_active":"2024-03-20T13:36:23.536166+0000","last_peered":"2024-03-20T13:36:23.536166+0000","last_clean":"2024-03-20T13:36:23.536166+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:23.536166+0000","last_undegraded":"2024-03-20T13:36:23.536166+0000","last_fullsized":"2024-03-20T13:36:23.536166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:00.430180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983193+0000","last_change":"2024-03-20T13:34:57.962327+0000","last_active":"2024-03-20T13:35:30.983193+0000","last_peered":"2024-03-20T13:35:30.983193+0000","last_clean":"2024-03-20T13:35:30.983193+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:35:30.983193+0000","last_undegraded":"2024-03-20T13:35:30.983193+0000","last_fullsized":"2024-03-20T13:35:30.983193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988480+0000","last_change":"2024-03-20T13:34:59.972683+0000","last_active":"2024-03-20T13:35:30.988480+0000","last_peered":"2024-03-20T13:35:30.988480+0000","last_clean":"2024-03-20T13:35:30.988480+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:35:30.988480+0000","last_undegraded":"2024-03-20T13:35:30.988480+0000","last_fullsized":"2024-03-20T13:35:30.988480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:59.288382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988291+0000","last_change":"2024-03-20T13:34:59.970132+0000","last_active":"2024-03-20T13:35:30.988291+0000","last_peered":"2024-03-20T13:35:30.988291+0000","last_clean":"2024-03-20T13:35:30.988291+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:35:30.988291+0000","last_undegraded":"2024-03-20T13:35:30.988291+0000","last_fullsized":"2024-03-20T13:35:30.988291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:38.005851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568412+0000","last_change":"2024-03-20T13:34:51.943309+0000","last_active":"2024-03-20T13:36:23.568412+0000","last_peered":"2024-03-20T13:36:23.568412+0000","last_clean":"2024-03-20T13:36:23.568412+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:36:23.568412+0000","last_undegraded":"2024-03-20T13:36:23.568412+0000","last_fullsized":"2024-03-20T13:36:23.568412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988151+0000","last_change":"2024-03-20T13:34:49.960700+0000","last_active":"2024-03-20T13:35:30.988151+0000","last_peered":"2024-03-20T13:35:30.988151+0000","last_clean":"2024-03-20T13:35:30.988151+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:35:30.988151+0000","last_undegraded":"2024-03-20T13:35:30.988151+0000","last_fullsized":"2024-03-20T13:35:30.988151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:08.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983120+0000","last_change":"2024-03-20T13:34:53.941620+0000","last_active":"2024-03-20T13:35:30.983120+0000","last_peered":"2024-03-20T13:35:30.983120+0000","last_clean":"2024-03-20T13:35:30.983120+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:35:30.983120+0000","last_undegraded":"2024-03-20T13:35:30.983120+0000","last_fullsized":"2024-03-20T13:35:30.983120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:02.878465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.946353+0000","last_change":"2024-03-20T13:34:55.955235+0000","last_active":"2024-03-20T13:36:17.946353+0000","last_peered":"2024-03-20T13:36:17.946353+0000","last_clean":"2024-03-20T13:36:17.946353+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:36:17.946353+0000","last_undegraded":"2024-03-20T13:36:17.946353+0000","last_fullsized":"2024-03-20T13:36:17.946353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:19.438768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984712+0000","last_change":"2024-03-20T13:34:57.968867+0000","last_active":"2024-03-20T13:35:30.984712+0000","last_peered":"2024-03-20T13:35:30.984712+0000","last_clean":"2024-03-20T13:35:30.984712+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:35:30.984712+0000","last_undegraded":"2024-03-20T13:35:30.984712+0000","last_fullsized":"2024-03-20T13:35:30.984712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:46.842366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983754+0000","last_change":"2024-03-20T13:34:59.966513+0000","last_active":"2024-03-20T13:35:30.983754+0000","last_peered":"2024-03-20T13:35:30.983754+0000","last_clean":"2024-03-20T13:35:30.983754+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:35:30.983754+0000","last_undegraded":"2024-03-20T13:35:30.983754+0000","last_fullsized":"2024-03-20T13:35:30.983754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:18.685347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568783+0000","last_change":"2024-03-20T13:34:51.944041+0000","last_active":"2024-03-20T13:36:23.568783+0000","last_peered":"2024-03-20T13:36:23.568783+0000","last_clean":"2024-03-20T13:36:23.568783+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:36:23.568783+0000","last_undegraded":"2024-03-20T13:36:23.568783+0000","last_fullsized":"2024-03-20T13:36:23.568783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:34.692691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.563792+0000","last_change":"2024-03-20T13:34:49.950884+0000","last_active":"2024-03-20T13:36:23.563792+0000","last_peered":"2024-03-20T13:36:23.563792+0000","last_clean":"2024-03-20T13:36:23.563792+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:36:23.563792+0000","last_undegraded":"2024-03-20T13:36:23.563792+0000","last_fullsized":"2024-03-20T13:36:23.563792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991514+0000","last_change":"2024-03-20T13:35:30.990765+0000","last_active":"2024-03-20T13:35:30.991514+0000","last_peered":"2024-03-20T13:35:30.991514+0000","last_clean":"2024-03-20T13:35:30.991514+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:35:30.991514+0000","last_undegraded":"2024-03-20T13:35:30.991514+0000","last_fullsized":"2024-03-20T13:35:30.991514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:11.082910+0000","last_change":"2024-03-20T13:34:55.949038+0000","last_active":"2024-03-20T13:36:11.082910+0000","last_peered":"2024-03-20T13:36:11.082910+0000","last_clean":"2024-03-20T13:36:11.082910+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:11.082910+0000","last_undegraded":"2024-03-20T13:36:11.082910+0000","last_fullsized":"2024-03-20T13:36:11.082910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:02.651523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985168+0000","last_change":"2024-03-20T13:34:57.970496+0000","last_active":"2024-03-20T13:35:30.985168+0000","last_peered":"2024-03-20T13:35:30.985168+0000","last_clean":"2024-03-20T13:35:30.985168+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:35:30.985168+0000","last_undegraded":"2024-03-20T13:35:30.985168+0000","last_fullsized":"2024-03-20T13:35:30.985168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:16.785640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983405+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:35:30.983405+0000","last_peered":"2024-03-20T13:35:30.983405+0000","last_clean":"2024-03-20T13:35:30.983405+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:35:30.983405+0000","last_undegraded":"2024-03-20T13:35:30.983405+0000","last_fullsized":"2024-03-20T13:35:30.983405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:16:57.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982873+0000","last_change":"2024-03-20T13:34:51.935236+0000","last_active":"2024-03-20T13:35:30.982873+0000","last_peered":"2024-03-20T13:35:30.982873+0000","last_clean":"2024-03-20T13:35:30.982873+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:35:30.982873+0000","last_undegraded":"2024-03-20T13:35:30.982873+0000","last_fullsized":"2024-03-20T13:35:30.982873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989247+0000","last_change":"2024-03-20T13:34:49.946529+0000","last_active":"2024-03-20T13:35:30.989247+0000","last_peered":"2024-03-20T13:35:30.989247+0000","last_clean":"2024-03-20T13:35:30.989247+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:35:30.989247+0000","last_undegraded":"2024-03-20T13:35:30.989247+0000","last_fullsized":"2024-03-20T13:35:30.989247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985010+0000","last_change":"2024-03-20T13:34:53.944081+0000","last_active":"2024-03-20T13:35:30.985010+0000","last_peered":"2024-03-20T13:35:30.985010+0000","last_clean":"2024-03-20T13:35:30.985010+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:35:30.985010+0000","last_undegraded":"2024-03-20T13:35:30.985010+0000","last_fullsized":"2024-03-20T13:35:30.985010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:52.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'35","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.362876+0000","last_change":"2024-03-20T13:34:55.953409+0000","last_active":"2024-03-20T13:36:23.362876+0000","last_peered":"2024-03-20T13:36:23.362876+0000","last_clean":"2024-03-20T13:36:23.362876+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:23.362876+0000","last_undegraded":"2024-03-20T13:36:23.362876+0000","last_fullsized":"2024-03-20T13:36:23.362876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:34.583675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980762+0000","last_change":"2024-03-20T13:34:57.962112+0000","last_active":"2024-03-20T13:35:30.980762+0000","last_peered":"2024-03-20T13:35:30.980762+0000","last_clean":"2024-03-20T13:35:30.980762+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:35:30.980762+0000","last_undegraded":"2024-03-20T13:35:30.980762+0000","last_fullsized":"2024-03-20T13:35:30.980762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988695+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:35:30.988695+0000","last_peered":"2024-03-20T13:35:30.988695+0000","last_clean":"2024-03-20T13:35:30.988695+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:35:30.988695+0000","last_undegraded":"2024-03-20T13:35:30.988695+0000","last_fullsized":"2024-03-20T13:35:30.988695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.676415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925369+0000","last_change":"2024-03-20T13:34:51.955727+0000","last_active":"2024-03-20T13:35:35.925369+0000","last_peered":"2024-03-20T13:35:35.925369+0000","last_clean":"2024-03-20T13:35:35.925369+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:35:35.925369+0000","last_undegraded":"2024-03-20T13:35:35.925369+0000","last_fullsized":"2024-03-20T13:35:35.925369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:18.390471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982684+0000","last_change":"2024-03-20T13:34:49.937900+0000","last_active":"2024-03-20T13:35:30.982684+0000","last_peered":"2024-03-20T13:35:30.982684+0000","last_clean":"2024-03-20T13:35:30.982684+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:35:30.982684+0000","last_undegraded":"2024-03-20T13:35:30.982684+0000","last_fullsized":"2024-03-20T13:35:30.982684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985583+0000","last_change":"2024-03-20T13:34:53.945375+0000","last_active":"2024-03-20T13:35:30.985583+0000","last_peered":"2024-03-20T13:35:30.985583+0000","last_clean":"2024-03-20T13:35:30.985583+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:35:30.985583+0000","last_undegraded":"2024-03-20T13:35:30.985583+0000","last_fullsized":"2024-03-20T13:35:30.985583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:02:59.804246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.931325+0000","last_change":"2024-03-20T13:34:55.950108+0000","last_active":"2024-03-20T13:36:17.931325+0000","last_peered":"2024-03-20T13:36:17.931325+0000","last_clean":"2024-03-20T13:36:17.931325+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:17.931325+0000","last_undegraded":"2024-03-20T13:36:17.931325+0000","last_fullsized":"2024-03-20T13:36:17.931325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:30.400371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986035+0000","last_change":"2024-03-20T13:34:57.962527+0000","last_active":"2024-03-20T13:35:30.986035+0000","last_peered":"2024-03-20T13:35:30.986035+0000","last_clean":"2024-03-20T13:35:30.986035+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:35:30.986035+0000","last_undegraded":"2024-03-20T13:35:30.986035+0000","last_fullsized":"2024-03-20T13:35:30.986035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:19.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.935434+0000","last_change":"2024-03-20T13:34:51.944100+0000","last_active":"2024-03-20T13:35:35.935434+0000","last_peered":"2024-03-20T13:35:35.935434+0000","last_clean":"2024-03-20T13:35:35.935434+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:35:35.935434+0000","last_undegraded":"2024-03-20T13:35:35.935434+0000","last_fullsized":"2024-03-20T13:35:35.935434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:42:06.297838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983864+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:35:30.983864+0000","last_peered":"2024-03-20T13:35:30.983864+0000","last_clean":"2024-03-20T13:35:30.983864+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:35:30.983864+0000","last_undegraded":"2024-03-20T13:35:30.983864+0000","last_fullsized":"2024-03-20T13:35:30.983864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:45.792646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985035+0000","last_change":"2024-03-20T13:34:53.942580+0000","last_active":"2024-03-20T13:35:30.985035+0000","last_peered":"2024-03-20T13:35:30.985035+0000","last_clean":"2024-03-20T13:35:30.985035+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:35:30.985035+0000","last_undegraded":"2024-03-20T13:35:30.985035+0000","last_fullsized":"2024-03-20T13:35:30.985035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'52","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.532779+0000","last_change":"2024-03-20T13:34:55.951412+0000","last_active":"2024-03-20T13:36:23.532779+0000","last_peered":"2024-03-20T13:36:23.532779+0000","last_clean":"2024-03-20T13:36:23.532779+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:23.532779+0000","last_undegraded":"2024-03-20T13:36:23.532779+0000","last_fullsized":"2024-03-20T13:36:23.532779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:14.777482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985864+0000","last_change":"2024-03-20T13:34:57.965582+0000","last_active":"2024-03-20T13:35:30.985864+0000","last_peered":"2024-03-20T13:35:30.985864+0000","last_clean":"2024-03-20T13:35:30.985864+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:35:30.985864+0000","last_undegraded":"2024-03-20T13:35:30.985864+0000","last_fullsized":"2024-03-20T13:35:30.985864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:34.285516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.435716+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:17.435716+0000","last_peered":"2024-03-20T13:36:17.435716+0000","last_clean":"2024-03-20T13:36:17.435716+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:17.435716+0000","last_undegraded":"2024-03-20T13:36:17.435716+0000","last_fullsized":"2024-03-20T13:36:17.435716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.947516+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980586+0000","last_change":"2024-03-20T13:34:49.946304+0000","last_active":"2024-03-20T13:35:30.980586+0000","last_peered":"2024-03-20T13:35:30.980586+0000","last_clean":"2024-03-20T13:35:30.980586+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:35:30.980586+0000","last_undegraded":"2024-03-20T13:35:30.980586+0000","last_fullsized":"2024-03-20T13:35:30.980586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:06:00.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.992863+0000","last_change":"2024-03-20T13:35:30.992863+0000","last_active":"2024-03-20T13:35:30.992863+0000","last_peered":"2024-03-20T13:35:30.992863+0000","last_clean":"2024-03-20T13:35:30.992863+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:35:30.992863+0000","last_undegraded":"2024-03-20T13:35:30.992863+0000","last_fullsized":"2024-03-20T13:35:30.992863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.932248+0000","last_change":"2024-03-20T13:34:55.955358+0000","last_active":"2024-03-20T13:36:17.932248+0000","last_peered":"2024-03-20T13:36:17.932248+0000","last_clean":"2024-03-20T13:36:17.932248+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:36:17.932248+0000","last_undegraded":"2024-03-20T13:36:17.932248+0000","last_fullsized":"2024-03-20T13:36:17.932248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:26:44.999814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981139+0000","last_change":"2024-03-20T13:34:57.964942+0000","last_active":"2024-03-20T13:35:30.981139+0000","last_peered":"2024-03-20T13:35:30.981139+0000","last_clean":"2024-03-20T13:35:30.981139+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:35:30.981139+0000","last_undegraded":"2024-03-20T13:35:30.981139+0000","last_fullsized":"2024-03-20T13:35:30.981139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985284+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:35:30.985284+0000","last_peered":"2024-03-20T13:35:30.985284+0000","last_clean":"2024-03-20T13:35:30.985284+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:35:30.985284+0000","last_undegraded":"2024-03-20T13:35:30.985284+0000","last_fullsized":"2024-03-20T13:35:30.985284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:56.733038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426416+0000","last_change":"2024-03-20T13:34:51.955633+0000","last_active":"2024-03-20T13:35:35.426416+0000","last_peered":"2024-03-20T13:35:35.426416+0000","last_clean":"2024-03-20T13:35:35.426416+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:35:35.426416+0000","last_undegraded":"2024-03-20T13:35:35.426416+0000","last_fullsized":"2024-03-20T13:35:35.426416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:58.692384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981144+0000","last_change":"2024-03-20T13:34:49.948392+0000","last_active":"2024-03-20T13:35:30.981144+0000","last_peered":"2024-03-20T13:35:30.981144+0000","last_clean":"2024-03-20T13:35:30.981144+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:35:30.981144+0000","last_undegraded":"2024-03-20T13:35:30.981144+0000","last_fullsized":"2024-03-20T13:35:30.981144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991895+0000","last_change":"2024-03-20T13:35:30.991895+0000","last_active":"2024-03-20T13:35:30.991895+0000","last_peered":"2024-03-20T13:35:30.991895+0000","last_clean":"2024-03-20T13:35:30.991895+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:35:30.991895+0000","last_undegraded":"2024-03-20T13:35:30.991895+0000","last_fullsized":"2024-03-20T13:35:30.991895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:03.644927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.950509+0000","last_change":"2024-03-20T13:34:55.946279+0000","last_active":"2024-03-20T13:36:17.950509+0000","last_peered":"2024-03-20T13:36:17.950509+0000","last_clean":"2024-03-20T13:36:17.950509+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:17.950509+0000","last_undegraded":"2024-03-20T13:36:17.950509+0000","last_fullsized":"2024-03-20T13:36:17.950509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:32.277358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984087+0000","last_change":"2024-03-20T13:34:57.968260+0000","last_active":"2024-03-20T13:35:30.984087+0000","last_peered":"2024-03-20T13:35:30.984087+0000","last_clean":"2024-03-20T13:35:30.984087+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:35:30.984087+0000","last_undegraded":"2024-03-20T13:35:30.984087+0000","last_fullsized":"2024-03-20T13:35:30.984087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:27.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559906+0000","last_change":"2024-03-20T13:34:59.970646+0000","last_active":"2024-03-20T13:36:23.559906+0000","last_peered":"2024-03-20T13:36:23.559906+0000","last_clean":"2024-03-20T13:36:23.559906+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:36:23.559906+0000","last_undegraded":"2024-03-20T13:36:23.559906+0000","last_fullsized":"2024-03-20T13:36:23.559906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:06.692527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432770+0000","last_change":"2024-03-20T13:34:51.943110+0000","last_active":"2024-03-20T13:35:35.432770+0000","last_peered":"2024-03-20T13:35:35.432770+0000","last_clean":"2024-03-20T13:35:35.432770+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:35:35.432770+0000","last_undegraded":"2024-03-20T13:35:35.432770+0000","last_fullsized":"2024-03-20T13:35:35.432770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987393+0000","last_change":"2024-03-20T13:34:49.960382+0000","last_active":"2024-03-20T13:35:30.987393+0000","last_peered":"2024-03-20T13:35:30.987393+0000","last_clean":"2024-03-20T13:35:30.987393+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:35:30.987393+0000","last_undegraded":"2024-03-20T13:35:30.987393+0000","last_fullsized":"2024-03-20T13:35:30.987393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:46.514364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982984+0000","last_change":"2024-03-20T13:34:53.940730+0000","last_active":"2024-03-20T13:35:30.982984+0000","last_peered":"2024-03-20T13:35:30.982984+0000","last_clean":"2024-03-20T13:35:30.982984+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:35:30.982984+0000","last_undegraded":"2024-03-20T13:35:30.982984+0000","last_fullsized":"2024-03-20T13:35:30.982984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:00.644448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988396+0000","last_change":"2024-03-20T13:34:55.962070+0000","last_active":"2024-03-20T13:35:30.988396+0000","last_peered":"2024-03-20T13:35:30.988396+0000","last_clean":"2024-03-20T13:35:30.988396+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:35:30.988396+0000","last_undegraded":"2024-03-20T13:35:30.988396+0000","last_fullsized":"2024-03-20T13:35:30.988396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:10:00.391997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":293,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002421+0000","last_change":"2024-03-20T13:34:57.966599+0000","last_active":"2024-03-20T13:36:24.002421+0000","last_peered":"2024-03-20T13:36:24.002421+0000","last_clean":"2024-03-20T13:36:24.002421+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:24.002421+0000","last_undegraded":"2024-03-20T13:36:24.002421+0000","last_fullsized":"2024-03-20T13:36:24.002421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:18.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983175+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:35:30.983175+0000","last_peered":"2024-03-20T13:35:30.983175+0000","last_clean":"2024-03-20T13:35:30.983175+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:35:30.983175+0000","last_undegraded":"2024-03-20T13:35:30.983175+0000","last_fullsized":"2024-03-20T13:35:30.983175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.814709+0000","last_change":"2024-03-20T13:34:51.935075+0000","last_active":"2024-03-20T13:35:34.814709+0000","last_peered":"2024-03-20T13:35:34.814709+0000","last_clean":"2024-03-20T13:35:34.814709+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:35:34.814709+0000","last_undegraded":"2024-03-20T13:35:34.814709+0000","last_fullsized":"2024-03-20T13:35:34.814709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982426+0000","last_change":"2024-03-20T13:34:49.939827+0000","last_active":"2024-03-20T13:35:30.982426+0000","last_peered":"2024-03-20T13:35:30.982426+0000","last_clean":"2024-03-20T13:35:30.982426+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:35:30.982426+0000","last_undegraded":"2024-03-20T13:35:30.982426+0000","last_fullsized":"2024-03-20T13:35:30.982426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982868+0000","last_change":"2024-03-20T13:34:53.942928+0000","last_active":"2024-03-20T13:35:30.982868+0000","last_peered":"2024-03-20T13:35:30.982868+0000","last_clean":"2024-03-20T13:35:30.982868+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:35:30.982868+0000","last_undegraded":"2024-03-20T13:35:30.982868+0000","last_fullsized":"2024-03-20T13:35:30.982868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:24.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.922811+0000","last_change":"2024-03-20T13:34:55.950261+0000","last_active":"2024-03-20T13:36:17.922811+0000","last_peered":"2024-03-20T13:36:17.922811+0000","last_clean":"2024-03-20T13:36:17.922811+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:17.922811+0000","last_undegraded":"2024-03-20T13:36:17.922811+0000","last_fullsized":"2024-03-20T13:36:17.922811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:16.051759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982076+0000","last_change":"2024-03-20T13:34:57.966567+0000","last_active":"2024-03-20T13:35:30.982076+0000","last_peered":"2024-03-20T13:35:30.982076+0000","last_clean":"2024-03-20T13:35:30.982076+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:35:30.982076+0000","last_undegraded":"2024-03-20T13:35:30.982076+0000","last_fullsized":"2024-03-20T13:35:30.982076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:00.530246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983022+0000","last_change":"2024-03-20T13:34:59.974362+0000","last_active":"2024-03-20T13:35:30.983022+0000","last_peered":"2024-03-20T13:35:30.983022+0000","last_clean":"2024-03-20T13:35:30.983022+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:35:30.983022+0000","last_undegraded":"2024-03-20T13:35:30.983022+0000","last_fullsized":"2024-03-20T13:35:30.983022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815573+0000","last_change":"2024-03-20T13:34:51.933525+0000","last_active":"2024-03-20T13:35:34.815573+0000","last_peered":"2024-03-20T13:35:34.815573+0000","last_clean":"2024-03-20T13:35:34.815573+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:35:34.815573+0000","last_undegraded":"2024-03-20T13:35:34.815573+0000","last_fullsized":"2024-03-20T13:35:34.815573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:31.807759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990071+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:35:30.990071+0000","last_peered":"2024-03-20T13:35:30.990071+0000","last_clean":"2024-03-20T13:35:30.990071+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:35:30.990071+0000","last_undegraded":"2024-03-20T13:35:30.990071+0000","last_fullsized":"2024-03-20T13:35:30.990071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:46.676895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987770+0000","last_change":"2024-03-20T13:34:53.944574+0000","last_active":"2024-03-20T13:35:30.987770+0000","last_peered":"2024-03-20T13:35:30.987770+0000","last_clean":"2024-03-20T13:35:30.987770+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:35:30.987770+0000","last_undegraded":"2024-03-20T13:35:30.987770+0000","last_fullsized":"2024-03-20T13:35:30.987770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:47.973325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.979760+0000","last_change":"2024-03-20T13:34:55.949632+0000","last_active":"2024-03-20T13:36:17.979760+0000","last_peered":"2024-03-20T13:36:17.979760+0000","last_clean":"2024-03-20T13:36:17.979760+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:17.979760+0000","last_undegraded":"2024-03-20T13:36:17.979760+0000","last_fullsized":"2024-03-20T13:36:17.979760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:56.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985258+0000","last_change":"2024-03-20T13:34:57.968928+0000","last_active":"2024-03-20T13:35:30.985258+0000","last_peered":"2024-03-20T13:35:30.985258+0000","last_clean":"2024-03-20T13:35:30.985258+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:35:30.985258+0000","last_undegraded":"2024-03-20T13:35:30.985258+0000","last_fullsized":"2024-03-20T13:35:30.985258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:19:52.024807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.930985+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:35:35.930985+0000","last_peered":"2024-03-20T13:35:35.930985+0000","last_clean":"2024-03-20T13:35:35.930985+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:35:35.930985+0000","last_undegraded":"2024-03-20T13:35:35.930985+0000","last_fullsized":"2024-03-20T13:35:35.930985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:22:02.192935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985680+0000","last_change":"2024-03-20T13:34:51.945209+0000","last_active":"2024-03-20T13:35:30.985680+0000","last_peered":"2024-03-20T13:35:30.985680+0000","last_clean":"2024-03-20T13:35:30.985680+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:35:30.985680+0000","last_undegraded":"2024-03-20T13:35:30.985680+0000","last_fullsized":"2024-03-20T13:35:30.985680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:44.470618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984496+0000","last_change":"2024-03-20T13:34:49.939306+0000","last_active":"2024-03-20T13:35:30.984496+0000","last_peered":"2024-03-20T13:35:30.984496+0000","last_clean":"2024-03-20T13:35:30.984496+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:35:30.984496+0000","last_undegraded":"2024-03-20T13:35:30.984496+0000","last_fullsized":"2024-03-20T13:35:30.984496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:42.593147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983070+0000","last_change":"2024-03-20T13:34:53.944784+0000","last_active":"2024-03-20T13:35:30.983070+0000","last_peered":"2024-03-20T13:35:30.983070+0000","last_clean":"2024-03-20T13:35:30.983070+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:35:30.983070+0000","last_undegraded":"2024-03-20T13:35:30.983070+0000","last_fullsized":"2024-03-20T13:35:30.983070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:45.631209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.948542+0000","last_change":"2024-03-20T13:34:55.953980+0000","last_active":"2024-03-20T13:36:17.948542+0000","last_peered":"2024-03-20T13:36:17.948542+0000","last_clean":"2024-03-20T13:36:17.948542+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:17.948542+0000","last_undegraded":"2024-03-20T13:36:17.948542+0000","last_fullsized":"2024-03-20T13:36:17.948542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:04.003649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985553+0000","last_change":"2024-03-20T13:34:57.968516+0000","last_active":"2024-03-20T13:35:30.985553+0000","last_peered":"2024-03-20T13:35:30.985553+0000","last_clean":"2024-03-20T13:35:30.985553+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:35:30.985553+0000","last_undegraded":"2024-03-20T13:35:30.985553+0000","last_fullsized":"2024-03-20T13:35:30.985553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:42.517997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988393+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:35:30.988393+0000","last_peered":"2024-03-20T13:35:30.988393+0000","last_clean":"2024-03-20T13:35:30.988393+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:35:30.988393+0000","last_undegraded":"2024-03-20T13:35:30.988393+0000","last_fullsized":"2024-03-20T13:35:30.988393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:18.372757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164827+0000","last_change":"2024-03-20T13:34:51.933565+0000","last_active":"2024-03-20T13:35:35.164827+0000","last_peered":"2024-03-20T13:35:35.164827+0000","last_clean":"2024-03-20T13:35:35.164827+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:35:35.164827+0000","last_undegraded":"2024-03-20T13:35:35.164827+0000","last_fullsized":"2024-03-20T13:35:35.164827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:23.975435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982828+0000","last_change":"2024-03-20T13:34:49.937954+0000","last_active":"2024-03-20T13:35:30.982828+0000","last_peered":"2024-03-20T13:35:30.982828+0000","last_clean":"2024-03-20T13:35:30.982828+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:35:30.982828+0000","last_undegraded":"2024-03-20T13:35:30.982828+0000","last_fullsized":"2024-03-20T13:35:30.982828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982077+0000","last_change":"2024-03-20T13:34:53.945758+0000","last_active":"2024-03-20T13:35:30.982077+0000","last_peered":"2024-03-20T13:35:30.982077+0000","last_clean":"2024-03-20T13:35:30.982077+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:35:30.982077+0000","last_undegraded":"2024-03-20T13:35:30.982077+0000","last_fullsized":"2024-03-20T13:35:30.982077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:56.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.554040+0000","last_change":"2024-03-20T13:34:55.955035+0000","last_active":"2024-03-20T13:36:23.554040+0000","last_peered":"2024-03-20T13:36:23.554040+0000","last_clean":"2024-03-20T13:36:23.554040+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:23.554040+0000","last_undegraded":"2024-03-20T13:36:23.554040+0000","last_fullsized":"2024-03-20T13:36:23.554040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:00:41.222083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983213+0000","last_change":"2024-03-20T13:34:57.961099+0000","last_active":"2024-03-20T13:35:30.983213+0000","last_peered":"2024-03-20T13:35:30.983213+0000","last_clean":"2024-03-20T13:35:30.983213+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:35:30.983213+0000","last_undegraded":"2024-03-20T13:35:30.983213+0000","last_fullsized":"2024-03-20T13:35:30.983213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987647+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:35:30.987647+0000","last_peered":"2024-03-20T13:35:30.987647+0000","last_clean":"2024-03-20T13:35:30.987647+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:35:30.987647+0000","last_undegraded":"2024-03-20T13:35:30.987647+0000","last_fullsized":"2024-03-20T13:35:30.987647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:50:50.872683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.927590+0000","last_change":"2024-03-20T13:34:51.957194+0000","last_active":"2024-03-20T13:35:35.927590+0000","last_peered":"2024-03-20T13:35:35.927590+0000","last_clean":"2024-03-20T13:35:35.927590+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:35:35.927590+0000","last_undegraded":"2024-03-20T13:35:35.927590+0000","last_fullsized":"2024-03-20T13:35:35.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984223+0000","last_change":"2024-03-20T13:34:49.949098+0000","last_active":"2024-03-20T13:35:30.984223+0000","last_peered":"2024-03-20T13:35:30.984223+0000","last_clean":"2024-03-20T13:35:30.984223+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:35:30.984223+0000","last_undegraded":"2024-03-20T13:35:30.984223+0000","last_fullsized":"2024-03-20T13:35:30.984223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984638+0000","last_change":"2024-03-20T13:34:51.943051+0000","last_active":"2024-03-20T13:35:30.984638+0000","last_peered":"2024-03-20T13:35:30.984638+0000","last_clean":"2024-03-20T13:35:30.984638+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:35:30.984638+0000","last_undegraded":"2024-03-20T13:35:30.984638+0000","last_fullsized":"2024-03-20T13:35:30.984638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982413+0000","last_change":"2024-03-20T13:34:49.933350+0000","last_active":"2024-03-20T13:35:30.982413+0000","last_peered":"2024-03-20T13:35:30.982413+0000","last_clean":"2024-03-20T13:35:30.982413+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:35:30.982413+0000","last_undegraded":"2024-03-20T13:35:30.982413+0000","last_fullsized":"2024-03-20T13:35:30.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426226+0000","last_change":"2024-03-20T13:34:51.945886+0000","last_active":"2024-03-20T13:35:35.426226+0000","last_peered":"2024-03-20T13:35:35.426226+0000","last_clean":"2024-03-20T13:35:35.426226+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:35:35.426226+0000","last_undegraded":"2024-03-20T13:35:35.426226+0000","last_fullsized":"2024-03-20T13:35:35.426226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:13.438792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985818+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:35:30.985818+0000","last_peered":"2024-03-20T13:35:30.985818+0000","last_clean":"2024-03-20T13:35:30.985818+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:35:30.985818+0000","last_undegraded":"2024-03-20T13:35:30.985818+0000","last_fullsized":"2024-03-20T13:35:30.985818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:48.329750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.942923+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984213+0000","last_change":"2024-03-20T13:34:49.933497+0000","last_active":"2024-03-20T13:35:30.984213+0000","last_peered":"2024-03-20T13:35:30.984213+0000","last_clean":"2024-03-20T13:35:30.984213+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:35:30.984213+0000","last_undegraded":"2024-03-20T13:35:30.984213+0000","last_fullsized":"2024-03-20T13:35:30.984213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983804+0000","last_change":"2024-03-20T13:34:51.937130+0000","last_active":"2024-03-20T13:35:30.983804+0000","last_peered":"2024-03-20T13:35:30.983804+0000","last_clean":"2024-03-20T13:35:30.983804+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:35:30.983804+0000","last_undegraded":"2024-03-20T13:35:30.983804+0000","last_fullsized":"2024-03-20T13:35:30.983804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984038+0000","last_change":"2024-03-20T13:34:49.946558+0000","last_active":"2024-03-20T13:35:30.984038+0000","last_peered":"2024-03-20T13:35:30.984038+0000","last_clean":"2024-03-20T13:35:30.984038+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:35:30.984038+0000","last_undegraded":"2024-03-20T13:35:30.984038+0000","last_fullsized":"2024-03-20T13:35:30.984038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.953134+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:01:47.441326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981395+0000","last_change":"2024-03-20T13:34:49.945395+0000","last_active":"2024-03-20T13:35:30.981395+0000","last_peered":"2024-03-20T13:35:30.981395+0000","last_clean":"2024-03-20T13:35:30.981395+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:35:30.981395+0000","last_undegraded":"2024-03-20T13:35:30.981395+0000","last_fullsized":"2024-03-20T13:35:30.981395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969303+0000","last_change":"2024-03-20T13:34:51.947021+0000","last_active":"2024-03-20T13:36:17.969303+0000","last_peered":"2024-03-20T13:36:17.969303+0000","last_clean":"2024-03-20T13:36:17.969303+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:36:17.969303+0000","last_undegraded":"2024-03-20T13:36:17.969303+0000","last_fullsized":"2024-03-20T13:36:17.969303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.962603+0000","last_change":"2024-03-20T13:34:49.946770+0000","last_active":"2024-03-20T13:36:17.962603+0000","last_peered":"2024-03-20T13:36:17.962603+0000","last_clean":"2024-03-20T13:36:17.962603+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:36:17.962603+0000","last_undegraded":"2024-03-20T13:36:17.962603+0000","last_fullsized":"2024-03-20T13:36:17.962603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426260+0000","last_change":"2024-03-20T13:34:51.941533+0000","last_active":"2024-03-20T13:35:35.426260+0000","last_peered":"2024-03-20T13:35:35.426260+0000","last_clean":"2024-03-20T13:35:35.426260+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:35:35.426260+0000","last_undegraded":"2024-03-20T13:35:35.426260+0000","last_fullsized":"2024-03-20T13:35:35.426260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984680+0000","last_change":"2024-03-20T13:34:49.934739+0000","last_active":"2024-03-20T13:35:30.984680+0000","last_peered":"2024-03-20T13:35:30.984680+0000","last_clean":"2024-03-20T13:35:30.984680+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:35:30.984680+0000","last_undegraded":"2024-03-20T13:35:30.984680+0000","last_fullsized":"2024-03-20T13:35:30.984680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:24.437773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983296+0000","last_change":"2024-03-20T13:34:51.948058+0000","last_active":"2024-03-20T13:35:30.983296+0000","last_peered":"2024-03-20T13:35:30.983296+0000","last_clean":"2024-03-20T13:35:30.983296+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:35:30.983296+0000","last_undegraded":"2024-03-20T13:35:30.983296+0000","last_fullsized":"2024-03-20T13:35:30.983296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.421616+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:35:35.421616+0000","last_peered":"2024-03-20T13:35:35.421616+0000","last_clean":"2024-03-20T13:35:35.421616+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:35:35.421616+0000","last_undegraded":"2024-03-20T13:35:35.421616+0000","last_fullsized":"2024-03-20T13:35:35.421616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:33.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988240+0000","last_change":"2024-03-20T13:34:51.949486+0000","last_active":"2024-03-20T13:35:30.988240+0000","last_peered":"2024-03-20T13:35:30.988240+0000","last_clean":"2024-03-20T13:35:30.988240+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:35:30.988240+0000","last_undegraded":"2024-03-20T13:35:30.988240+0000","last_fullsized":"2024-03-20T13:35:30.988240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:46.252000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982607+0000","last_change":"2024-03-20T13:34:49.934646+0000","last_active":"2024-03-20T13:35:30.982607+0000","last_peered":"2024-03-20T13:35:30.982607+0000","last_clean":"2024-03-20T13:35:30.982607+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:35:30.982607+0000","last_undegraded":"2024-03-20T13:35:30.982607+0000","last_fullsized":"2024-03-20T13:35:30.982607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568234+0000","last_change":"2024-03-20T13:34:51.935272+0000","last_active":"2024-03-20T13:36:23.568234+0000","last_peered":"2024-03-20T13:36:23.568234+0000","last_clean":"2024-03-20T13:36:23.568234+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:36:23.568234+0000","last_undegraded":"2024-03-20T13:36:23.568234+0000","last_fullsized":"2024-03-20T13:36:23.568234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981576+0000","last_change":"2024-03-20T13:34:49.955817+0000","last_active":"2024-03-20T13:35:30.981576+0000","last_peered":"2024-03-20T13:35:30.981576+0000","last_clean":"2024-03-20T13:35:30.981576+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:35:30.981576+0000","last_undegraded":"2024-03-20T13:35:30.981576+0000","last_fullsized":"2024-03-20T13:35:30.981576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925361+0000","last_change":"2024-03-20T13:34:51.946963+0000","last_active":"2024-03-20T13:35:35.925361+0000","last_peered":"2024-03-20T13:35:35.925361+0000","last_clean":"2024-03-20T13:35:35.925361+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:35:35.925361+0000","last_undegraded":"2024-03-20T13:35:35.925361+0000","last_fullsized":"2024-03-20T13:35:35.925361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980780+0000","last_change":"2024-03-20T13:34:49.944556+0000","last_active":"2024-03-20T13:35:30.980780+0000","last_peered":"2024-03-20T13:35:30.980780+0000","last_clean":"2024-03-20T13:35:30.980780+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:35:30.980780+0000","last_undegraded":"2024-03-20T13:35:30.980780+0000","last_fullsized":"2024-03-20T13:35:30.980780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164645+0000","last_change":"2024-03-20T13:34:51.948336+0000","last_active":"2024-03-20T13:35:35.164645+0000","last_peered":"2024-03-20T13:35:35.164645+0000","last_clean":"2024-03-20T13:35:35.164645+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:35:35.164645+0000","last_undegraded":"2024-03-20T13:35:35.164645+0000","last_fullsized":"2024-03-20T13:35:35.164645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:45.966592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988635+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:35:30.988635+0000","last_peered":"2024-03-20T13:35:30.988635+0000","last_clean":"2024-03-20T13:35:30.988635+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:35:30.988635+0000","last_undegraded":"2024-03-20T13:35:30.988635+0000","last_fullsized":"2024-03-20T13:35:30.988635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:46.604615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568629+0000","last_change":"2024-03-20T13:34:51.950006+0000","last_active":"2024-03-20T13:36:23.568629+0000","last_peered":"2024-03-20T13:36:23.568629+0000","last_clean":"2024-03-20T13:36:23.568629+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:23.568629+0000","last_undegraded":"2024-03-20T13:36:23.568629+0000","last_fullsized":"2024-03-20T13:36:23.568629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:54:37.940365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990260+0000","last_change":"2024-03-20T13:34:49.962883+0000","last_active":"2024-03-20T13:35:30.990260+0000","last_peered":"2024-03-20T13:35:30.990260+0000","last_clean":"2024-03-20T13:35:30.990260+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:35:30.990260+0000","last_undegraded":"2024-03-20T13:35:30.990260+0000","last_fullsized":"2024-03-20T13:35:30.990260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:06.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568300+0000","last_change":"2024-03-20T13:34:51.951979+0000","last_active":"2024-03-20T13:36:23.568300+0000","last_peered":"2024-03-20T13:36:23.568300+0000","last_clean":"2024-03-20T13:36:23.568300+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:36:23.568300+0000","last_undegraded":"2024-03-20T13:36:23.568300+0000","last_fullsized":"2024-03-20T13:36:23.568300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:41.546768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989598+0000","last_change":"2024-03-20T13:34:49.950220+0000","last_active":"2024-03-20T13:35:30.989598+0000","last_peered":"2024-03-20T13:35:30.989598+0000","last_clean":"2024-03-20T13:35:30.989598+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:35:30.989598+0000","last_undegraded":"2024-03-20T13:35:30.989598+0000","last_fullsized":"2024-03-20T13:35:30.989598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981812+0000","last_change":"2024-03-20T13:34:51.945790+0000","last_active":"2024-03-20T13:35:30.981812+0000","last_peered":"2024-03-20T13:35:30.981812+0000","last_clean":"2024-03-20T13:35:30.981812+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:35:30.981812+0000","last_undegraded":"2024-03-20T13:35:30.981812+0000","last_fullsized":"2024-03-20T13:35:30.981812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.312469+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:17.312469+0000","last_peered":"2024-03-20T13:36:17.312469+0000","last_clean":"2024-03-20T13:36:17.312469+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:17.312469+0000","last_undegraded":"2024-03-20T13:36:17.312469+0000","last_fullsized":"2024-03-20T13:36:17.312469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:59.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984472+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:35:30.984472+0000","last_peered":"2024-03-20T13:35:30.984472+0000","last_clean":"2024-03-20T13:35:30.984472+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:35:30.984472+0000","last_undegraded":"2024-03-20T13:35:30.984472+0000","last_fullsized":"2024-03-20T13:35:30.984472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:32.396271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984838+0000","last_change":"2024-03-20T13:34:51.947552+0000","last_active":"2024-03-20T13:35:30.984838+0000","last_peered":"2024-03-20T13:35:30.984838+0000","last_clean":"2024-03-20T13:35:30.984838+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:35:30.984838+0000","last_undegraded":"2024-03-20T13:35:30.984838+0000","last_fullsized":"2024-03-20T13:35:30.984838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982733+0000","last_change":"2024-03-20T13:34:49.941425+0000","last_active":"2024-03-20T13:35:30.982733+0000","last_peered":"2024-03-20T13:35:30.982733+0000","last_clean":"2024-03-20T13:35:30.982733+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:35:30.982733+0000","last_undegraded":"2024-03-20T13:35:30.982733+0000","last_fullsized":"2024-03-20T13:35:30.982733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969447+0000","last_change":"2024-03-20T13:34:51.944562+0000","last_active":"2024-03-20T13:36:17.969447+0000","last_peered":"2024-03-20T13:36:17.969447+0000","last_clean":"2024-03-20T13:36:17.969447+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:36:17.969447+0000","last_undegraded":"2024-03-20T13:36:17.969447+0000","last_fullsized":"2024-03-20T13:36:17.969447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.45000000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.308},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28399999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672987,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705689,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.14599999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.30299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:32.112 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-20T13:36:32.112 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:32.262 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.261+0000 7ff8dfc4a640 1 Processor -- start 2024-03-20T13:36:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.261+0000 7ff8dfc4a640 1 -- start start 2024-03-20T13:36:32.263 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dfc4a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff8d80993f0 0x7ff8d8133350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dfc4a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d809dc90 con 0x7ff8d8098900 2024-03-20T13:36:32.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dfc4a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d809a170 con 0x7ff8d80993f0 2024-03-20T13:36:32.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dd1e5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff8d80993f0 0x7ff8d8133350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.264 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dd9e6640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff8d8098900 0x7ff8d8098ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42940/0 (socket says 172.21.15.28:42940) 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dd9e6640 1 -- 172.21.15.28:0/1160457885 learned_addr learned my addr 172.21.15.28:0/1160457885 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dd1e5640 1 -- 172.21.15.28:0/1160457885 >> v1:172.21.15.28:6789/0 conn(0x7ff8d8098900 legacy=0x7ff8d8098ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dc9e4640 1 -- 172.21.15.28:0/1160457885 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090229770 0 0) 0x7ff8d809dc90 con 0x7ff8d8098900 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.262+0000 7ff8dd1e5640 1 -- 172.21.15.28:0/1160457885 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d8099d30 con 0x7ff8d80993f0 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.263+0000 7ff8dd1e5640 1 --2- 172.21.15.28:0/1160457885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d80993f0 0x7ff8d8133350 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009720 tx=0x7ff8d402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150c41235ae2634 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.263+0000 7ff8dc9e4640 1 -- 172.21.15.28:0/1160457885 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8d402e070 con 0x7ff8d80993f0 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.263+0000 7ff8dc9e4640 1 -- 172.21.15.28:0/1160457885 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d40316d0 con 0x7ff8d80993f0 2024-03-20T13:36:32.265 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.263+0000 7ff8dc9e4640 1 -- 172.21.15.28:0/1160457885 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8d4031990 con 0x7ff8d80993f0 2024-03-20T13:36:32.267 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/1160457885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d80993f0 msgr2=0x7ff8d8133350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 --2- 172.21.15.28:0/1160457885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d80993f0 0x7ff8d8133350 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009720 tx=0x7ff8d402b840 comp rx=0 tx=0).stop 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/1160457885 shutdown_connections 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 --2- 172.21.15.28:0/1160457885 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d80993f0 0x7ff8d8133350 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/1160457885 >> 172.21.15.28:0/1160457885 conn(0x7ff8d80a0a20 msgr2=0x7ff8d809cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/1160457885 shutdown_connections 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.264+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/1160457885 wait complete. 2024-03-20T13:36:32.268 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.265+0000 7ff8dfc4a640 1 Processor -- start 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.265+0000 7ff8dfc4a640 1 -- start start 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dfc4a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 0x7ff8d8128640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dfc4a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d8129d80 con 0x7ff8d8098900 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dd9e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 0x7ff8d8128640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dd9e6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 0x7ff8d8128640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48956/0 (socket says 172.21.15.28:48956) 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dd9e6640 1 -- 172.21.15.28:0/2863855198 learned_addr learned my addr 172.21.15.28:0/2863855198 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dd9e6640 1 -- 172.21.15.28:0/2863855198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d4009400 con 0x7ff8d8098900 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dd9e6640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 0x7ff8d8128640 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c420 tx=0x7ff8c800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8c80074d0 con 0x7ff8d8098900 2024-03-20T13:36:32.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c8007630 con 0x7ff8d8098900 2024-03-20T13:36:32.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff8c8004950 con 0x7ff8d8098900 2024-03-20T13:36:32.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d812ac40 con 0x7ff8d8098900 2024-03-20T13:36:32.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.266+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81298c0 con 0x7ff8d8098900 2024-03-20T13:36:32.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.267+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7ff8c8004b70 con 0x7ff8d8098900 2024-03-20T13:36:32.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.267+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d80627b0 con 0x7ff8d8098900 2024-03-20T13:36:32.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.267+0000 7ff8ce7fc640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff8bc037ea0 0x7ff8bc03a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.268+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7ff8c804aad0 con 0x7ff8d8098900 2024-03-20T13:36:32.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.268+0000 7ff8dd1e5640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff8bc037ea0 0x7ff8bc03a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.268+0000 7ff8dd1e5640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff8bc037ea0 0x7ff8bc03a360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4036000 tx=0x7ff8d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.273 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.272+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7ff8c801abe0 con 0x7ff8d8098900 2024-03-20T13:36:32.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.448+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff8d8099a20 con 0x7ff8bc037ea0 2024-03-20T13:36:32.465 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.464+0000 7ff8ce7fc640 1 -- 172.21.15.28:0/2863855198 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673678 (secure 0 0 0) 0x7ff8d4031b40 con 0x7ff8bc037ea0 2024-03-20T13:36:32.472 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:36:32.478 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:36:32.480 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff8bc037ea0 msgr2=0x7ff8bc03a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff8bc037ea0 0x7ff8bc03a360 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4036000 tx=0x7ff8d4008030 comp rx=0 tx=0).stop 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 msgr2=0x7ff8d8128640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 0x7ff8d8128640 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ff8c800c420 tx=0x7ff8c800c8e0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 shutdown_connections 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7ff8bc037ea0 0x7ff8bc03a360 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 --2- 172.21.15.28:0/2863855198 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff8d8098900 0x7ff8d8128640 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 >> 172.21.15.28:0/2863855198 conn(0x7ff8d80a0a20 msgr2=0x7ff8d80937f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.481 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 shutdown_connections 2024-03-20T13:36:32.482 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.468+0000 7ff8dfc4a640 1 -- 172.21.15.28:0/2863855198 wait complete. 2024-03-20T13:36:32.482 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2024-03-20T13:36:31.169793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":3797,"num_read_kb":3440,"num_write":1453,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3675,"ondisk_log_size":3675,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-1177,"num_objects":-18,"num_object_clones":0,"num_object_copies":-37,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-18,"num_whiteouts":0,"num_read":281,"num_read_kb":273,"num_write":79,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004281"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988720+0000","last_change":"2024-03-20T13:34:49.945378+0000","last_active":"2024-03-20T13:35:30.988720+0000","last_peered":"2024-03-20T13:35:30.988720+0000","last_clean":"2024-03-20T13:35:30.988720+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:35:30.988720+0000","last_undegraded":"2024-03-20T13:35:30.988720+0000","last_fullsized":"2024-03-20T13:35:30.988720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925322+0000","last_change":"2024-03-20T13:34:51.948629+0000","last_active":"2024-03-20T13:35:35.925322+0000","last_peered":"2024-03-20T13:35:35.925322+0000","last_clean":"2024-03-20T13:35:35.925322+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:35:35.925322+0000","last_undegraded":"2024-03-20T13:35:35.925322+0000","last_fullsized":"2024-03-20T13:35:35.925322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984600+0000","last_change":"2024-03-20T13:34:49.933462+0000","last_active":"2024-03-20T13:35:30.984600+0000","last_peered":"2024-03-20T13:35:30.984600+0000","last_clean":"2024-03-20T13:35:30.984600+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:35:30.984600+0000","last_undegraded":"2024-03-20T13:35:30.984600+0000","last_fullsized":"2024-03-20T13:35:30.984600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:34.991691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568207+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.568207+0000","last_peered":"2024-03-20T13:36:23.568207+0000","last_clean":"2024-03-20T13:36:23.568207+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.568207+0000","last_undegraded":"2024-03-20T13:36:23.568207+0000","last_fullsized":"2024-03-20T13:36:23.568207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:53.377689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.796505+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:35:34.796505+0000","last_peered":"2024-03-20T13:35:34.796505+0000","last_clean":"2024-03-20T13:35:34.796505+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:35:34.796505+0000","last_undegraded":"2024-03-20T13:35:34.796505+0000","last_fullsized":"2024-03-20T13:35:34.796505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:36.437918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986674+0000","last_change":"2024-03-20T13:34:51.947769+0000","last_active":"2024-03-20T13:35:30.986674+0000","last_peered":"2024-03-20T13:35:30.986674+0000","last_clean":"2024-03-20T13:35:30.986674+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:35:30.986674+0000","last_undegraded":"2024-03-20T13:35:30.986674+0000","last_fullsized":"2024-03-20T13:35:30.986674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:10.763673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.407859+0000","last_change":"2024-03-20T13:34:49.952708+0000","last_active":"2024-03-20T13:35:35.407859+0000","last_peered":"2024-03-20T13:35:35.407859+0000","last_clean":"2024-03-20T13:35:35.407859+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:35:35.407859+0000","last_undegraded":"2024-03-20T13:35:35.407859+0000","last_fullsized":"2024-03-20T13:35:35.407859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309640+0000","last_change":"2024-03-20T13:35:30.996431+0000","last_active":"2024-03-20T13:36:17.309640+0000","last_peered":"2024-03-20T13:36:17.309640+0000","last_clean":"2024-03-20T13:36:17.309640+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:36:17.309640+0000","last_undegraded":"2024-03-20T13:36:17.309640+0000","last_fullsized":"2024-03-20T13:36:17.309640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:29.110394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987551+0000","last_change":"2024-03-20T13:34:49.959192+0000","last_active":"2024-03-20T13:35:30.987551+0000","last_peered":"2024-03-20T13:35:30.987551+0000","last_clean":"2024-03-20T13:35:30.987551+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:35:30.987551+0000","last_undegraded":"2024-03-20T13:35:30.987551+0000","last_fullsized":"2024-03-20T13:35:30.987551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:53.061218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309603+0000","last_change":"2024-03-20T13:34:51.946953+0000","last_active":"2024-03-20T13:36:17.309603+0000","last_peered":"2024-03-20T13:36:17.309603+0000","last_clean":"2024-03-20T13:36:17.309603+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:36:17.309603+0000","last_undegraded":"2024-03-20T13:36:17.309603+0000","last_fullsized":"2024-03-20T13:36:17.309603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985613+0000","last_change":"2024-03-20T13:34:49.954949+0000","last_active":"2024-03-20T13:35:30.985613+0000","last_peered":"2024-03-20T13:35:30.985613+0000","last_clean":"2024-03-20T13:35:30.985613+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:35:30.985613+0000","last_undegraded":"2024-03-20T13:35:30.985613+0000","last_fullsized":"2024-03-20T13:35:30.985613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988705+0000","last_change":"2024-03-20T13:34:51.952540+0000","last_active":"2024-03-20T13:35:30.988705+0000","last_peered":"2024-03-20T13:35:30.988705+0000","last_clean":"2024-03-20T13:35:30.988705+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:35:30.988705+0000","last_undegraded":"2024-03-20T13:35:30.988705+0000","last_fullsized":"2024-03-20T13:35:30.988705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:28.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986108+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:35:30.986108+0000","last_peered":"2024-03-20T13:35:30.986108+0000","last_clean":"2024-03-20T13:35:30.986108+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:35:30.986108+0000","last_undegraded":"2024-03-20T13:35:30.986108+0000","last_fullsized":"2024-03-20T13:35:30.986108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:09:20.487446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568527+0000","last_change":"2024-03-20T13:34:51.948321+0000","last_active":"2024-03-20T13:36:23.568527+0000","last_peered":"2024-03-20T13:36:23.568527+0000","last_clean":"2024-03-20T13:36:23.568527+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:23.568527+0000","last_undegraded":"2024-03-20T13:36:23.568527+0000","last_fullsized":"2024-03-20T13:36:23.568527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982427+0000","last_change":"2024-03-20T13:34:49.940856+0000","last_active":"2024-03-20T13:35:30.982427+0000","last_peered":"2024-03-20T13:35:30.982427+0000","last_clean":"2024-03-20T13:35:30.982427+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:35:30.982427+0000","last_undegraded":"2024-03-20T13:35:30.982427+0000","last_fullsized":"2024-03-20T13:35:30.982427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309552+0000","last_change":"2024-03-20T13:34:51.945268+0000","last_active":"2024-03-20T13:36:17.309552+0000","last_peered":"2024-03-20T13:36:17.309552+0000","last_clean":"2024-03-20T13:36:17.309552+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:36:17.309552+0000","last_undegraded":"2024-03-20T13:36:17.309552+0000","last_fullsized":"2024-03-20T13:36:17.309552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969415+0000","last_change":"2024-03-20T13:34:51.949454+0000","last_active":"2024-03-20T13:36:17.969415+0000","last_peered":"2024-03-20T13:36:17.969415+0000","last_clean":"2024-03-20T13:36:17.969415+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:36:17.969415+0000","last_undegraded":"2024-03-20T13:36:17.969415+0000","last_fullsized":"2024-03-20T13:36:17.969415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:22.583858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983023+0000","last_change":"2024-03-20T13:34:49.945284+0000","last_active":"2024-03-20T13:35:30.983023+0000","last_peered":"2024-03-20T13:35:30.983023+0000","last_clean":"2024-03-20T13:35:30.983023+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:35:30.983023+0000","last_undegraded":"2024-03-20T13:35:30.983023+0000","last_fullsized":"2024-03-20T13:35:30.983023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568361+0000","last_change":"2024-03-20T13:34:51.948725+0000","last_active":"2024-03-20T13:36:23.568361+0000","last_peered":"2024-03-20T13:36:23.568361+0000","last_clean":"2024-03-20T13:36:23.568361+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:23.568361+0000","last_undegraded":"2024-03-20T13:36:23.568361+0000","last_fullsized":"2024-03-20T13:36:23.568361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990655+0000","last_change":"2024-03-20T13:34:49.950644+0000","last_active":"2024-03-20T13:35:30.990655+0000","last_peered":"2024-03-20T13:35:30.990655+0000","last_clean":"2024-03-20T13:35:30.990655+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:35:30.990655+0000","last_undegraded":"2024-03-20T13:35:30.990655+0000","last_fullsized":"2024-03-20T13:35:30.990655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.165007+0000","last_change":"2024-03-20T13:34:51.947958+0000","last_active":"2024-03-20T13:35:35.165007+0000","last_peered":"2024-03-20T13:35:35.165007+0000","last_clean":"2024-03-20T13:35:35.165007+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:35:35.165007+0000","last_undegraded":"2024-03-20T13:35:35.165007+0000","last_fullsized":"2024-03-20T13:35:35.165007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:26.305545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.410831+0000","last_change":"2024-03-20T13:34:49.946510+0000","last_active":"2024-03-20T13:35:35.410831+0000","last_peered":"2024-03-20T13:35:35.410831+0000","last_clean":"2024-03-20T13:35:35.410831+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:35:35.410831+0000","last_undegraded":"2024-03-20T13:35:35.410831+0000","last_fullsized":"2024-03-20T13:35:35.410831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815929+0000","last_change":"2024-03-20T13:34:51.937387+0000","last_active":"2024-03-20T13:35:34.815929+0000","last_peered":"2024-03-20T13:35:34.815929+0000","last_clean":"2024-03-20T13:35:34.815929+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:35:34.815929+0000","last_undegraded":"2024-03-20T13:35:34.815929+0000","last_fullsized":"2024-03-20T13:35:34.815929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982385+0000","last_change":"2024-03-20T13:34:49.949930+0000","last_active":"2024-03-20T13:35:30.982385+0000","last_peered":"2024-03-20T13:35:30.982385+0000","last_clean":"2024-03-20T13:35:30.982385+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:35:30.982385+0000","last_undegraded":"2024-03-20T13:35:30.982385+0000","last_fullsized":"2024-03-20T13:35:30.982385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976899+0000","last_change":"2024-03-20T13:34:51.941800+0000","last_active":"2024-03-20T13:36:17.976899+0000","last_peered":"2024-03-20T13:36:17.976899+0000","last_clean":"2024-03-20T13:36:17.976899+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:36:17.976899+0000","last_undegraded":"2024-03-20T13:36:17.976899+0000","last_fullsized":"2024-03-20T13:36:17.976899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984331+0000","last_change":"2024-03-20T13:34:49.934846+0000","last_active":"2024-03-20T13:35:30.984331+0000","last_peered":"2024-03-20T13:35:30.984331+0000","last_clean":"2024-03-20T13:35:30.984331+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:35:30.984331+0000","last_undegraded":"2024-03-20T13:35:30.984331+0000","last_fullsized":"2024-03-20T13:35:30.984331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309570+0000","last_change":"2024-03-20T13:34:51.948384+0000","last_active":"2024-03-20T13:36:17.309570+0000","last_peered":"2024-03-20T13:36:17.309570+0000","last_clean":"2024-03-20T13:36:17.309570+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:36:17.309570+0000","last_undegraded":"2024-03-20T13:36:17.309570+0000","last_fullsized":"2024-03-20T13:36:17.309570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:39.648807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986253+0000","last_change":"2024-03-20T13:34:49.959590+0000","last_active":"2024-03-20T13:35:30.986253+0000","last_peered":"2024-03-20T13:35:30.986253+0000","last_clean":"2024-03-20T13:35:30.986253+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:35:30.986253+0000","last_undegraded":"2024-03-20T13:35:30.986253+0000","last_fullsized":"2024-03-20T13:35:30.986253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:00.815146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559090+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:23.559090+0000","last_peered":"2024-03-20T13:36:23.559090+0000","last_clean":"2024-03-20T13:36:23.559090+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:23.559090+0000","last_undegraded":"2024-03-20T13:36:23.559090+0000","last_fullsized":"2024-03-20T13:36:23.559090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:37.139674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.994987+0000","last_change":"2024-03-20T13:35:30.994560+0000","last_active":"2024-03-20T13:35:30.994987+0000","last_peered":"2024-03-20T13:35:30.994987+0000","last_clean":"2024-03-20T13:35:30.994987+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:35:30.994987+0000","last_undegraded":"2024-03-20T13:35:30.994987+0000","last_fullsized":"2024-03-20T13:35:30.994987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:54.906208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987284+0000","last_change":"2024-03-20T13:34:49.959439+0000","last_active":"2024-03-20T13:35:30.987284+0000","last_peered":"2024-03-20T13:35:30.987284+0000","last_clean":"2024-03-20T13:35:30.987284+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:35:30.987284+0000","last_undegraded":"2024-03-20T13:35:30.987284+0000","last_fullsized":"2024-03-20T13:35:30.987284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:00.516394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988549+0000","last_change":"2024-03-20T13:34:53.942393+0000","last_active":"2024-03-20T13:35:30.988549+0000","last_peered":"2024-03-20T13:35:30.988549+0000","last_clean":"2024-03-20T13:35:30.988549+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:35:30.988549+0000","last_undegraded":"2024-03-20T13:35:30.988549+0000","last_fullsized":"2024-03-20T13:35:30.988549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:23.709018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.940990+0000","last_change":"2024-03-20T13:34:55.955194+0000","last_active":"2024-03-20T13:36:17.940990+0000","last_peered":"2024-03-20T13:36:17.940990+0000","last_clean":"2024-03-20T13:36:17.940990+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:36:17.940990+0000","last_undegraded":"2024-03-20T13:36:17.940990+0000","last_fullsized":"2024-03-20T13:36:17.940990+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:57.391498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982874+0000","last_change":"2024-03-20T13:34:57.964242+0000","last_active":"2024-03-20T13:35:30.982874+0000","last_peered":"2024-03-20T13:35:30.982874+0000","last_clean":"2024-03-20T13:35:30.982874+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:35:30.982874+0000","last_undegraded":"2024-03-20T13:35:30.982874+0000","last_fullsized":"2024-03-20T13:35:30.982874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.266272+0000","last_change":"2024-03-20T13:34:59.969467+0000","last_active":"2024-03-20T13:36:12.266272+0000","last_peered":"2024-03-20T13:36:12.266272+0000","last_clean":"2024-03-20T13:36:12.266272+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:36:12.266272+0000","last_undegraded":"2024-03-20T13:36:12.266272+0000","last_fullsized":"2024-03-20T13:36:12.266272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:06:17.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309566+0000","last_change":"2024-03-20T13:34:51.943450+0000","last_active":"2024-03-20T13:36:17.309566+0000","last_peered":"2024-03-20T13:36:17.309566+0000","last_clean":"2024-03-20T13:36:17.309566+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:36:17.309566+0000","last_undegraded":"2024-03-20T13:36:17.309566+0000","last_fullsized":"2024-03-20T13:36:17.309566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:12:33.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985408+0000","last_change":"2024-03-20T13:34:49.955248+0000","last_active":"2024-03-20T13:35:30.985408+0000","last_peered":"2024-03-20T13:35:30.985408+0000","last_clean":"2024-03-20T13:35:30.985408+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:35:30.985408+0000","last_undegraded":"2024-03-20T13:35:30.985408+0000","last_fullsized":"2024-03-20T13:35:30.985408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983126+0000","last_change":"2024-03-20T13:34:53.944586+0000","last_active":"2024-03-20T13:35:30.983126+0000","last_peered":"2024-03-20T13:35:30.983126+0000","last_clean":"2024-03-20T13:35:30.983126+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:35:30.983126+0000","last_undegraded":"2024-03-20T13:35:30.983126+0000","last_fullsized":"2024-03-20T13:35:30.983126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:55.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981904+0000","last_change":"2024-03-20T13:34:55.953888+0000","last_active":"2024-03-20T13:35:30.981904+0000","last_peered":"2024-03-20T13:35:30.981904+0000","last_clean":"2024-03-20T13:35:30.981904+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:35:30.981904+0000","last_undegraded":"2024-03-20T13:35:30.981904+0000","last_fullsized":"2024-03-20T13:35:30.981904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:49:02.706193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981211+0000","last_change":"2024-03-20T13:34:57.966274+0000","last_active":"2024-03-20T13:35:30.981211+0000","last_peered":"2024-03-20T13:35:30.981211+0000","last_clean":"2024-03-20T13:35:30.981211+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:35:30.981211+0000","last_undegraded":"2024-03-20T13:35:30.981211+0000","last_fullsized":"2024-03-20T13:35:30.981211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.957308+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:17.957308+0000","last_peered":"2024-03-20T13:36:17.957308+0000","last_clean":"2024-03-20T13:36:17.957308+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:17.957308+0000","last_undegraded":"2024-03-20T13:36:17.957308+0000","last_fullsized":"2024-03-20T13:36:17.957308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969171+0000","last_change":"2024-03-20T13:34:51.940751+0000","last_active":"2024-03-20T13:36:17.969171+0000","last_peered":"2024-03-20T13:36:17.969171+0000","last_clean":"2024-03-20T13:36:17.969171+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:36:17.969171+0000","last_undegraded":"2024-03-20T13:36:17.969171+0000","last_fullsized":"2024-03-20T13:36:17.969171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:12.037950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985656+0000","last_change":"2024-03-20T13:34:49.959865+0000","last_active":"2024-03-20T13:35:30.985656+0000","last_peered":"2024-03-20T13:35:30.985656+0000","last_clean":"2024-03-20T13:35:30.985656+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:35:30.985656+0000","last_undegraded":"2024-03-20T13:35:30.985656+0000","last_fullsized":"2024-03-20T13:35:30.985656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:21.968097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985039+0000","last_change":"2024-03-20T13:34:53.944429+0000","last_active":"2024-03-20T13:35:30.985039+0000","last_peered":"2024-03-20T13:35:30.985039+0000","last_clean":"2024-03-20T13:35:30.985039+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:35:30.985039+0000","last_undegraded":"2024-03-20T13:35:30.985039+0000","last_fullsized":"2024-03-20T13:35:30.985039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:58.423104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986686+0000","last_change":"2024-03-20T13:34:55.951242+0000","last_active":"2024-03-20T13:35:30.986686+0000","last_peered":"2024-03-20T13:35:30.986686+0000","last_clean":"2024-03-20T13:35:30.986686+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:35:30.986686+0000","last_undegraded":"2024-03-20T13:35:30.986686+0000","last_fullsized":"2024-03-20T13:35:30.986686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:19.540711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'240","reported_seq":316,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002439+0000","last_change":"2024-03-20T13:34:57.969943+0000","last_active":"2024-03-20T13:36:24.002439+0000","last_peered":"2024-03-20T13:36:24.002439+0000","last_clean":"2024-03-20T13:36:24.002439+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:36:24.002439+0000","last_undegraded":"2024-03-20T13:36:24.002439+0000","last_fullsized":"2024-03-20T13:36:24.002439+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:23.726307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985453+0000","last_change":"2024-03-20T13:34:59.971383+0000","last_active":"2024-03-20T13:35:30.985453+0000","last_peered":"2024-03-20T13:35:30.985453+0000","last_clean":"2024-03-20T13:35:30.985453+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:35:30.985453+0000","last_undegraded":"2024-03-20T13:35:30.985453+0000","last_fullsized":"2024-03-20T13:35:30.985453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:10.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.813600+0000","last_change":"2024-03-20T13:34:51.947848+0000","last_active":"2024-03-20T13:35:34.813600+0000","last_peered":"2024-03-20T13:35:34.813600+0000","last_clean":"2024-03-20T13:35:34.813600+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:35:34.813600+0000","last_undegraded":"2024-03-20T13:35:34.813600+0000","last_fullsized":"2024-03-20T13:35:34.813600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980679+0000","last_change":"2024-03-20T13:34:49.943444+0000","last_active":"2024-03-20T13:35:30.980679+0000","last_peered":"2024-03-20T13:35:30.980679+0000","last_clean":"2024-03-20T13:35:30.980679+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:35:30.980679+0000","last_undegraded":"2024-03-20T13:35:30.980679+0000","last_fullsized":"2024-03-20T13:35:30.980679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989445+0000","last_change":"2024-03-20T13:34:53.939852+0000","last_active":"2024-03-20T13:35:30.989445+0000","last_peered":"2024-03-20T13:35:30.989445+0000","last_clean":"2024-03-20T13:35:30.989445+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:35:30.989445+0000","last_undegraded":"2024-03-20T13:35:30.989445+0000","last_fullsized":"2024-03-20T13:35:30.989445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:56.912941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.935322+0000","last_change":"2024-03-20T13:34:55.957753+0000","last_active":"2024-03-20T13:36:17.935322+0000","last_peered":"2024-03-20T13:36:17.935322+0000","last_clean":"2024-03-20T13:36:17.935322+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:17.935322+0000","last_undegraded":"2024-03-20T13:36:17.935322+0000","last_fullsized":"2024-03-20T13:36:17.935322+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:14.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'240","reported_seq":336,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002289+0000","last_change":"2024-03-20T13:34:57.968163+0000","last_active":"2024-03-20T13:36:24.002289+0000","last_peered":"2024-03-20T13:36:24.002289+0000","last_clean":"2024-03-20T13:36:24.002289+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:24.002289+0000","last_undegraded":"2024-03-20T13:36:24.002289+0000","last_fullsized":"2024-03-20T13:36:24.002289+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:49.987254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969225+0000","last_change":"2024-03-20T13:34:51.953602+0000","last_active":"2024-03-20T13:36:17.969225+0000","last_peered":"2024-03-20T13:36:17.969225+0000","last_clean":"2024-03-20T13:36:17.969225+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:36:17.969225+0000","last_undegraded":"2024-03-20T13:36:17.969225+0000","last_fullsized":"2024-03-20T13:36:17.969225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:54.019802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988845+0000","last_change":"2024-03-20T13:34:49.944500+0000","last_active":"2024-03-20T13:35:30.988845+0000","last_peered":"2024-03-20T13:35:30.988845+0000","last_clean":"2024-03-20T13:35:30.988845+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:35:30.988845+0000","last_undegraded":"2024-03-20T13:35:30.988845+0000","last_fullsized":"2024-03-20T13:35:30.988845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980677+0000","last_change":"2024-03-20T13:34:53.945355+0000","last_active":"2024-03-20T13:35:30.980677+0000","last_peered":"2024-03-20T13:35:30.980677+0000","last_clean":"2024-03-20T13:35:30.980677+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:35:30.980677+0000","last_undegraded":"2024-03-20T13:35:30.980677+0000","last_fullsized":"2024-03-20T13:35:30.980677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'38","reported_seq":84,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.945229+0000","last_change":"2024-03-20T13:34:55.952069+0000","last_active":"2024-03-20T13:36:17.945229+0000","last_peered":"2024-03-20T13:36:17.945229+0000","last_clean":"2024-03-20T13:36:17.945229+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:17.945229+0000","last_undegraded":"2024-03-20T13:36:17.945229+0000","last_fullsized":"2024-03-20T13:36:17.945229+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:43.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983837+0000","last_change":"2024-03-20T13:34:57.967957+0000","last_active":"2024-03-20T13:35:30.983837+0000","last_peered":"2024-03-20T13:35:30.983837+0000","last_clean":"2024-03-20T13:35:30.983837+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:35:30.983837+0000","last_undegraded":"2024-03-20T13:35:30.983837+0000","last_fullsized":"2024-03-20T13:35:30.983837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:03:03.819479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.754329+0000","last_change":"2024-03-20T13:34:59.974067+0000","last_active":"2024-03-20T13:36:17.754329+0000","last_peered":"2024-03-20T13:36:17.754329+0000","last_clean":"2024-03-20T13:36:17.754329+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:36:17.754329+0000","last_undegraded":"2024-03-20T13:36:17.754329+0000","last_fullsized":"2024-03-20T13:36:17.754329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:57.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164674+0000","last_change":"2024-03-20T13:34:51.941910+0000","last_active":"2024-03-20T13:35:35.164674+0000","last_peered":"2024-03-20T13:35:35.164674+0000","last_clean":"2024-03-20T13:35:35.164674+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:35:35.164674+0000","last_undegraded":"2024-03-20T13:35:35.164674+0000","last_fullsized":"2024-03-20T13:35:35.164674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.418375+0000","last_change":"2024-03-20T13:34:49.939109+0000","last_active":"2024-03-20T13:35:35.418375+0000","last_peered":"2024-03-20T13:35:35.418375+0000","last_clean":"2024-03-20T13:35:35.418375+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:35:35.418375+0000","last_undegraded":"2024-03-20T13:35:35.418375+0000","last_fullsized":"2024-03-20T13:35:35.418375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982623+0000","last_change":"2024-03-20T13:34:53.943905+0000","last_active":"2024-03-20T13:35:30.982623+0000","last_peered":"2024-03-20T13:35:30.982623+0000","last_clean":"2024-03-20T13:35:30.982623+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:35:30.982623+0000","last_undegraded":"2024-03-20T13:35:30.982623+0000","last_fullsized":"2024-03-20T13:35:30.982623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:30:51.851311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.527633+0000","last_change":"2024-03-20T13:34:55.954351+0000","last_active":"2024-03-20T13:36:23.527633+0000","last_peered":"2024-03-20T13:36:23.527633+0000","last_clean":"2024-03-20T13:36:23.527633+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:23.527633+0000","last_undegraded":"2024-03-20T13:36:23.527633+0000","last_fullsized":"2024-03-20T13:36:23.527633+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:27:04.344480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982540+0000","last_change":"2024-03-20T13:34:57.962956+0000","last_active":"2024-03-20T13:35:30.982540+0000","last_peered":"2024-03-20T13:35:30.982540+0000","last_clean":"2024-03-20T13:35:30.982540+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:35:30.982540+0000","last_undegraded":"2024-03-20T13:35:30.982540+0000","last_fullsized":"2024-03-20T13:35:30.982540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.151593+0000","last_change":"2024-03-20T13:34:59.972444+0000","last_active":"2024-03-20T13:36:12.151593+0000","last_peered":"2024-03-20T13:36:12.151593+0000","last_clean":"2024-03-20T13:36:12.151593+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:36:12.151593+0000","last_undegraded":"2024-03-20T13:36:12.151593+0000","last_fullsized":"2024-03-20T13:36:12.151593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309560+0000","last_change":"2024-03-20T13:34:51.941838+0000","last_active":"2024-03-20T13:36:17.309560+0000","last_peered":"2024-03-20T13:36:17.309560+0000","last_clean":"2024-03-20T13:36:17.309560+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:36:17.309560+0000","last_undegraded":"2024-03-20T13:36:17.309560+0000","last_fullsized":"2024-03-20T13:36:17.309560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:08.971370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990186+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:35:30.990186+0000","last_peered":"2024-03-20T13:35:30.990186+0000","last_clean":"2024-03-20T13:35:30.990186+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:35:30.990186+0000","last_undegraded":"2024-03-20T13:35:30.990186+0000","last_fullsized":"2024-03-20T13:35:30.990186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:10.797692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984920+0000","last_change":"2024-03-20T13:34:53.942038+0000","last_active":"2024-03-20T13:35:30.984920+0000","last_peered":"2024-03-20T13:35:30.984920+0000","last_clean":"2024-03-20T13:35:30.984920+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:35:30.984920+0000","last_undegraded":"2024-03-20T13:35:30.984920+0000","last_fullsized":"2024-03-20T13:35:30.984920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:28.393295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.947391+0000","last_change":"2024-03-20T13:34:55.954800+0000","last_active":"2024-03-20T13:36:17.947391+0000","last_peered":"2024-03-20T13:36:17.947391+0000","last_clean":"2024-03-20T13:36:17.947391+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:17.947391+0000","last_undegraded":"2024-03-20T13:36:17.947391+0000","last_fullsized":"2024-03-20T13:36:17.947391+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:36:42.942474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'240","reported_seq":284,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002273+0000","last_change":"2024-03-20T13:34:57.969445+0000","last_active":"2024-03-20T13:36:24.002273+0000","last_peered":"2024-03-20T13:36:24.002273+0000","last_clean":"2024-03-20T13:36:24.002273+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:24.002273+0000","last_undegraded":"2024-03-20T13:36:24.002273+0000","last_fullsized":"2024-03-20T13:36:24.002273+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983928+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:35:30.983928+0000","last_peered":"2024-03-20T13:35:30.983928+0000","last_clean":"2024-03-20T13:35:30.983928+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:35:30.983928+0000","last_undegraded":"2024-03-20T13:35:30.983928+0000","last_fullsized":"2024-03-20T13:35:30.983928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:24:13.286967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986688+0000","last_change":"2024-03-20T13:34:51.935109+0000","last_active":"2024-03-20T13:35:30.986688+0000","last_peered":"2024-03-20T13:35:30.986688+0000","last_clean":"2024-03-20T13:35:30.986688+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:35:30.986688+0000","last_undegraded":"2024-03-20T13:35:30.986688+0000","last_fullsized":"2024-03-20T13:35:30.986688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988096+0000","last_change":"2024-03-20T13:34:49.962872+0000","last_active":"2024-03-20T13:35:30.988096+0000","last_peered":"2024-03-20T13:35:30.988096+0000","last_clean":"2024-03-20T13:35:30.988096+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:35:30.988096+0000","last_undegraded":"2024-03-20T13:35:30.988096+0000","last_fullsized":"2024-03-20T13:35:30.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:07.620568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982955+0000","last_change":"2024-03-20T13:34:53.943850+0000","last_active":"2024-03-20T13:35:30.982955+0000","last_peered":"2024-03-20T13:35:30.982955+0000","last_clean":"2024-03-20T13:35:30.982955+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:35:30.982955+0000","last_undegraded":"2024-03-20T13:35:30.982955+0000","last_fullsized":"2024-03-20T13:35:30.982955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:11.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'50","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.530542+0000","last_change":"2024-03-20T13:34:55.951028+0000","last_active":"2024-03-20T13:36:23.530542+0000","last_peered":"2024-03-20T13:36:23.530542+0000","last_clean":"2024-03-20T13:36:23.530542+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:23.530542+0000","last_undegraded":"2024-03-20T13:36:23.530542+0000","last_fullsized":"2024-03-20T13:36:23.530542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:57.615475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982468+0000","last_change":"2024-03-20T13:34:57.962288+0000","last_active":"2024-03-20T13:35:30.982468+0000","last_peered":"2024-03-20T13:35:30.982468+0000","last_clean":"2024-03-20T13:35:30.982468+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:35:30.982468+0000","last_undegraded":"2024-03-20T13:35:30.982468+0000","last_fullsized":"2024-03-20T13:35:30.982468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985030+0000","last_change":"2024-03-20T13:34:59.966660+0000","last_active":"2024-03-20T13:35:30.985030+0000","last_peered":"2024-03-20T13:35:30.985030+0000","last_clean":"2024-03-20T13:35:30.985030+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:35:30.985030+0000","last_undegraded":"2024-03-20T13:35:30.985030+0000","last_fullsized":"2024-03-20T13:35:30.985030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:19.864210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.812450+0000","last_change":"2024-03-20T13:34:51.943562+0000","last_active":"2024-03-20T13:35:34.812450+0000","last_peered":"2024-03-20T13:35:34.812450+0000","last_clean":"2024-03-20T13:35:34.812450+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:35:34.812450+0000","last_undegraded":"2024-03-20T13:35:34.812450+0000","last_fullsized":"2024-03-20T13:35:34.812450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983744+0000","last_change":"2024-03-20T13:34:49.933792+0000","last_active":"2024-03-20T13:35:30.983744+0000","last_peered":"2024-03-20T13:35:30.983744+0000","last_clean":"2024-03-20T13:35:30.983744+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:35:30.983744+0000","last_undegraded":"2024-03-20T13:35:30.983744+0000","last_fullsized":"2024-03-20T13:35:30.983744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":199,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.581973+0000","last_change":"2024-03-20T13:34:53.944673+0000","last_active":"2024-03-20T13:36:24.581973+0000","last_peered":"2024-03-20T13:36:24.581973+0000","last_clean":"2024-03-20T13:36:24.581973+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:24.581973+0000","last_undegraded":"2024-03-20T13:36:24.581973+0000","last_fullsized":"2024-03-20T13:36:24.581973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:36.699424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":261,"num_read_kb":260,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.929174+0000","last_change":"2024-03-20T13:34:55.952299+0000","last_active":"2024-03-20T13:36:17.929174+0000","last_peered":"2024-03-20T13:36:17.929174+0000","last_clean":"2024-03-20T13:36:17.929174+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:17.929174+0000","last_undegraded":"2024-03-20T13:36:17.929174+0000","last_fullsized":"2024-03-20T13:36:17.929174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:26:51.439053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989229+0000","last_change":"2024-03-20T13:34:57.962715+0000","last_active":"2024-03-20T13:35:30.989229+0000","last_peered":"2024-03-20T13:35:30.989229+0000","last_clean":"2024-03-20T13:35:30.989229+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:35:30.989229+0000","last_undegraded":"2024-03-20T13:35:30.989229+0000","last_fullsized":"2024-03-20T13:35:30.989229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:03.988490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.263192+0000","last_change":"2024-03-20T13:34:59.971713+0000","last_active":"2024-03-20T13:36:12.263192+0000","last_peered":"2024-03-20T13:36:12.263192+0000","last_clean":"2024-03-20T13:36:12.263192+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:36:12.263192+0000","last_undegraded":"2024-03-20T13:36:12.263192+0000","last_fullsized":"2024-03-20T13:36:12.263192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:17.405294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969186+0000","last_change":"2024-03-20T13:35:30.988681+0000","last_active":"2024-03-20T13:36:17.969186+0000","last_peered":"2024-03-20T13:36:17.969186+0000","last_clean":"2024-03-20T13:36:17.969186+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:36:17.969186+0000","last_undegraded":"2024-03-20T13:36:17.969186+0000","last_fullsized":"2024-03-20T13:36:17.969186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:48.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986833+0000","last_change":"2024-03-20T13:34:49.958288+0000","last_active":"2024-03-20T13:35:30.986833+0000","last_peered":"2024-03-20T13:35:30.986833+0000","last_clean":"2024-03-20T13:35:30.986833+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:35:30.986833+0000","last_undegraded":"2024-03-20T13:35:30.986833+0000","last_fullsized":"2024-03-20T13:35:30.986833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:55.228134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983298+0000","last_change":"2024-03-20T13:34:53.943738+0000","last_active":"2024-03-20T13:35:30.983298+0000","last_peered":"2024-03-20T13:35:30.983298+0000","last_clean":"2024-03-20T13:35:30.983298+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:35:30.983298+0000","last_undegraded":"2024-03-20T13:35:30.983298+0000","last_fullsized":"2024-03-20T13:35:30.983298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:23.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.955427+0000","last_change":"2024-03-20T13:34:55.948943+0000","last_active":"2024-03-20T13:36:17.955427+0000","last_peered":"2024-03-20T13:36:17.955427+0000","last_clean":"2024-03-20T13:36:17.955427+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:17.955427+0000","last_undegraded":"2024-03-20T13:36:17.955427+0000","last_fullsized":"2024-03-20T13:36:17.955427+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'240","reported_seq":360,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002429+0000","last_change":"2024-03-20T13:34:57.967289+0000","last_active":"2024-03-20T13:36:24.002429+0000","last_peered":"2024-03-20T13:36:24.002429+0000","last_clean":"2024-03-20T13:36:24.002429+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:24.002429+0000","last_undegraded":"2024-03-20T13:36:24.002429+0000","last_fullsized":"2024-03-20T13:36:24.002429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:24.412437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.980936+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:17.980936+0000","last_peered":"2024-03-20T13:36:17.980936+0000","last_clean":"2024-03-20T13:36:17.980936+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:17.980936+0000","last_undegraded":"2024-03-20T13:36:17.980936+0000","last_fullsized":"2024-03-20T13:36:17.980936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989507+0000","last_change":"2024-03-20T13:34:51.942028+0000","last_active":"2024-03-20T13:35:30.989507+0000","last_peered":"2024-03-20T13:35:30.989507+0000","last_clean":"2024-03-20T13:35:30.989507+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:35:30.989507+0000","last_undegraded":"2024-03-20T13:35:30.989507+0000","last_fullsized":"2024-03-20T13:35:30.989507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986721+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:35:30.986721+0000","last_peered":"2024-03-20T13:35:30.986721+0000","last_clean":"2024-03-20T13:35:30.986721+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:35:30.986721+0000","last_undegraded":"2024-03-20T13:35:30.986721+0000","last_fullsized":"2024-03-20T13:35:30.986721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:29.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":359,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.581184+0000","last_change":"2024-03-20T13:34:53.942494+0000","last_active":"2024-03-20T13:36:24.581184+0000","last_peered":"2024-03-20T13:36:24.581184+0000","last_clean":"2024-03-20T13:36:24.581184+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:24.581184+0000","last_undegraded":"2024-03-20T13:36:24.581184+0000","last_fullsized":"2024-03-20T13:36:24.581184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:46.477351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":328,"num_read_kb":328,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989550+0000","last_change":"2024-03-20T13:34:55.953548+0000","last_active":"2024-03-20T13:35:30.989550+0000","last_peered":"2024-03-20T13:35:30.989550+0000","last_clean":"2024-03-20T13:35:30.989550+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:35:30.989550+0000","last_undegraded":"2024-03-20T13:35:30.989550+0000","last_fullsized":"2024-03-20T13:35:30.989550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:54:51.879036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'240","reported_seq":335,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002383+0000","last_change":"2024-03-20T13:34:57.961142+0000","last_active":"2024-03-20T13:36:24.002383+0000","last_peered":"2024-03-20T13:36:24.002383+0000","last_clean":"2024-03-20T13:36:24.002383+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:24.002383+0000","last_undegraded":"2024-03-20T13:36:24.002383+0000","last_fullsized":"2024-03-20T13:36:24.002383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984851+0000","last_change":"2024-03-20T13:34:59.973435+0000","last_active":"2024-03-20T13:35:30.984851+0000","last_peered":"2024-03-20T13:35:30.984851+0000","last_clean":"2024-03-20T13:35:30.984851+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:35:30.984851+0000","last_undegraded":"2024-03-20T13:35:30.984851+0000","last_fullsized":"2024-03-20T13:35:30.984851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:02.537560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.957248+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984276+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:35:30.984276+0000","last_peered":"2024-03-20T13:35:30.984276+0000","last_clean":"2024-03-20T13:35:30.984276+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:35:30.984276+0000","last_undegraded":"2024-03-20T13:35:30.984276+0000","last_fullsized":"2024-03-20T13:35:30.984276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:13:57.917330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988824+0000","last_change":"2024-03-20T13:34:53.944868+0000","last_active":"2024-03-20T13:35:30.988824+0000","last_peered":"2024-03-20T13:35:30.988824+0000","last_clean":"2024-03-20T13:35:30.988824+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:35:30.988824+0000","last_undegraded":"2024-03-20T13:35:30.988824+0000","last_fullsized":"2024-03-20T13:35:30.988824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'36","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.941994+0000","last_change":"2024-03-20T13:34:55.953350+0000","last_active":"2024-03-20T13:36:17.941994+0000","last_peered":"2024-03-20T13:36:17.941994+0000","last_clean":"2024-03-20T13:36:17.941994+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:17.941994+0000","last_undegraded":"2024-03-20T13:36:17.941994+0000","last_fullsized":"2024-03-20T13:36:17.941994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:50.265808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986529+0000","last_change":"2024-03-20T13:34:57.966451+0000","last_active":"2024-03-20T13:35:30.986529+0000","last_peered":"2024-03-20T13:35:30.986529+0000","last_clean":"2024-03-20T13:35:30.986529+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:35:30.986529+0000","last_undegraded":"2024-03-20T13:35:30.986529+0000","last_fullsized":"2024-03-20T13:35:30.986529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:08.191295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981156+0000","last_change":"2024-03-20T13:34:59.968783+0000","last_active":"2024-03-20T13:35:30.981156+0000","last_peered":"2024-03-20T13:35:30.981156+0000","last_clean":"2024-03-20T13:35:30.981156+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:35:30.981156+0000","last_undegraded":"2024-03-20T13:35:30.981156+0000","last_fullsized":"2024-03-20T13:35:30.981156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.660196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990368+0000","last_change":"2024-03-20T13:34:51.954171+0000","last_active":"2024-03-20T13:35:30.990368+0000","last_peered":"2024-03-20T13:35:30.990368+0000","last_clean":"2024-03-20T13:35:30.990368+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:35:30.990368+0000","last_undegraded":"2024-03-20T13:35:30.990368+0000","last_fullsized":"2024-03-20T13:35:30.990368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:02.169329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":202,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980412+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:35:30.980412+0000","last_peered":"2024-03-20T13:35:30.980412+0000","last_clean":"2024-03-20T13:35:30.980412+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:35:30.980412+0000","last_undegraded":"2024-03-20T13:35:30.980412+0000","last_fullsized":"2024-03-20T13:35:30.980412+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:19.105808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987720+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:35:30.987720+0000","last_peered":"2024-03-20T13:35:30.987720+0000","last_clean":"2024-03-20T13:35:30.987720+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:35:30.987720+0000","last_undegraded":"2024-03-20T13:35:30.987720+0000","last_fullsized":"2024-03-20T13:35:30.987720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:56.825560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985917+0000","last_change":"2024-03-20T13:34:49.963030+0000","last_active":"2024-03-20T13:35:30.985917+0000","last_peered":"2024-03-20T13:35:30.985917+0000","last_clean":"2024-03-20T13:35:30.985917+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:35:30.985917+0000","last_undegraded":"2024-03-20T13:35:30.985917+0000","last_fullsized":"2024-03-20T13:35:30.985917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:06.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981550+0000","last_change":"2024-03-20T13:34:53.940877+0000","last_active":"2024-03-20T13:35:30.981550+0000","last_peered":"2024-03-20T13:35:30.981550+0000","last_clean":"2024-03-20T13:35:30.981550+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:35:30.981550+0000","last_undegraded":"2024-03-20T13:35:30.981550+0000","last_fullsized":"2024-03-20T13:35:30.981550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:43.553501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'71","reported_seq":139,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.547108+0000","last_change":"2024-03-20T13:34:55.954716+0000","last_active":"2024-03-20T13:36:23.547108+0000","last_peered":"2024-03-20T13:36:23.547108+0000","last_clean":"2024-03-20T13:36:23.547108+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:23.547108+0000","last_undegraded":"2024-03-20T13:36:23.547108+0000","last_fullsized":"2024-03-20T13:36:23.547108+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:21:49.386776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984143+0000","last_change":"2024-03-20T13:34:57.961066+0000","last_active":"2024-03-20T13:35:30.984143+0000","last_peered":"2024-03-20T13:35:30.984143+0000","last_clean":"2024-03-20T13:35:30.984143+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:35:30.984143+0000","last_undegraded":"2024-03-20T13:35:30.984143+0000","last_fullsized":"2024-03-20T13:35:30.984143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:54.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.580959+0000","last_change":"2024-03-20T13:34:59.973427+0000","last_active":"2024-03-20T13:36:23.580959+0000","last_peered":"2024-03-20T13:36:23.580959+0000","last_clean":"2024-03-20T13:36:23.580959+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:23.580959+0000","last_undegraded":"2024-03-20T13:36:23.580959+0000","last_fullsized":"2024-03-20T13:36:23.580959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:32.618548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989266+0000","last_change":"2024-03-20T13:34:51.941170+0000","last_active":"2024-03-20T13:35:30.989266+0000","last_peered":"2024-03-20T13:35:30.989266+0000","last_clean":"2024-03-20T13:35:30.989266+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:35:30.989266+0000","last_undegraded":"2024-03-20T13:35:30.989266+0000","last_fullsized":"2024-03-20T13:35:30.989266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:10.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983697+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:35:30.983697+0000","last_peered":"2024-03-20T13:35:30.983697+0000","last_clean":"2024-03-20T13:35:30.983697+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:35:30.983697+0000","last_undegraded":"2024-03-20T13:35:30.983697+0000","last_fullsized":"2024-03-20T13:35:30.983697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:50:32.764565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982480+0000","last_change":"2024-03-20T13:34:49.941798+0000","last_active":"2024-03-20T13:35:30.982480+0000","last_peered":"2024-03-20T13:35:30.982480+0000","last_clean":"2024-03-20T13:35:30.982480+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:35:30.982480+0000","last_undegraded":"2024-03-20T13:35:30.982480+0000","last_fullsized":"2024-03-20T13:35:30.982480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990445+0000","last_change":"2024-03-20T13:34:53.941487+0000","last_active":"2024-03-20T13:35:30.990445+0000","last_peered":"2024-03-20T13:35:30.990445+0000","last_clean":"2024-03-20T13:35:30.990445+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:35:30.990445+0000","last_undegraded":"2024-03-20T13:35:30.990445+0000","last_fullsized":"2024-03-20T13:35:30.990445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'239","reported_seq":408,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002647+0000","last_change":"2024-03-20T13:34:55.956289+0000","last_active":"2024-03-20T13:36:24.002647+0000","last_peered":"2024-03-20T13:36:24.002647+0000","last_clean":"2024-03-20T13:36:24.002647+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:24.002647+0000","last_undegraded":"2024-03-20T13:36:24.002647+0000","last_fullsized":"2024-03-20T13:36:24.002647+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":239,"log_dups_size":0,"ondisk_log_size":239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:14.758225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":315,"num_read_kb":300,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987849+0000","last_change":"2024-03-20T13:34:57.964648+0000","last_active":"2024-03-20T13:35:30.987849+0000","last_peered":"2024-03-20T13:35:30.987849+0000","last_clean":"2024-03-20T13:35:30.987849+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:35:30.987849+0000","last_undegraded":"2024-03-20T13:35:30.987849+0000","last_fullsized":"2024-03-20T13:35:30.987849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:41.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.276503+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:12.276503+0000","last_peered":"2024-03-20T13:36:12.276503+0000","last_clean":"2024-03-20T13:36:12.276503+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:12.276503+0000","last_undegraded":"2024-03-20T13:36:12.276503+0000","last_fullsized":"2024-03-20T13:36:12.276503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969323+0000","last_change":"2024-03-20T13:34:51.947812+0000","last_active":"2024-03-20T13:36:17.969323+0000","last_peered":"2024-03-20T13:36:17.969323+0000","last_clean":"2024-03-20T13:36:17.969323+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:36:17.969323+0000","last_undegraded":"2024-03-20T13:36:17.969323+0000","last_fullsized":"2024-03-20T13:36:17.969323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985007+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:35:30.985007+0000","last_peered":"2024-03-20T13:35:30.985007+0000","last_clean":"2024-03-20T13:35:30.985007+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:35:30.985007+0000","last_undegraded":"2024-03-20T13:35:30.985007+0000","last_fullsized":"2024-03-20T13:35:30.985007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982056+0000","last_change":"2024-03-20T13:34:49.934321+0000","last_active":"2024-03-20T13:35:30.982056+0000","last_peered":"2024-03-20T13:35:30.982056+0000","last_clean":"2024-03-20T13:35:30.982056+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:35:30.982056+0000","last_undegraded":"2024-03-20T13:35:30.982056+0000","last_fullsized":"2024-03-20T13:35:30.982056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988938+0000","last_change":"2024-03-20T13:34:53.943172+0000","last_active":"2024-03-20T13:35:30.988938+0000","last_peered":"2024-03-20T13:35:30.988938+0000","last_clean":"2024-03-20T13:35:30.988938+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:35:30.988938+0000","last_undegraded":"2024-03-20T13:35:30.988938+0000","last_fullsized":"2024-03-20T13:35:30.988938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:28.432587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002508+0000","last_change":"2024-03-20T13:34:55.954133+0000","last_active":"2024-03-20T13:36:24.002508+0000","last_peered":"2024-03-20T13:36:24.002508+0000","last_clean":"2024-03-20T13:36:24.002508+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:24.002508+0000","last_undegraded":"2024-03-20T13:36:24.002508+0000","last_fullsized":"2024-03-20T13:36:24.002508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:47.638285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983783+0000","last_change":"2024-03-20T13:34:57.961111+0000","last_active":"2024-03-20T13:35:30.983783+0000","last_peered":"2024-03-20T13:35:30.983783+0000","last_clean":"2024-03-20T13:35:30.983783+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:35:30.983783+0000","last_undegraded":"2024-03-20T13:35:30.983783+0000","last_fullsized":"2024-03-20T13:35:30.983783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:59.940736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986127+0000","last_change":"2024-03-20T13:34:59.970194+0000","last_active":"2024-03-20T13:35:30.986127+0000","last_peered":"2024-03-20T13:35:30.986127+0000","last_clean":"2024-03-20T13:35:30.986127+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:35:30.986127+0000","last_undegraded":"2024-03-20T13:35:30.986127+0000","last_fullsized":"2024-03-20T13:35:30.986127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:45:19.139667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568296+0000","last_change":"2024-03-20T13:34:51.937043+0000","last_active":"2024-03-20T13:36:23.568296+0000","last_peered":"2024-03-20T13:36:23.568296+0000","last_clean":"2024-03-20T13:36:23.568296+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:36:23.568296+0000","last_undegraded":"2024-03-20T13:36:23.568296+0000","last_fullsized":"2024-03-20T13:36:23.568296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985645+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:35:30.985645+0000","last_peered":"2024-03-20T13:35:30.985645+0000","last_clean":"2024-03-20T13:35:30.985645+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:35:30.985645+0000","last_undegraded":"2024-03-20T13:35:30.985645+0000","last_fullsized":"2024-03-20T13:35:30.985645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:55:41.281803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987595+0000","last_change":"2024-03-20T13:34:49.938266+0000","last_active":"2024-03-20T13:35:30.987595+0000","last_peered":"2024-03-20T13:35:30.987595+0000","last_clean":"2024-03-20T13:35:30.987595+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:35:30.987595+0000","last_undegraded":"2024-03-20T13:35:30.987595+0000","last_fullsized":"2024-03-20T13:35:30.987595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983933+0000","last_change":"2024-03-20T13:34:53.942835+0000","last_active":"2024-03-20T13:35:30.983933+0000","last_peered":"2024-03-20T13:35:30.983933+0000","last_clean":"2024-03-20T13:35:30.983933+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:35:30.983933+0000","last_undegraded":"2024-03-20T13:35:30.983933+0000","last_fullsized":"2024-03-20T13:35:30.983933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:41.480924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988052+0000","last_change":"2024-03-20T13:34:55.955766+0000","last_active":"2024-03-20T13:35:30.988052+0000","last_peered":"2024-03-20T13:35:30.988052+0000","last_clean":"2024-03-20T13:35:30.988052+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:35:30.988052+0000","last_undegraded":"2024-03-20T13:35:30.988052+0000","last_fullsized":"2024-03-20T13:35:30.988052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:28.399469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989373+0000","last_change":"2024-03-20T13:34:57.962510+0000","last_active":"2024-03-20T13:35:30.989373+0000","last_peered":"2024-03-20T13:35:30.989373+0000","last_clean":"2024-03-20T13:35:30.989373+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:35:30.989373+0000","last_undegraded":"2024-03-20T13:35:30.989373+0000","last_fullsized":"2024-03-20T13:35:30.989373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.491130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982121+0000","last_change":"2024-03-20T13:34:59.972480+0000","last_active":"2024-03-20T13:35:30.982121+0000","last_peered":"2024-03-20T13:35:30.982121+0000","last_clean":"2024-03-20T13:35:30.982121+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:35:30.982121+0000","last_undegraded":"2024-03-20T13:35:30.982121+0000","last_fullsized":"2024-03-20T13:35:30.982121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:37.262606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612699+0000","last_change":"2024-03-20T13:34:51.950770+0000","last_active":"2024-03-20T13:36:17.612699+0000","last_peered":"2024-03-20T13:36:17.612699+0000","last_clean":"2024-03-20T13:36:17.612699+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:17.612699+0000","last_undegraded":"2024-03-20T13:36:17.612699+0000","last_fullsized":"2024-03-20T13:36:17.612699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:26.425854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986795+0000","last_change":"2024-03-20T13:34:49.936614+0000","last_active":"2024-03-20T13:35:30.986795+0000","last_peered":"2024-03-20T13:35:30.986795+0000","last_clean":"2024-03-20T13:35:30.986795+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:35:30.986795+0000","last_undegraded":"2024-03-20T13:35:30.986795+0000","last_fullsized":"2024-03-20T13:35:30.986795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983575+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:35:30.983575+0000","last_peered":"2024-03-20T13:35:30.983575+0000","last_clean":"2024-03-20T13:35:30.983575+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:35:30.983575+0000","last_undegraded":"2024-03-20T13:35:30.983575+0000","last_fullsized":"2024-03-20T13:35:30.983575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:35.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":192,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.489699+0000","last_change":"2024-03-20T13:34:53.942462+0000","last_active":"2024-03-20T13:36:24.489699+0000","last_peered":"2024-03-20T13:36:24.489699+0000","last_clean":"2024-03-20T13:36:24.489699+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:24.489699+0000","last_undegraded":"2024-03-20T13:36:24.489699+0000","last_fullsized":"2024-03-20T13:36:24.489699+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:17.533635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":247,"num_read_kb":246,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'56","reported_seq":114,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.539599+0000","last_change":"2024-03-20T13:34:55.955509+0000","last_active":"2024-03-20T13:36:23.539599+0000","last_peered":"2024-03-20T13:36:23.539599+0000","last_clean":"2024-03-20T13:36:23.539599+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:23.539599+0000","last_undegraded":"2024-03-20T13:36:23.539599+0000","last_fullsized":"2024-03-20T13:36:23.539599+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:22.404279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985626+0000","last_change":"2024-03-20T13:34:57.966334+0000","last_active":"2024-03-20T13:35:30.985626+0000","last_peered":"2024-03-20T13:35:30.985626+0000","last_clean":"2024-03-20T13:35:30.985626+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:35:30.985626+0000","last_undegraded":"2024-03-20T13:35:30.985626+0000","last_fullsized":"2024-03-20T13:35:30.985626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:16.766382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.956419+0000","last_change":"2024-03-20T13:34:59.968897+0000","last_active":"2024-03-20T13:36:17.956419+0000","last_peered":"2024-03-20T13:36:17.956419+0000","last_clean":"2024-03-20T13:36:17.956419+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:36:17.956419+0000","last_undegraded":"2024-03-20T13:36:17.956419+0000","last_fullsized":"2024-03-20T13:36:17.956419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:14.952118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980915+0000","last_change":"2024-03-20T13:34:51.941739+0000","last_active":"2024-03-20T13:35:30.980915+0000","last_peered":"2024-03-20T13:35:30.980915+0000","last_clean":"2024-03-20T13:35:30.980915+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:35:30.980915+0000","last_undegraded":"2024-03-20T13:35:30.980915+0000","last_fullsized":"2024-03-20T13:35:30.980915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:50.899013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984034+0000","last_change":"2024-03-20T13:34:49.946734+0000","last_active":"2024-03-20T13:35:30.984034+0000","last_peered":"2024-03-20T13:35:30.984034+0000","last_clean":"2024-03-20T13:35:30.984034+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:35:30.984034+0000","last_undegraded":"2024-03-20T13:35:30.984034+0000","last_fullsized":"2024-03-20T13:35:30.984034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988794+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:35:30.988794+0000","last_peered":"2024-03-20T13:35:30.988794+0000","last_clean":"2024-03-20T13:35:30.988794+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:35:30.988794+0000","last_undegraded":"2024-03-20T13:35:30.988794+0000","last_fullsized":"2024-03-20T13:35:30.988794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:29.981275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985463+0000","last_change":"2024-03-20T13:34:53.941252+0000","last_active":"2024-03-20T13:35:30.985463+0000","last_peered":"2024-03-20T13:35:30.985463+0000","last_clean":"2024-03-20T13:35:30.985463+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:35:30.985463+0000","last_undegraded":"2024-03-20T13:35:30.985463+0000","last_fullsized":"2024-03-20T13:35:30.985463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:45.972021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980973+0000","last_change":"2024-03-20T13:34:55.956604+0000","last_active":"2024-03-20T13:35:30.980973+0000","last_peered":"2024-03-20T13:35:30.980973+0000","last_clean":"2024-03-20T13:35:30.980973+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:35:30.980973+0000","last_undegraded":"2024-03-20T13:35:30.980973+0000","last_fullsized":"2024-03-20T13:35:30.980973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:06.183137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'240","reported_seq":278,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002369+0000","last_change":"2024-03-20T13:34:57.962603+0000","last_active":"2024-03-20T13:36:24.002369+0000","last_peered":"2024-03-20T13:36:24.002369+0000","last_clean":"2024-03-20T13:36:24.002369+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:24.002369+0000","last_undegraded":"2024-03-20T13:36:24.002369+0000","last_fullsized":"2024-03-20T13:36:24.002369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.166687+0000","last_change":"2024-03-20T13:34:59.965966+0000","last_active":"2024-03-20T13:35:35.166687+0000","last_peered":"2024-03-20T13:35:35.166687+0000","last_clean":"2024-03-20T13:35:35.166687+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:35:35.166687+0000","last_undegraded":"2024-03-20T13:35:35.166687+0000","last_fullsized":"2024-03-20T13:35:35.166687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:32:13.594344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984374+0000","last_change":"2024-03-20T13:34:51.955616+0000","last_active":"2024-03-20T13:35:30.984374+0000","last_peered":"2024-03-20T13:35:30.984374+0000","last_clean":"2024-03-20T13:35:30.984374+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:35:30.984374+0000","last_undegraded":"2024-03-20T13:35:30.984374+0000","last_fullsized":"2024-03-20T13:35:30.984374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:30.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990294+0000","last_change":"2024-03-20T13:34:49.957658+0000","last_active":"2024-03-20T13:35:30.990294+0000","last_peered":"2024-03-20T13:35:30.990294+0000","last_clean":"2024-03-20T13:35:30.990294+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:35:30.990294+0000","last_undegraded":"2024-03-20T13:35:30.990294+0000","last_fullsized":"2024-03-20T13:35:30.990294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:35.010181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984370+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:35:30.984370+0000","last_peered":"2024-03-20T13:35:30.984370+0000","last_clean":"2024-03-20T13:35:30.984370+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:35:30.984370+0000","last_undegraded":"2024-03-20T13:35:30.984370+0000","last_fullsized":"2024-03-20T13:35:30.984370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:29:46.424197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990699+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:35:30.990699+0000","last_peered":"2024-03-20T13:35:30.990699+0000","last_clean":"2024-03-20T13:35:30.990699+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:35:30.990699+0000","last_undegraded":"2024-03-20T13:35:30.990699+0000","last_fullsized":"2024-03-20T13:35:30.990699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:35.641007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986513+0000","last_change":"2024-03-20T13:34:55.955147+0000","last_active":"2024-03-20T13:35:30.986513+0000","last_peered":"2024-03-20T13:35:30.986513+0000","last_clean":"2024-03-20T13:35:30.986513+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:35:30.986513+0000","last_undegraded":"2024-03-20T13:35:30.986513+0000","last_fullsized":"2024-03-20T13:35:30.986513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:58.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'240","reported_seq":317,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002217+0000","last_change":"2024-03-20T13:34:57.967987+0000","last_active":"2024-03-20T13:36:24.002217+0000","last_peered":"2024-03-20T13:36:24.002217+0000","last_clean":"2024-03-20T13:36:24.002217+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:24.002217+0000","last_undegraded":"2024-03-20T13:36:24.002217+0000","last_fullsized":"2024-03-20T13:36:24.002217+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981031+0000","last_change":"2024-03-20T13:34:59.968359+0000","last_active":"2024-03-20T13:35:30.981031+0000","last_peered":"2024-03-20T13:35:30.981031+0000","last_clean":"2024-03-20T13:35:30.981031+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:35:30.981031+0000","last_undegraded":"2024-03-20T13:35:30.981031+0000","last_fullsized":"2024-03-20T13:35:30.981031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:40.280747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164886+0000","last_change":"2024-03-20T13:34:51.944433+0000","last_active":"2024-03-20T13:35:35.164886+0000","last_peered":"2024-03-20T13:35:35.164886+0000","last_clean":"2024-03-20T13:35:35.164886+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:35:35.164886+0000","last_undegraded":"2024-03-20T13:35:35.164886+0000","last_fullsized":"2024-03-20T13:35:35.164886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:57.235472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982049+0000","last_change":"2024-03-20T13:34:49.947597+0000","last_active":"2024-03-20T13:35:30.982049+0000","last_peered":"2024-03-20T13:35:30.982049+0000","last_clean":"2024-03-20T13:35:30.982049+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:35:30.982049+0000","last_undegraded":"2024-03-20T13:35:30.982049+0000","last_fullsized":"2024-03-20T13:35:30.982049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:23.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989275+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:35:30.989275+0000","last_peered":"2024-03-20T13:35:30.989275+0000","last_clean":"2024-03-20T13:35:30.989275+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:35:30.989275+0000","last_undegraded":"2024-03-20T13:35:30.989275+0000","last_fullsized":"2024-03-20T13:35:30.989275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:53.016765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984914+0000","last_change":"2024-03-20T13:34:53.941526+0000","last_active":"2024-03-20T13:35:30.984914+0000","last_peered":"2024-03-20T13:35:30.984914+0000","last_clean":"2024-03-20T13:35:30.984914+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:35:30.984914+0000","last_undegraded":"2024-03-20T13:35:30.984914+0000","last_fullsized":"2024-03-20T13:35:30.984914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:50.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'77","reported_seq":148,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.536166+0000","last_change":"2024-03-20T13:34:55.956339+0000","last_active":"2024-03-20T13:36:23.536166+0000","last_peered":"2024-03-20T13:36:23.536166+0000","last_clean":"2024-03-20T13:36:23.536166+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:23.536166+0000","last_undegraded":"2024-03-20T13:36:23.536166+0000","last_fullsized":"2024-03-20T13:36:23.536166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:00.430180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983193+0000","last_change":"2024-03-20T13:34:57.962327+0000","last_active":"2024-03-20T13:35:30.983193+0000","last_peered":"2024-03-20T13:35:30.983193+0000","last_clean":"2024-03-20T13:35:30.983193+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:35:30.983193+0000","last_undegraded":"2024-03-20T13:35:30.983193+0000","last_fullsized":"2024-03-20T13:35:30.983193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988480+0000","last_change":"2024-03-20T13:34:59.972683+0000","last_active":"2024-03-20T13:35:30.988480+0000","last_peered":"2024-03-20T13:35:30.988480+0000","last_clean":"2024-03-20T13:35:30.988480+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:35:30.988480+0000","last_undegraded":"2024-03-20T13:35:30.988480+0000","last_fullsized":"2024-03-20T13:35:30.988480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:59.288382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988291+0000","last_change":"2024-03-20T13:34:59.970132+0000","last_active":"2024-03-20T13:35:30.988291+0000","last_peered":"2024-03-20T13:35:30.988291+0000","last_clean":"2024-03-20T13:35:30.988291+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:35:30.988291+0000","last_undegraded":"2024-03-20T13:35:30.988291+0000","last_fullsized":"2024-03-20T13:35:30.988291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:38.005851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568412+0000","last_change":"2024-03-20T13:34:51.943309+0000","last_active":"2024-03-20T13:36:23.568412+0000","last_peered":"2024-03-20T13:36:23.568412+0000","last_clean":"2024-03-20T13:36:23.568412+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:36:23.568412+0000","last_undegraded":"2024-03-20T13:36:23.568412+0000","last_fullsized":"2024-03-20T13:36:23.568412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988151+0000","last_change":"2024-03-20T13:34:49.960700+0000","last_active":"2024-03-20T13:35:30.988151+0000","last_peered":"2024-03-20T13:35:30.988151+0000","last_clean":"2024-03-20T13:35:30.988151+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:35:30.988151+0000","last_undegraded":"2024-03-20T13:35:30.988151+0000","last_fullsized":"2024-03-20T13:35:30.988151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:08.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983120+0000","last_change":"2024-03-20T13:34:53.941620+0000","last_active":"2024-03-20T13:35:30.983120+0000","last_peered":"2024-03-20T13:35:30.983120+0000","last_clean":"2024-03-20T13:35:30.983120+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:35:30.983120+0000","last_undegraded":"2024-03-20T13:35:30.983120+0000","last_fullsized":"2024-03-20T13:35:30.983120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:02.878465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.946353+0000","last_change":"2024-03-20T13:34:55.955235+0000","last_active":"2024-03-20T13:36:17.946353+0000","last_peered":"2024-03-20T13:36:17.946353+0000","last_clean":"2024-03-20T13:36:17.946353+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:36:17.946353+0000","last_undegraded":"2024-03-20T13:36:17.946353+0000","last_fullsized":"2024-03-20T13:36:17.946353+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:19.438768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984712+0000","last_change":"2024-03-20T13:34:57.968867+0000","last_active":"2024-03-20T13:35:30.984712+0000","last_peered":"2024-03-20T13:35:30.984712+0000","last_clean":"2024-03-20T13:35:30.984712+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:35:30.984712+0000","last_undegraded":"2024-03-20T13:35:30.984712+0000","last_fullsized":"2024-03-20T13:35:30.984712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:46.842366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983754+0000","last_change":"2024-03-20T13:34:59.966513+0000","last_active":"2024-03-20T13:35:30.983754+0000","last_peered":"2024-03-20T13:35:30.983754+0000","last_clean":"2024-03-20T13:35:30.983754+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:35:30.983754+0000","last_undegraded":"2024-03-20T13:35:30.983754+0000","last_fullsized":"2024-03-20T13:35:30.983754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:18.685347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568783+0000","last_change":"2024-03-20T13:34:51.944041+0000","last_active":"2024-03-20T13:36:23.568783+0000","last_peered":"2024-03-20T13:36:23.568783+0000","last_clean":"2024-03-20T13:36:23.568783+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:36:23.568783+0000","last_undegraded":"2024-03-20T13:36:23.568783+0000","last_fullsized":"2024-03-20T13:36:23.568783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:34.692691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.563792+0000","last_change":"2024-03-20T13:34:49.950884+0000","last_active":"2024-03-20T13:36:23.563792+0000","last_peered":"2024-03-20T13:36:23.563792+0000","last_clean":"2024-03-20T13:36:23.563792+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:36:23.563792+0000","last_undegraded":"2024-03-20T13:36:23.563792+0000","last_fullsized":"2024-03-20T13:36:23.563792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991514+0000","last_change":"2024-03-20T13:35:30.990765+0000","last_active":"2024-03-20T13:35:30.991514+0000","last_peered":"2024-03-20T13:35:30.991514+0000","last_clean":"2024-03-20T13:35:30.991514+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:35:30.991514+0000","last_undegraded":"2024-03-20T13:35:30.991514+0000","last_fullsized":"2024-03-20T13:35:30.991514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:11.082910+0000","last_change":"2024-03-20T13:34:55.949038+0000","last_active":"2024-03-20T13:36:11.082910+0000","last_peered":"2024-03-20T13:36:11.082910+0000","last_clean":"2024-03-20T13:36:11.082910+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:11.082910+0000","last_undegraded":"2024-03-20T13:36:11.082910+0000","last_fullsized":"2024-03-20T13:36:11.082910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:02.651523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985168+0000","last_change":"2024-03-20T13:34:57.970496+0000","last_active":"2024-03-20T13:35:30.985168+0000","last_peered":"2024-03-20T13:35:30.985168+0000","last_clean":"2024-03-20T13:35:30.985168+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:35:30.985168+0000","last_undegraded":"2024-03-20T13:35:30.985168+0000","last_fullsized":"2024-03-20T13:35:30.985168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:16.785640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983405+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:35:30.983405+0000","last_peered":"2024-03-20T13:35:30.983405+0000","last_clean":"2024-03-20T13:35:30.983405+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:35:30.983405+0000","last_undegraded":"2024-03-20T13:35:30.983405+0000","last_fullsized":"2024-03-20T13:35:30.983405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:16:57.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982873+0000","last_change":"2024-03-20T13:34:51.935236+0000","last_active":"2024-03-20T13:35:30.982873+0000","last_peered":"2024-03-20T13:35:30.982873+0000","last_clean":"2024-03-20T13:35:30.982873+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:35:30.982873+0000","last_undegraded":"2024-03-20T13:35:30.982873+0000","last_fullsized":"2024-03-20T13:35:30.982873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989247+0000","last_change":"2024-03-20T13:34:49.946529+0000","last_active":"2024-03-20T13:35:30.989247+0000","last_peered":"2024-03-20T13:35:30.989247+0000","last_clean":"2024-03-20T13:35:30.989247+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:35:30.989247+0000","last_undegraded":"2024-03-20T13:35:30.989247+0000","last_fullsized":"2024-03-20T13:35:30.989247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985010+0000","last_change":"2024-03-20T13:34:53.944081+0000","last_active":"2024-03-20T13:35:30.985010+0000","last_peered":"2024-03-20T13:35:30.985010+0000","last_clean":"2024-03-20T13:35:30.985010+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:35:30.985010+0000","last_undegraded":"2024-03-20T13:35:30.985010+0000","last_fullsized":"2024-03-20T13:35:30.985010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:52.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'35","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.362876+0000","last_change":"2024-03-20T13:34:55.953409+0000","last_active":"2024-03-20T13:36:23.362876+0000","last_peered":"2024-03-20T13:36:23.362876+0000","last_clean":"2024-03-20T13:36:23.362876+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:23.362876+0000","last_undegraded":"2024-03-20T13:36:23.362876+0000","last_fullsized":"2024-03-20T13:36:23.362876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:34.583675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":48,"num_read_kb":50,"num_write":36,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980762+0000","last_change":"2024-03-20T13:34:57.962112+0000","last_active":"2024-03-20T13:35:30.980762+0000","last_peered":"2024-03-20T13:35:30.980762+0000","last_clean":"2024-03-20T13:35:30.980762+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:35:30.980762+0000","last_undegraded":"2024-03-20T13:35:30.980762+0000","last_fullsized":"2024-03-20T13:35:30.980762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988695+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:35:30.988695+0000","last_peered":"2024-03-20T13:35:30.988695+0000","last_clean":"2024-03-20T13:35:30.988695+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:35:30.988695+0000","last_undegraded":"2024-03-20T13:35:30.988695+0000","last_fullsized":"2024-03-20T13:35:30.988695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.676415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925369+0000","last_change":"2024-03-20T13:34:51.955727+0000","last_active":"2024-03-20T13:35:35.925369+0000","last_peered":"2024-03-20T13:35:35.925369+0000","last_clean":"2024-03-20T13:35:35.925369+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:35:35.925369+0000","last_undegraded":"2024-03-20T13:35:35.925369+0000","last_fullsized":"2024-03-20T13:35:35.925369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:18.390471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982684+0000","last_change":"2024-03-20T13:34:49.937900+0000","last_active":"2024-03-20T13:35:30.982684+0000","last_peered":"2024-03-20T13:35:30.982684+0000","last_clean":"2024-03-20T13:35:30.982684+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:35:30.982684+0000","last_undegraded":"2024-03-20T13:35:30.982684+0000","last_fullsized":"2024-03-20T13:35:30.982684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985583+0000","last_change":"2024-03-20T13:34:53.945375+0000","last_active":"2024-03-20T13:35:30.985583+0000","last_peered":"2024-03-20T13:35:30.985583+0000","last_clean":"2024-03-20T13:35:30.985583+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:35:30.985583+0000","last_undegraded":"2024-03-20T13:35:30.985583+0000","last_fullsized":"2024-03-20T13:35:30.985583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:02:59.804246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'28","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.931325+0000","last_change":"2024-03-20T13:34:55.950108+0000","last_active":"2024-03-20T13:36:17.931325+0000","last_peered":"2024-03-20T13:36:17.931325+0000","last_clean":"2024-03-20T13:36:17.931325+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:17.931325+0000","last_undegraded":"2024-03-20T13:36:17.931325+0000","last_fullsized":"2024-03-20T13:36:17.931325+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:30.400371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986035+0000","last_change":"2024-03-20T13:34:57.962527+0000","last_active":"2024-03-20T13:35:30.986035+0000","last_peered":"2024-03-20T13:35:30.986035+0000","last_clean":"2024-03-20T13:35:30.986035+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:35:30.986035+0000","last_undegraded":"2024-03-20T13:35:30.986035+0000","last_fullsized":"2024-03-20T13:35:30.986035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:19.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.935434+0000","last_change":"2024-03-20T13:34:51.944100+0000","last_active":"2024-03-20T13:35:35.935434+0000","last_peered":"2024-03-20T13:35:35.935434+0000","last_clean":"2024-03-20T13:35:35.935434+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:35:35.935434+0000","last_undegraded":"2024-03-20T13:35:35.935434+0000","last_fullsized":"2024-03-20T13:35:35.935434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:42:06.297838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983864+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:35:30.983864+0000","last_peered":"2024-03-20T13:35:30.983864+0000","last_clean":"2024-03-20T13:35:30.983864+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:35:30.983864+0000","last_undegraded":"2024-03-20T13:35:30.983864+0000","last_fullsized":"2024-03-20T13:35:30.983864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:45.792646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985035+0000","last_change":"2024-03-20T13:34:53.942580+0000","last_active":"2024-03-20T13:35:30.985035+0000","last_peered":"2024-03-20T13:35:30.985035+0000","last_clean":"2024-03-20T13:35:30.985035+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:35:30.985035+0000","last_undegraded":"2024-03-20T13:35:30.985035+0000","last_fullsized":"2024-03-20T13:35:30.985035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'52","reported_seq":107,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.532779+0000","last_change":"2024-03-20T13:34:55.951412+0000","last_active":"2024-03-20T13:36:23.532779+0000","last_peered":"2024-03-20T13:36:23.532779+0000","last_clean":"2024-03-20T13:36:23.532779+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:23.532779+0000","last_undegraded":"2024-03-20T13:36:23.532779+0000","last_fullsized":"2024-03-20T13:36:23.532779+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:14.777482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985864+0000","last_change":"2024-03-20T13:34:57.965582+0000","last_active":"2024-03-20T13:35:30.985864+0000","last_peered":"2024-03-20T13:35:30.985864+0000","last_clean":"2024-03-20T13:35:30.985864+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:35:30.985864+0000","last_undegraded":"2024-03-20T13:35:30.985864+0000","last_fullsized":"2024-03-20T13:35:30.985864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:34.285516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.435716+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:17.435716+0000","last_peered":"2024-03-20T13:36:17.435716+0000","last_clean":"2024-03-20T13:36:17.435716+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:17.435716+0000","last_undegraded":"2024-03-20T13:36:17.435716+0000","last_fullsized":"2024-03-20T13:36:17.435716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.947516+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980586+0000","last_change":"2024-03-20T13:34:49.946304+0000","last_active":"2024-03-20T13:35:30.980586+0000","last_peered":"2024-03-20T13:35:30.980586+0000","last_clean":"2024-03-20T13:35:30.980586+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:35:30.980586+0000","last_undegraded":"2024-03-20T13:35:30.980586+0000","last_fullsized":"2024-03-20T13:35:30.980586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:06:00.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.992863+0000","last_change":"2024-03-20T13:35:30.992863+0000","last_active":"2024-03-20T13:35:30.992863+0000","last_peered":"2024-03-20T13:35:30.992863+0000","last_clean":"2024-03-20T13:35:30.992863+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:35:30.992863+0000","last_undegraded":"2024-03-20T13:35:30.992863+0000","last_fullsized":"2024-03-20T13:35:30.992863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.932248+0000","last_change":"2024-03-20T13:34:55.955358+0000","last_active":"2024-03-20T13:36:17.932248+0000","last_peered":"2024-03-20T13:36:17.932248+0000","last_clean":"2024-03-20T13:36:17.932248+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:36:17.932248+0000","last_undegraded":"2024-03-20T13:36:17.932248+0000","last_fullsized":"2024-03-20T13:36:17.932248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:26:44.999814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981139+0000","last_change":"2024-03-20T13:34:57.964942+0000","last_active":"2024-03-20T13:35:30.981139+0000","last_peered":"2024-03-20T13:35:30.981139+0000","last_clean":"2024-03-20T13:35:30.981139+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:35:30.981139+0000","last_undegraded":"2024-03-20T13:35:30.981139+0000","last_fullsized":"2024-03-20T13:35:30.981139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985284+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:35:30.985284+0000","last_peered":"2024-03-20T13:35:30.985284+0000","last_clean":"2024-03-20T13:35:30.985284+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:35:30.985284+0000","last_undegraded":"2024-03-20T13:35:30.985284+0000","last_fullsized":"2024-03-20T13:35:30.985284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:56.733038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426416+0000","last_change":"2024-03-20T13:34:51.955633+0000","last_active":"2024-03-20T13:35:35.426416+0000","last_peered":"2024-03-20T13:35:35.426416+0000","last_clean":"2024-03-20T13:35:35.426416+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:35:35.426416+0000","last_undegraded":"2024-03-20T13:35:35.426416+0000","last_fullsized":"2024-03-20T13:35:35.426416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:58.692384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981144+0000","last_change":"2024-03-20T13:34:49.948392+0000","last_active":"2024-03-20T13:35:30.981144+0000","last_peered":"2024-03-20T13:35:30.981144+0000","last_clean":"2024-03-20T13:35:30.981144+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:35:30.981144+0000","last_undegraded":"2024-03-20T13:35:30.981144+0000","last_fullsized":"2024-03-20T13:35:30.981144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991895+0000","last_change":"2024-03-20T13:35:30.991895+0000","last_active":"2024-03-20T13:35:30.991895+0000","last_peered":"2024-03-20T13:35:30.991895+0000","last_clean":"2024-03-20T13:35:30.991895+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:35:30.991895+0000","last_undegraded":"2024-03-20T13:35:30.991895+0000","last_fullsized":"2024-03-20T13:35:30.991895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:03.644927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'30","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.950509+0000","last_change":"2024-03-20T13:34:55.946279+0000","last_active":"2024-03-20T13:36:17.950509+0000","last_peered":"2024-03-20T13:36:17.950509+0000","last_clean":"2024-03-20T13:36:17.950509+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:17.950509+0000","last_undegraded":"2024-03-20T13:36:17.950509+0000","last_fullsized":"2024-03-20T13:36:17.950509+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:32.277358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984087+0000","last_change":"2024-03-20T13:34:57.968260+0000","last_active":"2024-03-20T13:35:30.984087+0000","last_peered":"2024-03-20T13:35:30.984087+0000","last_clean":"2024-03-20T13:35:30.984087+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:35:30.984087+0000","last_undegraded":"2024-03-20T13:35:30.984087+0000","last_fullsized":"2024-03-20T13:35:30.984087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:27.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559906+0000","last_change":"2024-03-20T13:34:59.970646+0000","last_active":"2024-03-20T13:36:23.559906+0000","last_peered":"2024-03-20T13:36:23.559906+0000","last_clean":"2024-03-20T13:36:23.559906+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:36:23.559906+0000","last_undegraded":"2024-03-20T13:36:23.559906+0000","last_fullsized":"2024-03-20T13:36:23.559906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:06.692527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432770+0000","last_change":"2024-03-20T13:34:51.943110+0000","last_active":"2024-03-20T13:35:35.432770+0000","last_peered":"2024-03-20T13:35:35.432770+0000","last_clean":"2024-03-20T13:35:35.432770+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:35:35.432770+0000","last_undegraded":"2024-03-20T13:35:35.432770+0000","last_fullsized":"2024-03-20T13:35:35.432770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987393+0000","last_change":"2024-03-20T13:34:49.960382+0000","last_active":"2024-03-20T13:35:30.987393+0000","last_peered":"2024-03-20T13:35:30.987393+0000","last_clean":"2024-03-20T13:35:30.987393+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:35:30.987393+0000","last_undegraded":"2024-03-20T13:35:30.987393+0000","last_fullsized":"2024-03-20T13:35:30.987393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:46.514364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982984+0000","last_change":"2024-03-20T13:34:53.940730+0000","last_active":"2024-03-20T13:35:30.982984+0000","last_peered":"2024-03-20T13:35:30.982984+0000","last_clean":"2024-03-20T13:35:30.982984+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:35:30.982984+0000","last_undegraded":"2024-03-20T13:35:30.982984+0000","last_fullsized":"2024-03-20T13:35:30.982984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:00.644448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988396+0000","last_change":"2024-03-20T13:34:55.962070+0000","last_active":"2024-03-20T13:35:30.988396+0000","last_peered":"2024-03-20T13:35:30.988396+0000","last_clean":"2024-03-20T13:35:30.988396+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:35:30.988396+0000","last_undegraded":"2024-03-20T13:35:30.988396+0000","last_fullsized":"2024-03-20T13:35:30.988396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:10:00.391997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'240","reported_seq":293,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002421+0000","last_change":"2024-03-20T13:34:57.966599+0000","last_active":"2024-03-20T13:36:24.002421+0000","last_peered":"2024-03-20T13:36:24.002421+0000","last_clean":"2024-03-20T13:36:24.002421+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:24.002421+0000","last_undegraded":"2024-03-20T13:36:24.002421+0000","last_fullsized":"2024-03-20T13:36:24.002421+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":240,"log_dups_size":0,"ondisk_log_size":240,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:18.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983175+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:35:30.983175+0000","last_peered":"2024-03-20T13:35:30.983175+0000","last_clean":"2024-03-20T13:35:30.983175+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:35:30.983175+0000","last_undegraded":"2024-03-20T13:35:30.983175+0000","last_fullsized":"2024-03-20T13:35:30.983175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.814709+0000","last_change":"2024-03-20T13:34:51.935075+0000","last_active":"2024-03-20T13:35:34.814709+0000","last_peered":"2024-03-20T13:35:34.814709+0000","last_clean":"2024-03-20T13:35:34.814709+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:35:34.814709+0000","last_undegraded":"2024-03-20T13:35:34.814709+0000","last_fullsized":"2024-03-20T13:35:34.814709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982426+0000","last_change":"2024-03-20T13:34:49.939827+0000","last_active":"2024-03-20T13:35:30.982426+0000","last_peered":"2024-03-20T13:35:30.982426+0000","last_clean":"2024-03-20T13:35:30.982426+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:35:30.982426+0000","last_undegraded":"2024-03-20T13:35:30.982426+0000","last_fullsized":"2024-03-20T13:35:30.982426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982868+0000","last_change":"2024-03-20T13:34:53.942928+0000","last_active":"2024-03-20T13:35:30.982868+0000","last_peered":"2024-03-20T13:35:30.982868+0000","last_clean":"2024-03-20T13:35:30.982868+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:35:30.982868+0000","last_undegraded":"2024-03-20T13:35:30.982868+0000","last_fullsized":"2024-03-20T13:35:30.982868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:24.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'34","reported_seq":78,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.922811+0000","last_change":"2024-03-20T13:34:55.950261+0000","last_active":"2024-03-20T13:36:17.922811+0000","last_peered":"2024-03-20T13:36:17.922811+0000","last_clean":"2024-03-20T13:36:17.922811+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:17.922811+0000","last_undegraded":"2024-03-20T13:36:17.922811+0000","last_fullsized":"2024-03-20T13:36:17.922811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:16.051759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982076+0000","last_change":"2024-03-20T13:34:57.966567+0000","last_active":"2024-03-20T13:35:30.982076+0000","last_peered":"2024-03-20T13:35:30.982076+0000","last_clean":"2024-03-20T13:35:30.982076+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:35:30.982076+0000","last_undegraded":"2024-03-20T13:35:30.982076+0000","last_fullsized":"2024-03-20T13:35:30.982076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:00.530246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983022+0000","last_change":"2024-03-20T13:34:59.974362+0000","last_active":"2024-03-20T13:35:30.983022+0000","last_peered":"2024-03-20T13:35:30.983022+0000","last_clean":"2024-03-20T13:35:30.983022+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:35:30.983022+0000","last_undegraded":"2024-03-20T13:35:30.983022+0000","last_fullsized":"2024-03-20T13:35:30.983022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815573+0000","last_change":"2024-03-20T13:34:51.933525+0000","last_active":"2024-03-20T13:35:34.815573+0000","last_peered":"2024-03-20T13:35:34.815573+0000","last_clean":"2024-03-20T13:35:34.815573+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:35:34.815573+0000","last_undegraded":"2024-03-20T13:35:34.815573+0000","last_fullsized":"2024-03-20T13:35:34.815573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:31.807759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990071+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:35:30.990071+0000","last_peered":"2024-03-20T13:35:30.990071+0000","last_clean":"2024-03-20T13:35:30.990071+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:35:30.990071+0000","last_undegraded":"2024-03-20T13:35:30.990071+0000","last_fullsized":"2024-03-20T13:35:30.990071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:46.676895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987770+0000","last_change":"2024-03-20T13:34:53.944574+0000","last_active":"2024-03-20T13:35:30.987770+0000","last_peered":"2024-03-20T13:35:30.987770+0000","last_clean":"2024-03-20T13:35:30.987770+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:35:30.987770+0000","last_undegraded":"2024-03-20T13:35:30.987770+0000","last_fullsized":"2024-03-20T13:35:30.987770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:47.973325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.979760+0000","last_change":"2024-03-20T13:34:55.949632+0000","last_active":"2024-03-20T13:36:17.979760+0000","last_peered":"2024-03-20T13:36:17.979760+0000","last_clean":"2024-03-20T13:36:17.979760+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:17.979760+0000","last_undegraded":"2024-03-20T13:36:17.979760+0000","last_fullsized":"2024-03-20T13:36:17.979760+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:56.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985258+0000","last_change":"2024-03-20T13:34:57.968928+0000","last_active":"2024-03-20T13:35:30.985258+0000","last_peered":"2024-03-20T13:35:30.985258+0000","last_clean":"2024-03-20T13:35:30.985258+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:35:30.985258+0000","last_undegraded":"2024-03-20T13:35:30.985258+0000","last_fullsized":"2024-03-20T13:35:30.985258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:19:52.024807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.930985+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:35:35.930985+0000","last_peered":"2024-03-20T13:35:35.930985+0000","last_clean":"2024-03-20T13:35:35.930985+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:35:35.930985+0000","last_undegraded":"2024-03-20T13:35:35.930985+0000","last_fullsized":"2024-03-20T13:35:35.930985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:22:02.192935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985680+0000","last_change":"2024-03-20T13:34:51.945209+0000","last_active":"2024-03-20T13:35:30.985680+0000","last_peered":"2024-03-20T13:35:30.985680+0000","last_clean":"2024-03-20T13:35:30.985680+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:35:30.985680+0000","last_undegraded":"2024-03-20T13:35:30.985680+0000","last_fullsized":"2024-03-20T13:35:30.985680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:44.470618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984496+0000","last_change":"2024-03-20T13:34:49.939306+0000","last_active":"2024-03-20T13:35:30.984496+0000","last_peered":"2024-03-20T13:35:30.984496+0000","last_clean":"2024-03-20T13:35:30.984496+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:35:30.984496+0000","last_undegraded":"2024-03-20T13:35:30.984496+0000","last_fullsized":"2024-03-20T13:35:30.984496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:42.593147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983070+0000","last_change":"2024-03-20T13:34:53.944784+0000","last_active":"2024-03-20T13:35:30.983070+0000","last_peered":"2024-03-20T13:35:30.983070+0000","last_clean":"2024-03-20T13:35:30.983070+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:35:30.983070+0000","last_undegraded":"2024-03-20T13:35:30.983070+0000","last_fullsized":"2024-03-20T13:35:30.983070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:45.631209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'24","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.948542+0000","last_change":"2024-03-20T13:34:55.953980+0000","last_active":"2024-03-20T13:36:17.948542+0000","last_peered":"2024-03-20T13:36:17.948542+0000","last_clean":"2024-03-20T13:36:17.948542+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:17.948542+0000","last_undegraded":"2024-03-20T13:36:17.948542+0000","last_fullsized":"2024-03-20T13:36:17.948542+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:04.003649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985553+0000","last_change":"2024-03-20T13:34:57.968516+0000","last_active":"2024-03-20T13:35:30.985553+0000","last_peered":"2024-03-20T13:35:30.985553+0000","last_clean":"2024-03-20T13:35:30.985553+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:35:30.985553+0000","last_undegraded":"2024-03-20T13:35:30.985553+0000","last_fullsized":"2024-03-20T13:35:30.985553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:42.517997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988393+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:35:30.988393+0000","last_peered":"2024-03-20T13:35:30.988393+0000","last_clean":"2024-03-20T13:35:30.988393+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:35:30.988393+0000","last_undegraded":"2024-03-20T13:35:30.988393+0000","last_fullsized":"2024-03-20T13:35:30.988393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:18.372757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164827+0000","last_change":"2024-03-20T13:34:51.933565+0000","last_active":"2024-03-20T13:35:35.164827+0000","last_peered":"2024-03-20T13:35:35.164827+0000","last_clean":"2024-03-20T13:35:35.164827+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:35:35.164827+0000","last_undegraded":"2024-03-20T13:35:35.164827+0000","last_fullsized":"2024-03-20T13:35:35.164827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:23.975435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982828+0000","last_change":"2024-03-20T13:34:49.937954+0000","last_active":"2024-03-20T13:35:30.982828+0000","last_peered":"2024-03-20T13:35:30.982828+0000","last_clean":"2024-03-20T13:35:30.982828+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:35:30.982828+0000","last_undegraded":"2024-03-20T13:35:30.982828+0000","last_fullsized":"2024-03-20T13:35:30.982828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982077+0000","last_change":"2024-03-20T13:34:53.945758+0000","last_active":"2024-03-20T13:35:30.982077+0000","last_peered":"2024-03-20T13:35:30.982077+0000","last_clean":"2024-03-20T13:35:30.982077+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:35:30.982077+0000","last_undegraded":"2024-03-20T13:35:30.982077+0000","last_fullsized":"2024-03-20T13:35:30.982077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:56.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'29","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.554040+0000","last_change":"2024-03-20T13:34:55.955035+0000","last_active":"2024-03-20T13:36:23.554040+0000","last_peered":"2024-03-20T13:36:23.554040+0000","last_clean":"2024-03-20T13:36:23.554040+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:23.554040+0000","last_undegraded":"2024-03-20T13:36:23.554040+0000","last_fullsized":"2024-03-20T13:36:23.554040+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:00:41.222083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":25,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983213+0000","last_change":"2024-03-20T13:34:57.961099+0000","last_active":"2024-03-20T13:35:30.983213+0000","last_peered":"2024-03-20T13:35:30.983213+0000","last_clean":"2024-03-20T13:35:30.983213+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:35:30.983213+0000","last_undegraded":"2024-03-20T13:35:30.983213+0000","last_fullsized":"2024-03-20T13:35:30.983213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987647+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:35:30.987647+0000","last_peered":"2024-03-20T13:35:30.987647+0000","last_clean":"2024-03-20T13:35:30.987647+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:35:30.987647+0000","last_undegraded":"2024-03-20T13:35:30.987647+0000","last_fullsized":"2024-03-20T13:35:30.987647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:50:50.872683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.927590+0000","last_change":"2024-03-20T13:34:51.957194+0000","last_active":"2024-03-20T13:35:35.927590+0000","last_peered":"2024-03-20T13:35:35.927590+0000","last_clean":"2024-03-20T13:35:35.927590+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:35:35.927590+0000","last_undegraded":"2024-03-20T13:35:35.927590+0000","last_fullsized":"2024-03-20T13:35:35.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984223+0000","last_change":"2024-03-20T13:34:49.949098+0000","last_active":"2024-03-20T13:35:30.984223+0000","last_peered":"2024-03-20T13:35:30.984223+0000","last_clean":"2024-03-20T13:35:30.984223+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:35:30.984223+0000","last_undegraded":"2024-03-20T13:35:30.984223+0000","last_fullsized":"2024-03-20T13:35:30.984223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984638+0000","last_change":"2024-03-20T13:34:51.943051+0000","last_active":"2024-03-20T13:35:30.984638+0000","last_peered":"2024-03-20T13:35:30.984638+0000","last_clean":"2024-03-20T13:35:30.984638+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:35:30.984638+0000","last_undegraded":"2024-03-20T13:35:30.984638+0000","last_fullsized":"2024-03-20T13:35:30.984638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982413+0000","last_change":"2024-03-20T13:34:49.933350+0000","last_active":"2024-03-20T13:35:30.982413+0000","last_peered":"2024-03-20T13:35:30.982413+0000","last_clean":"2024-03-20T13:35:30.982413+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:35:30.982413+0000","last_undegraded":"2024-03-20T13:35:30.982413+0000","last_fullsized":"2024-03-20T13:35:30.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426226+0000","last_change":"2024-03-20T13:34:51.945886+0000","last_active":"2024-03-20T13:35:35.426226+0000","last_peered":"2024-03-20T13:35:35.426226+0000","last_clean":"2024-03-20T13:35:35.426226+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:35:35.426226+0000","last_undegraded":"2024-03-20T13:35:35.426226+0000","last_fullsized":"2024-03-20T13:35:35.426226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:13.438792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985818+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:35:30.985818+0000","last_peered":"2024-03-20T13:35:30.985818+0000","last_clean":"2024-03-20T13:35:30.985818+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:35:30.985818+0000","last_undegraded":"2024-03-20T13:35:30.985818+0000","last_fullsized":"2024-03-20T13:35:30.985818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:48.329750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.942923+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984213+0000","last_change":"2024-03-20T13:34:49.933497+0000","last_active":"2024-03-20T13:35:30.984213+0000","last_peered":"2024-03-20T13:35:30.984213+0000","last_clean":"2024-03-20T13:35:30.984213+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:35:30.984213+0000","last_undegraded":"2024-03-20T13:35:30.984213+0000","last_fullsized":"2024-03-20T13:35:30.984213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983804+0000","last_change":"2024-03-20T13:34:51.937130+0000","last_active":"2024-03-20T13:35:30.983804+0000","last_peered":"2024-03-20T13:35:30.983804+0000","last_clean":"2024-03-20T13:35:30.983804+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:35:30.983804+0000","last_undegraded":"2024-03-20T13:35:30.983804+0000","last_fullsized":"2024-03-20T13:35:30.983804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984038+0000","last_change":"2024-03-20T13:34:49.946558+0000","last_active":"2024-03-20T13:35:30.984038+0000","last_peered":"2024-03-20T13:35:30.984038+0000","last_clean":"2024-03-20T13:35:30.984038+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:35:30.984038+0000","last_undegraded":"2024-03-20T13:35:30.984038+0000","last_fullsized":"2024-03-20T13:35:30.984038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.953134+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:01:47.441326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981395+0000","last_change":"2024-03-20T13:34:49.945395+0000","last_active":"2024-03-20T13:35:30.981395+0000","last_peered":"2024-03-20T13:35:30.981395+0000","last_clean":"2024-03-20T13:35:30.981395+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:35:30.981395+0000","last_undegraded":"2024-03-20T13:35:30.981395+0000","last_fullsized":"2024-03-20T13:35:30.981395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969303+0000","last_change":"2024-03-20T13:34:51.947021+0000","last_active":"2024-03-20T13:36:17.969303+0000","last_peered":"2024-03-20T13:36:17.969303+0000","last_clean":"2024-03-20T13:36:17.969303+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:36:17.969303+0000","last_undegraded":"2024-03-20T13:36:17.969303+0000","last_fullsized":"2024-03-20T13:36:17.969303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.962603+0000","last_change":"2024-03-20T13:34:49.946770+0000","last_active":"2024-03-20T13:36:17.962603+0000","last_peered":"2024-03-20T13:36:17.962603+0000","last_clean":"2024-03-20T13:36:17.962603+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:36:17.962603+0000","last_undegraded":"2024-03-20T13:36:17.962603+0000","last_fullsized":"2024-03-20T13:36:17.962603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426260+0000","last_change":"2024-03-20T13:34:51.941533+0000","last_active":"2024-03-20T13:35:35.426260+0000","last_peered":"2024-03-20T13:35:35.426260+0000","last_clean":"2024-03-20T13:35:35.426260+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:35:35.426260+0000","last_undegraded":"2024-03-20T13:35:35.426260+0000","last_fullsized":"2024-03-20T13:35:35.426260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984680+0000","last_change":"2024-03-20T13:34:49.934739+0000","last_active":"2024-03-20T13:35:30.984680+0000","last_peered":"2024-03-20T13:35:30.984680+0000","last_clean":"2024-03-20T13:35:30.984680+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:35:30.984680+0000","last_undegraded":"2024-03-20T13:35:30.984680+0000","last_fullsized":"2024-03-20T13:35:30.984680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:24.437773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983296+0000","last_change":"2024-03-20T13:34:51.948058+0000","last_active":"2024-03-20T13:35:30.983296+0000","last_peered":"2024-03-20T13:35:30.983296+0000","last_clean":"2024-03-20T13:35:30.983296+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:35:30.983296+0000","last_undegraded":"2024-03-20T13:35:30.983296+0000","last_fullsized":"2024-03-20T13:35:30.983296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.421616+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:35:35.421616+0000","last_peered":"2024-03-20T13:35:35.421616+0000","last_clean":"2024-03-20T13:35:35.421616+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:35:35.421616+0000","last_undegraded":"2024-03-20T13:35:35.421616+0000","last_fullsized":"2024-03-20T13:35:35.421616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:33.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988240+0000","last_change":"2024-03-20T13:34:51.949486+0000","last_active":"2024-03-20T13:35:30.988240+0000","last_peered":"2024-03-20T13:35:30.988240+0000","last_clean":"2024-03-20T13:35:30.988240+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:35:30.988240+0000","last_undegraded":"2024-03-20T13:35:30.988240+0000","last_fullsized":"2024-03-20T13:35:30.988240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:46.252000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982607+0000","last_change":"2024-03-20T13:34:49.934646+0000","last_active":"2024-03-20T13:35:30.982607+0000","last_peered":"2024-03-20T13:35:30.982607+0000","last_clean":"2024-03-20T13:35:30.982607+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:35:30.982607+0000","last_undegraded":"2024-03-20T13:35:30.982607+0000","last_fullsized":"2024-03-20T13:35:30.982607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568234+0000","last_change":"2024-03-20T13:34:51.935272+0000","last_active":"2024-03-20T13:36:23.568234+0000","last_peered":"2024-03-20T13:36:23.568234+0000","last_clean":"2024-03-20T13:36:23.568234+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:36:23.568234+0000","last_undegraded":"2024-03-20T13:36:23.568234+0000","last_fullsized":"2024-03-20T13:36:23.568234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981576+0000","last_change":"2024-03-20T13:34:49.955817+0000","last_active":"2024-03-20T13:35:30.981576+0000","last_peered":"2024-03-20T13:35:30.981576+0000","last_clean":"2024-03-20T13:35:30.981576+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:35:30.981576+0000","last_undegraded":"2024-03-20T13:35:30.981576+0000","last_fullsized":"2024-03-20T13:35:30.981576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925361+0000","last_change":"2024-03-20T13:34:51.946963+0000","last_active":"2024-03-20T13:35:35.925361+0000","last_peered":"2024-03-20T13:35:35.925361+0000","last_clean":"2024-03-20T13:35:35.925361+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:35:35.925361+0000","last_undegraded":"2024-03-20T13:35:35.925361+0000","last_fullsized":"2024-03-20T13:35:35.925361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980780+0000","last_change":"2024-03-20T13:34:49.944556+0000","last_active":"2024-03-20T13:35:30.980780+0000","last_peered":"2024-03-20T13:35:30.980780+0000","last_clean":"2024-03-20T13:35:30.980780+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:35:30.980780+0000","last_undegraded":"2024-03-20T13:35:30.980780+0000","last_fullsized":"2024-03-20T13:35:30.980780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164645+0000","last_change":"2024-03-20T13:34:51.948336+0000","last_active":"2024-03-20T13:35:35.164645+0000","last_peered":"2024-03-20T13:35:35.164645+0000","last_clean":"2024-03-20T13:35:35.164645+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:35:35.164645+0000","last_undegraded":"2024-03-20T13:35:35.164645+0000","last_fullsized":"2024-03-20T13:35:35.164645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:45.966592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988635+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:35:30.988635+0000","last_peered":"2024-03-20T13:35:30.988635+0000","last_clean":"2024-03-20T13:35:30.988635+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:35:30.988635+0000","last_undegraded":"2024-03-20T13:35:30.988635+0000","last_fullsized":"2024-03-20T13:35:30.988635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:46.604615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568629+0000","last_change":"2024-03-20T13:34:51.950006+0000","last_active":"2024-03-20T13:36:23.568629+0000","last_peered":"2024-03-20T13:36:23.568629+0000","last_clean":"2024-03-20T13:36:23.568629+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:23.568629+0000","last_undegraded":"2024-03-20T13:36:23.568629+0000","last_fullsized":"2024-03-20T13:36:23.568629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:54:37.940365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990260+0000","last_change":"2024-03-20T13:34:49.962883+0000","last_active":"2024-03-20T13:35:30.990260+0000","last_peered":"2024-03-20T13:35:30.990260+0000","last_clean":"2024-03-20T13:35:30.990260+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:35:30.990260+0000","last_undegraded":"2024-03-20T13:35:30.990260+0000","last_fullsized":"2024-03-20T13:35:30.990260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:06.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568300+0000","last_change":"2024-03-20T13:34:51.951979+0000","last_active":"2024-03-20T13:36:23.568300+0000","last_peered":"2024-03-20T13:36:23.568300+0000","last_clean":"2024-03-20T13:36:23.568300+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:36:23.568300+0000","last_undegraded":"2024-03-20T13:36:23.568300+0000","last_fullsized":"2024-03-20T13:36:23.568300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:41.546768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989598+0000","last_change":"2024-03-20T13:34:49.950220+0000","last_active":"2024-03-20T13:35:30.989598+0000","last_peered":"2024-03-20T13:35:30.989598+0000","last_clean":"2024-03-20T13:35:30.989598+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:35:30.989598+0000","last_undegraded":"2024-03-20T13:35:30.989598+0000","last_fullsized":"2024-03-20T13:35:30.989598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981812+0000","last_change":"2024-03-20T13:34:51.945790+0000","last_active":"2024-03-20T13:35:30.981812+0000","last_peered":"2024-03-20T13:35:30.981812+0000","last_clean":"2024-03-20T13:35:30.981812+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:35:30.981812+0000","last_undegraded":"2024-03-20T13:35:30.981812+0000","last_fullsized":"2024-03-20T13:35:30.981812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.312469+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:17.312469+0000","last_peered":"2024-03-20T13:36:17.312469+0000","last_clean":"2024-03-20T13:36:17.312469+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:17.312469+0000","last_undegraded":"2024-03-20T13:36:17.312469+0000","last_fullsized":"2024-03-20T13:36:17.312469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:59.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984472+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:35:30.984472+0000","last_peered":"2024-03-20T13:35:30.984472+0000","last_clean":"2024-03-20T13:35:30.984472+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:35:30.984472+0000","last_undegraded":"2024-03-20T13:35:30.984472+0000","last_fullsized":"2024-03-20T13:35:30.984472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:32.396271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984838+0000","last_change":"2024-03-20T13:34:51.947552+0000","last_active":"2024-03-20T13:35:30.984838+0000","last_peered":"2024-03-20T13:35:30.984838+0000","last_clean":"2024-03-20T13:35:30.984838+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:35:30.984838+0000","last_undegraded":"2024-03-20T13:35:30.984838+0000","last_fullsized":"2024-03-20T13:35:30.984838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982733+0000","last_change":"2024-03-20T13:34:49.941425+0000","last_active":"2024-03-20T13:35:30.982733+0000","last_peered":"2024-03-20T13:35:30.982733+0000","last_clean":"2024-03-20T13:35:30.982733+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:35:30.982733+0000","last_undegraded":"2024-03-20T13:35:30.982733+0000","last_fullsized":"2024-03-20T13:35:30.982733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969447+0000","last_change":"2024-03-20T13:34:51.944562+0000","last_active":"2024-03-20T13:36:17.969447+0000","last_peered":"2024-03-20T13:36:17.969447+0000","last_clean":"2024-03-20T13:36:17.969447+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:36:17.969447+0000","last_undegraded":"2024-03-20T13:36:17.969447+0000","last_fullsized":"2024-03-20T13:36:17.969447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1920,"ondisk_log_size":1920,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1337,"num_read_kb":1120,"num_write":515,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1171,"ondisk_log_size":1171,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":836,"num_read_kb":834,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672988,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.45000000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.26500000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.308},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.28399999999999997}]}]},{"osd":1,"up_from":10,"seq":42949672987,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.68700000000000006}]},{"osd":2,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.41899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705689,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.40699999999999997}]},{"osd":1,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.14599999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.30299999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705691,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:32.491 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-20T13:36:32.622 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.620+0000 7f486639d640 1 Processor -- start 2024-03-20T13:36:32.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.620+0000 7f486639d640 1 -- start start 2024-03-20T13:36:32.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.620+0000 7f486639d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4860098900 0x7f4860098ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f486639d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f486009dc90 con 0x7f4860099220 2024-03-20T13:36:32.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f486639d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486009a360 con 0x7f4860098900 2024-03-20T13:36:32.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f485ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4860098900 0x7f4860098ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.623 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f485f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4860099220 0x7f4860096580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42948/0 (socket says 172.21.15.28:42948) 2024-03-20T13:36:32.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f485f7fe640 1 -- 172.21.15.28:0/2018768977 learned_addr learned my addr 172.21.15.28:0/2018768977 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:32.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f485ffff640 1 -- 172.21.15.28:0/2018768977 >> v1:172.21.15.28:6789/0 conn(0x7f4860099220 legacy=0x7f4860096580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f485effd640 1 -- 172.21.15.28:0/2018768977 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529781892 0 0) 0x7f486009dc90 con 0x7f4860099220 2024-03-20T13:36:32.624 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.621+0000 7f485ffff640 1 -- 172.21.15.28:0/2018768977 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4860099d30 con 0x7f4860098900 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f485ffff640 1 --2- 172.21.15.28:0/2018768977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f4860098ce0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4854009720 tx=0x7f485402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cdd96abbc35051 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f485effd640 1 -- 172.21.15.28:0/2018768977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f485402e070 con 0x7f4860098900 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f485effd640 1 -- 172.21.15.28:0/2018768977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540316d0 con 0x7f4860098900 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f485effd640 1 -- 172.21.15.28:0/2018768977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4854031990 con 0x7f4860098900 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f486639d640 1 -- 172.21.15.28:0/2018768977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 msgr2=0x7f4860098ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f486639d640 1 --2- 172.21.15.28:0/2018768977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f4860098ce0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f4854009720 tx=0x7f485402b840 comp rx=0 tx=0).stop 2024-03-20T13:36:32.628 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f486639d640 1 -- 172.21.15.28:0/2018768977 shutdown_connections 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f486639d640 1 --2- 172.21.15.28:0/2018768977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f4860098ce0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f486639d640 1 -- 172.21.15.28:0/2018768977 >> 172.21.15.28:0/2018768977 conn(0x7f48600a0a20 msgr2=0x7f486009cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.622+0000 7f486639d640 1 -- 172.21.15.28:0/2018768977 shutdown_connections 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.623+0000 7f486639d640 1 -- 172.21.15.28:0/2018768977 wait complete. 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.623+0000 7f486639d640 1 Processor -- start 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.623+0000 7f486639d640 1 -- start start 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f486639d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f48601b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.629 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f486639d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486006c9c0 con 0x7f4860098900 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f485ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f48601b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f485ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f48601b2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48982/0 (socket says 172.21.15.28:48982) 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f485ffff640 1 -- 172.21.15.28:0/3704297865 learned_addr learned my addr 172.21.15.28:0/3704297865 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f485ffff640 1 -- 172.21.15.28:0/3704297865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4854009400 con 0x7f4860098900 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f485ffff640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f48601b2a20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4854034040 tx=0x7f48540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.624+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4854032830 con 0x7f4860098900 2024-03-20T13:36:32.630 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.625+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854032990 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.625+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f486006c520 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.625+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4854032c50 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.625+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48601b43f0 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.625+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f485404e450 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.625+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48600627b0 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.626+0000 7f485cff9640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f484c037ef0 0x7f484c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.626+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f485406d6a0 con 0x7f4860098900 2024-03-20T13:36:32.631 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.626+0000 7f485f7fe640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f484c037ef0 0x7f484c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:32.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.627+0000 7f485f7fe640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f484c037ef0 0x7f484c03a3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4850000c00 tx=0x7f4850007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:32.632 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.630+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f4854032db0 con 0x7f4860098900 2024-03-20T13:36:32.814 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.812+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48601b5a30 con 0x7f4860098900 2024-03-20T13:36:32.815 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.814+0000 7f485cff9640 1 -- 172.21.15.28:0/3704297865 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+21009 (secure 0 0 0) 0x7f485404c350 con 0x7f4860098900 2024-03-20T13:36:32.815 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:36:32.816 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"fsid":"9edff1c8-555e-48c3-ac0b-d5587f9be096","created":"2024-03-20T13:34:24.820949+0000","modified":"2024-03-20T13:35:30.977272+0000","last_up_change":"2024-03-20T13:34:33.883766+0000","last_in_change":"2024-03-20T13:34:25.905721+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-20T13:34:33.177605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-03-20T13:34:40.425350+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-03-20T13:34:47.931153+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-03-20T13:34:50.262102+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-03-20T13:34:52.112494+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-03-20T13:34:54.021108+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-03-20T13:34:55.975571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-03-20T13:34:58.048943+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"ce70bf47-7c35-4e78-80ea-b50bc701391e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6801","nonce":801909073}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6803","nonce":801909073}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6807","nonce":801909073}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6804","nonce":801909073},{"type":"v1","addr":"172.21.15.28:6805","nonce":801909073}]},"public_addr":"172.21.15.28:6801/801909073","cluster_addr":"172.21.15.28:6803/801909073","heartbeat_back_addr":"172.21.15.28:6807/801909073","heartbeat_front_addr":"172.21.15.28:6805/801909073","state":["exists","up"]},{"osd":1,"uuid":"ba65bad5-2710-4d75-82f4-a0f9b573f885","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6810","nonce":2492741617}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6814","nonce":2492741617}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6822","nonce":2492741617}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":2492741617},{"type":"v1","addr":"172.21.15.177:6818","nonce":2492741617}]},"public_addr":"172.21.15.177:6810/2492741617","cluster_addr":"172.21.15.177:6814/2492741617","heartbeat_back_addr":"172.21.15.177:6822/2492741617","heartbeat_front_addr":"172.21.15.177:6818/2492741617","state":["exists","up"]},{"osd":2,"uuid":"c1773e64-4aed-4bb8-a290-27b4963b7ed1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6801","nonce":3663022842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6803","nonce":3663022842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6807","nonce":3663022842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":3663022842},{"type":"v1","addr":"172.21.15.177:6805","nonce":3663022842}]},"public_addr":"172.21.15.177:6801/3663022842","cluster_addr":"172.21.15.177:6803/3663022842","heartbeat_back_addr":"172.21.15.177:6807/3663022842","heartbeat_front_addr":"172.21.15.177:6805/3663022842","state":["exists","up"]},{"osd":3,"uuid":"fe8f1d9b-26c1-4f6e-afd5-ecd9a7eb755b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6809","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6811","nonce":1493521224}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6813","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6815","nonce":1493521224}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6821","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6823","nonce":1493521224}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6817","nonce":1493521224},{"type":"v1","addr":"172.21.15.177:6819","nonce":1493521224}]},"public_addr":"172.21.15.177:6811/1493521224","cluster_addr":"172.21.15.177:6815/1493521224","heartbeat_back_addr":"172.21.15.177:6823/1493521224","heartbeat_front_addr":"172.21.15.177:6819/1493521224","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.985582+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:30.990757+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.029723+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-20T13:34:31.082287+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.14","mappings":[{"from":3,"to":2}]},{"pgid":"4.39","mappings":[{"from":3,"to":0}]},{"pgid":"4.3b","mappings":[{"from":3,"to":2}]},{"pgid":"5.1","mappings":[{"from":0,"to":2}]},{"pgid":"5.13","mappings":[{"from":3,"to":2}]},{"pgid":"5.1c","mappings":[{"from":0,"to":1}]},{"pgid":"5.1f","mappings":[{"from":0,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-20T13:36:32.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f484c037ef0 msgr2=0x7f484c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.817 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f484c037ef0 0x7f484c03a3b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4850000c00 tx=0x7f4850007910 comp rx=0 tx=0).stop 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 msgr2=0x7f48601b2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f48601b2a20 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f4854034040 tx=0x7f48540046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 shutdown_connections 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f484c037ef0 0x7f484c03a3b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 --2- 172.21.15.28:0/3704297865 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4860098900 0x7f48601b2a20 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 >> 172.21.15.28:0/3704297865 conn(0x7f48600a0a20 msgr2=0x7f48601b5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:32.818 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 shutdown_connections 2024-03-20T13:36:32.819 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:32.816+0000 7f486639d640 1 -- 172.21.15.28:0/3704297865 wait complete. 2024-03-20T13:36:33.828 INFO:tasks.ceph:Scrubbing osd.0 2024-03-20T13:36:33.829 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:36:33.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f94fb640 1 Processor -- start 2024-03-20T13:36:33.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f94fb640 1 -- start start 2024-03-20T13:36:33.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f94fb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00f4098820 0x7f00f4098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f94fb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00f409a800 con 0x7f00f4099140 2024-03-20T13:36:33.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f94fb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00f409dab0 con 0x7f00f4098820 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f00f4098820 0x7f00f4098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00ebfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f00f4099140 0x7f00f4096480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42964/0 (socket says 172.21.15.28:42964) 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00ebfff640 1 -- 172.21.15.28:0/3962275747 learned_addr learned my addr 172.21.15.28:0/3962275747 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f27fc640 1 -- 172.21.15.28:0/3962275747 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 631489570 0 0) 0x7f00f409a800 con 0x7f00f4099140 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.947+0000 7f00f27fc640 1 -- 172.21.15.28:0/3962275747 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00e0003520 con 0x7f00f4099140 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.948+0000 7f00f2ffd640 1 -- 172.21.15.28:0/3962275747 >> v1:172.21.15.28:6789/0 conn(0x7f00f4099140 legacy=0x7f00f4096480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.948+0000 7f00f2ffd640 1 -- 172.21.15.28:0/3962275747 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f409d790 con 0x7f00f4098820 2024-03-20T13:36:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.948+0000 7f00f2ffd640 1 --2- 172.21.15.28:0/3962275747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f4098c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009720 tx=0x7f00e402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b1a40bc44f5986 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.948+0000 7f00f27fc640 1 -- 172.21.15.28:0/3962275747 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00e402e070 con 0x7f00f4098820 2024-03-20T13:36:33.954 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.948+0000 7f00f27fc640 1 -- 172.21.15.28:0/3962275747 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e40316d0 con 0x7f00f4098820 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.948+0000 7f00f27fc640 1 -- 172.21.15.28:0/3962275747 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00e4031990 con 0x7f00f4098820 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 -- 172.21.15.28:0/3962275747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 msgr2=0x7f00f4098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 --2- 172.21.15.28:0/3962275747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f4098c00 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f00e4009720 tx=0x7f00e402b840 comp rx=0 tx=0).stop 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 -- 172.21.15.28:0/3962275747 shutdown_connections 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 --2- 172.21.15.28:0/3962275747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f4098c00 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 -- 172.21.15.28:0/3962275747 >> 172.21.15.28:0/3962275747 conn(0x7f00f40a0940 msgr2=0x7f00f409ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 -- 172.21.15.28:0/3962275747 shutdown_connections 2024-03-20T13:36:33.955 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.949+0000 7f00f94fb640 1 -- 172.21.15.28:0/3962275747 wait complete. 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.950+0000 7f00f94fb640 1 Processor -- start 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.950+0000 7f00f94fb640 1 -- start start 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.950+0000 7f00f94fb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f41c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.950+0000 7f00f94fb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f412ad00 con 0x7f00f4098820 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.950+0000 7f00f2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f41c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00f2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f41c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:48998/0 (socket says 172.21.15.28:48998) 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00f2ffd640 1 -- 172.21.15.28:0/1857698958 learned_addr learned my addr 172.21.15.28:0/1857698958 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00f2ffd640 1 -- 172.21.15.28:0/1857698958 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00e4009400 con 0x7f00f4098820 2024-03-20T13:36:33.956 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00f2ffd640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f41c2930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f00e4000c00 tx=0x7f00e40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00e4032770 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00e40328d0 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00f41c2450 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00e4032b90 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.951+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00f406d8c0 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f00e4032cf0 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00f40998d0 con 0x7f00f4098820 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00eb7fe640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f00d4037f40 0x7f00d403a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.957 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f00e406d370 con 0x7f00f4098820 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00eb7fe640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f00d4044420 0x7f00d40468c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00d4046f90 con 0x7f00d4044420 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00e403b3f0 con 0x7f00f4098820 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.952+0000 7f00ebfff640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f00d4037f40 0x7f00d403a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.953+0000 7f00f37fe640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f00d4044420 0x7f00d40468c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.953+0000 7f00f37fe640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f00d4044420 0x7f00d40468c0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.958 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.953+0000 7f00ebfff640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f00d4037f40 0x7f00d403a400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001610 tx=0x7f00dc007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:33.959 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.954+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== osd.0 v2:172.21.15.28:6800/801909073 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f00d4046f90 con 0x7f00d4044420 2024-03-20T13:36:33.968 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.967+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 --> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f00f40627b0 con 0x7f00d4044420 2024-03-20T13:36:33.969 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00eb7fe640 1 -- 172.21.15.28:0/1857698958 <== osd.0 v2:172.21.15.28:6800/801909073 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f00f40627b0 con 0x7f00d4044420 2024-03-20T13:36:33.969 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-20T13:36:33.969 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:36:33.969 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-20T13:36:33.970 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f00d4044420 msgr2=0x7f00d40468c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f00d4044420 0x7f00d40468c0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f00d4037f40 msgr2=0x7f00d403a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f00d4037f40 0x7f00d403a400 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f00dc001610 tx=0x7f00dc007970 comp rx=0 tx=0).stop 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 msgr2=0x7f00f41c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f41c2930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f00e4000c00 tx=0x7f00e40046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 shutdown_connections 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:6800/801909073,v1:172.21.15.28:6801/801909073] conn(0x7f00d4044420 0x7f00d40468c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f00d4037f40 0x7f00d403a400 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 --2- 172.21.15.28:0/1857698958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f00f4098820 0x7f00f41c2930 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:33.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 >> 172.21.15.28:0/1857698958 conn(0x7f00f40a0940 msgr2=0x7f00f409aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:33.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 shutdown_connections 2024-03-20T13:36:33.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:33.968+0000 7f00f94fb640 1 -- 172.21.15.28:0/1857698958 wait complete. 2024-03-20T13:36:33.980 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-20T13:36:34.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.080+0000 7fb0a7f64640 1 Processor -- start 2024-03-20T13:36:34.084 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.080+0000 7fb0a7f64640 1 -- start start 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a7f64640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0a0097f00 0x7fb0a00982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a7f64640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0a006bdf0 con 0x7fb0a0098820 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a7f64640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0a00672c0 con 0x7fb0a0097f00 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a5d00640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb0a0097f00 0x7fb0a00982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a54ff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb0a0098820 0x7fb0a012deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42980/0 (socket says 172.21.15.28:42980) 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a54ff640 1 -- 172.21.15.28:0/3325536162 learned_addr learned my addr 172.21.15.28:0/3325536162 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a5d00640 1 -- 172.21.15.28:0/3325536162 >> v1:172.21.15.28:6789/0 conn(0x7fb0a0098820 legacy=0x7fb0a012deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.085 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a4cfe640 1 -- 172.21.15.28:0/3325536162 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2763685437 0 0) 0x7fb0a006bdf0 con 0x7fb0a0098820 2024-03-20T13:36:34.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.081+0000 7fb0a5d00640 1 -- 172.21.15.28:0/3325536162 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0a009a5c0 con 0x7fb0a0097f00 2024-03-20T13:36:34.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.082+0000 7fb0a5d00640 1 --2- 172.21.15.28:0/3325536162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a00982e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009720 tx=0x7fb09c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d0c6b71a09378f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.082+0000 7fb0a4cfe640 1 -- 172.21.15.28:0/3325536162 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c02e070 con 0x7fb0a0097f00 2024-03-20T13:36:34.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.082+0000 7fb0a4cfe640 1 -- 172.21.15.28:0/3325536162 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c0316d0 con 0x7fb0a0097f00 2024-03-20T13:36:34.086 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.082+0000 7fb0a4cfe640 1 -- 172.21.15.28:0/3325536162 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c031990 con 0x7fb0a0097f00 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.082+0000 7fb0a7f64640 1 -- 172.21.15.28:0/3325536162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 msgr2=0x7fb0a00982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.082+0000 7fb0a7f64640 1 --2- 172.21.15.28:0/3325536162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a00982e0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009720 tx=0x7fb09c02b840 comp rx=0 tx=0).stop 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 -- 172.21.15.28:0/3325536162 shutdown_connections 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 --2- 172.21.15.28:0/3325536162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a00982e0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 -- 172.21.15.28:0/3325536162 >> 172.21.15.28:0/3325536162 conn(0x7fb0a009e640 msgr2=0x7fb0a009ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 -- 172.21.15.28:0/3325536162 shutdown_connections 2024-03-20T13:36:34.087 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 -- 172.21.15.28:0/3325536162 wait complete. 2024-03-20T13:36:34.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 Processor -- start 2024-03-20T13:36:34.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.083+0000 7fb0a7f64640 1 -- start start 2024-03-20T13:36:34.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a7f64640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a01c2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a7f64640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0a012dcc0 con 0x7fb0a0097f00 2024-03-20T13:36:34.090 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a5d00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a01c2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a5d00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a01c2700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49016/0 (socket says 172.21.15.28:49016) 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a5d00640 1 -- 172.21.15.28:0/4015809379 learned_addr learned my addr 172.21.15.28:0/4015809379 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a5d00640 1 -- 172.21.15.28:0/4015809379 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb09c009400 con 0x7fb0a0097f00 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a5d00640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a01c2700 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009720 tx=0x7fb09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c0328b0 con 0x7fb0a0097f00 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb09c032a10 con 0x7fb0a0097f00 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0a0099a10 con 0x7fb0a0097f00 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb09c032cb0 con 0x7fb0a0097f00 2024-03-20T13:36:34.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.084+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0a006e290 con 0x7fb0a0097f00 2024-03-20T13:36:34.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.085+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fb09c04e450 con 0x7fb0a0097f00 2024-03-20T13:36:34.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.085+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0a00627b0 con 0x7fb0a0097f00 2024-03-20T13:36:34.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.086+0000 7fb0967fc640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb084037ef0 0x7fb08403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.093 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.086+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fb09c06d600 con 0x7fb0a0097f00 2024-03-20T13:36:34.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.086+0000 7fb0a54ff640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb084037ef0 0x7fb08403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.086+0000 7fb0a54ff640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb084037ef0 0x7fb08403a3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb090000c00 tx=0x7fb090007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.094 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.090+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fb09c04c940 con 0x7fb0a0097f00 2024-03-20T13:36:34.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.269+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7fb0a0099890 con 0x7fb084037ef0 2024-03-20T13:36:34.271 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.270+0000 7fb0967fc640 1 -- 172.21.15.28:0/4015809379 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb0900012b0 con 0x7fb084037ef0 2024-03-20T13:36:34.271 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 0 to deep-scrub 2024-03-20T13:36:34.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.272+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb084037ef0 msgr2=0x7fb08403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.272+0000 7fb0a7f64640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb084037ef0 0x7fb08403a3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb090000c00 tx=0x7fb090007910 comp rx=0 tx=0).stop 2024-03-20T13:36:34.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.272+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 msgr2=0x7fb0a01c2700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.272+0000 7fb0a7f64640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a01c2700 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fb09c009720 tx=0x7fb09c0046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.273+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 shutdown_connections 2024-03-20T13:36:34.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.273+0000 7fb0a7f64640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fb084037ef0 0x7fb08403a3b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.273+0000 7fb0a7f64640 1 --2- 172.21.15.28:0/4015809379 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb0a0097f00 0x7fb0a01c2700 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.273+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 >> 172.21.15.28:0/4015809379 conn(0x7fb0a009e640 msgr2=0x7fb0a0096570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.273+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 shutdown_connections 2024-03-20T13:36:34.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.273+0000 7fb0a7f64640 1 -- 172.21.15.28:0/4015809379 wait complete. 2024-03-20T13:36:34.284 INFO:tasks.ceph:Scrubbing osd.1 2024-03-20T13:36:34.284 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:36:34.388 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.387+0000 7fcf27ff6640 1 Processor -- start 2024-03-20T13:36:34.389 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.387+0000 7fcf27ff6640 1 -- start start 2024-03-20T13:36:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf27ff6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf20098820 0x7fcf20098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf27ff6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2009a800 con 0x7fcf20099140 2024-03-20T13:36:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf27ff6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2009dab0 con 0x7fcf20098820 2024-03-20T13:36:34.390 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf25d92640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf20098820 0x7fcf20098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf25591640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcf20099140 0x7fcf20096480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42996/0 (socket says 172.21.15.28:42996) 2024-03-20T13:36:34.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf25591640 1 -- 172.21.15.28:0/1736444378 learned_addr learned my addr 172.21.15.28:0/1736444378 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:34.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf25d92640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcf20098820 0x7fcf20098c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49020/0 (socket says 172.21.15.28:49020) 2024-03-20T13:36:34.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf25d92640 1 -- 172.21.15.28:0/1736444378 >> v1:172.21.15.28:6789/0 conn(0x7fcf20099140 legacy=0x7fcf20096480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.391 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.388+0000 7fcf25d92640 1 -- 172.21.15.28:0/1736444378 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2009d790 con 0x7fcf20098820 2024-03-20T13:36:34.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf25d92640 1 --2- 172.21.15.28:0/1736444378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf20098c00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009720 tx=0x7fcf1802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b730143a8e53c00 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf24d90640 1 -- 172.21.15.28:0/1736444378 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf1802e070 con 0x7fcf20098820 2024-03-20T13:36:34.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf24d90640 1 -- 172.21.15.28:0/1736444378 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf180316d0 con 0x7fcf20098820 2024-03-20T13:36:34.392 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf24d90640 1 -- 172.21.15.28:0/1736444378 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf18031990 con 0x7fcf20098820 2024-03-20T13:36:34.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf27ff6640 1 -- 172.21.15.28:0/1736444378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 msgr2=0x7fcf20098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/1736444378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf20098c00 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fcf18009720 tx=0x7fcf1802b840 comp rx=0 tx=0).stop 2024-03-20T13:36:34.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf27ff6640 1 -- 172.21.15.28:0/1736444378 shutdown_connections 2024-03-20T13:36:34.396 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/1736444378 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf20098c00 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.389+0000 7fcf27ff6640 1 -- 172.21.15.28:0/1736444378 >> 172.21.15.28:0/1736444378 conn(0x7fcf200a0940 msgr2=0x7fcf2009ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.390+0000 7fcf27ff6640 1 -- 172.21.15.28:0/1736444378 shutdown_connections 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.390+0000 7fcf27ff6640 1 -- 172.21.15.28:0/1736444378 wait complete. 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.390+0000 7fcf27ff6640 1 Processor -- start 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.390+0000 7fcf27ff6640 1 -- start start 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf27ff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf201c29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf27ff6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2006e250 con 0x7fcf20098820 2024-03-20T13:36:34.397 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf25d92640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf201c29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf25d92640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf201c29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49024/0 (socket says 172.21.15.28:49024) 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf25d92640 1 -- 172.21.15.28:0/2848664776 learned_addr learned my addr 172.21.15.28:0/2848664776 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf25d92640 1 -- 172.21.15.28:0/2848664776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf18009400 con 0x7fcf20098820 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf25d92640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf201c29d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcf18034040 tx=0x7fcf180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf18032830 con 0x7fcf20098820 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf18032990 con 0x7fcf20098820 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf201c2610 con 0x7fcf20098820 2024-03-20T13:36:34.398 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fcf18032c50 con 0x7fcf20098820 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.391+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2012b6f0 con 0x7fcf20098820 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fcf1804d3f0 con 0x7fcf20098820 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf200998d0 con 0x7fcf20098820 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf167fc640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fcf04037ef0 0x7fcf0403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fcf1806d360 con 0x7fcf20098820 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf167fc640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7fcf040443d0 0x7fcf04046870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.399 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf04046f40 con 0x7fcf040443d0 2024-03-20T13:36:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.392+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf1806f9d0 con 0x7fcf20098820 2024-03-20T13:36:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.393+0000 7fcf25591640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fcf04037ef0 0x7fcf0403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.393+0000 7fcf26593640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7fcf040443d0 0x7fcf04046870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.393+0000 7fcf26593640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7fcf040443d0 0x7fcf04046870 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.393+0000 7fcf25591640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fcf04037ef0 0x7fcf0403a3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcf10007fd0 tx=0x7fcf10007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.400 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.394+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== osd.1 v2:172.21.15.177:6808/2492741617 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fcf04046f40 con 0x7fcf040443d0 2024-03-20T13:36:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.407+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 --> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcf200627b0 con 0x7fcf040443d0 2024-03-20T13:36:34.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf167fc640 1 -- 172.21.15.28:0/2848664776 <== osd.1 v2:172.21.15.177:6808/2492741617 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcf200627b0 con 0x7fcf040443d0 2024-03-20T13:36:34.409 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-20T13:36:34.409 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:36:34.409 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-20T13:36:34.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7fcf040443d0 msgr2=0x7fcf04046870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7fcf040443d0 0x7fcf04046870 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fcf04037ef0 msgr2=0x7fcf0403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fcf04037ef0 0x7fcf0403a3b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fcf10007fd0 tx=0x7fcf10007ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 msgr2=0x7fcf201c29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf201c29d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fcf18034040 tx=0x7fcf180046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 shutdown_connections 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6808/2492741617,v1:172.21.15.177:6810/2492741617] conn(0x7fcf040443d0 0x7fcf04046870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fcf04037ef0 0x7fcf0403a3b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 --2- 172.21.15.28:0/2848664776 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcf20098820 0x7fcf201c29d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 >> 172.21.15.28:0/2848664776 conn(0x7fcf200a0940 msgr2=0x7fcf2009b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 shutdown_connections 2024-03-20T13:36:34.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.408+0000 7fcf27ff6640 1 -- 172.21.15.28:0/2848664776 wait complete. 2024-03-20T13:36:34.419 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-20T13:36:34.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.520+0000 7fa2174fb640 1 Processor -- start 2024-03-20T13:36:34.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.520+0000 7fa2174fb640 1 -- start start 2024-03-20T13:36:34.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.520+0000 7fa2174fb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa21012af10 0x7fa21012b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.522 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.520+0000 7fa2174fb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa210072220 con 0x7fa210095020 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.520+0000 7fa2174fb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa21006cc30 con 0x7fa21012af10 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.521+0000 7fa215297640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa21012af10 0x7fa21012b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.521+0000 7fa214a96640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa210095020 0x7fa210095440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42998/0 (socket says 172.21.15.28:42998) 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.521+0000 7fa214a96640 1 -- 172.21.15.28:0/3993399498 learned_addr learned my addr 172.21.15.28:0/3993399498 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.521+0000 7fa215297640 1 -- 172.21.15.28:0/3993399498 >> v1:172.21.15.28:6789/0 conn(0x7fa210095020 legacy=0x7fa210095440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.521+0000 7fa215297640 1 -- 172.21.15.28:0/3993399498 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa21012aae0 con 0x7fa21012af10 2024-03-20T13:36:34.523 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.521+0000 7fa20ffff640 1 -- 172.21.15.28:0/3993399498 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1219346515 0 0) 0x7fa204001110 con 0x7fa210095020 2024-03-20T13:36:34.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa215297640 1 --2- 172.21.15.28:0/3993399498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa21012af10 0x7fa21012b2f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa208009720 tx=0x7fa20802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c294b4dd578cb6f6 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa20ffff640 1 -- 172.21.15.28:0/3993399498 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa20802e070 con 0x7fa21012af10 2024-03-20T13:36:34.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa20ffff640 1 -- 172.21.15.28:0/3993399498 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2080316d0 con 0x7fa21012af10 2024-03-20T13:36:34.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa20ffff640 1 -- 172.21.15.28:0/3993399498 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa208031990 con 0x7fa21012af10 2024-03-20T13:36:34.527 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 -- 172.21.15.28:0/3993399498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa21012af10 msgr2=0x7fa21012b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 --2- 172.21.15.28:0/3993399498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa21012af10 0x7fa21012b2f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fa208009720 tx=0x7fa20802b840 comp rx=0 tx=0).stop 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 -- 172.21.15.28:0/3993399498 shutdown_connections 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 --2- 172.21.15.28:0/3993399498 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa21012af10 0x7fa21012b2f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 -- 172.21.15.28:0/3993399498 >> 172.21.15.28:0/3993399498 conn(0x7fa21009a050 msgr2=0x7fa21009a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 -- 172.21.15.28:0/3993399498 shutdown_connections 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.522+0000 7fa2174fb640 1 -- 172.21.15.28:0/3993399498 wait complete. 2024-03-20T13:36:34.528 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.523+0000 7fa2174fb640 1 Processor -- start 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.523+0000 7fa2174fb640 1 -- start start 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.523+0000 7fa2174fb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 0x7fa210123360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.523+0000 7fa2174fb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21006e510 con 0x7fa210095020 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa215297640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 0x7fa210123360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa215297640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 0x7fa210123360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49048/0 (socket says 172.21.15.28:49048) 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa215297640 1 -- 172.21.15.28:0/156676084 learned_addr learned my addr 172.21.15.28:0/156676084 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:34.529 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa215297640 1 -- 172.21.15.28:0/156676084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa208009400 con 0x7fa210095020 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa215297640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 0x7fa210123360 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa208009840 tx=0x7fa2080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa2080328b0 con 0x7fa210095020 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa208032a10 con 0x7fa210095020 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa208032cf0 con 0x7fa210095020 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa21006e820 con 0x7fa210095020 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.524+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa210124c40 con 0x7fa210095020 2024-03-20T13:36:34.530 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.525+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa20804d3f0 con 0x7fa210095020 2024-03-20T13:36:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.525+0000 7fa20dffb640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa1fc037ef0 0x7fa1fc03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.525+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fa20806d400 con 0x7fa210095020 2024-03-20T13:36:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.525+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2100627b0 con 0x7fa210095020 2024-03-20T13:36:34.531 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.526+0000 7fa214a96640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa1fc037ef0 0x7fa1fc03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.526+0000 7fa214a96640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa1fc037ef0 0x7fa1fc03a3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa204001630 tx=0x7fa204007bb0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.532 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.530+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa2080308e0 con 0x7fa210095020 2024-03-20T13:36:34.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.709+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa21006c250 con 0x7fa1fc037ef0 2024-03-20T13:36:34.711 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.710+0000 7fa20dffb640 1 -- 172.21.15.28:0/156676084 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa2040070d0 con 0x7fa1fc037ef0 2024-03-20T13:36:34.711 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 1 to deep-scrub 2024-03-20T13:36:34.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa1fc037ef0 msgr2=0x7fa1fc03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa1fc037ef0 0x7fa1fc03a3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa204001630 tx=0x7fa204007bb0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 msgr2=0x7fa210123360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 0x7fa210123360 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fa208009840 tx=0x7fa2080046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 shutdown_connections 2024-03-20T13:36:34.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa1fc037ef0 0x7fa1fc03a3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 --2- 172.21.15.28:0/156676084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa210095020 0x7fa210123360 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 >> 172.21.15.28:0/156676084 conn(0x7fa21009a050 msgr2=0x7fa210093ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 shutdown_connections 2024-03-20T13:36:34.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.712+0000 7fa2174fb640 1 -- 172.21.15.28:0/156676084 wait complete. 2024-03-20T13:36:34.723 INFO:tasks.ceph:Scrubbing osd.2 2024-03-20T13:36:34.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:36:34.828 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.826+0000 7fdce710e640 1 Processor -- start 2024-03-20T13:36:34.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.826+0000 7fdce710e640 1 -- start start 2024-03-20T13:36:34.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdce710e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdce0098820 0x7fdce0098c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdce710e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdce009a800 con 0x7fdce0099140 2024-03-20T13:36:34.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdce710e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdce009dab0 con 0x7fdce0098820 2024-03-20T13:36:34.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdce4eaa640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdce0098820 0x7fdce0098c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.829 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdcdffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdce0099140 0x7fdce0096480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43006/0 (socket says 172.21.15.28:43006) 2024-03-20T13:36:34.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdcdffff640 1 -- 172.21.15.28:0/21410016 learned_addr learned my addr 172.21.15.28:0/21410016 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:34.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdce4eaa640 1 -- 172.21.15.28:0/21410016 >> v1:172.21.15.28:6789/0 conn(0x7fdce0099140 legacy=0x7fdce0096480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdce4eaa640 1 -- 172.21.15.28:0/21410016 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdce009d790 con 0x7fdce0098820 2024-03-20T13:36:34.830 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.827+0000 7fdcdf7fe640 1 -- 172.21.15.28:0/21410016 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 165339307 0 0) 0x7fdce009a800 con 0x7fdce0099140 2024-03-20T13:36:34.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.828+0000 7fdce4eaa640 1 --2- 172.21.15.28:0/21410016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce0098c00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009720 tx=0x7fdcd802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92064c836f2d89b server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.828+0000 7fdcdf7fe640 1 -- 172.21.15.28:0/21410016 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd802e070 con 0x7fdce0098820 2024-03-20T13:36:34.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.828+0000 7fdcdf7fe640 1 -- 172.21.15.28:0/21410016 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd80316d0 con 0x7fdce0098820 2024-03-20T13:36:34.834 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.828+0000 7fdcdf7fe640 1 -- 172.21.15.28:0/21410016 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8031990 con 0x7fdce0098820 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 -- 172.21.15.28:0/21410016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 msgr2=0x7fdce0098c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 --2- 172.21.15.28:0/21410016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce0098c00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8009720 tx=0x7fdcd802b840 comp rx=0 tx=0).stop 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 -- 172.21.15.28:0/21410016 shutdown_connections 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 --2- 172.21.15.28:0/21410016 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce0098c00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 -- 172.21.15.28:0/21410016 >> 172.21.15.28:0/21410016 conn(0x7fdce00a0940 msgr2=0x7fdce009ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 -- 172.21.15.28:0/21410016 shutdown_connections 2024-03-20T13:36:34.835 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 -- 172.21.15.28:0/21410016 wait complete. 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.829+0000 7fdce710e640 1 Processor -- start 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce710e640 1 -- start start 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce710e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce01c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce710e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce012ad00 con 0x7fdce0098820 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce4eaa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce01c2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce4eaa640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce01c2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49076/0 (socket says 172.21.15.28:49076) 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce4eaa640 1 -- 172.21.15.28:0/4038701465 learned_addr learned my addr 172.21.15.28:0/4038701465 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.830+0000 7fdce4eaa640 1 -- 172.21.15.28:0/4038701465 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd8009400 con 0x7fdce0098820 2024-03-20T13:36:34.836 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.831+0000 7fdce4eaa640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce01c2930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8034040 tx=0x7fdcd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.831+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8032830 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.831+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcd8032990 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.831+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce01c2450 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.831+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdcd8032c50 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.831+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce006d8c0 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fdcd804e450 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdce00998d0 con 0x7fdce0098820 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdd7fa640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdcc0037ef0 0x7fdcc003a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.837 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fdcd806d6a0 con 0x7fdce0098820 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdd7fa640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fdcc0044350 0x7fdcc00467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdcc0046ec0 con 0x7fdcc0044350 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdcd804c940 con 0x7fdce0098820 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdcdffff640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdcc0037ef0 0x7fdcc003a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.832+0000 7fdce56ab640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fdcc0044350 0x7fdcc00467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.833+0000 7fdcdffff640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdcc0037ef0 0x7fdcc003a3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0000f80 tx=0x7fdcd00016b0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.838 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.833+0000 7fdce56ab640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fdcc0044350 0x7fdcc00467f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.839 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.834+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== osd.2 v2:172.21.15.177:6800/3663022842 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7fdcc0046ec0 con 0x7fdcc0044350 2024-03-20T13:36:34.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.847+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 --> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdce00627b0 con 0x7fdcc0044350 2024-03-20T13:36:34.848 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.847+0000 7fdcdd7fa640 1 -- 172.21.15.28:0/4038701465 <== osd.2 v2:172.21.15.177:6800/3663022842 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdce00627b0 con 0x7fdcc0044350 2024-03-20T13:36:34.849 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-20T13:36:34.849 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:36:34.849 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-20T13:36:34.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fdcc0044350 msgr2=0x7fdcc00467f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fdcc0044350 0x7fdcc00467f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.850 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdcc0037ef0 msgr2=0x7fdcc003a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdcc0037ef0 0x7fdcc003a3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdcd0000f80 tx=0x7fdcd00016b0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 msgr2=0x7fdce01c2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce01c2930 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8034040 tx=0x7fdcd80046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 shutdown_connections 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6800/3663022842,v1:172.21.15.177:6801/3663022842] conn(0x7fdcc0044350 0x7fdcc00467f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fdcc0037ef0 0x7fdcc003a3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 --2- 172.21.15.28:0/4038701465 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdce0098820 0x7fdce01c2930 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.851 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 >> 172.21.15.28:0/4038701465 conn(0x7fdce00a0940 msgr2=0x7fdce009aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 shutdown_connections 2024-03-20T13:36:34.852 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.848+0000 7fdce710e640 1 -- 172.21.15.28:0/4038701465 wait complete. 2024-03-20T13:36:34.859 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-20T13:36:34.963 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.959+0000 7f8d08d79640 1 Processor -- start 2024-03-20T13:36:34.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.959+0000 7f8d08d79640 1 -- start start 2024-03-20T13:36:34.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d08d79640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8d04097f00 0x7f8d040982e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d08d79640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d0406bdf0 con 0x7f8d04098820 2024-03-20T13:36:34.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d08d79640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d040672c0 con 0x7f8d04097f00 2024-03-20T13:36:34.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d0259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8d04097f00 0x7f8d040982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.964 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8cfbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8d04098820 0x7f8d0412deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43012/0 (socket says 172.21.15.28:43012) 2024-03-20T13:36:34.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8cfbfff640 1 -- 172.21.15.28:0/1444008827 learned_addr learned my addr 172.21.15.28:0/1444008827 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:34.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d0259c640 1 -- 172.21.15.28:0/1444008827 >> v1:172.21.15.28:6789/0 conn(0x7f8d04098820 legacy=0x7f8d0412deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d0259c640 1 -- 172.21.15.28:0/1444008827 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d0409a5c0 con 0x7f8d04097f00 2024-03-20T13:36:34.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.960+0000 7f8d01d9b640 1 -- 172.21.15.28:0/1444008827 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818055112 0 0) 0x7f8d0406bdf0 con 0x7f8d04098820 2024-03-20T13:36:34.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.961+0000 7f8d0259c640 1 --2- 172.21.15.28:0/1444008827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d040982e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009720 tx=0x7f8cf402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c497eb6091683bf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.965 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.961+0000 7f8d01d9b640 1 -- 172.21.15.28:0/1444008827 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cf402e070 con 0x7f8d04097f00 2024-03-20T13:36:34.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.961+0000 7f8d01d9b640 1 -- 172.21.15.28:0/1444008827 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40316d0 con 0x7f8d04097f00 2024-03-20T13:36:34.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.961+0000 7f8d01d9b640 1 -- 172.21.15.28:0/1444008827 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cf4031990 con 0x7f8d04097f00 2024-03-20T13:36:34.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 -- 172.21.15.28:0/1444008827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 msgr2=0x7f8d040982e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:34.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 --2- 172.21.15.28:0/1444008827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d040982e0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f8cf4009720 tx=0x7f8cf402b840 comp rx=0 tx=0).stop 2024-03-20T13:36:34.966 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 -- 172.21.15.28:0/1444008827 shutdown_connections 2024-03-20T13:36:34.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 --2- 172.21.15.28:0/1444008827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d040982e0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:34.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 -- 172.21.15.28:0/1444008827 >> 172.21.15.28:0/1444008827 conn(0x7f8d0409e640 msgr2=0x7f8d0409ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:34.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 -- 172.21.15.28:0/1444008827 shutdown_connections 2024-03-20T13:36:34.967 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 -- 172.21.15.28:0/1444008827 wait complete. 2024-03-20T13:36:34.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.962+0000 7f8d08d79640 1 Processor -- start 2024-03-20T13:36:34.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d08d79640 1 -- start start 2024-03-20T13:36:34.971 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d08d79640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d041c2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d08d79640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0406ed40 con 0x7f8d04097f00 2024-03-20T13:36:34.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d0259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d041c2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d0259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d041c2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49094/0 (socket says 172.21.15.28:49094) 2024-03-20T13:36:34.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d0259c640 1 -- 172.21.15.28:0/3626175919 learned_addr learned my addr 172.21.15.28:0/3626175919 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:34.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d0259c640 1 -- 172.21.15.28:0/3626175919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf4009400 con 0x7f8d04097f00 2024-03-20T13:36:34.972 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.963+0000 7f8d0259c640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d041c2520 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8cf402b880 tx=0x7f8cf40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.964+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cf4004160 con 0x7f8d04097f00 2024-03-20T13:36:34.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.964+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf40042c0 con 0x7f8d04097f00 2024-03-20T13:36:34.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.964+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d04099a10 con 0x7f8d04097f00 2024-03-20T13:36:34.973 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.964+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8cf4032780 con 0x7f8d04097f00 2024-03-20T13:36:34.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.964+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0406d8a0 con 0x7f8d04097f00 2024-03-20T13:36:34.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.964+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f8cf40329b0 con 0x7f8d04097f00 2024-03-20T13:36:34.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.965+0000 7f8cfaffd640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8ce4037ea0 0x7f8ce403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:34.974 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.965+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f8cf406da60 con 0x7f8d04097f00 2024-03-20T13:36:34.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.965+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d0406e2a0 con 0x7f8d04097f00 2024-03-20T13:36:34.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.965+0000 7f8cfbfff640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8ce4037ea0 0x7f8ce403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:34.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.965+0000 7f8cfbfff640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8ce4037ea0 0x7f8ce403a360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8cec000c00 tx=0x7f8cec007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:34.975 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:34.969+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f8d0406e2a0 con 0x7f8d04097f00 2024-03-20T13:36:35.149 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.148+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d0409a9f0 con 0x7f8ce4037ea0 2024-03-20T13:36:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.149+0000 7f8cfaffd640 1 -- 172.21.15.28:0/3626175919 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8cec0012b0 con 0x7f8ce4037ea0 2024-03-20T13:36:35.151 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 2 to deep-scrub 2024-03-20T13:36:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8ce4037ea0 msgr2=0x7f8ce403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8ce4037ea0 0x7f8ce403a360 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8cec000c00 tx=0x7f8cec007910 comp rx=0 tx=0).stop 2024-03-20T13:36:35.153 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 msgr2=0x7f8d041c2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d041c2520 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f8cf402b880 tx=0x7f8cf40046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 shutdown_connections 2024-03-20T13:36:35.154 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f8ce4037ea0 0x7f8ce403a360 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 --2- 172.21.15.28:0/3626175919 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8d04097f00 0x7f8d041c2520 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 >> 172.21.15.28:0/3626175919 conn(0x7f8d0409e640 msgr2=0x7f8d0409be90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 shutdown_connections 2024-03-20T13:36:35.155 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.151+0000 7f8d08d79640 1 -- 172.21.15.28:0/3626175919 wait complete. 2024-03-20T13:36:35.163 INFO:tasks.ceph:Scrubbing osd.3 2024-03-20T13:36:35.163 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-20T13:36:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37caeef640 1 Processor -- start 2024-03-20T13:36:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37caeef640 1 -- start start 2024-03-20T13:36:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37caeef640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f37c412c350 0x7f37c412c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.269 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37caeef640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c40956f0 con 0x7f37c412cc70 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37caeef640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c4067d50 con 0x7f37c412c350 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37c8c8b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f37c412c350 0x7f37c412c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37c3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f37c412cc70 0x7f37c4093860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43014/0 (socket says 172.21.15.28:43014) 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.267+0000 7f37c3fff640 1 -- 172.21.15.28:0/1238010781 learned_addr learned my addr 172.21.15.28:0/1238010781 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.268+0000 7f37c8c8b640 1 -- 172.21.15.28:0/1238010781 >> v1:172.21.15.28:6789/0 conn(0x7f37c412cc70 legacy=0x7f37c4093860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.268+0000 7f37c8c8b640 1 -- 172.21.15.28:0/1238010781 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c4095880 con 0x7f37c412c350 2024-03-20T13:36:35.270 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.268+0000 7f37c37fe640 1 -- 172.21.15.28:0/1238010781 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3685673676 0 0) 0x7f37c40956f0 con 0x7f37c412cc70 2024-03-20T13:36:35.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.268+0000 7f37c8c8b640 1 --2- 172.21.15.28:0/1238010781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c412c730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009720 tx=0x7f37b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d3a18f8eda7241 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37c37fe640 1 -- 172.21.15.28:0/1238010781 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37b802e070 con 0x7f37c412c350 2024-03-20T13:36:35.274 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37c37fe640 1 -- 172.21.15.28:0/1238010781 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b80316d0 con 0x7f37c412c350 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37c37fe640 1 -- 172.21.15.28:0/1238010781 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37b8031990 con 0x7f37c412c350 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 -- 172.21.15.28:0/1238010781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 msgr2=0x7f37c412c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 --2- 172.21.15.28:0/1238010781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c412c730 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009720 tx=0x7f37b802b840 comp rx=0 tx=0).stop 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 -- 172.21.15.28:0/1238010781 shutdown_connections 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 --2- 172.21.15.28:0/1238010781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c412c730 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 -- 172.21.15.28:0/1238010781 >> 172.21.15.28:0/1238010781 conn(0x7f37c409a290 msgr2=0x7f37c409a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 -- 172.21.15.28:0/1238010781 shutdown_connections 2024-03-20T13:36:35.275 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.269+0000 7f37caeef640 1 -- 172.21.15.28:0/1238010781 wait complete. 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.270+0000 7f37caeef640 1 Processor -- start 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.270+0000 7f37caeef640 1 -- start start 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.270+0000 7f37caeef640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c4071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.270+0000 7f37caeef640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c406e6b0 con 0x7f37c412c350 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.270+0000 7f37c8c8b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c4071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c8c8b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c4071020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49102/0 (socket says 172.21.15.28:49102) 2024-03-20T13:36:35.276 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c8c8b640 1 -- 172.21.15.28:0/474831648 learned_addr learned my addr 172.21.15.28:0/474831648 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:35.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c8c8b640 1 -- 172.21.15.28:0/474831648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8009400 con 0x7f37c412c350 2024-03-20T13:36:35.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c8c8b640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c4071020 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f37b802b880 tx=0x7f37b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37b8004160 con 0x7f37c412c350 2024-03-20T13:36:35.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b80042c0 con 0x7f37c412c350 2024-03-20T13:36:35.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c4072070 con 0x7f37c412c350 2024-03-20T13:36:35.277 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f37b8032640 con 0x7f37c412c350 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.271+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c41b5e40 con 0x7f37c412c350 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f37b80327a0 con 0x7f37c412c350 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f37c4093930 con 0x7f37c412c350 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c17fa640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f37a8037ef0 0x7f37a803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f37b806d980 con 0x7f37c412c350 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c17fa640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f37a80443d0 0x7f37a8046870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37a8046f40 con 0x7f37a80443d0 2024-03-20T13:36:35.278 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f37b80722a0 con 0x7f37c412c350 2024-03-20T13:36:35.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c3fff640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f37a8037ef0 0x7f37a803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.272+0000 7f37c948c640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f37a80443d0 0x7f37a8046870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.273+0000 7f37c3fff640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f37a8037ef0 0x7f37a803a3b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f37b0000c00 tx=0x7f37b0007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.273+0000 7f37c948c640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f37a80443d0 0x7f37a8046870 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.279 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.274+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== osd.3 v2:172.21.15.177:6809/1493521224 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+27193 (crc 0 0 0) 0x7f37a8046f40 con 0x7f37a80443d0 2024-03-20T13:36:35.288 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.287+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 --> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f37c40627b0 con 0x7f37a80443d0 2024-03-20T13:36:35.289 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37c17fa640 1 -- 172.21.15.28:0/474831648 <== osd.3 v2:172.21.15.177:6809/1493521224 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f37c40627b0 con 0x7f37a80443d0 2024-03-20T13:36:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2024-03-20T13:36:35.289 INFO:teuthology.orchestra.run.smithi028.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-20T13:36:35.289 INFO:teuthology.orchestra.run.smithi028.stdout:} 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f37a80443d0 msgr2=0x7f37a8046870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f37a80443d0 0x7f37a8046870 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f37a8037ef0 msgr2=0x7f37a803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f37a8037ef0 0x7f37a803a3b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f37b0000c00 tx=0x7f37b0007970 comp rx=0 tx=0).stop 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 msgr2=0x7f37c4071020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c4071020 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f37b802b880 tx=0x7f37b80046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.291 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 shutdown_connections 2024-03-20T13:36:35.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6809/1493521224,v1:172.21.15.177:6811/1493521224] conn(0x7f37a80443d0 0x7f37a8046870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f37a8037ef0 0x7f37a803a3b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 --2- 172.21.15.28:0/474831648 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37c412c350 0x7f37c4071020 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 >> 172.21.15.28:0/474831648 conn(0x7f37c409a290 msgr2=0x7f37c41b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 shutdown_connections 2024-03-20T13:36:35.292 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.288+0000 7f37caeef640 1 -- 172.21.15.28:0/474831648 wait complete. 2024-03-20T13:36:35.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-20T13:36:35.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa958bab640 1 Processor -- start 2024-03-20T13:36:35.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa958bab640 1 -- start start 2024-03-20T13:36:35.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa958bab640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa95412dc90 0x7fa954130080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa958bab640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa954072220 con 0x7fa95412af10 2024-03-20T13:36:35.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa958bab640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa95406cc30 con 0x7fa95412dc90 2024-03-20T13:36:35.402 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa949d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa95412dc90 0x7fa954130080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa95259c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa95412af10 0x7fa95412b2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43016/0 (socket says 172.21.15.28:43016) 2024-03-20T13:36:35.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa95259c640 1 -- 172.21.15.28:0/212306320 learned_addr learned my addr 172.21.15.28:0/212306320 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:35.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa949d9b640 1 -- 172.21.15.28:0/212306320 >> v1:172.21.15.28:6789/0 conn(0x7fa95412af10 legacy=0x7fa95412b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.403 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.400+0000 7fa949d9b640 1 -- 172.21.15.28:0/212306320 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa95412aae0 con 0x7fa95412dc90 2024-03-20T13:36:35.405 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.401+0000 7fa949d9b640 1 --2- 172.21.15.28:0/212306320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412dc90 0x7fa954130080 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009720 tx=0x7fa93c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0904535dd2165e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.401+0000 7fa951d9b640 1 -- 172.21.15.28:0/212306320 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c02e070 con 0x7fa95412dc90 2024-03-20T13:36:35.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.401+0000 7fa951d9b640 1 -- 172.21.15.28:0/212306320 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93c0316d0 con 0x7fa95412dc90 2024-03-20T13:36:35.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.401+0000 7fa951d9b640 1 -- 172.21.15.28:0/212306320 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa93c031990 con 0x7fa95412dc90 2024-03-20T13:36:35.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 -- 172.21.15.28:0/212306320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412dc90 msgr2=0x7fa954130080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 --2- 172.21.15.28:0/212306320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412dc90 0x7fa954130080 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fa93c009720 tx=0x7fa93c02b840 comp rx=0 tx=0).stop 2024-03-20T13:36:35.406 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 -- 172.21.15.28:0/212306320 shutdown_connections 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 --2- 172.21.15.28:0/212306320 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412dc90 0x7fa954130080 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 -- 172.21.15.28:0/212306320 >> 172.21.15.28:0/212306320 conn(0x7fa95409a050 msgr2=0x7fa95409a460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 -- 172.21.15.28:0/212306320 shutdown_connections 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.402+0000 7fa958bab640 1 -- 172.21.15.28:0/212306320 wait complete. 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa958bab640 1 Processor -- start 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa958bab640 1 -- start start 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa958bab640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 0x7fa9541c0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.407 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa958bab640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa95406d8e0 con 0x7fa95412af10 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa95259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 0x7fa9541c0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa95259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 0x7fa9541c0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49120/0 (socket says 172.21.15.28:49120) 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.403+0000 7fa95259c640 1 -- 172.21.15.28:0/1656973916 learned_addr learned my addr 172.21.15.28:0/1656973916 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa95259c640 1 -- 172.21.15.28:0/1656973916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c009400 con 0x7fa95412af10 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa95259c640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 0x7fa9541c0680 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c4a0 tx=0x7fa94400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa944005c10 con 0x7fa95412af10 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa944005d70 con 0x7fa95412af10 2024-03-20T13:36:35.408 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa95406d600 con 0x7fa95412af10 2024-03-20T13:36:35.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa9440071a0 con 0x7fa95412af10 2024-03-20T13:36:35.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.404+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa954124b10 con 0x7fa95412af10 2024-03-20T13:36:35.409 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.405+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fa944007300 con 0x7fa95412af10 2024-03-20T13:36:35.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.405+0000 7fa94b7fe640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa934037ef0 0x7fa93403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.405+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa954072220 con 0x7fa95412af10 2024-03-20T13:36:35.410 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.405+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fa94404a810 con 0x7fa95412af10 2024-03-20T13:36:35.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.405+0000 7fa949d9b640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa934037ef0 0x7fa93403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.411 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.406+0000 7fa949d9b640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa934037ef0 0x7fa93403a3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa93c036000 tx=0x7fa93c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.412 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.410+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fa954072220 con 0x7fa95412af10 2024-03-20T13:36:35.592 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.591+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fa95406c250 con 0x7fa934037ef0 2024-03-20T13:36:35.593 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.591+0000 7fa94b7fe640 1 -- 172.21.15.28:0/1656973916 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa93c031c00 con 0x7fa934037ef0 2024-03-20T13:36:35.593 INFO:teuthology.orchestra.run.smithi028.stderr:instructed osd(s) 3 to deep-scrub 2024-03-20T13:36:35.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa934037ef0 msgr2=0x7fa93403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa934037ef0 0x7fa93403a3b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa93c036000 tx=0x7fa93c008030 comp rx=0 tx=0).stop 2024-03-20T13:36:35.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 msgr2=0x7fa9541c0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 0x7fa9541c0680 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fa94400c4a0 tx=0x7fa94400c960 comp rx=0 tx=0).stop 2024-03-20T13:36:35.595 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 shutdown_connections 2024-03-20T13:36:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fa934037ef0 0x7fa93403a3b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 --2- 172.21.15.28:0/1656973916 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa95412af10 0x7fa9541c0680 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.593+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 >> 172.21.15.28:0/1656973916 conn(0x7fa95409a050 msgr2=0x7fa954128760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.594+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 shutdown_connections 2024-03-20T13:36:35.596 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.594+0000 7fa958bab640 1 -- 172.21.15.28:0/1656973916 wait complete. 2024-03-20T13:36:35.605 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:35.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10e6704640 1 Processor -- start 2024-03-20T13:36:35.707 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10e6704640 1 -- start start 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10e6704640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10e0130f10 0x7f10e0133300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10e6704640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10e008f480 con 0x7f10e012e0f0 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10e6704640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10e006c250 con 0x7f10e0130f10 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10df7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10e0130f10 0x7f10e0133300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10dffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f10e012e0f0 0x7f10e012e4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43032/0 (socket says 172.21.15.28:43032) 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10dffff640 1 -- 172.21.15.28:0/3522150986 learned_addr learned my addr 172.21.15.28:0/3522150986 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:35.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.705+0000 7f10df7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10e0130f10 0x7f10e0133300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49134/0 (socket says 172.21.15.28:49134) 2024-03-20T13:36:35.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.706+0000 7f10df7fe640 1 -- 172.21.15.28:0/3522150986 >> v1:172.21.15.28:6789/0 conn(0x7f10e012e0f0 legacy=0x7f10e012e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.709 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.706+0000 7f10df7fe640 1 -- 172.21.15.28:0/3522150986 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e008fd00 con 0x7f10e0130f10 2024-03-20T13:36:35.712 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.706+0000 7f10df7fe640 1 --2- 172.21.15.28:0/3522150986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e0130f10 0x7f10e0133300 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009720 tx=0x7f10d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1edf27071db0dd8 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.706+0000 7f10deffd640 1 -- 172.21.15.28:0/3522150986 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d4031760 con 0x7f10e0130f10 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.706+0000 7f10deffd640 1 -- 172.21.15.28:0/3522150986 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d40318c0 con 0x7f10e0130f10 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.706+0000 7f10deffd640 1 -- 172.21.15.28:0/3522150986 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d4031b80 con 0x7f10e0130f10 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 -- 172.21.15.28:0/3522150986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e0130f10 msgr2=0x7f10e0133300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 --2- 172.21.15.28:0/3522150986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e0130f10 0x7f10e0133300 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009720 tx=0x7f10d402b8d0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 -- 172.21.15.28:0/3522150986 shutdown_connections 2024-03-20T13:36:35.713 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 --2- 172.21.15.28:0/3522150986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e0130f10 0x7f10e0133300 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 -- 172.21.15.28:0/3522150986 >> 172.21.15.28:0/3522150986 conn(0x7f10e009a7f0 msgr2=0x7f10e009ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 -- 172.21.15.28:0/3522150986 shutdown_connections 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.707+0000 7f10e6704640 1 -- 172.21.15.28:0/3522150986 wait complete. 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.708+0000 7f10e6704640 1 Processor -- start 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.708+0000 7f10e6704640 1 -- start start 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.708+0000 7f10e6704640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 0x7f10e01c2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.708+0000 7f10e6704640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10e006e7a0 con 0x7f10e012e0f0 2024-03-20T13:36:35.714 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.708+0000 7f10dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 0x7f10e01c2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 0x7f10e01c2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:49144/0 (socket says 172.21.15.28:49144) 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dffff640 1 -- 172.21.15.28:0/134114728 learned_addr learned my addr 172.21.15.28:0/134114728 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dffff640 1 -- 172.21.15.28:0/134114728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009400 con 0x7f10e012e0f0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dffff640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 0x7f10e01c2af0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c480 tx=0x7f10d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d0005c10 con 0x7f10e012e0f0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d0005d70 con 0x7f10e012e0f0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10d0007200 con 0x7f10e012e0f0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10e006ec70 con 0x7f10e012e0f0 2024-03-20T13:36:35.715 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.709+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10e006e9b0 con 0x7f10e012e0f0 2024-03-20T13:36:35.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.710+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f10d0007360 con 0x7f10e012e0f0 2024-03-20T13:36:35.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.710+0000 7f10dcff9640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f10cc037ef0 0x7f10cc03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:35.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.710+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10e00627b0 con 0x7f10e012e0f0 2024-03-20T13:36:35.716 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.710+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f10d004a900 con 0x7f10e012e0f0 2024-03-20T13:36:35.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.710+0000 7f10df7fe640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f10cc037ef0 0x7f10cc03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:35.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.711+0000 7f10df7fe640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f10cc037ef0 0x7f10cc03a3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f10e0096910 tx=0x7f10d4008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:35.717 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.715+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f10d001b3b0 con 0x7f10e012e0f0 2024-03-20T13:36:35.891 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.890+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10e012bea0 con 0x7f10cc037ef0 2024-03-20T13:36:35.906 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.905+0000 7f10dcff9640 1 -- 172.21.15.28:0/134114728 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673651 (secure 0 0 0) 0x7f10e012bea0 con 0x7f10cc037ef0 2024-03-20T13:36:35.920 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:36:35.928 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:36:35.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f10cc037ef0 msgr2=0x7f10cc03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.932 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f10cc037ef0 0x7f10cc03a3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f10e0096910 tx=0x7f10d4008030 comp rx=0 tx=0).stop 2024-03-20T13:36:35.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 msgr2=0x7f10e01c2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:35.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 0x7f10e01c2af0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f10d000c480 tx=0x7f10d000c940 comp rx=0 tx=0).stop 2024-03-20T13:36:35.933 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 shutdown_connections 2024-03-20T13:36:35.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f10cc037ef0 0x7f10cc03a3b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 --2- 172.21.15.28:0/134114728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10e012e0f0 0x7f10e01c2af0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:35.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 >> 172.21.15.28:0/134114728 conn(0x7f10e009a7f0 msgr2=0x7f10e00983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:35.934 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 shutdown_connections 2024-03-20T13:36:35.935 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:35.910+0000 7f10e6704640 1 -- 172.21.15.28:0/134114728 wait complete. 2024-03-20T13:36:35.935 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2024-03-20T13:36:35.171003+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4002,"num_read_kb":3648,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3797,"ondisk_log_size":3797,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-824,"num_objects":-16,"num_object_clones":0,"num_object_copies":-33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-16,"num_whiteouts":0,"num_read":388,"num_read_kb":386,"num_write":118,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003950"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988720+0000","last_change":"2024-03-20T13:34:49.945378+0000","last_active":"2024-03-20T13:35:30.988720+0000","last_peered":"2024-03-20T13:35:30.988720+0000","last_clean":"2024-03-20T13:35:30.988720+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:35:30.988720+0000","last_undegraded":"2024-03-20T13:35:30.988720+0000","last_fullsized":"2024-03-20T13:35:30.988720+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925322+0000","last_change":"2024-03-20T13:34:51.948629+0000","last_active":"2024-03-20T13:35:35.925322+0000","last_peered":"2024-03-20T13:35:35.925322+0000","last_clean":"2024-03-20T13:35:35.925322+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:35:35.925322+0000","last_undegraded":"2024-03-20T13:35:35.925322+0000","last_fullsized":"2024-03-20T13:35:35.925322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984600+0000","last_change":"2024-03-20T13:34:49.933462+0000","last_active":"2024-03-20T13:35:30.984600+0000","last_peered":"2024-03-20T13:35:30.984600+0000","last_clean":"2024-03-20T13:35:30.984600+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:35:30.984600+0000","last_undegraded":"2024-03-20T13:35:30.984600+0000","last_fullsized":"2024-03-20T13:35:30.984600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:09:34.991691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568207+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.568207+0000","last_peered":"2024-03-20T13:36:23.568207+0000","last_clean":"2024-03-20T13:36:23.568207+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.568207+0000","last_undegraded":"2024-03-20T13:36:23.568207+0000","last_fullsized":"2024-03-20T13:36:23.568207+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:53.377689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.796505+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:35:34.796505+0000","last_peered":"2024-03-20T13:35:34.796505+0000","last_clean":"2024-03-20T13:35:34.796505+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:35:34.796505+0000","last_undegraded":"2024-03-20T13:35:34.796505+0000","last_fullsized":"2024-03-20T13:35:34.796505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:36.437918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986674+0000","last_change":"2024-03-20T13:34:51.947769+0000","last_active":"2024-03-20T13:35:30.986674+0000","last_peered":"2024-03-20T13:35:30.986674+0000","last_clean":"2024-03-20T13:35:30.986674+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:35:30.986674+0000","last_undegraded":"2024-03-20T13:35:30.986674+0000","last_fullsized":"2024-03-20T13:35:30.986674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:10.763673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.407859+0000","last_change":"2024-03-20T13:34:49.952708+0000","last_active":"2024-03-20T13:35:35.407859+0000","last_peered":"2024-03-20T13:35:35.407859+0000","last_clean":"2024-03-20T13:35:35.407859+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:35:35.407859+0000","last_undegraded":"2024-03-20T13:35:35.407859+0000","last_fullsized":"2024-03-20T13:35:35.407859+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309640+0000","last_change":"2024-03-20T13:35:30.996431+0000","last_active":"2024-03-20T13:36:17.309640+0000","last_peered":"2024-03-20T13:36:17.309640+0000","last_clean":"2024-03-20T13:36:17.309640+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:36:17.309640+0000","last_undegraded":"2024-03-20T13:36:17.309640+0000","last_fullsized":"2024-03-20T13:36:17.309640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:29.110394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987551+0000","last_change":"2024-03-20T13:34:49.959192+0000","last_active":"2024-03-20T13:35:30.987551+0000","last_peered":"2024-03-20T13:35:30.987551+0000","last_clean":"2024-03-20T13:35:30.987551+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:35:30.987551+0000","last_undegraded":"2024-03-20T13:35:30.987551+0000","last_fullsized":"2024-03-20T13:35:30.987551+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:53.061218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309603+0000","last_change":"2024-03-20T13:34:51.946953+0000","last_active":"2024-03-20T13:36:17.309603+0000","last_peered":"2024-03-20T13:36:17.309603+0000","last_clean":"2024-03-20T13:36:17.309603+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:36:17.309603+0000","last_undegraded":"2024-03-20T13:36:17.309603+0000","last_fullsized":"2024-03-20T13:36:17.309603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985613+0000","last_change":"2024-03-20T13:34:49.954949+0000","last_active":"2024-03-20T13:35:30.985613+0000","last_peered":"2024-03-20T13:35:30.985613+0000","last_clean":"2024-03-20T13:35:30.985613+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:35:30.985613+0000","last_undegraded":"2024-03-20T13:35:30.985613+0000","last_fullsized":"2024-03-20T13:35:30.985613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988705+0000","last_change":"2024-03-20T13:34:51.952540+0000","last_active":"2024-03-20T13:35:30.988705+0000","last_peered":"2024-03-20T13:35:30.988705+0000","last_clean":"2024-03-20T13:35:30.988705+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:35:30.988705+0000","last_undegraded":"2024-03-20T13:35:30.988705+0000","last_fullsized":"2024-03-20T13:35:30.988705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:28.263549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986108+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:35:30.986108+0000","last_peered":"2024-03-20T13:35:30.986108+0000","last_clean":"2024-03-20T13:35:30.986108+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:35:30.986108+0000","last_undegraded":"2024-03-20T13:35:30.986108+0000","last_fullsized":"2024-03-20T13:35:30.986108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:09:20.487446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568527+0000","last_change":"2024-03-20T13:34:51.948321+0000","last_active":"2024-03-20T13:36:23.568527+0000","last_peered":"2024-03-20T13:36:23.568527+0000","last_clean":"2024-03-20T13:36:23.568527+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:23.568527+0000","last_undegraded":"2024-03-20T13:36:23.568527+0000","last_fullsized":"2024-03-20T13:36:23.568527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982427+0000","last_change":"2024-03-20T13:34:49.940856+0000","last_active":"2024-03-20T13:35:30.982427+0000","last_peered":"2024-03-20T13:35:30.982427+0000","last_clean":"2024-03-20T13:35:30.982427+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:35:30.982427+0000","last_undegraded":"2024-03-20T13:35:30.982427+0000","last_fullsized":"2024-03-20T13:35:30.982427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'5","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309552+0000","last_change":"2024-03-20T13:34:51.945268+0000","last_active":"2024-03-20T13:36:17.309552+0000","last_peered":"2024-03-20T13:36:17.309552+0000","last_clean":"2024-03-20T13:36:17.309552+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:36:17.309552+0000","last_undegraded":"2024-03-20T13:36:17.309552+0000","last_fullsized":"2024-03-20T13:36:17.309552+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969415+0000","last_change":"2024-03-20T13:34:51.949454+0000","last_active":"2024-03-20T13:36:17.969415+0000","last_peered":"2024-03-20T13:36:17.969415+0000","last_clean":"2024-03-20T13:36:17.969415+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:36:17.969415+0000","last_undegraded":"2024-03-20T13:36:17.969415+0000","last_fullsized":"2024-03-20T13:36:17.969415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:22.583858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983023+0000","last_change":"2024-03-20T13:34:49.945284+0000","last_active":"2024-03-20T13:35:30.983023+0000","last_peered":"2024-03-20T13:35:30.983023+0000","last_clean":"2024-03-20T13:35:30.983023+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:35:30.983023+0000","last_undegraded":"2024-03-20T13:35:30.983023+0000","last_fullsized":"2024-03-20T13:35:30.983023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568361+0000","last_change":"2024-03-20T13:34:51.948725+0000","last_active":"2024-03-20T13:36:23.568361+0000","last_peered":"2024-03-20T13:36:23.568361+0000","last_clean":"2024-03-20T13:36:23.568361+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:23.568361+0000","last_undegraded":"2024-03-20T13:36:23.568361+0000","last_fullsized":"2024-03-20T13:36:23.568361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990655+0000","last_change":"2024-03-20T13:34:49.950644+0000","last_active":"2024-03-20T13:35:30.990655+0000","last_peered":"2024-03-20T13:35:30.990655+0000","last_clean":"2024-03-20T13:35:30.990655+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:35:30.990655+0000","last_undegraded":"2024-03-20T13:35:30.990655+0000","last_fullsized":"2024-03-20T13:35:30.990655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.165007+0000","last_change":"2024-03-20T13:34:51.947958+0000","last_active":"2024-03-20T13:35:35.165007+0000","last_peered":"2024-03-20T13:35:35.165007+0000","last_clean":"2024-03-20T13:35:35.165007+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:35:35.165007+0000","last_undegraded":"2024-03-20T13:35:35.165007+0000","last_fullsized":"2024-03-20T13:35:35.165007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:26.305545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.410831+0000","last_change":"2024-03-20T13:34:49.946510+0000","last_active":"2024-03-20T13:35:35.410831+0000","last_peered":"2024-03-20T13:35:35.410831+0000","last_clean":"2024-03-20T13:35:35.410831+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:35:35.410831+0000","last_undegraded":"2024-03-20T13:35:35.410831+0000","last_fullsized":"2024-03-20T13:35:35.410831+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:02:35.008119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815929+0000","last_change":"2024-03-20T13:34:51.937387+0000","last_active":"2024-03-20T13:35:34.815929+0000","last_peered":"2024-03-20T13:35:34.815929+0000","last_clean":"2024-03-20T13:35:34.815929+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:35:34.815929+0000","last_undegraded":"2024-03-20T13:35:34.815929+0000","last_fullsized":"2024-03-20T13:35:34.815929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:37.017519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982385+0000","last_change":"2024-03-20T13:34:49.949930+0000","last_active":"2024-03-20T13:35:30.982385+0000","last_peered":"2024-03-20T13:35:30.982385+0000","last_clean":"2024-03-20T13:35:30.982385+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:35:30.982385+0000","last_undegraded":"2024-03-20T13:35:30.982385+0000","last_fullsized":"2024-03-20T13:35:30.982385+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976899+0000","last_change":"2024-03-20T13:34:51.941800+0000","last_active":"2024-03-20T13:36:17.976899+0000","last_peered":"2024-03-20T13:36:17.976899+0000","last_clean":"2024-03-20T13:36:17.976899+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:36:17.976899+0000","last_undegraded":"2024-03-20T13:36:17.976899+0000","last_fullsized":"2024-03-20T13:36:17.976899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984331+0000","last_change":"2024-03-20T13:34:49.934846+0000","last_active":"2024-03-20T13:35:30.984331+0000","last_peered":"2024-03-20T13:35:30.984331+0000","last_clean":"2024-03-20T13:35:30.984331+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:35:30.984331+0000","last_undegraded":"2024-03-20T13:35:30.984331+0000","last_fullsized":"2024-03-20T13:35:30.984331+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'5","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309570+0000","last_change":"2024-03-20T13:34:51.948384+0000","last_active":"2024-03-20T13:36:17.309570+0000","last_peered":"2024-03-20T13:36:17.309570+0000","last_clean":"2024-03-20T13:36:17.309570+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:36:17.309570+0000","last_undegraded":"2024-03-20T13:36:17.309570+0000","last_fullsized":"2024-03-20T13:36:17.309570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:39.648807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986253+0000","last_change":"2024-03-20T13:34:49.959590+0000","last_active":"2024-03-20T13:35:30.986253+0000","last_peered":"2024-03-20T13:35:30.986253+0000","last_clean":"2024-03-20T13:35:30.986253+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:35:30.986253+0000","last_undegraded":"2024-03-20T13:35:30.986253+0000","last_fullsized":"2024-03-20T13:35:30.986253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:11:00.815146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":75,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559090+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:23.559090+0000","last_peered":"2024-03-20T13:36:23.559090+0000","last_clean":"2024-03-20T13:36:23.559090+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:23.559090+0000","last_undegraded":"2024-03-20T13:36:23.559090+0000","last_fullsized":"2024-03-20T13:36:23.559090+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:51:37.139674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.994987+0000","last_change":"2024-03-20T13:35:30.994560+0000","last_active":"2024-03-20T13:35:30.994987+0000","last_peered":"2024-03-20T13:35:30.994987+0000","last_clean":"2024-03-20T13:35:30.994987+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:35:30.994987+0000","last_undegraded":"2024-03-20T13:35:30.994987+0000","last_fullsized":"2024-03-20T13:35:30.994987+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:54.906208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987284+0000","last_change":"2024-03-20T13:34:49.959439+0000","last_active":"2024-03-20T13:35:30.987284+0000","last_peered":"2024-03-20T13:35:30.987284+0000","last_clean":"2024-03-20T13:35:30.987284+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:35:30.987284+0000","last_undegraded":"2024-03-20T13:35:30.987284+0000","last_fullsized":"2024-03-20T13:35:30.987284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:00.516394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988549+0000","last_change":"2024-03-20T13:34:53.942393+0000","last_active":"2024-03-20T13:35:30.988549+0000","last_peered":"2024-03-20T13:35:30.988549+0000","last_clean":"2024-03-20T13:35:30.988549+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:35:30.988549+0000","last_undegraded":"2024-03-20T13:35:30.988549+0000","last_fullsized":"2024-03-20T13:35:30.988549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:23.709018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.265276+0000","last_change":"2024-03-20T13:34:55.955194+0000","last_active":"2024-03-20T13:36:31.265276+0000","last_peered":"2024-03-20T13:36:31.265276+0000","last_clean":"2024-03-20T13:36:31.265276+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:36:31.265276+0000","last_undegraded":"2024-03-20T13:36:31.265276+0000","last_fullsized":"2024-03-20T13:36:31.265276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:57:57.391498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982874+0000","last_change":"2024-03-20T13:34:57.964242+0000","last_active":"2024-03-20T13:35:30.982874+0000","last_peered":"2024-03-20T13:35:30.982874+0000","last_clean":"2024-03-20T13:35:30.982874+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:35:30.982874+0000","last_undegraded":"2024-03-20T13:35:30.982874+0000","last_fullsized":"2024-03-20T13:35:30.982874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.266272+0000","last_change":"2024-03-20T13:34:59.969467+0000","last_active":"2024-03-20T13:36:12.266272+0000","last_peered":"2024-03-20T13:36:12.266272+0000","last_clean":"2024-03-20T13:36:12.266272+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:36:12.266272+0000","last_undegraded":"2024-03-20T13:36:12.266272+0000","last_fullsized":"2024-03-20T13:36:12.266272+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:06:17.436460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309566+0000","last_change":"2024-03-20T13:34:51.943450+0000","last_active":"2024-03-20T13:36:17.309566+0000","last_peered":"2024-03-20T13:36:17.309566+0000","last_clean":"2024-03-20T13:36:17.309566+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:36:17.309566+0000","last_undegraded":"2024-03-20T13:36:17.309566+0000","last_fullsized":"2024-03-20T13:36:17.309566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:12:33.274074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985408+0000","last_change":"2024-03-20T13:34:49.955248+0000","last_active":"2024-03-20T13:35:30.985408+0000","last_peered":"2024-03-20T13:35:30.985408+0000","last_clean":"2024-03-20T13:35:30.985408+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:35:30.985408+0000","last_undegraded":"2024-03-20T13:35:30.985408+0000","last_fullsized":"2024-03-20T13:35:30.985408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983126+0000","last_change":"2024-03-20T13:34:53.944586+0000","last_active":"2024-03-20T13:35:30.983126+0000","last_peered":"2024-03-20T13:35:30.983126+0000","last_clean":"2024-03-20T13:35:30.983126+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:35:30.983126+0000","last_undegraded":"2024-03-20T13:35:30.983126+0000","last_fullsized":"2024-03-20T13:35:30.983126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:55.336150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"30'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981904+0000","last_change":"2024-03-20T13:34:55.953888+0000","last_active":"2024-03-20T13:35:30.981904+0000","last_peered":"2024-03-20T13:35:30.981904+0000","last_clean":"2024-03-20T13:35:30.981904+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:35:30.981904+0000","last_undegraded":"2024-03-20T13:35:30.981904+0000","last_fullsized":"2024-03-20T13:35:30.981904+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:49:02.706193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981211+0000","last_change":"2024-03-20T13:34:57.966274+0000","last_active":"2024-03-20T13:35:30.981211+0000","last_peered":"2024-03-20T13:35:30.981211+0000","last_clean":"2024-03-20T13:35:30.981211+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:35:30.981211+0000","last_undegraded":"2024-03-20T13:35:30.981211+0000","last_fullsized":"2024-03-20T13:35:30.981211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.957308+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:17.957308+0000","last_peered":"2024-03-20T13:36:17.957308+0000","last_clean":"2024-03-20T13:36:17.957308+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:17.957308+0000","last_undegraded":"2024-03-20T13:36:17.957308+0000","last_fullsized":"2024-03-20T13:36:17.957308+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969171+0000","last_change":"2024-03-20T13:34:51.940751+0000","last_active":"2024-03-20T13:36:17.969171+0000","last_peered":"2024-03-20T13:36:17.969171+0000","last_clean":"2024-03-20T13:36:17.969171+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:36:17.969171+0000","last_undegraded":"2024-03-20T13:36:17.969171+0000","last_fullsized":"2024-03-20T13:36:17.969171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:12.037950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985656+0000","last_change":"2024-03-20T13:34:49.959865+0000","last_active":"2024-03-20T13:35:30.985656+0000","last_peered":"2024-03-20T13:35:30.985656+0000","last_clean":"2024-03-20T13:35:30.985656+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:35:30.985656+0000","last_undegraded":"2024-03-20T13:35:30.985656+0000","last_fullsized":"2024-03-20T13:35:30.985656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:21.968097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985039+0000","last_change":"2024-03-20T13:34:53.944429+0000","last_active":"2024-03-20T13:35:30.985039+0000","last_peered":"2024-03-20T13:35:30.985039+0000","last_clean":"2024-03-20T13:35:30.985039+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:35:30.985039+0000","last_undegraded":"2024-03-20T13:35:30.985039+0000","last_fullsized":"2024-03-20T13:35:30.985039+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:58.423104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986686+0000","last_change":"2024-03-20T13:34:55.951242+0000","last_active":"2024-03-20T13:35:30.986686+0000","last_peered":"2024-03-20T13:35:30.986686+0000","last_clean":"2024-03-20T13:35:30.986686+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:35:30.986686+0000","last_undegraded":"2024-03-20T13:35:30.986686+0000","last_fullsized":"2024-03-20T13:35:30.986686+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:19.540711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'243","reported_seq":319,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.211315+0000","last_change":"2024-03-20T13:34:57.969943+0000","last_active":"2024-03-20T13:36:31.211315+0000","last_peered":"2024-03-20T13:36:31.211315+0000","last_clean":"2024-03-20T13:36:31.211315+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:36:31.211315+0000","last_undegraded":"2024-03-20T13:36:31.211315+0000","last_fullsized":"2024-03-20T13:36:31.211315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:23.726307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985453+0000","last_change":"2024-03-20T13:34:59.971383+0000","last_active":"2024-03-20T13:35:30.985453+0000","last_peered":"2024-03-20T13:35:30.985453+0000","last_clean":"2024-03-20T13:35:30.985453+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:35:30.985453+0000","last_undegraded":"2024-03-20T13:35:30.985453+0000","last_fullsized":"2024-03-20T13:35:30.985453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:10.732462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.813600+0000","last_change":"2024-03-20T13:34:51.947848+0000","last_active":"2024-03-20T13:35:34.813600+0000","last_peered":"2024-03-20T13:35:34.813600+0000","last_clean":"2024-03-20T13:35:34.813600+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:35:34.813600+0000","last_undegraded":"2024-03-20T13:35:34.813600+0000","last_fullsized":"2024-03-20T13:35:34.813600+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980679+0000","last_change":"2024-03-20T13:34:49.943444+0000","last_active":"2024-03-20T13:35:30.980679+0000","last_peered":"2024-03-20T13:35:30.980679+0000","last_clean":"2024-03-20T13:35:30.980679+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:35:30.980679+0000","last_undegraded":"2024-03-20T13:35:30.980679+0000","last_fullsized":"2024-03-20T13:35:30.980679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989445+0000","last_change":"2024-03-20T13:34:53.939852+0000","last_active":"2024-03-20T13:35:30.989445+0000","last_peered":"2024-03-20T13:35:30.989445+0000","last_clean":"2024-03-20T13:35:30.989445+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:35:30.989445+0000","last_undegraded":"2024-03-20T13:35:30.989445+0000","last_fullsized":"2024-03-20T13:35:30.989445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:39:56.912941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.347906+0000","last_change":"2024-03-20T13:34:55.957753+0000","last_active":"2024-03-20T13:36:31.347906+0000","last_peered":"2024-03-20T13:36:31.347906+0000","last_clean":"2024-03-20T13:36:31.347906+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:31.347906+0000","last_undegraded":"2024-03-20T13:36:31.347906+0000","last_fullsized":"2024-03-20T13:36:31.347906+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:14.992205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":339,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.215951+0000","last_change":"2024-03-20T13:34:57.968163+0000","last_active":"2024-03-20T13:36:31.215951+0000","last_peered":"2024-03-20T13:36:31.215951+0000","last_clean":"2024-03-20T13:36:31.215951+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:31.215951+0000","last_undegraded":"2024-03-20T13:36:31.215951+0000","last_fullsized":"2024-03-20T13:36:31.215951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:49.987254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969225+0000","last_change":"2024-03-20T13:34:51.953602+0000","last_active":"2024-03-20T13:36:17.969225+0000","last_peered":"2024-03-20T13:36:17.969225+0000","last_clean":"2024-03-20T13:36:17.969225+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:36:17.969225+0000","last_undegraded":"2024-03-20T13:36:17.969225+0000","last_fullsized":"2024-03-20T13:36:17.969225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:54.019802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988845+0000","last_change":"2024-03-20T13:34:49.944500+0000","last_active":"2024-03-20T13:35:30.988845+0000","last_peered":"2024-03-20T13:35:30.988845+0000","last_clean":"2024-03-20T13:35:30.988845+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:35:30.988845+0000","last_undegraded":"2024-03-20T13:35:30.988845+0000","last_fullsized":"2024-03-20T13:35:30.988845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980677+0000","last_change":"2024-03-20T13:34:53.945355+0000","last_active":"2024-03-20T13:35:30.980677+0000","last_peered":"2024-03-20T13:35:30.980677+0000","last_clean":"2024-03-20T13:35:30.980677+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:35:30.980677+0000","last_undegraded":"2024-03-20T13:35:30.980677+0000","last_fullsized":"2024-03-20T13:35:30.980677+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'41","reported_seq":91,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.277617+0000","last_change":"2024-03-20T13:34:55.952069+0000","last_active":"2024-03-20T13:36:31.277617+0000","last_peered":"2024-03-20T13:36:31.277617+0000","last_clean":"2024-03-20T13:36:31.277617+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:31.277617+0000","last_undegraded":"2024-03-20T13:36:31.277617+0000","last_fullsized":"2024-03-20T13:36:31.277617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:43.487999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983837+0000","last_change":"2024-03-20T13:34:57.967957+0000","last_active":"2024-03-20T13:35:30.983837+0000","last_peered":"2024-03-20T13:35:30.983837+0000","last_clean":"2024-03-20T13:35:30.983837+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:35:30.983837+0000","last_undegraded":"2024-03-20T13:35:30.983837+0000","last_fullsized":"2024-03-20T13:35:30.983837+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:03:03.819479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.754329+0000","last_change":"2024-03-20T13:34:59.974067+0000","last_active":"2024-03-20T13:36:17.754329+0000","last_peered":"2024-03-20T13:36:17.754329+0000","last_clean":"2024-03-20T13:36:17.754329+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:36:17.754329+0000","last_undegraded":"2024-03-20T13:36:17.754329+0000","last_fullsized":"2024-03-20T13:36:17.754329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:57.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164674+0000","last_change":"2024-03-20T13:34:51.941910+0000","last_active":"2024-03-20T13:35:35.164674+0000","last_peered":"2024-03-20T13:35:35.164674+0000","last_clean":"2024-03-20T13:35:35.164674+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:35:35.164674+0000","last_undegraded":"2024-03-20T13:35:35.164674+0000","last_fullsized":"2024-03-20T13:35:35.164674+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:31:38.445257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.418375+0000","last_change":"2024-03-20T13:34:49.939109+0000","last_active":"2024-03-20T13:35:35.418375+0000","last_peered":"2024-03-20T13:35:35.418375+0000","last_clean":"2024-03-20T13:35:35.418375+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:35:35.418375+0000","last_undegraded":"2024-03-20T13:35:35.418375+0000","last_fullsized":"2024-03-20T13:35:35.418375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982623+0000","last_change":"2024-03-20T13:34:53.943905+0000","last_active":"2024-03-20T13:35:30.982623+0000","last_peered":"2024-03-20T13:35:30.982623+0000","last_clean":"2024-03-20T13:35:30.982623+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:35:30.982623+0000","last_undegraded":"2024-03-20T13:35:30.982623+0000","last_fullsized":"2024-03-20T13:35:30.982623+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:30:51.851311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.316931+0000","last_change":"2024-03-20T13:34:55.954351+0000","last_active":"2024-03-20T13:36:31.316931+0000","last_peered":"2024-03-20T13:36:31.316931+0000","last_clean":"2024-03-20T13:36:31.316931+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:31.316931+0000","last_undegraded":"2024-03-20T13:36:31.316931+0000","last_fullsized":"2024-03-20T13:36:31.316931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:27:04.344480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982540+0000","last_change":"2024-03-20T13:34:57.962956+0000","last_active":"2024-03-20T13:35:30.982540+0000","last_peered":"2024-03-20T13:35:30.982540+0000","last_clean":"2024-03-20T13:35:30.982540+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:35:30.982540+0000","last_undegraded":"2024-03-20T13:35:30.982540+0000","last_fullsized":"2024-03-20T13:35:30.982540+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.151593+0000","last_change":"2024-03-20T13:34:59.972444+0000","last_active":"2024-03-20T13:36:12.151593+0000","last_peered":"2024-03-20T13:36:12.151593+0000","last_clean":"2024-03-20T13:36:12.151593+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:36:12.151593+0000","last_undegraded":"2024-03-20T13:36:12.151593+0000","last_fullsized":"2024-03-20T13:36:12.151593+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:35:10.911254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'1","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309560+0000","last_change":"2024-03-20T13:34:51.941838+0000","last_active":"2024-03-20T13:36:17.309560+0000","last_peered":"2024-03-20T13:36:17.309560+0000","last_clean":"2024-03-20T13:36:17.309560+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:36:17.309560+0000","last_undegraded":"2024-03-20T13:36:17.309560+0000","last_fullsized":"2024-03-20T13:36:17.309560+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:08.971370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990186+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:35:30.990186+0000","last_peered":"2024-03-20T13:35:30.990186+0000","last_clean":"2024-03-20T13:35:30.990186+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:35:30.990186+0000","last_undegraded":"2024-03-20T13:35:30.990186+0000","last_fullsized":"2024-03-20T13:35:30.990186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:10.797692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984920+0000","last_change":"2024-03-20T13:34:53.942038+0000","last_active":"2024-03-20T13:35:30.984920+0000","last_peered":"2024-03-20T13:35:30.984920+0000","last_clean":"2024-03-20T13:35:30.984920+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:35:30.984920+0000","last_undegraded":"2024-03-20T13:35:30.984920+0000","last_fullsized":"2024-03-20T13:35:30.984920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:28.393295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.283106+0000","last_change":"2024-03-20T13:34:55.954800+0000","last_active":"2024-03-20T13:36:31.283106+0000","last_peered":"2024-03-20T13:36:31.283106+0000","last_clean":"2024-03-20T13:36:31.283106+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:31.283106+0000","last_undegraded":"2024-03-20T13:36:31.283106+0000","last_fullsized":"2024-03-20T13:36:31.283106+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:36:42.942474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":287,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.216963+0000","last_change":"2024-03-20T13:34:57.969445+0000","last_active":"2024-03-20T13:36:31.216963+0000","last_peered":"2024-03-20T13:36:31.216963+0000","last_clean":"2024-03-20T13:36:31.216963+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:31.216963+0000","last_undegraded":"2024-03-20T13:36:31.216963+0000","last_fullsized":"2024-03-20T13:36:31.216963+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:35.998538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983928+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:35:30.983928+0000","last_peered":"2024-03-20T13:35:30.983928+0000","last_clean":"2024-03-20T13:35:30.983928+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:35:30.983928+0000","last_undegraded":"2024-03-20T13:35:30.983928+0000","last_fullsized":"2024-03-20T13:35:30.983928+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:24:13.286967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986688+0000","last_change":"2024-03-20T13:34:51.935109+0000","last_active":"2024-03-20T13:35:30.986688+0000","last_peered":"2024-03-20T13:35:30.986688+0000","last_clean":"2024-03-20T13:35:30.986688+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:35:30.986688+0000","last_undegraded":"2024-03-20T13:35:30.986688+0000","last_fullsized":"2024-03-20T13:35:30.986688+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988096+0000","last_change":"2024-03-20T13:34:49.962872+0000","last_active":"2024-03-20T13:35:30.988096+0000","last_peered":"2024-03-20T13:35:30.988096+0000","last_clean":"2024-03-20T13:35:30.988096+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:35:30.988096+0000","last_undegraded":"2024-03-20T13:35:30.988096+0000","last_fullsized":"2024-03-20T13:35:30.988096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:07.620568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982955+0000","last_change":"2024-03-20T13:34:53.943850+0000","last_active":"2024-03-20T13:35:30.982955+0000","last_peered":"2024-03-20T13:35:30.982955+0000","last_clean":"2024-03-20T13:35:30.982955+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:35:30.982955+0000","last_undegraded":"2024-03-20T13:35:30.982955+0000","last_fullsized":"2024-03-20T13:35:30.982955+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:11.216414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'56","reported_seq":119,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.325579+0000","last_change":"2024-03-20T13:34:55.951028+0000","last_active":"2024-03-20T13:36:31.325579+0000","last_peered":"2024-03-20T13:36:31.325579+0000","last_clean":"2024-03-20T13:36:31.325579+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:31.325579+0000","last_undegraded":"2024-03-20T13:36:31.325579+0000","last_fullsized":"2024-03-20T13:36:31.325579+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:26:57.615475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982468+0000","last_change":"2024-03-20T13:34:57.962288+0000","last_active":"2024-03-20T13:35:30.982468+0000","last_peered":"2024-03-20T13:35:30.982468+0000","last_clean":"2024-03-20T13:35:30.982468+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:35:30.982468+0000","last_undegraded":"2024-03-20T13:35:30.982468+0000","last_fullsized":"2024-03-20T13:35:30.982468+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985030+0000","last_change":"2024-03-20T13:34:59.966660+0000","last_active":"2024-03-20T13:35:30.985030+0000","last_peered":"2024-03-20T13:35:30.985030+0000","last_clean":"2024-03-20T13:35:30.985030+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:35:30.985030+0000","last_undegraded":"2024-03-20T13:35:30.985030+0000","last_fullsized":"2024-03-20T13:35:30.985030+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:58:19.864210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.812450+0000","last_change":"2024-03-20T13:34:51.943562+0000","last_active":"2024-03-20T13:35:34.812450+0000","last_peered":"2024-03-20T13:35:34.812450+0000","last_clean":"2024-03-20T13:35:34.812450+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:35:34.812450+0000","last_undegraded":"2024-03-20T13:35:34.812450+0000","last_fullsized":"2024-03-20T13:35:34.812450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983744+0000","last_change":"2024-03-20T13:34:49.933792+0000","last_active":"2024-03-20T13:35:30.983744+0000","last_peered":"2024-03-20T13:35:30.983744+0000","last_clean":"2024-03-20T13:35:30.983744+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:35:30.983744+0000","last_undegraded":"2024-03-20T13:35:30.983744+0000","last_fullsized":"2024-03-20T13:35:30.983744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":201,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.183376+0000","last_change":"2024-03-20T13:34:53.944673+0000","last_active":"2024-03-20T13:36:31.183376+0000","last_peered":"2024-03-20T13:36:31.183376+0000","last_clean":"2024-03-20T13:36:31.183376+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:31.183376+0000","last_undegraded":"2024-03-20T13:36:31.183376+0000","last_fullsized":"2024-03-20T13:36:31.183376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:36.699424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.328629+0000","last_change":"2024-03-20T13:34:55.952299+0000","last_active":"2024-03-20T13:36:31.328629+0000","last_peered":"2024-03-20T13:36:31.328629+0000","last_clean":"2024-03-20T13:36:31.328629+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:31.328629+0000","last_undegraded":"2024-03-20T13:36:31.328629+0000","last_fullsized":"2024-03-20T13:36:31.328629+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:26:51.439053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989229+0000","last_change":"2024-03-20T13:34:57.962715+0000","last_active":"2024-03-20T13:35:30.989229+0000","last_peered":"2024-03-20T13:35:30.989229+0000","last_clean":"2024-03-20T13:35:30.989229+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:35:30.989229+0000","last_undegraded":"2024-03-20T13:35:30.989229+0000","last_fullsized":"2024-03-20T13:35:30.989229+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:03.988490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.263192+0000","last_change":"2024-03-20T13:34:59.971713+0000","last_active":"2024-03-20T13:36:12.263192+0000","last_peered":"2024-03-20T13:36:12.263192+0000","last_clean":"2024-03-20T13:36:12.263192+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:36:12.263192+0000","last_undegraded":"2024-03-20T13:36:12.263192+0000","last_fullsized":"2024-03-20T13:36:12.263192+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:17.405294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969186+0000","last_change":"2024-03-20T13:35:30.988681+0000","last_active":"2024-03-20T13:36:17.969186+0000","last_peered":"2024-03-20T13:36:17.969186+0000","last_clean":"2024-03-20T13:36:17.969186+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:36:17.969186+0000","last_undegraded":"2024-03-20T13:36:17.969186+0000","last_fullsized":"2024-03-20T13:36:17.969186+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:48.425990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986833+0000","last_change":"2024-03-20T13:34:49.958288+0000","last_active":"2024-03-20T13:35:30.986833+0000","last_peered":"2024-03-20T13:35:30.986833+0000","last_clean":"2024-03-20T13:35:30.986833+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:35:30.986833+0000","last_undegraded":"2024-03-20T13:35:30.986833+0000","last_fullsized":"2024-03-20T13:35:30.986833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:55.228134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983298+0000","last_change":"2024-03-20T13:34:53.943738+0000","last_active":"2024-03-20T13:35:30.983298+0000","last_peered":"2024-03-20T13:35:30.983298+0000","last_clean":"2024-03-20T13:35:30.983298+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:35:30.983298+0000","last_undegraded":"2024-03-20T13:35:30.983298+0000","last_fullsized":"2024-03-20T13:35:30.983298+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:23.427825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.308006+0000","last_change":"2024-03-20T13:34:55.948943+0000","last_active":"2024-03-20T13:36:31.308006+0000","last_peered":"2024-03-20T13:36:31.308006+0000","last_clean":"2024-03-20T13:36:31.308006+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:31.308006+0000","last_undegraded":"2024-03-20T13:36:31.308006+0000","last_fullsized":"2024-03-20T13:36:31.308006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:58.033611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.212409+0000","last_change":"2024-03-20T13:34:57.967289+0000","last_active":"2024-03-20T13:36:31.212409+0000","last_peered":"2024-03-20T13:36:31.212409+0000","last_clean":"2024-03-20T13:36:31.212409+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:31.212409+0000","last_undegraded":"2024-03-20T13:36:31.212409+0000","last_fullsized":"2024-03-20T13:36:31.212409+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:24.412437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.980936+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:17.980936+0000","last_peered":"2024-03-20T13:36:17.980936+0000","last_clean":"2024-03-20T13:36:17.980936+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:17.980936+0000","last_undegraded":"2024-03-20T13:36:17.980936+0000","last_fullsized":"2024-03-20T13:36:17.980936+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989507+0000","last_change":"2024-03-20T13:34:51.942028+0000","last_active":"2024-03-20T13:35:30.989507+0000","last_peered":"2024-03-20T13:35:30.989507+0000","last_clean":"2024-03-20T13:35:30.989507+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:35:30.989507+0000","last_undegraded":"2024-03-20T13:35:30.989507+0000","last_fullsized":"2024-03-20T13:35:30.989507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986721+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:35:30.986721+0000","last_peered":"2024-03-20T13:35:30.986721+0000","last_clean":"2024-03-20T13:35:30.986721+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:35:30.986721+0000","last_undegraded":"2024-03-20T13:35:30.986721+0000","last_fullsized":"2024-03-20T13:35:30.986721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:29.800421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'3","reported_seq":363,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.194180+0000","last_change":"2024-03-20T13:34:53.942494+0000","last_active":"2024-03-20T13:36:31.194180+0000","last_peered":"2024-03-20T13:36:31.194180+0000","last_clean":"2024-03-20T13:36:31.194180+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:31.194180+0000","last_undegraded":"2024-03-20T13:36:31.194180+0000","last_fullsized":"2024-03-20T13:36:31.194180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:46.477351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989550+0000","last_change":"2024-03-20T13:34:55.953548+0000","last_active":"2024-03-20T13:35:30.989550+0000","last_peered":"2024-03-20T13:35:30.989550+0000","last_clean":"2024-03-20T13:35:30.989550+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:35:30.989550+0000","last_undegraded":"2024-03-20T13:35:30.989550+0000","last_fullsized":"2024-03-20T13:35:30.989550+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:54:51.879036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":338,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.213578+0000","last_change":"2024-03-20T13:34:57.961142+0000","last_active":"2024-03-20T13:36:31.213578+0000","last_peered":"2024-03-20T13:36:31.213578+0000","last_clean":"2024-03-20T13:36:31.213578+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:31.213578+0000","last_undegraded":"2024-03-20T13:36:31.213578+0000","last_fullsized":"2024-03-20T13:36:31.213578+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984851+0000","last_change":"2024-03-20T13:34:59.973435+0000","last_active":"2024-03-20T13:35:30.984851+0000","last_peered":"2024-03-20T13:35:30.984851+0000","last_clean":"2024-03-20T13:35:30.984851+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:35:30.984851+0000","last_undegraded":"2024-03-20T13:35:30.984851+0000","last_fullsized":"2024-03-20T13:35:30.984851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:02.537560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.957248+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984276+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:35:30.984276+0000","last_peered":"2024-03-20T13:35:30.984276+0000","last_clean":"2024-03-20T13:35:30.984276+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:35:30.984276+0000","last_undegraded":"2024-03-20T13:35:30.984276+0000","last_fullsized":"2024-03-20T13:35:30.984276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:13:57.917330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988824+0000","last_change":"2024-03-20T13:34:53.944868+0000","last_active":"2024-03-20T13:35:30.988824+0000","last_peered":"2024-03-20T13:35:30.988824+0000","last_clean":"2024-03-20T13:35:30.988824+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:35:30.988824+0000","last_undegraded":"2024-03-20T13:35:30.988824+0000","last_fullsized":"2024-03-20T13:35:30.988824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'39","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.268155+0000","last_change":"2024-03-20T13:34:55.953350+0000","last_active":"2024-03-20T13:36:31.268155+0000","last_peered":"2024-03-20T13:36:31.268155+0000","last_clean":"2024-03-20T13:36:31.268155+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:31.268155+0000","last_undegraded":"2024-03-20T13:36:31.268155+0000","last_fullsized":"2024-03-20T13:36:31.268155+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:50.265808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986529+0000","last_change":"2024-03-20T13:34:57.966451+0000","last_active":"2024-03-20T13:35:30.986529+0000","last_peered":"2024-03-20T13:35:30.986529+0000","last_clean":"2024-03-20T13:35:30.986529+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:35:30.986529+0000","last_undegraded":"2024-03-20T13:35:30.986529+0000","last_fullsized":"2024-03-20T13:35:30.986529+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:08.191295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981156+0000","last_change":"2024-03-20T13:34:59.968783+0000","last_active":"2024-03-20T13:35:30.981156+0000","last_peered":"2024-03-20T13:35:30.981156+0000","last_clean":"2024-03-20T13:35:30.981156+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:35:30.981156+0000","last_undegraded":"2024-03-20T13:35:30.981156+0000","last_fullsized":"2024-03-20T13:35:30.981156+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.660196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990368+0000","last_change":"2024-03-20T13:34:51.954171+0000","last_active":"2024-03-20T13:35:30.990368+0000","last_peered":"2024-03-20T13:35:30.990368+0000","last_clean":"2024-03-20T13:35:30.990368+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:35:30.990368+0000","last_undegraded":"2024-03-20T13:35:30.990368+0000","last_fullsized":"2024-03-20T13:35:30.990368+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:02.169329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":203,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980467+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:35:30.980467+0000","last_peered":"2024-03-20T13:35:30.980467+0000","last_clean":"2024-03-20T13:35:30.980467+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:35:30.980467+0000","last_undegraded":"2024-03-20T13:35:30.980467+0000","last_fullsized":"2024-03-20T13:35:30.980467+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:19.105808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987720+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:35:30.987720+0000","last_peered":"2024-03-20T13:35:30.987720+0000","last_clean":"2024-03-20T13:35:30.987720+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:35:30.987720+0000","last_undegraded":"2024-03-20T13:35:30.987720+0000","last_fullsized":"2024-03-20T13:35:30.987720+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:56.825560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985917+0000","last_change":"2024-03-20T13:34:49.963030+0000","last_active":"2024-03-20T13:35:30.985917+0000","last_peered":"2024-03-20T13:35:30.985917+0000","last_clean":"2024-03-20T13:35:30.985917+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:35:30.985917+0000","last_undegraded":"2024-03-20T13:35:30.985917+0000","last_fullsized":"2024-03-20T13:35:30.985917+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:34:06.964032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981550+0000","last_change":"2024-03-20T13:34:53.940877+0000","last_active":"2024-03-20T13:35:30.981550+0000","last_peered":"2024-03-20T13:35:30.981550+0000","last_clean":"2024-03-20T13:35:30.981550+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:35:30.981550+0000","last_undegraded":"2024-03-20T13:35:30.981550+0000","last_fullsized":"2024-03-20T13:35:30.981550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:43.553501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'80","reported_seq":160,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.301743+0000","last_change":"2024-03-20T13:34:55.954716+0000","last_active":"2024-03-20T13:36:31.301743+0000","last_peered":"2024-03-20T13:36:31.301743+0000","last_clean":"2024-03-20T13:36:31.301743+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:31.301743+0000","last_undegraded":"2024-03-20T13:36:31.301743+0000","last_fullsized":"2024-03-20T13:36:31.301743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:21:49.386776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984143+0000","last_change":"2024-03-20T13:34:57.961066+0000","last_active":"2024-03-20T13:35:30.984143+0000","last_peered":"2024-03-20T13:35:30.984143+0000","last_clean":"2024-03-20T13:35:30.984143+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:35:30.984143+0000","last_undegraded":"2024-03-20T13:35:30.984143+0000","last_fullsized":"2024-03-20T13:35:30.984143+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:54.447957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":111,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.580959+0000","last_change":"2024-03-20T13:34:59.973427+0000","last_active":"2024-03-20T13:36:23.580959+0000","last_peered":"2024-03-20T13:36:23.580959+0000","last_clean":"2024-03-20T13:36:23.580959+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:23.580959+0000","last_undegraded":"2024-03-20T13:36:23.580959+0000","last_fullsized":"2024-03-20T13:36:23.580959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:32.618548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989266+0000","last_change":"2024-03-20T13:34:51.941170+0000","last_active":"2024-03-20T13:35:30.989266+0000","last_peered":"2024-03-20T13:35:30.989266+0000","last_clean":"2024-03-20T13:35:30.989266+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:35:30.989266+0000","last_undegraded":"2024-03-20T13:35:30.989266+0000","last_fullsized":"2024-03-20T13:35:30.989266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:10.744416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983697+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:35:30.983697+0000","last_peered":"2024-03-20T13:35:30.983697+0000","last_clean":"2024-03-20T13:35:30.983697+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:35:30.983697+0000","last_undegraded":"2024-03-20T13:35:30.983697+0000","last_fullsized":"2024-03-20T13:35:30.983697+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:50:32.764565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982480+0000","last_change":"2024-03-20T13:34:49.941798+0000","last_active":"2024-03-20T13:35:30.982480+0000","last_peered":"2024-03-20T13:35:30.982480+0000","last_clean":"2024-03-20T13:35:30.982480+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:35:30.982480+0000","last_undegraded":"2024-03-20T13:35:30.982480+0000","last_fullsized":"2024-03-20T13:35:30.982480+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990445+0000","last_change":"2024-03-20T13:34:53.941487+0000","last_active":"2024-03-20T13:35:30.990445+0000","last_peered":"2024-03-20T13:35:30.990445+0000","last_clean":"2024-03-20T13:35:30.990445+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:35:30.990445+0000","last_undegraded":"2024-03-20T13:35:30.990445+0000","last_fullsized":"2024-03-20T13:35:30.990445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'250","reported_seq":432,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.320845+0000","last_change":"2024-03-20T13:34:55.956289+0000","last_active":"2024-03-20T13:36:31.320845+0000","last_peered":"2024-03-20T13:36:31.320845+0000","last_clean":"2024-03-20T13:36:31.320845+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:31.320845+0000","last_undegraded":"2024-03-20T13:36:31.320845+0000","last_fullsized":"2024-03-20T13:36:31.320845+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":250,"log_dups_size":0,"ondisk_log_size":250,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:14.758225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987849+0000","last_change":"2024-03-20T13:34:57.964648+0000","last_active":"2024-03-20T13:35:30.987849+0000","last_peered":"2024-03-20T13:35:30.987849+0000","last_clean":"2024-03-20T13:35:30.987849+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:35:30.987849+0000","last_undegraded":"2024-03-20T13:35:30.987849+0000","last_fullsized":"2024-03-20T13:35:30.987849+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:16:41.477827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.276503+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:12.276503+0000","last_peered":"2024-03-20T13:36:12.276503+0000","last_clean":"2024-03-20T13:36:12.276503+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:12.276503+0000","last_undegraded":"2024-03-20T13:36:12.276503+0000","last_fullsized":"2024-03-20T13:36:12.276503+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:25:01.400446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969323+0000","last_change":"2024-03-20T13:34:51.947812+0000","last_active":"2024-03-20T13:36:17.969323+0000","last_peered":"2024-03-20T13:36:17.969323+0000","last_clean":"2024-03-20T13:36:17.969323+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:36:17.969323+0000","last_undegraded":"2024-03-20T13:36:17.969323+0000","last_fullsized":"2024-03-20T13:36:17.969323+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985007+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:35:30.985007+0000","last_peered":"2024-03-20T13:35:30.985007+0000","last_clean":"2024-03-20T13:35:30.985007+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:35:30.985007+0000","last_undegraded":"2024-03-20T13:35:30.985007+0000","last_fullsized":"2024-03-20T13:35:30.985007+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:12:15.378385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982056+0000","last_change":"2024-03-20T13:34:49.934321+0000","last_active":"2024-03-20T13:35:30.982056+0000","last_peered":"2024-03-20T13:35:30.982056+0000","last_clean":"2024-03-20T13:35:30.982056+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:35:30.982056+0000","last_undegraded":"2024-03-20T13:35:30.982056+0000","last_fullsized":"2024-03-20T13:35:30.982056+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988938+0000","last_change":"2024-03-20T13:34:53.943172+0000","last_active":"2024-03-20T13:35:30.988938+0000","last_peered":"2024-03-20T13:35:30.988938+0000","last_clean":"2024-03-20T13:35:30.988938+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:35:30.988938+0000","last_undegraded":"2024-03-20T13:35:30.988938+0000","last_fullsized":"2024-03-20T13:35:30.988938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:28.432587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'16","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.002508+0000","last_change":"2024-03-20T13:34:55.954133+0000","last_active":"2024-03-20T13:36:24.002508+0000","last_peered":"2024-03-20T13:36:24.002508+0000","last_clean":"2024-03-20T13:36:24.002508+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:24.002508+0000","last_undegraded":"2024-03-20T13:36:24.002508+0000","last_fullsized":"2024-03-20T13:36:24.002508+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:47.638285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983783+0000","last_change":"2024-03-20T13:34:57.961111+0000","last_active":"2024-03-20T13:35:30.983783+0000","last_peered":"2024-03-20T13:35:30.983783+0000","last_clean":"2024-03-20T13:35:30.983783+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:35:30.983783+0000","last_undegraded":"2024-03-20T13:35:30.983783+0000","last_fullsized":"2024-03-20T13:35:30.983783+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:46:59.940736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986127+0000","last_change":"2024-03-20T13:34:59.970194+0000","last_active":"2024-03-20T13:35:30.986127+0000","last_peered":"2024-03-20T13:35:30.986127+0000","last_clean":"2024-03-20T13:35:30.986127+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:35:30.986127+0000","last_undegraded":"2024-03-20T13:35:30.986127+0000","last_fullsized":"2024-03-20T13:35:30.986127+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:45:19.139667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568296+0000","last_change":"2024-03-20T13:34:51.937043+0000","last_active":"2024-03-20T13:36:23.568296+0000","last_peered":"2024-03-20T13:36:23.568296+0000","last_clean":"2024-03-20T13:36:23.568296+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:36:23.568296+0000","last_undegraded":"2024-03-20T13:36:23.568296+0000","last_fullsized":"2024-03-20T13:36:23.568296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985645+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:35:30.985645+0000","last_peered":"2024-03-20T13:35:30.985645+0000","last_clean":"2024-03-20T13:35:30.985645+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:35:30.985645+0000","last_undegraded":"2024-03-20T13:35:30.985645+0000","last_fullsized":"2024-03-20T13:35:30.985645+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:55:41.281803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987595+0000","last_change":"2024-03-20T13:34:49.938266+0000","last_active":"2024-03-20T13:35:30.987595+0000","last_peered":"2024-03-20T13:35:30.987595+0000","last_clean":"2024-03-20T13:35:30.987595+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:35:30.987595+0000","last_undegraded":"2024-03-20T13:35:30.987595+0000","last_fullsized":"2024-03-20T13:35:30.987595+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983933+0000","last_change":"2024-03-20T13:34:53.942835+0000","last_active":"2024-03-20T13:35:30.983933+0000","last_peered":"2024-03-20T13:35:30.983933+0000","last_clean":"2024-03-20T13:35:30.983933+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:35:30.983933+0000","last_undegraded":"2024-03-20T13:35:30.983933+0000","last_fullsized":"2024-03-20T13:35:30.983933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:41.480924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988052+0000","last_change":"2024-03-20T13:34:55.955766+0000","last_active":"2024-03-20T13:35:30.988052+0000","last_peered":"2024-03-20T13:35:30.988052+0000","last_clean":"2024-03-20T13:35:30.988052+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:35:30.988052+0000","last_undegraded":"2024-03-20T13:35:30.988052+0000","last_fullsized":"2024-03-20T13:35:30.988052+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:04:28.399469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989373+0000","last_change":"2024-03-20T13:34:57.962510+0000","last_active":"2024-03-20T13:35:30.989373+0000","last_peered":"2024-03-20T13:35:30.989373+0000","last_clean":"2024-03-20T13:35:30.989373+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:35:30.989373+0000","last_undegraded":"2024-03-20T13:35:30.989373+0000","last_fullsized":"2024-03-20T13:35:30.989373+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:19:20.491130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982121+0000","last_change":"2024-03-20T13:34:59.972480+0000","last_active":"2024-03-20T13:35:30.982121+0000","last_peered":"2024-03-20T13:35:30.982121+0000","last_clean":"2024-03-20T13:35:30.982121+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:35:30.982121+0000","last_undegraded":"2024-03-20T13:35:30.982121+0000","last_fullsized":"2024-03-20T13:35:30.982121+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:37.262606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612699+0000","last_change":"2024-03-20T13:34:51.950770+0000","last_active":"2024-03-20T13:36:17.612699+0000","last_peered":"2024-03-20T13:36:17.612699+0000","last_clean":"2024-03-20T13:36:17.612699+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:17.612699+0000","last_undegraded":"2024-03-20T13:36:17.612699+0000","last_fullsized":"2024-03-20T13:36:17.612699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:39:26.425854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986795+0000","last_change":"2024-03-20T13:34:49.936614+0000","last_active":"2024-03-20T13:35:30.986795+0000","last_peered":"2024-03-20T13:35:30.986795+0000","last_clean":"2024-03-20T13:35:30.986795+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:35:30.986795+0000","last_undegraded":"2024-03-20T13:35:30.986795+0000","last_fullsized":"2024-03-20T13:35:30.986795+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.192210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983575+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:35:30.983575+0000","last_peered":"2024-03-20T13:35:30.983575+0000","last_clean":"2024-03-20T13:35:30.983575+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:35:30.983575+0000","last_undegraded":"2024-03-20T13:35:30.983575+0000","last_fullsized":"2024-03-20T13:35:30.983575+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:35.147814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.184735+0000","last_change":"2024-03-20T13:34:53.942462+0000","last_active":"2024-03-20T13:36:31.184735+0000","last_peered":"2024-03-20T13:36:31.184735+0000","last_clean":"2024-03-20T13:36:31.184735+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:31.184735+0000","last_undegraded":"2024-03-20T13:36:31.184735+0000","last_fullsized":"2024-03-20T13:36:31.184735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:17.533635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'62","reported_seq":128,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.351248+0000","last_change":"2024-03-20T13:34:55.955509+0000","last_active":"2024-03-20T13:36:31.351248+0000","last_peered":"2024-03-20T13:36:31.351248+0000","last_clean":"2024-03-20T13:36:31.351248+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:31.351248+0000","last_undegraded":"2024-03-20T13:36:31.351248+0000","last_fullsized":"2024-03-20T13:36:31.351248+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:22.404279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985626+0000","last_change":"2024-03-20T13:34:57.966334+0000","last_active":"2024-03-20T13:35:30.985626+0000","last_peered":"2024-03-20T13:35:30.985626+0000","last_clean":"2024-03-20T13:35:30.985626+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:35:30.985626+0000","last_undegraded":"2024-03-20T13:35:30.985626+0000","last_fullsized":"2024-03-20T13:35:30.985626+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:48:16.766382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.956419+0000","last_change":"2024-03-20T13:34:59.968897+0000","last_active":"2024-03-20T13:36:17.956419+0000","last_peered":"2024-03-20T13:36:17.956419+0000","last_clean":"2024-03-20T13:36:17.956419+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:36:17.956419+0000","last_undegraded":"2024-03-20T13:36:17.956419+0000","last_fullsized":"2024-03-20T13:36:17.956419+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:15:14.952118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980915+0000","last_change":"2024-03-20T13:34:51.941739+0000","last_active":"2024-03-20T13:35:30.980915+0000","last_peered":"2024-03-20T13:35:30.980915+0000","last_clean":"2024-03-20T13:35:30.980915+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:35:30.980915+0000","last_undegraded":"2024-03-20T13:35:30.980915+0000","last_fullsized":"2024-03-20T13:35:30.980915+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:50.899013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984034+0000","last_change":"2024-03-20T13:34:49.946734+0000","last_active":"2024-03-20T13:35:30.984034+0000","last_peered":"2024-03-20T13:35:30.984034+0000","last_clean":"2024-03-20T13:35:30.984034+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:35:30.984034+0000","last_undegraded":"2024-03-20T13:35:30.984034+0000","last_fullsized":"2024-03-20T13:35:30.984034+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:15:30.182060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988794+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:35:30.988794+0000","last_peered":"2024-03-20T13:35:30.988794+0000","last_clean":"2024-03-20T13:35:30.988794+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:35:30.988794+0000","last_undegraded":"2024-03-20T13:35:30.988794+0000","last_fullsized":"2024-03-20T13:35:30.988794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:29.981275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985463+0000","last_change":"2024-03-20T13:34:53.941252+0000","last_active":"2024-03-20T13:35:30.985463+0000","last_peered":"2024-03-20T13:35:30.985463+0000","last_clean":"2024-03-20T13:35:30.985463+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:35:30.985463+0000","last_undegraded":"2024-03-20T13:35:30.985463+0000","last_fullsized":"2024-03-20T13:35:30.985463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:05:45.972021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"30'14","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980973+0000","last_change":"2024-03-20T13:34:55.956604+0000","last_active":"2024-03-20T13:35:30.980973+0000","last_peered":"2024-03-20T13:35:30.980973+0000","last_clean":"2024-03-20T13:35:30.980973+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:35:30.980973+0000","last_undegraded":"2024-03-20T13:35:30.980973+0000","last_fullsized":"2024-03-20T13:35:30.980973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:22:06.183137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":281,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.209896+0000","last_change":"2024-03-20T13:34:57.962603+0000","last_active":"2024-03-20T13:36:31.209896+0000","last_peered":"2024-03-20T13:36:31.209896+0000","last_clean":"2024-03-20T13:36:31.209896+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:31.209896+0000","last_undegraded":"2024-03-20T13:36:31.209896+0000","last_fullsized":"2024-03-20T13:36:31.209896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:58:55.219867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.166687+0000","last_change":"2024-03-20T13:34:59.965966+0000","last_active":"2024-03-20T13:35:35.166687+0000","last_peered":"2024-03-20T13:35:35.166687+0000","last_clean":"2024-03-20T13:35:35.166687+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:35:35.166687+0000","last_undegraded":"2024-03-20T13:35:35.166687+0000","last_fullsized":"2024-03-20T13:35:35.166687+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:32:13.594344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984374+0000","last_change":"2024-03-20T13:34:51.955616+0000","last_active":"2024-03-20T13:35:30.984374+0000","last_peered":"2024-03-20T13:35:30.984374+0000","last_clean":"2024-03-20T13:35:30.984374+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:35:30.984374+0000","last_undegraded":"2024-03-20T13:35:30.984374+0000","last_fullsized":"2024-03-20T13:35:30.984374+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:30.569867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990294+0000","last_change":"2024-03-20T13:34:49.957658+0000","last_active":"2024-03-20T13:35:30.990294+0000","last_peered":"2024-03-20T13:35:30.990294+0000","last_clean":"2024-03-20T13:35:30.990294+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:35:30.990294+0000","last_undegraded":"2024-03-20T13:35:30.990294+0000","last_fullsized":"2024-03-20T13:35:30.990294+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:02:35.010181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984370+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:35:30.984370+0000","last_peered":"2024-03-20T13:35:30.984370+0000","last_clean":"2024-03-20T13:35:30.984370+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:35:30.984370+0000","last_undegraded":"2024-03-20T13:35:30.984370+0000","last_fullsized":"2024-03-20T13:35:30.984370+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:29:46.424197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990699+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:35:30.990699+0000","last_peered":"2024-03-20T13:35:30.990699+0000","last_clean":"2024-03-20T13:35:30.990699+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:35:30.990699+0000","last_undegraded":"2024-03-20T13:35:30.990699+0000","last_fullsized":"2024-03-20T13:35:30.990699+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:35.641007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986513+0000","last_change":"2024-03-20T13:34:55.955147+0000","last_active":"2024-03-20T13:35:30.986513+0000","last_peered":"2024-03-20T13:35:30.986513+0000","last_clean":"2024-03-20T13:35:30.986513+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:35:30.986513+0000","last_undegraded":"2024-03-20T13:35:30.986513+0000","last_fullsized":"2024-03-20T13:35:30.986513+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:58.497049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":320,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.214741+0000","last_change":"2024-03-20T13:34:57.967987+0000","last_active":"2024-03-20T13:36:31.214741+0000","last_peered":"2024-03-20T13:36:31.214741+0000","last_clean":"2024-03-20T13:36:31.214741+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:31.214741+0000","last_undegraded":"2024-03-20T13:36:31.214741+0000","last_fullsized":"2024-03-20T13:36:31.214741+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981031+0000","last_change":"2024-03-20T13:34:59.968359+0000","last_active":"2024-03-20T13:35:30.981031+0000","last_peered":"2024-03-20T13:35:30.981031+0000","last_clean":"2024-03-20T13:35:30.981031+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:35:30.981031+0000","last_undegraded":"2024-03-20T13:35:30.981031+0000","last_fullsized":"2024-03-20T13:35:30.981031+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:40.280747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164886+0000","last_change":"2024-03-20T13:34:51.944433+0000","last_active":"2024-03-20T13:35:35.164886+0000","last_peered":"2024-03-20T13:35:35.164886+0000","last_clean":"2024-03-20T13:35:35.164886+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:35:35.164886+0000","last_undegraded":"2024-03-20T13:35:35.164886+0000","last_fullsized":"2024-03-20T13:35:35.164886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:40:57.235472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982049+0000","last_change":"2024-03-20T13:34:49.947597+0000","last_active":"2024-03-20T13:35:30.982049+0000","last_peered":"2024-03-20T13:35:30.982049+0000","last_clean":"2024-03-20T13:35:30.982049+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:35:30.982049+0000","last_undegraded":"2024-03-20T13:35:30.982049+0000","last_fullsized":"2024-03-20T13:35:30.982049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:23.483200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989275+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:35:30.989275+0000","last_peered":"2024-03-20T13:35:30.989275+0000","last_clean":"2024-03-20T13:35:30.989275+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:35:30.989275+0000","last_undegraded":"2024-03-20T13:35:30.989275+0000","last_fullsized":"2024-03-20T13:35:30.989275+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:45:53.016765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984914+0000","last_change":"2024-03-20T13:34:53.941526+0000","last_active":"2024-03-20T13:35:30.984914+0000","last_peered":"2024-03-20T13:35:30.984914+0000","last_clean":"2024-03-20T13:35:30.984914+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:35:30.984914+0000","last_undegraded":"2024-03-20T13:35:30.984914+0000","last_fullsized":"2024-03-20T13:35:30.984914+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:01:50.432723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'86","reported_seq":169,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.340797+0000","last_change":"2024-03-20T13:34:55.956339+0000","last_active":"2024-03-20T13:36:31.340797+0000","last_peered":"2024-03-20T13:36:31.340797+0000","last_clean":"2024-03-20T13:36:31.340797+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:31.340797+0000","last_undegraded":"2024-03-20T13:36:31.340797+0000","last_fullsized":"2024-03-20T13:36:31.340797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:37:00.430180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983193+0000","last_change":"2024-03-20T13:34:57.962327+0000","last_active":"2024-03-20T13:35:30.983193+0000","last_peered":"2024-03-20T13:35:30.983193+0000","last_clean":"2024-03-20T13:35:30.983193+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:35:30.983193+0000","last_undegraded":"2024-03-20T13:35:30.983193+0000","last_fullsized":"2024-03-20T13:35:30.983193+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:56.058663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988480+0000","last_change":"2024-03-20T13:34:59.972683+0000","last_active":"2024-03-20T13:35:30.988480+0000","last_peered":"2024-03-20T13:35:30.988480+0000","last_clean":"2024-03-20T13:35:30.988480+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:35:30.988480+0000","last_undegraded":"2024-03-20T13:35:30.988480+0000","last_fullsized":"2024-03-20T13:35:30.988480+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:59.288382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988291+0000","last_change":"2024-03-20T13:34:59.970132+0000","last_active":"2024-03-20T13:35:30.988291+0000","last_peered":"2024-03-20T13:35:30.988291+0000","last_clean":"2024-03-20T13:35:30.988291+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:35:30.988291+0000","last_undegraded":"2024-03-20T13:35:30.988291+0000","last_fullsized":"2024-03-20T13:35:30.988291+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:53:38.005851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568412+0000","last_change":"2024-03-20T13:34:51.943309+0000","last_active":"2024-03-20T13:36:23.568412+0000","last_peered":"2024-03-20T13:36:23.568412+0000","last_clean":"2024-03-20T13:36:23.568412+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:36:23.568412+0000","last_undegraded":"2024-03-20T13:36:23.568412+0000","last_fullsized":"2024-03-20T13:36:23.568412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988151+0000","last_change":"2024-03-20T13:34:49.960700+0000","last_active":"2024-03-20T13:35:30.988151+0000","last_peered":"2024-03-20T13:35:30.988151+0000","last_clean":"2024-03-20T13:35:30.988151+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:35:30.988151+0000","last_undegraded":"2024-03-20T13:35:30.988151+0000","last_fullsized":"2024-03-20T13:35:30.988151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:08.663709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983120+0000","last_change":"2024-03-20T13:34:53.941620+0000","last_active":"2024-03-20T13:35:30.983120+0000","last_peered":"2024-03-20T13:35:30.983120+0000","last_clean":"2024-03-20T13:35:30.983120+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:35:30.983120+0000","last_undegraded":"2024-03-20T13:35:30.983120+0000","last_fullsized":"2024-03-20T13:35:30.983120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:02.878465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.280327+0000","last_change":"2024-03-20T13:34:55.955235+0000","last_active":"2024-03-20T13:36:31.280327+0000","last_peered":"2024-03-20T13:36:31.280327+0000","last_clean":"2024-03-20T13:36:31.280327+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:36:31.280327+0000","last_undegraded":"2024-03-20T13:36:31.280327+0000","last_fullsized":"2024-03-20T13:36:31.280327+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:41:19.438768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984712+0000","last_change":"2024-03-20T13:34:57.968867+0000","last_active":"2024-03-20T13:35:30.984712+0000","last_peered":"2024-03-20T13:35:30.984712+0000","last_clean":"2024-03-20T13:35:30.984712+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:35:30.984712+0000","last_undegraded":"2024-03-20T13:35:30.984712+0000","last_fullsized":"2024-03-20T13:35:30.984712+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:46.842366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983754+0000","last_change":"2024-03-20T13:34:59.966513+0000","last_active":"2024-03-20T13:35:30.983754+0000","last_peered":"2024-03-20T13:35:30.983754+0000","last_clean":"2024-03-20T13:35:30.983754+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:35:30.983754+0000","last_undegraded":"2024-03-20T13:35:30.983754+0000","last_fullsized":"2024-03-20T13:35:30.983754+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:49:18.685347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568783+0000","last_change":"2024-03-20T13:34:51.944041+0000","last_active":"2024-03-20T13:36:23.568783+0000","last_peered":"2024-03-20T13:36:23.568783+0000","last_clean":"2024-03-20T13:36:23.568783+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:36:23.568783+0000","last_undegraded":"2024-03-20T13:36:23.568783+0000","last_fullsized":"2024-03-20T13:36:23.568783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:34:34.692691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.563792+0000","last_change":"2024-03-20T13:34:49.950884+0000","last_active":"2024-03-20T13:36:23.563792+0000","last_peered":"2024-03-20T13:36:23.563792+0000","last_clean":"2024-03-20T13:36:23.563792+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:36:23.563792+0000","last_undegraded":"2024-03-20T13:36:23.563792+0000","last_fullsized":"2024-03-20T13:36:23.563792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991514+0000","last_change":"2024-03-20T13:35:30.990765+0000","last_active":"2024-03-20T13:35:30.991514+0000","last_peered":"2024-03-20T13:35:30.991514+0000","last_clean":"2024-03-20T13:35:30.991514+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:35:30.991514+0000","last_undegraded":"2024-03-20T13:35:30.991514+0000","last_fullsized":"2024-03-20T13:35:30.991514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:42:17.261365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'7","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:11.082910+0000","last_change":"2024-03-20T13:34:55.949038+0000","last_active":"2024-03-20T13:36:11.082910+0000","last_peered":"2024-03-20T13:36:11.082910+0000","last_clean":"2024-03-20T13:36:11.082910+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:11.082910+0000","last_undegraded":"2024-03-20T13:36:11.082910+0000","last_fullsized":"2024-03-20T13:36:11.082910+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:02.651523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985168+0000","last_change":"2024-03-20T13:34:57.970496+0000","last_active":"2024-03-20T13:35:30.985168+0000","last_peered":"2024-03-20T13:35:30.985168+0000","last_clean":"2024-03-20T13:35:30.985168+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:35:30.985168+0000","last_undegraded":"2024-03-20T13:35:30.985168+0000","last_fullsized":"2024-03-20T13:35:30.985168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:16.785640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983405+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:35:30.983405+0000","last_peered":"2024-03-20T13:35:30.983405+0000","last_clean":"2024-03-20T13:35:30.983405+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:35:30.983405+0000","last_undegraded":"2024-03-20T13:35:30.983405+0000","last_fullsized":"2024-03-20T13:35:30.983405+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:16:57.907400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982873+0000","last_change":"2024-03-20T13:34:51.935236+0000","last_active":"2024-03-20T13:35:30.982873+0000","last_peered":"2024-03-20T13:35:30.982873+0000","last_clean":"2024-03-20T13:35:30.982873+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:35:30.982873+0000","last_undegraded":"2024-03-20T13:35:30.982873+0000","last_fullsized":"2024-03-20T13:35:30.982873+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989247+0000","last_change":"2024-03-20T13:34:49.946529+0000","last_active":"2024-03-20T13:35:30.989247+0000","last_peered":"2024-03-20T13:35:30.989247+0000","last_clean":"2024-03-20T13:35:30.989247+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:35:30.989247+0000","last_undegraded":"2024-03-20T13:35:30.989247+0000","last_fullsized":"2024-03-20T13:35:30.989247+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:32:00.505366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985010+0000","last_change":"2024-03-20T13:34:53.944081+0000","last_active":"2024-03-20T13:35:30.985010+0000","last_peered":"2024-03-20T13:35:30.985010+0000","last_clean":"2024-03-20T13:35:30.985010+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:35:30.985010+0000","last_undegraded":"2024-03-20T13:35:30.985010+0000","last_fullsized":"2024-03-20T13:35:30.985010+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:52.905746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'38","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.344145+0000","last_change":"2024-03-20T13:34:55.953409+0000","last_active":"2024-03-20T13:36:31.344145+0000","last_peered":"2024-03-20T13:36:31.344145+0000","last_clean":"2024-03-20T13:36:31.344145+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:31.344145+0000","last_undegraded":"2024-03-20T13:36:31.344145+0000","last_fullsized":"2024-03-20T13:36:31.344145+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:34.583675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980762+0000","last_change":"2024-03-20T13:34:57.962112+0000","last_active":"2024-03-20T13:35:30.980762+0000","last_peered":"2024-03-20T13:35:30.980762+0000","last_clean":"2024-03-20T13:35:30.980762+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:35:30.980762+0000","last_undegraded":"2024-03-20T13:35:30.980762+0000","last_fullsized":"2024-03-20T13:35:30.980762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:08.725148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988695+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:35:30.988695+0000","last_peered":"2024-03-20T13:35:30.988695+0000","last_clean":"2024-03-20T13:35:30.988695+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:35:30.988695+0000","last_undegraded":"2024-03-20T13:35:30.988695+0000","last_fullsized":"2024-03-20T13:35:30.988695+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:27:48.676415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925369+0000","last_change":"2024-03-20T13:34:51.955727+0000","last_active":"2024-03-20T13:35:35.925369+0000","last_peered":"2024-03-20T13:35:35.925369+0000","last_clean":"2024-03-20T13:35:35.925369+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:35:35.925369+0000","last_undegraded":"2024-03-20T13:35:35.925369+0000","last_fullsized":"2024-03-20T13:35:35.925369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:11:18.390471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982684+0000","last_change":"2024-03-20T13:34:49.937900+0000","last_active":"2024-03-20T13:35:30.982684+0000","last_peered":"2024-03-20T13:35:30.982684+0000","last_clean":"2024-03-20T13:35:30.982684+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:35:30.982684+0000","last_undegraded":"2024-03-20T13:35:30.982684+0000","last_fullsized":"2024-03-20T13:35:30.982684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:56:10.897767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985583+0000","last_change":"2024-03-20T13:34:53.945375+0000","last_active":"2024-03-20T13:35:30.985583+0000","last_peered":"2024-03-20T13:35:30.985583+0000","last_clean":"2024-03-20T13:35:30.985583+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:35:30.985583+0000","last_undegraded":"2024-03-20T13:35:30.985583+0000","last_fullsized":"2024-03-20T13:35:30.985583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:02:59.804246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'31","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.335311+0000","last_change":"2024-03-20T13:34:55.950108+0000","last_active":"2024-03-20T13:36:31.335311+0000","last_peered":"2024-03-20T13:36:31.335311+0000","last_clean":"2024-03-20T13:36:31.335311+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:31.335311+0000","last_undegraded":"2024-03-20T13:36:31.335311+0000","last_fullsized":"2024-03-20T13:36:31.335311+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:10:30.400371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986035+0000","last_change":"2024-03-20T13:34:57.962527+0000","last_active":"2024-03-20T13:35:30.986035+0000","last_peered":"2024-03-20T13:35:30.986035+0000","last_clean":"2024-03-20T13:35:30.986035+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:35:30.986035+0000","last_undegraded":"2024-03-20T13:35:30.986035+0000","last_fullsized":"2024-03-20T13:35:30.986035+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:19.460759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.935434+0000","last_change":"2024-03-20T13:34:51.944100+0000","last_active":"2024-03-20T13:35:35.935434+0000","last_peered":"2024-03-20T13:35:35.935434+0000","last_clean":"2024-03-20T13:35:35.935434+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:35:35.935434+0000","last_undegraded":"2024-03-20T13:35:35.935434+0000","last_fullsized":"2024-03-20T13:35:35.935434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:42:06.297838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983864+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:35:30.983864+0000","last_peered":"2024-03-20T13:35:30.983864+0000","last_clean":"2024-03-20T13:35:30.983864+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:35:30.983864+0000","last_undegraded":"2024-03-20T13:35:30.983864+0000","last_fullsized":"2024-03-20T13:35:30.983864+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:02:45.792646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985035+0000","last_change":"2024-03-20T13:34:53.942580+0000","last_active":"2024-03-20T13:35:30.985035+0000","last_peered":"2024-03-20T13:35:30.985035+0000","last_clean":"2024-03-20T13:35:30.985035+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:35:30.985035+0000","last_undegraded":"2024-03-20T13:35:30.985035+0000","last_fullsized":"2024-03-20T13:35:30.985035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:43:12.985129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'58","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.332308+0000","last_change":"2024-03-20T13:34:55.951412+0000","last_active":"2024-03-20T13:36:31.332308+0000","last_peered":"2024-03-20T13:36:31.332308+0000","last_clean":"2024-03-20T13:36:31.332308+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:31.332308+0000","last_undegraded":"2024-03-20T13:36:31.332308+0000","last_fullsized":"2024-03-20T13:36:31.332308+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:27:14.777482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985864+0000","last_change":"2024-03-20T13:34:57.965582+0000","last_active":"2024-03-20T13:35:30.985864+0000","last_peered":"2024-03-20T13:35:30.985864+0000","last_clean":"2024-03-20T13:35:30.985864+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:35:30.985864+0000","last_undegraded":"2024-03-20T13:35:30.985864+0000","last_fullsized":"2024-03-20T13:35:30.985864+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:34.285516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.435716+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:17.435716+0000","last_peered":"2024-03-20T13:36:17.435716+0000","last_clean":"2024-03-20T13:36:17.435716+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:17.435716+0000","last_undegraded":"2024-03-20T13:36:17.435716+0000","last_fullsized":"2024-03-20T13:36:17.435716+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'3","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.947516+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:08.165547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980586+0000","last_change":"2024-03-20T13:34:49.946304+0000","last_active":"2024-03-20T13:35:30.980586+0000","last_peered":"2024-03-20T13:35:30.980586+0000","last_clean":"2024-03-20T13:35:30.980586+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:35:30.980586+0000","last_undegraded":"2024-03-20T13:35:30.980586+0000","last_fullsized":"2024-03-20T13:35:30.980586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:06:00.445602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.992863+0000","last_change":"2024-03-20T13:35:30.992863+0000","last_active":"2024-03-20T13:35:30.992863+0000","last_peered":"2024-03-20T13:35:30.992863+0000","last_clean":"2024-03-20T13:35:30.992863+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:35:30.992863+0000","last_undegraded":"2024-03-20T13:35:30.992863+0000","last_fullsized":"2024-03-20T13:35:30.992863+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:51.568511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.338082+0000","last_change":"2024-03-20T13:34:55.955358+0000","last_active":"2024-03-20T13:36:31.338082+0000","last_peered":"2024-03-20T13:36:31.338082+0000","last_clean":"2024-03-20T13:36:31.338082+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:36:31.338082+0000","last_undegraded":"2024-03-20T13:36:31.338082+0000","last_fullsized":"2024-03-20T13:36:31.338082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:26:44.999814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981139+0000","last_change":"2024-03-20T13:34:57.964942+0000","last_active":"2024-03-20T13:35:30.981139+0000","last_peered":"2024-03-20T13:35:30.981139+0000","last_clean":"2024-03-20T13:35:30.981139+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:35:30.981139+0000","last_undegraded":"2024-03-20T13:35:30.981139+0000","last_fullsized":"2024-03-20T13:35:30.981139+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:08:57.281069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985284+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:35:30.985284+0000","last_peered":"2024-03-20T13:35:30.985284+0000","last_clean":"2024-03-20T13:35:30.985284+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:35:30.985284+0000","last_undegraded":"2024-03-20T13:35:30.985284+0000","last_fullsized":"2024-03-20T13:35:30.985284+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:46:56.733038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426416+0000","last_change":"2024-03-20T13:34:51.955633+0000","last_active":"2024-03-20T13:35:35.426416+0000","last_peered":"2024-03-20T13:35:35.426416+0000","last_clean":"2024-03-20T13:35:35.426416+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:35:35.426416+0000","last_undegraded":"2024-03-20T13:35:35.426416+0000","last_fullsized":"2024-03-20T13:35:35.426416+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:48:58.692384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981144+0000","last_change":"2024-03-20T13:34:49.948392+0000","last_active":"2024-03-20T13:35:30.981144+0000","last_peered":"2024-03-20T13:35:30.981144+0000","last_clean":"2024-03-20T13:35:30.981144+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:35:30.981144+0000","last_undegraded":"2024-03-20T13:35:30.981144+0000","last_fullsized":"2024-03-20T13:35:30.981144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991895+0000","last_change":"2024-03-20T13:35:30.991895+0000","last_active":"2024-03-20T13:35:30.991895+0000","last_peered":"2024-03-20T13:35:30.991895+0000","last_clean":"2024-03-20T13:35:30.991895+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:35:30.991895+0000","last_undegraded":"2024-03-20T13:35:30.991895+0000","last_fullsized":"2024-03-20T13:35:30.991895+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:03.644927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'33","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.292433+0000","last_change":"2024-03-20T13:34:55.946279+0000","last_active":"2024-03-20T13:36:31.292433+0000","last_peered":"2024-03-20T13:36:31.292433+0000","last_clean":"2024-03-20T13:36:31.292433+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:31.292433+0000","last_undegraded":"2024-03-20T13:36:31.292433+0000","last_fullsized":"2024-03-20T13:36:31.292433+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:32.277358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984087+0000","last_change":"2024-03-20T13:34:57.968260+0000","last_active":"2024-03-20T13:35:30.984087+0000","last_peered":"2024-03-20T13:35:30.984087+0000","last_clean":"2024-03-20T13:35:30.984087+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:35:30.984087+0000","last_undegraded":"2024-03-20T13:35:30.984087+0000","last_fullsized":"2024-03-20T13:35:30.984087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:27.724251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.559906+0000","last_change":"2024-03-20T13:34:59.970646+0000","last_active":"2024-03-20T13:36:23.559906+0000","last_peered":"2024-03-20T13:36:23.559906+0000","last_clean":"2024-03-20T13:36:23.559906+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:36:23.559906+0000","last_undegraded":"2024-03-20T13:36:23.559906+0000","last_fullsized":"2024-03-20T13:36:23.559906+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:06.692527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432770+0000","last_change":"2024-03-20T13:34:51.943110+0000","last_active":"2024-03-20T13:35:35.432770+0000","last_peered":"2024-03-20T13:35:35.432770+0000","last_clean":"2024-03-20T13:35:35.432770+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:35:35.432770+0000","last_undegraded":"2024-03-20T13:35:35.432770+0000","last_fullsized":"2024-03-20T13:35:35.432770+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987393+0000","last_change":"2024-03-20T13:34:49.960382+0000","last_active":"2024-03-20T13:35:30.987393+0000","last_peered":"2024-03-20T13:35:30.987393+0000","last_clean":"2024-03-20T13:35:30.987393+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:35:30.987393+0000","last_undegraded":"2024-03-20T13:35:30.987393+0000","last_fullsized":"2024-03-20T13:35:30.987393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:46.514364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982984+0000","last_change":"2024-03-20T13:34:53.940730+0000","last_active":"2024-03-20T13:35:30.982984+0000","last_peered":"2024-03-20T13:35:30.982984+0000","last_clean":"2024-03-20T13:35:30.982984+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:35:30.982984+0000","last_undegraded":"2024-03-20T13:35:30.982984+0000","last_fullsized":"2024-03-20T13:35:30.982984+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:00.644448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988396+0000","last_change":"2024-03-20T13:34:55.962070+0000","last_active":"2024-03-20T13:35:30.988396+0000","last_peered":"2024-03-20T13:35:30.988396+0000","last_clean":"2024-03-20T13:35:30.988396+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:35:30.988396+0000","last_undegraded":"2024-03-20T13:35:30.988396+0000","last_fullsized":"2024-03-20T13:35:30.988396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:10:00.391997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":296,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.208751+0000","last_change":"2024-03-20T13:34:57.966599+0000","last_active":"2024-03-20T13:36:31.208751+0000","last_peered":"2024-03-20T13:36:31.208751+0000","last_clean":"2024-03-20T13:36:31.208751+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:31.208751+0000","last_undegraded":"2024-03-20T13:36:31.208751+0000","last_fullsized":"2024-03-20T13:36:31.208751+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:18.059916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983175+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:35:30.983175+0000","last_peered":"2024-03-20T13:35:30.983175+0000","last_clean":"2024-03-20T13:35:30.983175+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:35:30.983175+0000","last_undegraded":"2024-03-20T13:35:30.983175+0000","last_fullsized":"2024-03-20T13:35:30.983175+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.192691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.814709+0000","last_change":"2024-03-20T13:34:51.935075+0000","last_active":"2024-03-20T13:35:34.814709+0000","last_peered":"2024-03-20T13:35:34.814709+0000","last_clean":"2024-03-20T13:35:34.814709+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:35:34.814709+0000","last_undegraded":"2024-03-20T13:35:34.814709+0000","last_fullsized":"2024-03-20T13:35:34.814709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982426+0000","last_change":"2024-03-20T13:34:49.939827+0000","last_active":"2024-03-20T13:35:30.982426+0000","last_peered":"2024-03-20T13:35:30.982426+0000","last_clean":"2024-03-20T13:35:30.982426+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:35:30.982426+0000","last_undegraded":"2024-03-20T13:35:30.982426+0000","last_fullsized":"2024-03-20T13:35:30.982426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982868+0000","last_change":"2024-03-20T13:34:53.942928+0000","last_active":"2024-03-20T13:35:30.982868+0000","last_peered":"2024-03-20T13:35:30.982868+0000","last_clean":"2024-03-20T13:35:30.982868+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:35:30.982868+0000","last_undegraded":"2024-03-20T13:35:30.982868+0000","last_fullsized":"2024-03-20T13:35:30.982868+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:45:24.590591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'37","reported_seq":85,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.310974+0000","last_change":"2024-03-20T13:34:55.950261+0000","last_active":"2024-03-20T13:36:31.310974+0000","last_peered":"2024-03-20T13:36:31.310974+0000","last_clean":"2024-03-20T13:36:31.310974+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:31.310974+0000","last_undegraded":"2024-03-20T13:36:31.310974+0000","last_fullsized":"2024-03-20T13:36:31.310974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:57:16.051759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982076+0000","last_change":"2024-03-20T13:34:57.966567+0000","last_active":"2024-03-20T13:35:30.982076+0000","last_peered":"2024-03-20T13:35:30.982076+0000","last_clean":"2024-03-20T13:35:30.982076+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:35:30.982076+0000","last_undegraded":"2024-03-20T13:35:30.982076+0000","last_fullsized":"2024-03-20T13:35:30.982076+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:18:00.530246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983022+0000","last_change":"2024-03-20T13:34:59.974362+0000","last_active":"2024-03-20T13:35:30.983022+0000","last_peered":"2024-03-20T13:35:30.983022+0000","last_clean":"2024-03-20T13:35:30.983022+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:35:30.983022+0000","last_undegraded":"2024-03-20T13:35:30.983022+0000","last_fullsized":"2024-03-20T13:35:30.983022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:37:32.596315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.815573+0000","last_change":"2024-03-20T13:34:51.933525+0000","last_active":"2024-03-20T13:35:34.815573+0000","last_peered":"2024-03-20T13:35:34.815573+0000","last_clean":"2024-03-20T13:35:34.815573+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:35:34.815573+0000","last_undegraded":"2024-03-20T13:35:34.815573+0000","last_fullsized":"2024-03-20T13:35:34.815573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:25:31.807759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990071+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:35:30.990071+0000","last_peered":"2024-03-20T13:35:30.990071+0000","last_clean":"2024-03-20T13:35:30.990071+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:35:30.990071+0000","last_undegraded":"2024-03-20T13:35:30.990071+0000","last_fullsized":"2024-03-20T13:35:30.990071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:46.676895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987770+0000","last_change":"2024-03-20T13:34:53.944574+0000","last_active":"2024-03-20T13:35:30.987770+0000","last_peered":"2024-03-20T13:35:30.987770+0000","last_clean":"2024-03-20T13:35:30.987770+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:35:30.987770+0000","last_undegraded":"2024-03-20T13:35:30.987770+0000","last_fullsized":"2024-03-20T13:35:30.987770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:47.973325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.313838+0000","last_change":"2024-03-20T13:34:55.949632+0000","last_active":"2024-03-20T13:36:31.313838+0000","last_peered":"2024-03-20T13:36:31.313838+0000","last_clean":"2024-03-20T13:36:31.313838+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:31.313838+0000","last_undegraded":"2024-03-20T13:36:31.313838+0000","last_fullsized":"2024-03-20T13:36:31.313838+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:46:56.067847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985258+0000","last_change":"2024-03-20T13:34:57.968928+0000","last_active":"2024-03-20T13:35:30.985258+0000","last_peered":"2024-03-20T13:35:30.985258+0000","last_clean":"2024-03-20T13:35:30.985258+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:35:30.985258+0000","last_undegraded":"2024-03-20T13:35:30.985258+0000","last_fullsized":"2024-03-20T13:35:30.985258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:19:52.024807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.930985+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:35:35.930985+0000","last_peered":"2024-03-20T13:35:35.930985+0000","last_clean":"2024-03-20T13:35:35.930985+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:35:35.930985+0000","last_undegraded":"2024-03-20T13:35:35.930985+0000","last_fullsized":"2024-03-20T13:35:35.930985+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:22:02.192935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985680+0000","last_change":"2024-03-20T13:34:51.945209+0000","last_active":"2024-03-20T13:35:30.985680+0000","last_peered":"2024-03-20T13:35:30.985680+0000","last_clean":"2024-03-20T13:35:30.985680+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:35:30.985680+0000","last_undegraded":"2024-03-20T13:35:30.985680+0000","last_fullsized":"2024-03-20T13:35:30.985680+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:04:44.470618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984496+0000","last_change":"2024-03-20T13:34:49.939306+0000","last_active":"2024-03-20T13:35:30.984496+0000","last_peered":"2024-03-20T13:35:30.984496+0000","last_clean":"2024-03-20T13:35:30.984496+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:35:30.984496+0000","last_undegraded":"2024-03-20T13:35:30.984496+0000","last_fullsized":"2024-03-20T13:35:30.984496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:42.593147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983070+0000","last_change":"2024-03-20T13:34:53.944784+0000","last_active":"2024-03-20T13:35:30.983070+0000","last_peered":"2024-03-20T13:35:30.983070+0000","last_clean":"2024-03-20T13:35:30.983070+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:35:30.983070+0000","last_undegraded":"2024-03-20T13:35:30.983070+0000","last_fullsized":"2024-03-20T13:35:30.983070+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:45.631209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'27","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.285739+0000","last_change":"2024-03-20T13:34:55.953980+0000","last_active":"2024-03-20T13:36:31.285739+0000","last_peered":"2024-03-20T13:36:31.285739+0000","last_clean":"2024-03-20T13:36:31.285739+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:31.285739+0000","last_undegraded":"2024-03-20T13:36:31.285739+0000","last_fullsized":"2024-03-20T13:36:31.285739+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:04.003649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985553+0000","last_change":"2024-03-20T13:34:57.968516+0000","last_active":"2024-03-20T13:35:30.985553+0000","last_peered":"2024-03-20T13:35:30.985553+0000","last_clean":"2024-03-20T13:35:30.985553+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:35:30.985553+0000","last_undegraded":"2024-03-20T13:35:30.985553+0000","last_fullsized":"2024-03-20T13:35:30.985553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:42.517997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988393+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:35:30.988393+0000","last_peered":"2024-03-20T13:35:30.988393+0000","last_clean":"2024-03-20T13:35:30.988393+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:35:30.988393+0000","last_undegraded":"2024-03-20T13:35:30.988393+0000","last_fullsized":"2024-03-20T13:35:30.988393+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:37:18.372757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164827+0000","last_change":"2024-03-20T13:34:51.933565+0000","last_active":"2024-03-20T13:35:35.164827+0000","last_peered":"2024-03-20T13:35:35.164827+0000","last_clean":"2024-03-20T13:35:35.164827+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:35:35.164827+0000","last_undegraded":"2024-03-20T13:35:35.164827+0000","last_fullsized":"2024-03-20T13:35:35.164827+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:36:23.975435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982828+0000","last_change":"2024-03-20T13:34:49.937954+0000","last_active":"2024-03-20T13:35:30.982828+0000","last_peered":"2024-03-20T13:35:30.982828+0000","last_clean":"2024-03-20T13:35:30.982828+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:35:30.982828+0000","last_undegraded":"2024-03-20T13:35:30.982828+0000","last_fullsized":"2024-03-20T13:35:30.982828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'2","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982077+0000","last_change":"2024-03-20T13:34:53.945758+0000","last_active":"2024-03-20T13:35:30.982077+0000","last_peered":"2024-03-20T13:35:30.982077+0000","last_clean":"2024-03-20T13:35:30.982077+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:35:30.982077+0000","last_undegraded":"2024-03-20T13:35:30.982077+0000","last_fullsized":"2024-03-20T13:35:30.982077+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:36:56.026535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'32","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.295736+0000","last_change":"2024-03-20T13:34:55.955035+0000","last_active":"2024-03-20T13:36:31.295736+0000","last_peered":"2024-03-20T13:36:31.295736+0000","last_clean":"2024-03-20T13:36:31.295736+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:31.295736+0000","last_undegraded":"2024-03-20T13:36:31.295736+0000","last_fullsized":"2024-03-20T13:36:31.295736+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:00:41.222083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983213+0000","last_change":"2024-03-20T13:34:57.961099+0000","last_active":"2024-03-20T13:35:30.983213+0000","last_peered":"2024-03-20T13:35:30.983213+0000","last_clean":"2024-03-20T13:35:30.983213+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:35:30.983213+0000","last_undegraded":"2024-03-20T13:35:30.983213+0000","last_fullsized":"2024-03-20T13:35:30.983213+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:00.717967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987647+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:35:30.987647+0000","last_peered":"2024-03-20T13:35:30.987647+0000","last_clean":"2024-03-20T13:35:30.987647+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:35:30.987647+0000","last_undegraded":"2024-03-20T13:35:30.987647+0000","last_fullsized":"2024-03-20T13:35:30.987647+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:50:50.872683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.927590+0000","last_change":"2024-03-20T13:34:51.957194+0000","last_active":"2024-03-20T13:35:35.927590+0000","last_peered":"2024-03-20T13:35:35.927590+0000","last_clean":"2024-03-20T13:35:35.927590+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:35:35.927590+0000","last_undegraded":"2024-03-20T13:35:35.927590+0000","last_fullsized":"2024-03-20T13:35:35.927590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984223+0000","last_change":"2024-03-20T13:34:49.949098+0000","last_active":"2024-03-20T13:35:30.984223+0000","last_peered":"2024-03-20T13:35:30.984223+0000","last_clean":"2024-03-20T13:35:30.984223+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:35:30.984223+0000","last_undegraded":"2024-03-20T13:35:30.984223+0000","last_fullsized":"2024-03-20T13:35:30.984223+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984638+0000","last_change":"2024-03-20T13:34:51.943051+0000","last_active":"2024-03-20T13:35:30.984638+0000","last_peered":"2024-03-20T13:35:30.984638+0000","last_clean":"2024-03-20T13:35:30.984638+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:35:30.984638+0000","last_undegraded":"2024-03-20T13:35:30.984638+0000","last_fullsized":"2024-03-20T13:35:30.984638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982413+0000","last_change":"2024-03-20T13:34:49.933350+0000","last_active":"2024-03-20T13:35:30.982413+0000","last_peered":"2024-03-20T13:35:30.982413+0000","last_clean":"2024-03-20T13:35:30.982413+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:35:30.982413+0000","last_undegraded":"2024-03-20T13:35:30.982413+0000","last_fullsized":"2024-03-20T13:35:30.982413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:51:11.891236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426226+0000","last_change":"2024-03-20T13:34:51.945886+0000","last_active":"2024-03-20T13:35:35.426226+0000","last_peered":"2024-03-20T13:35:35.426226+0000","last_clean":"2024-03-20T13:35:35.426226+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:35:35.426226+0000","last_undegraded":"2024-03-20T13:35:35.426226+0000","last_fullsized":"2024-03-20T13:35:35.426226+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:31:13.438792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985818+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:35:30.985818+0000","last_peered":"2024-03-20T13:35:30.985818+0000","last_clean":"2024-03-20T13:35:30.985818+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:35:30.985818+0000","last_undegraded":"2024-03-20T13:35:30.985818+0000","last_fullsized":"2024-03-20T13:35:30.985818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:24:48.329750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.309466+0000","last_change":"2024-03-20T13:34:51.942923+0000","last_active":"2024-03-20T13:36:17.309466+0000","last_peered":"2024-03-20T13:36:17.309466+0000","last_clean":"2024-03-20T13:36:17.309466+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:36:17.309466+0000","last_undegraded":"2024-03-20T13:36:17.309466+0000","last_fullsized":"2024-03-20T13:36:17.309466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:21:48.684233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984213+0000","last_change":"2024-03-20T13:34:49.933497+0000","last_active":"2024-03-20T13:35:30.984213+0000","last_peered":"2024-03-20T13:35:30.984213+0000","last_clean":"2024-03-20T13:35:30.984213+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:35:30.984213+0000","last_undegraded":"2024-03-20T13:35:30.984213+0000","last_fullsized":"2024-03-20T13:35:30.984213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983804+0000","last_change":"2024-03-20T13:34:51.937130+0000","last_active":"2024-03-20T13:35:30.983804+0000","last_peered":"2024-03-20T13:35:30.983804+0000","last_clean":"2024-03-20T13:35:30.983804+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:35:30.983804+0000","last_undegraded":"2024-03-20T13:35:30.983804+0000","last_fullsized":"2024-03-20T13:35:30.983804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:48.521702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984038+0000","last_change":"2024-03-20T13:34:49.946558+0000","last_active":"2024-03-20T13:35:30.984038+0000","last_peered":"2024-03-20T13:35:30.984038+0000","last_clean":"2024-03-20T13:35:30.984038+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:35:30.984038+0000","last_undegraded":"2024-03-20T13:35:30.984038+0000","last_fullsized":"2024-03-20T13:35:30.984038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:46:24.206457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568432+0000","last_change":"2024-03-20T13:34:51.953134+0000","last_active":"2024-03-20T13:36:23.568432+0000","last_peered":"2024-03-20T13:36:23.568432+0000","last_clean":"2024-03-20T13:36:23.568432+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:23.568432+0000","last_undegraded":"2024-03-20T13:36:23.568432+0000","last_fullsized":"2024-03-20T13:36:23.568432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:01:47.441326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981395+0000","last_change":"2024-03-20T13:34:49.945395+0000","last_active":"2024-03-20T13:35:30.981395+0000","last_peered":"2024-03-20T13:35:30.981395+0000","last_clean":"2024-03-20T13:35:30.981395+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:35:30.981395+0000","last_undegraded":"2024-03-20T13:35:30.981395+0000","last_fullsized":"2024-03-20T13:35:30.981395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:05.624895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969303+0000","last_change":"2024-03-20T13:34:51.947021+0000","last_active":"2024-03-20T13:36:17.969303+0000","last_peered":"2024-03-20T13:36:17.969303+0000","last_clean":"2024-03-20T13:36:17.969303+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:36:17.969303+0000","last_undegraded":"2024-03-20T13:36:17.969303+0000","last_fullsized":"2024-03-20T13:36:17.969303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:35.510105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.962603+0000","last_change":"2024-03-20T13:34:49.946770+0000","last_active":"2024-03-20T13:36:17.962603+0000","last_peered":"2024-03-20T13:36:17.962603+0000","last_clean":"2024-03-20T13:36:17.962603+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:36:17.962603+0000","last_undegraded":"2024-03-20T13:36:17.962603+0000","last_fullsized":"2024-03-20T13:36:17.962603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:57.113298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.426260+0000","last_change":"2024-03-20T13:34:51.941533+0000","last_active":"2024-03-20T13:35:35.426260+0000","last_peered":"2024-03-20T13:35:35.426260+0000","last_clean":"2024-03-20T13:35:35.426260+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:35:35.426260+0000","last_undegraded":"2024-03-20T13:35:35.426260+0000","last_fullsized":"2024-03-20T13:35:35.426260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:15:09.627906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984680+0000","last_change":"2024-03-20T13:34:49.934739+0000","last_active":"2024-03-20T13:35:30.984680+0000","last_peered":"2024-03-20T13:35:30.984680+0000","last_clean":"2024-03-20T13:35:30.984680+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:35:30.984680+0000","last_undegraded":"2024-03-20T13:35:30.984680+0000","last_fullsized":"2024-03-20T13:35:30.984680+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:18:24.437773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983296+0000","last_change":"2024-03-20T13:34:51.948058+0000","last_active":"2024-03-20T13:35:30.983296+0000","last_peered":"2024-03-20T13:35:30.983296+0000","last_clean":"2024-03-20T13:35:30.983296+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:35:30.983296+0000","last_undegraded":"2024-03-20T13:35:30.983296+0000","last_fullsized":"2024-03-20T13:35:30.983296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:43:10.671047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.421616+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:35:35.421616+0000","last_peered":"2024-03-20T13:35:35.421616+0000","last_clean":"2024-03-20T13:35:35.421616+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:35:35.421616+0000","last_undegraded":"2024-03-20T13:35:35.421616+0000","last_fullsized":"2024-03-20T13:35:35.421616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:33.502767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988240+0000","last_change":"2024-03-20T13:34:51.949486+0000","last_active":"2024-03-20T13:35:30.988240+0000","last_peered":"2024-03-20T13:35:30.988240+0000","last_clean":"2024-03-20T13:35:30.988240+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:35:30.988240+0000","last_undegraded":"2024-03-20T13:35:30.988240+0000","last_fullsized":"2024-03-20T13:35:30.988240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:52:46.252000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982607+0000","last_change":"2024-03-20T13:34:49.934646+0000","last_active":"2024-03-20T13:35:30.982607+0000","last_peered":"2024-03-20T13:35:30.982607+0000","last_clean":"2024-03-20T13:35:30.982607+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:35:30.982607+0000","last_undegraded":"2024-03-20T13:35:30.982607+0000","last_fullsized":"2024-03-20T13:35:30.982607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:31:38.834487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568234+0000","last_change":"2024-03-20T13:34:51.935272+0000","last_active":"2024-03-20T13:36:23.568234+0000","last_peered":"2024-03-20T13:36:23.568234+0000","last_clean":"2024-03-20T13:36:23.568234+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:36:23.568234+0000","last_undegraded":"2024-03-20T13:36:23.568234+0000","last_fullsized":"2024-03-20T13:36:23.568234+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:37:02.523733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981576+0000","last_change":"2024-03-20T13:34:49.955817+0000","last_active":"2024-03-20T13:35:30.981576+0000","last_peered":"2024-03-20T13:35:30.981576+0000","last_clean":"2024-03-20T13:35:30.981576+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:35:30.981576+0000","last_undegraded":"2024-03-20T13:35:30.981576+0000","last_fullsized":"2024-03-20T13:35:30.981576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:37:29.429639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.925361+0000","last_change":"2024-03-20T13:34:51.946963+0000","last_active":"2024-03-20T13:35:35.925361+0000","last_peered":"2024-03-20T13:35:35.925361+0000","last_clean":"2024-03-20T13:35:35.925361+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:35:35.925361+0000","last_undegraded":"2024-03-20T13:35:35.925361+0000","last_fullsized":"2024-03-20T13:35:35.925361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:54:12.805030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980780+0000","last_change":"2024-03-20T13:34:49.944556+0000","last_active":"2024-03-20T13:35:30.980780+0000","last_peered":"2024-03-20T13:35:30.980780+0000","last_clean":"2024-03-20T13:35:30.980780+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:35:30.980780+0000","last_undegraded":"2024-03-20T13:35:30.980780+0000","last_fullsized":"2024-03-20T13:35:30.980780+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:04:15.924580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.164645+0000","last_change":"2024-03-20T13:34:51.948336+0000","last_active":"2024-03-20T13:35:35.164645+0000","last_peered":"2024-03-20T13:35:35.164645+0000","last_clean":"2024-03-20T13:35:35.164645+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:35:35.164645+0000","last_undegraded":"2024-03-20T13:35:35.164645+0000","last_fullsized":"2024-03-20T13:35:35.164645+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:54:45.966592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988635+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:35:30.988635+0000","last_peered":"2024-03-20T13:35:30.988635+0000","last_clean":"2024-03-20T13:35:30.988635+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:35:30.988635+0000","last_undegraded":"2024-03-20T13:35:30.988635+0000","last_fullsized":"2024-03-20T13:35:30.988635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:46.604615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568629+0000","last_change":"2024-03-20T13:34:51.950006+0000","last_active":"2024-03-20T13:36:23.568629+0000","last_peered":"2024-03-20T13:36:23.568629+0000","last_clean":"2024-03-20T13:36:23.568629+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:23.568629+0000","last_undegraded":"2024-03-20T13:36:23.568629+0000","last_fullsized":"2024-03-20T13:36:23.568629+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:54:37.940365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990260+0000","last_change":"2024-03-20T13:34:49.962883+0000","last_active":"2024-03-20T13:35:30.990260+0000","last_peered":"2024-03-20T13:35:30.990260+0000","last_clean":"2024-03-20T13:35:30.990260+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:35:30.990260+0000","last_undegraded":"2024-03-20T13:35:30.990260+0000","last_fullsized":"2024-03-20T13:35:30.990260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:19:06.158208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.568300+0000","last_change":"2024-03-20T13:34:51.951979+0000","last_active":"2024-03-20T13:36:23.568300+0000","last_peered":"2024-03-20T13:36:23.568300+0000","last_clean":"2024-03-20T13:36:23.568300+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:36:23.568300+0000","last_undegraded":"2024-03-20T13:36:23.568300+0000","last_fullsized":"2024-03-20T13:36:23.568300+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:41.546768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989598+0000","last_change":"2024-03-20T13:34:49.950220+0000","last_active":"2024-03-20T13:35:30.989598+0000","last_peered":"2024-03-20T13:35:30.989598+0000","last_clean":"2024-03-20T13:35:30.989598+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:35:30.989598+0000","last_undegraded":"2024-03-20T13:35:30.989598+0000","last_fullsized":"2024-03-20T13:35:30.989598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:43:13.123441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981812+0000","last_change":"2024-03-20T13:34:51.945790+0000","last_active":"2024-03-20T13:35:30.981812+0000","last_peered":"2024-03-20T13:35:30.981812+0000","last_clean":"2024-03-20T13:35:30.981812+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:35:30.981812+0000","last_undegraded":"2024-03-20T13:35:30.981812+0000","last_fullsized":"2024-03-20T13:35:30.981812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:59:48.611953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.312469+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:17.312469+0000","last_peered":"2024-03-20T13:36:17.312469+0000","last_clean":"2024-03-20T13:36:17.312469+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:17.312469+0000","last_undegraded":"2024-03-20T13:36:17.312469+0000","last_fullsized":"2024-03-20T13:36:17.312469+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:47:59.418222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984472+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:35:30.984472+0000","last_peered":"2024-03-20T13:35:30.984472+0000","last_clean":"2024-03-20T13:35:30.984472+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:35:30.984472+0000","last_undegraded":"2024-03-20T13:35:30.984472+0000","last_fullsized":"2024-03-20T13:35:30.984472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:20:32.396271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984838+0000","last_change":"2024-03-20T13:34:51.947552+0000","last_active":"2024-03-20T13:35:30.984838+0000","last_peered":"2024-03-20T13:35:30.984838+0000","last_clean":"2024-03-20T13:35:30.984838+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:35:30.984838+0000","last_undegraded":"2024-03-20T13:35:30.984838+0000","last_fullsized":"2024-03-20T13:35:30.984838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:48:01.425560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982733+0000","last_change":"2024-03-20T13:34:49.941425+0000","last_active":"2024-03-20T13:35:30.982733+0000","last_peered":"2024-03-20T13:35:30.982733+0000","last_clean":"2024-03-20T13:35:30.982733+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:35:30.982733+0000","last_undegraded":"2024-03-20T13:35:30.982733+0000","last_fullsized":"2024-03-20T13:35:30.982733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:52:02.007923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'3","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.969447+0000","last_change":"2024-03-20T13:34:51.944562+0000","last_active":"2024-03-20T13:36:17.969447+0000","last_peered":"2024-03-20T13:36:17.969447+0000","last_clean":"2024-03-20T13:36:17.969447+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:36:17.969447+0000","last_undegraded":"2024-03-20T13:36:17.969447+0000","last_fullsized":"2024-03-20T13:36:17.969447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:01:55.068556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1269,"ondisk_log_size":1269,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13,"ondisk_log_size":13,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672989,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.372},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.22900000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.33600000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:35:35 2024","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.39600000000000002}]}]},{"osd":1,"up_from":10,"seq":42949672988,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35699999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.20699999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"last":0.311}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.502,"5min":0.502,"15min":0.502},"last":0.371},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.33500000000000002}]}]},{"osd":3,"up_from":9,"seq":38654705690,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:35:33 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.34699999999999998}]},{"osd":1,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.311,"15min":0.311},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.14599999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.29599999999999999}]},{"osd":2,"last update":"Wed Mar 20 13:35:38 2024","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"min":{"1min":0.17799999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.38100000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705692,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.60399999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:35:40 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":0.53900000000000003}]},{"osd":3,"last update":"Wed Mar 20 13:35:36 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:35.957 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.958 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.958 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.958 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.959 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.959 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.959 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.960 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.960 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.960 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.960 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.961 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.961 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.961 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.962 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.962 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.963 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.963 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.963 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.964 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.964 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.964 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.964 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.965 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.965 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.965 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.966 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.966 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.967 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.967 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.967 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.967 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.968 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.968 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.969 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.969 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.969 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.970 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.970 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.970 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.971 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.971 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.971 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.972 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.972 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.973 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.973 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.974 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.974 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.974 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.975 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.975 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.975 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.976 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.976 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.976 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.977 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.977 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.977 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.977 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.977 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.977 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.978 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.978 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.978 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.978 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.978 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.978 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.979 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.979 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.979 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.979 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.979 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.979 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.980 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.980 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.980 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.980 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.980 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.980 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.981 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.981 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.981 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.981 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.981 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.981 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.982 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.982 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.982 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.982 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.982 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.982 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.983 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.983 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.983 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.983 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.983 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.983 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.984 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.984 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.984 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.984 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-20T13:34:33.883766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=33, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.984 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.984 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.985 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.985 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.985 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.985 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.985 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.985 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.986 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.986 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.986 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.986 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.986 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.986 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.987 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.988 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.988 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.988 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.988 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.988 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.988 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.989 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.989 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.989 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.989 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.989 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.989 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.990 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.990 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.990 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.990 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.990 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.990 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.991 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.991 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.991 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.991 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.991 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.991 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.992 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.993 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.993 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.993 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.993 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.993 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.993 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.994 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.994 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.994 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.994 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.994 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.994 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.995 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.995 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.995 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.995 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.995 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.995 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.996 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.997 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.997 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.997 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.997 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.997 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.997 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.998 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.998 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.998 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.998 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.998 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.998 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.999 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.999 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.999 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.999 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.999 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:35.999 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.000 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.001 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.001 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.001 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.001 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.001 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.001 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.002 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.002 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.002 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.002 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.002 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.002 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.003 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.003 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.003 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.003 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.003 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.003 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.004 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.005 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.005 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.005 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.005 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.005 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.005 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.006 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.006 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.006 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.006 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.006 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.006 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.007 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.008 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.008 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.008 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.008 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.008 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.008 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.009 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.010 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.010 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.010 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.010 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:36.010 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:36:36.515 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-03-20T13:36:56.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:36:56.125 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.123+0000 7f590c414640 1 Processor -- start 2024-03-20T13:36:56.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.123+0000 7f590c414640 1 -- start start 2024-03-20T13:36:56.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f590c414640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f59040956a0 0x7f5904095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f590c414640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5904095270 con 0x7f5904127460 2024-03-20T13:36:56.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f590c414640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59040954a0 con 0x7f59040956a0 2024-03-20T13:36:56.126 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f590a1b0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f59040956a0 0x7f5904095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f59099af640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5904127460 0x7f5904127870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:41488/0 (socket says 172.21.15.28:41488) 2024-03-20T13:36:56.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f59099af640 1 -- 172.21.15.28:0/2291508921 learned_addr learned my addr 172.21.15.28:0/2291508921 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:36:56.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f590a1b0640 1 -- 172.21.15.28:0/2291508921 >> v1:172.21.15.28:6789/0 conn(0x7f5904127460 legacy=0x7f5904127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.127 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.124+0000 7f590a1b0640 1 -- 172.21.15.28:0/2291508921 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5904093d90 con 0x7f59040956a0 2024-03-20T13:36:56.130 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.125+0000 7f590a1b0640 1 --2- 172.21.15.28:0/2291508921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f5904095a80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5900009720 tx=0x7f590002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed15f8ce46af1adf server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.125+0000 7f59091ae640 1 -- 172.21.15.28:0/2291508921 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f590002e070 con 0x7f59040956a0 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.125+0000 7f59091ae640 1 -- 172.21.15.28:0/2291508921 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59000316d0 con 0x7f59040956a0 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.125+0000 7f59091ae640 1 -- 172.21.15.28:0/2291508921 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5900031990 con 0x7f59040956a0 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 -- 172.21.15.28:0/2291508921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 msgr2=0x7f5904095a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 --2- 172.21.15.28:0/2291508921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f5904095a80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5900009720 tx=0x7f590002b840 comp rx=0 tx=0).stop 2024-03-20T13:36:56.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 -- 172.21.15.28:0/2291508921 shutdown_connections 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 --2- 172.21.15.28:0/2291508921 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f5904095a80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 -- 172.21.15.28:0/2291508921 >> 172.21.15.28:0/2291508921 conn(0x7f590409a300 msgr2=0x7f590409a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 -- 172.21.15.28:0/2291508921 shutdown_connections 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.126+0000 7f590c414640 1 -- 172.21.15.28:0/2291508921 wait complete. 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590c414640 1 Processor -- start 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590c414640 1 -- start start 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590c414640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f59041c2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.132 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590c414640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59040903b0 con 0x7f59040956a0 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590a1b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f59041c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590a1b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f59041c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:36172/0 (socket says 172.21.15.28:36172) 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.127+0000 7f590a1b0640 1 -- 172.21.15.28:0/592191567 learned_addr learned my addr 172.21.15.28:0/592191567 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f590a1b0640 1 -- 172.21.15.28:0/592191567 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5900009400 con 0x7f59040956a0 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f590a1b0640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f59041c2830 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5900009840 tx=0x7f59000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f59000328b0 con 0x7f59040956a0 2024-03-20T13:36:56.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5900032a10 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5904090080 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5900032cf0 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.128+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5904097f90 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.129+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f590004d3f0 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.129+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f590408fed0 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.129+0000 7f58faffd640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f58e8037ef0 0x7f58e803a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.129+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f590006d020 con 0x7f59040956a0 2024-03-20T13:36:56.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.129+0000 7f59099af640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f58e8037ef0 0x7f58e803a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:36:56.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.130+0000 7f59099af640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f58e8037ef0 0x7f58e803a3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58f4007fd0 tx=0x7f58f4007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:36:56.135 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.134+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f59000a08c0 con 0x7f59040956a0 2024-03-20T13:36:56.314 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.312+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5904093ba0 con 0x7f58e8037ef0 2024-03-20T13:36:56.329 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.328+0000 7f58faffd640 1 -- 172.21.15.28:0/592191567 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+666456 (secure 0 0 0) 0x7f5904093ba0 con 0x7f58e8037ef0 2024-03-20T13:36:56.337 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:36:56.342 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:36:56.345 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f58e8037ef0 msgr2=0x7f58e803a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f58e8037ef0 0x7f58e803a3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f58f4007fd0 tx=0x7f58f4007ac0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 msgr2=0x7f59041c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f59041c2830 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5900009840 tx=0x7f59000046c0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 shutdown_connections 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f58e8037ef0 0x7f58e803a3b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.332+0000 7f590c414640 1 --2- 172.21.15.28:0/592191567 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f59040956a0 0x7f59041c2830 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.333+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 >> 172.21.15.28:0/592191567 conn(0x7f590409a300 msgr2=0x7f5904094160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:36:56.346 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.333+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 shutdown_connections 2024-03-20T13:36:56.347 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:36:56.333+0000 7f590c414640 1 -- 172.21.15.28:0/592191567 wait complete. 2024-03-20T13:36:56.347 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":100,"stamp":"2024-03-20T13:36:55.178002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4002,"num_read_kb":3648,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1150,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3915,"ondisk_log_size":3915,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1150,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004169"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150747+0000","last_change":"2024-03-20T13:34:49.945378+0000","last_active":"2024-03-20T13:36:35.150747+0000","last_peered":"2024-03-20T13:36:35.150747+0000","last_clean":"2024-03-20T13:36:35.150747+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:36:35.150747+0000","last_undegraded":"2024-03-20T13:36:35.150747+0000","last_fullsized":"2024-03-20T13:36:35.150747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.937403+0000","last_change":"2024-03-20T13:34:51.948629+0000","last_active":"2024-03-20T13:35:35.937403+0000","last_peered":"2024-03-20T13:35:35.937403+0000","last_clean":"2024-03-20T13:35:35.937403+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:35:35.937403+0000","last_undegraded":"2024-03-20T13:35:35.937403+0000","last_fullsized":"2024-03-20T13:35:35.937403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984651+0000","last_change":"2024-03-20T13:34:49.933462+0000","last_active":"2024-03-20T13:35:30.984651+0000","last_peered":"2024-03-20T13:35:30.984651+0000","last_clean":"2024-03-20T13:35:30.984651+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:35:30.984651+0000","last_undegraded":"2024-03-20T13:35:30.984651+0000","last_fullsized":"2024-03-20T13:35:30.984651+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.578010+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.578010+0000","last_peered":"2024-03-20T13:36:23.578010+0000","last_clean":"2024-03-20T13:36:23.578010+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.578010+0000","last_undegraded":"2024-03-20T13:36:23.578010+0000","last_fullsized":"2024-03-20T13:36:23.578010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.799150+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:35:34.799150+0000","last_peered":"2024-03-20T13:35:34.799150+0000","last_clean":"2024-03-20T13:35:34.799150+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:35:34.799150+0000","last_undegraded":"2024-03-20T13:35:34.799150+0000","last_fullsized":"2024-03-20T13:35:34.799150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986714+0000","last_change":"2024-03-20T13:34:51.947769+0000","last_active":"2024-03-20T13:35:30.986714+0000","last_peered":"2024-03-20T13:35:30.986714+0000","last_clean":"2024-03-20T13:35:30.986714+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:35:30.986714+0000","last_undegraded":"2024-03-20T13:35:30.986714+0000","last_fullsized":"2024-03-20T13:35:30.986714+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150756+0000","last_change":"2024-03-20T13:34:49.952708+0000","last_active":"2024-03-20T13:36:35.150756+0000","last_peered":"2024-03-20T13:36:35.150756+0000","last_clean":"2024-03-20T13:36:35.150756+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:36:35.150756+0000","last_undegraded":"2024-03-20T13:36:35.150756+0000","last_fullsized":"2024-03-20T13:36:35.150756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612905+0000","last_change":"2024-03-20T13:35:30.996431+0000","last_active":"2024-03-20T13:36:17.612905+0000","last_peered":"2024-03-20T13:36:17.612905+0000","last_clean":"2024-03-20T13:36:17.612905+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:36:17.612905+0000","last_undegraded":"2024-03-20T13:36:17.612905+0000","last_fullsized":"2024-03-20T13:36:17.612905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987600+0000","last_change":"2024-03-20T13:34:49.959192+0000","last_active":"2024-03-20T13:35:30.987600+0000","last_peered":"2024-03-20T13:35:30.987600+0000","last_clean":"2024-03-20T13:35:30.987600+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:35:30.987600+0000","last_undegraded":"2024-03-20T13:35:30.987600+0000","last_fullsized":"2024-03-20T13:35:30.987600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711612+0000","last_change":"2024-03-20T13:34:51.946953+0000","last_active":"2024-03-20T13:36:34.711612+0000","last_peered":"2024-03-20T13:36:34.711612+0000","last_clean":"2024-03-20T13:36:34.711612+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:36:34.711612+0000","last_undegraded":"2024-03-20T13:36:34.711612+0000","last_fullsized":"2024-03-20T13:36:34.711612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.347162+0000","last_change":"2024-03-20T13:34:49.954949+0000","last_active":"2024-03-20T13:35:34.347162+0000","last_peered":"2024-03-20T13:35:34.347162+0000","last_clean":"2024-03-20T13:35:34.347162+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:35:34.347162+0000","last_undegraded":"2024-03-20T13:35:34.347162+0000","last_fullsized":"2024-03-20T13:35:34.347162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988746+0000","last_change":"2024-03-20T13:34:51.952540+0000","last_active":"2024-03-20T13:35:30.988746+0000","last_peered":"2024-03-20T13:35:30.988746+0000","last_clean":"2024-03-20T13:35:30.988746+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:35:30.988746+0000","last_undegraded":"2024-03-20T13:35:30.988746+0000","last_fullsized":"2024-03-20T13:35:30.988746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986150+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:35:30.986150+0000","last_peered":"2024-03-20T13:35:30.986150+0000","last_clean":"2024-03-20T13:35:30.986150+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:35:30.986150+0000","last_undegraded":"2024-03-20T13:35:30.986150+0000","last_fullsized":"2024-03-20T13:35:30.986150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.575854+0000","last_change":"2024-03-20T13:34:51.948321+0000","last_active":"2024-03-20T13:36:23.575854+0000","last_peered":"2024-03-20T13:36:23.575854+0000","last_clean":"2024-03-20T13:36:23.575854+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:23.575854+0000","last_undegraded":"2024-03-20T13:36:23.575854+0000","last_fullsized":"2024-03-20T13:36:23.575854+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982474+0000","last_change":"2024-03-20T13:34:49.940856+0000","last_active":"2024-03-20T13:35:30.982474+0000","last_peered":"2024-03-20T13:35:30.982474+0000","last_clean":"2024-03-20T13:35:30.982474+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:35:30.982474+0000","last_undegraded":"2024-03-20T13:35:30.982474+0000","last_fullsized":"2024-03-20T13:35:30.982474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'5","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612701+0000","last_change":"2024-03-20T13:34:51.945268+0000","last_active":"2024-03-20T13:36:17.612701+0000","last_peered":"2024-03-20T13:36:17.612701+0000","last_clean":"2024-03-20T13:36:17.612701+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:36:17.612701+0000","last_undegraded":"2024-03-20T13:36:17.612701+0000","last_fullsized":"2024-03-20T13:36:17.612701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.977322+0000","last_change":"2024-03-20T13:34:51.949454+0000","last_active":"2024-03-20T13:36:17.977322+0000","last_peered":"2024-03-20T13:36:17.977322+0000","last_clean":"2024-03-20T13:36:17.977322+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:36:17.977322+0000","last_undegraded":"2024-03-20T13:36:17.977322+0000","last_fullsized":"2024-03-20T13:36:17.977322+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.348624+0000","last_change":"2024-03-20T13:34:49.945284+0000","last_active":"2024-03-20T13:35:34.348624+0000","last_peered":"2024-03-20T13:35:34.348624+0000","last_clean":"2024-03-20T13:35:34.348624+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:35:34.348624+0000","last_undegraded":"2024-03-20T13:35:34.348624+0000","last_fullsized":"2024-03-20T13:35:34.348624+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.576068+0000","last_change":"2024-03-20T13:34:51.948725+0000","last_active":"2024-03-20T13:36:23.576068+0000","last_peered":"2024-03-20T13:36:23.576068+0000","last_clean":"2024-03-20T13:36:23.576068+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:23.576068+0000","last_undegraded":"2024-03-20T13:36:23.576068+0000","last_fullsized":"2024-03-20T13:36:23.576068+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990708+0000","last_change":"2024-03-20T13:34:49.950644+0000","last_active":"2024-03-20T13:35:30.990708+0000","last_peered":"2024-03-20T13:35:30.990708+0000","last_clean":"2024-03-20T13:35:30.990708+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:35:30.990708+0000","last_undegraded":"2024-03-20T13:35:30.990708+0000","last_fullsized":"2024-03-20T13:35:30.990708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.170996+0000","last_change":"2024-03-20T13:34:51.947958+0000","last_active":"2024-03-20T13:35:35.170996+0000","last_peered":"2024-03-20T13:35:35.170996+0000","last_clean":"2024-03-20T13:35:35.170996+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:35:35.170996+0000","last_undegraded":"2024-03-20T13:35:35.170996+0000","last_fullsized":"2024-03-20T13:35:35.170996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.413335+0000","last_change":"2024-03-20T13:34:49.946510+0000","last_active":"2024-03-20T13:35:35.413335+0000","last_peered":"2024-03-20T13:35:35.413335+0000","last_clean":"2024-03-20T13:35:35.413335+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:35:35.413335+0000","last_undegraded":"2024-03-20T13:35:35.413335+0000","last_fullsized":"2024-03-20T13:35:35.413335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.823524+0000","last_change":"2024-03-20T13:34:51.937387+0000","last_active":"2024-03-20T13:35:34.823524+0000","last_peered":"2024-03-20T13:35:34.823524+0000","last_clean":"2024-03-20T13:35:34.823524+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:35:34.823524+0000","last_undegraded":"2024-03-20T13:35:34.823524+0000","last_fullsized":"2024-03-20T13:35:34.823524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982424+0000","last_change":"2024-03-20T13:34:49.949930+0000","last_active":"2024-03-20T13:35:30.982424+0000","last_peered":"2024-03-20T13:35:30.982424+0000","last_clean":"2024-03-20T13:35:30.982424+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:35:30.982424+0000","last_undegraded":"2024-03-20T13:35:30.982424+0000","last_fullsized":"2024-03-20T13:35:30.982424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.977365+0000","last_change":"2024-03-20T13:34:51.941800+0000","last_active":"2024-03-20T13:36:17.977365+0000","last_peered":"2024-03-20T13:36:17.977365+0000","last_clean":"2024-03-20T13:36:17.977365+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:36:17.977365+0000","last_undegraded":"2024-03-20T13:36:17.977365+0000","last_fullsized":"2024-03-20T13:36:17.977365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984390+0000","last_change":"2024-03-20T13:34:49.934846+0000","last_active":"2024-03-20T13:35:30.984390+0000","last_peered":"2024-03-20T13:35:30.984390+0000","last_clean":"2024-03-20T13:35:30.984390+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:35:30.984390+0000","last_undegraded":"2024-03-20T13:35:30.984390+0000","last_fullsized":"2024-03-20T13:35:30.984390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'5","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612698+0000","last_change":"2024-03-20T13:34:51.948384+0000","last_active":"2024-03-20T13:36:17.612698+0000","last_peered":"2024-03-20T13:36:17.612698+0000","last_clean":"2024-03-20T13:36:17.612698+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:36:17.612698+0000","last_undegraded":"2024-03-20T13:36:17.612698+0000","last_fullsized":"2024-03-20T13:36:17.612698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986297+0000","last_change":"2024-03-20T13:34:49.959590+0000","last_active":"2024-03-20T13:35:30.986297+0000","last_peered":"2024-03-20T13:35:30.986297+0000","last_clean":"2024-03-20T13:35:30.986297+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:35:30.986297+0000","last_undegraded":"2024-03-20T13:35:30.986297+0000","last_fullsized":"2024-03-20T13:35:30.986297+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.587959+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:23.587959+0000","last_peered":"2024-03-20T13:36:23.587959+0000","last_clean":"2024-03-20T13:36:23.587959+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:23.587959+0000","last_undegraded":"2024-03-20T13:36:23.587959+0000","last_fullsized":"2024-03-20T13:36:23.587959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.205213+0000","last_change":"2024-03-20T13:35:30.994560+0000","last_active":"2024-03-20T13:35:34.205213+0000","last_peered":"2024-03-20T13:35:34.205213+0000","last_clean":"2024-03-20T13:35:34.205213+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:35:34.205213+0000","last_undegraded":"2024-03-20T13:35:34.205213+0000","last_fullsized":"2024-03-20T13:35:34.205213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987330+0000","last_change":"2024-03-20T13:34:49.959439+0000","last_active":"2024-03-20T13:35:30.987330+0000","last_peered":"2024-03-20T13:35:30.987330+0000","last_clean":"2024-03-20T13:35:30.987330+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:35:30.987330+0000","last_undegraded":"2024-03-20T13:35:30.987330+0000","last_fullsized":"2024-03-20T13:35:30.987330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.127793+0000","last_change":"2024-03-20T13:36:41.127878+0000","last_active":"2024-03-20T13:36:41.127793+0000","last_peered":"2024-03-20T13:36:41.127793+0000","last_clean":"2024-03-20T13:36:41.127793+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:36:41.127793+0000","last_undegraded":"2024-03-20T13:36:41.127793+0000","last_fullsized":"2024-03-20T13:36:41.127793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.127679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:24.954726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'31","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.266152+0000","last_change":"2024-03-20T13:34:55.955194+0000","last_active":"2024-03-20T13:36:31.266152+0000","last_peered":"2024-03-20T13:36:31.266152+0000","last_clean":"2024-03-20T13:36:31.266152+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:36:31.266152+0000","last_undegraded":"2024-03-20T13:36:31.266152+0000","last_fullsized":"2024-03-20T13:36:31.266152+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.930551+0000","last_change":"2024-03-20T13:36:50.930574+0000","last_active":"2024-03-20T13:36:50.930551+0000","last_peered":"2024-03-20T13:36:50.930551+0000","last_clean":"2024-03-20T13:36:50.930551+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:36:50.930551+0000","last_undegraded":"2024-03-20T13:36:50.930551+0000","last_fullsized":"2024-03-20T13:36:50.930551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.930463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:21.352868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.758171+0000","last_change":"2024-03-20T13:34:59.969467+0000","last_active":"2024-03-20T13:36:17.758171+0000","last_peered":"2024-03-20T13:36:17.758171+0000","last_clean":"2024-03-20T13:36:17.758171+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:36:17.758171+0000","last_undegraded":"2024-03-20T13:36:17.758171+0000","last_fullsized":"2024-03-20T13:36:17.758171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612698+0000","last_change":"2024-03-20T13:34:51.943450+0000","last_active":"2024-03-20T13:36:17.612698+0000","last_peered":"2024-03-20T13:36:17.612698+0000","last_clean":"2024-03-20T13:36:17.612698+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:36:17.612698+0000","last_undegraded":"2024-03-20T13:36:17.612698+0000","last_fullsized":"2024-03-20T13:36:17.612698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985468+0000","last_change":"2024-03-20T13:34:49.955248+0000","last_active":"2024-03-20T13:35:30.985468+0000","last_peered":"2024-03-20T13:35:30.985468+0000","last_clean":"2024-03-20T13:35:30.985468+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:35:30.985468+0000","last_undegraded":"2024-03-20T13:35:30.985468+0000","last_fullsized":"2024-03-20T13:35:30.985468+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.442834+0000","last_change":"2024-03-20T13:36:50.442856+0000","last_active":"2024-03-20T13:36:50.442834+0000","last_peered":"2024-03-20T13:36:50.442834+0000","last_clean":"2024-03-20T13:36:50.442834+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:36:50.442834+0000","last_undegraded":"2024-03-20T13:36:50.442834+0000","last_fullsized":"2024-03-20T13:36:50.442834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.442744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:21.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.832854+0000","last_change":"2024-03-20T13:36:36.832911+0000","last_active":"2024-03-20T13:36:36.832854+0000","last_peered":"2024-03-20T13:36:36.832854+0000","last_clean":"2024-03-20T13:36:36.832854+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:36:36.832854+0000","last_undegraded":"2024-03-20T13:36:36.832854+0000","last_fullsized":"2024-03-20T13:36:36.832854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.832759+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:49.042157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981526+0000","last_change":"2024-03-20T13:34:57.966274+0000","last_active":"2024-03-20T13:35:30.981526+0000","last_peered":"2024-03-20T13:35:30.981526+0000","last_clean":"2024-03-20T13:35:30.981526+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:35:30.981526+0000","last_undegraded":"2024-03-20T13:35:30.981526+0000","last_fullsized":"2024-03-20T13:35:30.981526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.975009+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:17.975009+0000","last_peered":"2024-03-20T13:36:17.975009+0000","last_clean":"2024-03-20T13:36:17.975009+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:17.975009+0000","last_undegraded":"2024-03-20T13:36:17.975009+0000","last_fullsized":"2024-03-20T13:36:17.975009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976572+0000","last_change":"2024-03-20T13:34:51.940751+0000","last_active":"2024-03-20T13:36:17.976572+0000","last_peered":"2024-03-20T13:36:17.976572+0000","last_clean":"2024-03-20T13:36:17.976572+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:36:17.976572+0000","last_undegraded":"2024-03-20T13:36:17.976572+0000","last_fullsized":"2024-03-20T13:36:17.976572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985707+0000","last_change":"2024-03-20T13:34:49.959865+0000","last_active":"2024-03-20T13:35:30.985707+0000","last_peered":"2024-03-20T13:35:30.985707+0000","last_clean":"2024-03-20T13:35:30.985707+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:35:30.985707+0000","last_undegraded":"2024-03-20T13:35:30.985707+0000","last_fullsized":"2024-03-20T13:35:30.985707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.419235+0000","last_change":"2024-03-20T13:36:51.419261+0000","last_active":"2024-03-20T13:36:51.419235+0000","last_peered":"2024-03-20T13:36:51.419235+0000","last_clean":"2024-03-20T13:36:51.419235+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:36:51.419235+0000","last_undegraded":"2024-03-20T13:36:51.419235+0000","last_fullsized":"2024-03-20T13:36:51.419235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.419143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:49.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.226149+0000","last_change":"2024-03-20T13:36:49.226186+0000","last_active":"2024-03-20T13:36:49.226149+0000","last_peered":"2024-03-20T13:36:49.226149+0000","last_clean":"2024-03-20T13:36:49.226149+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:36:49.226149+0000","last_undegraded":"2024-03-20T13:36:49.226149+0000","last_fullsized":"2024-03-20T13:36:49.226149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.226058+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:05.000426+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'243","reported_seq":320,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.357491+0000","last_change":"2024-03-20T13:34:57.969943+0000","last_active":"2024-03-20T13:36:31.357491+0000","last_peered":"2024-03-20T13:36:31.357491+0000","last_clean":"2024-03-20T13:36:31.357491+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:36:31.357491+0000","last_undegraded":"2024-03-20T13:36:31.357491+0000","last_fullsized":"2024-03-20T13:36:31.357491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.208740+0000","last_change":"2024-03-20T13:36:46.208783+0000","last_active":"2024-03-20T13:36:46.208740+0000","last_peered":"2024-03-20T13:36:46.208740+0000","last_clean":"2024-03-20T13:36:46.208740+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:36:46.208740+0000","last_undegraded":"2024-03-20T13:36:46.208740+0000","last_fullsized":"2024-03-20T13:36:46.208740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.208641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:45.085668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.823633+0000","last_change":"2024-03-20T13:34:51.947848+0000","last_active":"2024-03-20T13:35:34.823633+0000","last_peered":"2024-03-20T13:35:34.823633+0000","last_clean":"2024-03-20T13:35:34.823633+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:35:34.823633+0000","last_undegraded":"2024-03-20T13:35:34.823633+0000","last_fullsized":"2024-03-20T13:35:34.823633+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980738+0000","last_change":"2024-03-20T13:34:49.943444+0000","last_active":"2024-03-20T13:35:30.980738+0000","last_peered":"2024-03-20T13:35:30.980738+0000","last_clean":"2024-03-20T13:35:30.980738+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:35:30.980738+0000","last_undegraded":"2024-03-20T13:35:30.980738+0000","last_fullsized":"2024-03-20T13:35:30.980738+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.164505+0000","last_change":"2024-03-20T13:36:47.164527+0000","last_active":"2024-03-20T13:36:47.164505+0000","last_peered":"2024-03-20T13:36:47.164505+0000","last_clean":"2024-03-20T13:36:47.164505+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:36:47.164505+0000","last_undegraded":"2024-03-20T13:36:47.164505+0000","last_fullsized":"2024-03-20T13:36:47.164505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.164416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:15.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.124342+0000","last_change":"2024-03-20T13:36:44.124403+0000","last_active":"2024-03-20T13:36:44.124342+0000","last_peered":"2024-03-20T13:36:44.124342+0000","last_clean":"2024-03-20T13:36:44.124342+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:44.124342+0000","last_undegraded":"2024-03-20T13:36:44.124342+0000","last_fullsized":"2024-03-20T13:36:44.124342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.124221+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:07.675114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.427126+0000","last_change":"2024-03-20T13:36:49.427157+0000","last_active":"2024-03-20T13:36:49.427126+0000","last_peered":"2024-03-20T13:36:49.427126+0000","last_clean":"2024-03-20T13:36:49.427126+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:49.427126+0000","last_undegraded":"2024-03-20T13:36:49.427126+0000","last_fullsized":"2024-03-20T13:36:49.427126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.427037+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:05:56.566896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.977510+0000","last_change":"2024-03-20T13:34:51.953602+0000","last_active":"2024-03-20T13:36:17.977510+0000","last_peered":"2024-03-20T13:36:17.977510+0000","last_clean":"2024-03-20T13:36:17.977510+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:36:17.977510+0000","last_undegraded":"2024-03-20T13:36:17.977510+0000","last_fullsized":"2024-03-20T13:36:17.977510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988886+0000","last_change":"2024-03-20T13:34:49.944500+0000","last_active":"2024-03-20T13:35:30.988886+0000","last_peered":"2024-03-20T13:35:30.988886+0000","last_clean":"2024-03-20T13:35:30.988886+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:35:30.988886+0000","last_undegraded":"2024-03-20T13:35:30.988886+0000","last_fullsized":"2024-03-20T13:35:30.988886+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.819975+0000","last_change":"2024-03-20T13:36:43.819999+0000","last_active":"2024-03-20T13:36:43.819975+0000","last_peered":"2024-03-20T13:36:43.819975+0000","last_clean":"2024-03-20T13:36:43.819975+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:36:43.819975+0000","last_undegraded":"2024-03-20T13:36:43.819975+0000","last_fullsized":"2024-03-20T13:36:43.819975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.819876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:18.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":108,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.190436+0000","last_change":"2024-03-20T13:36:48.190487+0000","last_active":"2024-03-20T13:36:48.190436+0000","last_peered":"2024-03-20T13:36:48.190436+0000","last_clean":"2024-03-20T13:36:48.190436+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:48.190436+0000","last_undegraded":"2024-03-20T13:36:48.190436+0000","last_fullsized":"2024-03-20T13:36:48.190436+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.190343+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:33:34.104031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.451297+0000","last_change":"2024-03-20T13:36:41.451320+0000","last_active":"2024-03-20T13:36:41.451297+0000","last_peered":"2024-03-20T13:36:41.451297+0000","last_clean":"2024-03-20T13:36:41.451297+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:36:41.451297+0000","last_undegraded":"2024-03-20T13:36:41.451297+0000","last_fullsized":"2024-03-20T13:36:41.451297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.451207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:01.674365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.760203+0000","last_change":"2024-03-20T13:34:59.974067+0000","last_active":"2024-03-20T13:36:17.760203+0000","last_peered":"2024-03-20T13:36:17.760203+0000","last_clean":"2024-03-20T13:36:17.760203+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:36:17.760203+0000","last_undegraded":"2024-03-20T13:36:17.760203+0000","last_fullsized":"2024-03-20T13:36:17.760203+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.170769+0000","last_change":"2024-03-20T13:34:51.941910+0000","last_active":"2024-03-20T13:35:35.170769+0000","last_peered":"2024-03-20T13:35:35.170769+0000","last_clean":"2024-03-20T13:35:35.170769+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:35:35.170769+0000","last_undegraded":"2024-03-20T13:35:35.170769+0000","last_fullsized":"2024-03-20T13:35:35.170769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.421252+0000","last_change":"2024-03-20T13:34:49.939109+0000","last_active":"2024-03-20T13:35:35.421252+0000","last_peered":"2024-03-20T13:35:35.421252+0000","last_clean":"2024-03-20T13:35:35.421252+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:35:35.421252+0000","last_undegraded":"2024-03-20T13:35:35.421252+0000","last_fullsized":"2024-03-20T13:35:35.421252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.409259+0000","last_change":"2024-03-20T13:36:52.409281+0000","last_active":"2024-03-20T13:36:52.409259+0000","last_peered":"2024-03-20T13:36:52.409259+0000","last_clean":"2024-03-20T13:36:52.409259+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:36:52.409259+0000","last_undegraded":"2024-03-20T13:36:52.409259+0000","last_fullsized":"2024-03-20T13:36:52.409259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.409171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:56:42.443923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.098988+0000","last_change":"2024-03-20T13:36:44.099051+0000","last_active":"2024-03-20T13:36:44.098988+0000","last_peered":"2024-03-20T13:36:44.098988+0000","last_clean":"2024-03-20T13:36:44.098988+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:44.098988+0000","last_undegraded":"2024-03-20T13:36:44.098988+0000","last_fullsized":"2024-03-20T13:36:44.098988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.098880+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:38.576272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.461666+0000","last_change":"2024-03-20T13:36:35.461685+0000","last_active":"2024-03-20T13:36:35.461666+0000","last_peered":"2024-03-20T13:36:35.461666+0000","last_clean":"2024-03-20T13:36:35.461666+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:36:35.461666+0000","last_undegraded":"2024-03-20T13:36:35.461666+0000","last_fullsized":"2024-03-20T13:36:35.461666+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.461582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:53.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.262699+0000","last_change":"2024-03-20T13:34:59.972444+0000","last_active":"2024-03-20T13:36:12.262699+0000","last_peered":"2024-03-20T13:36:12.262699+0000","last_clean":"2024-03-20T13:36:12.262699+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:36:12.262699+0000","last_undegraded":"2024-03-20T13:36:12.262699+0000","last_fullsized":"2024-03-20T13:36:12.262699+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'1","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612700+0000","last_change":"2024-03-20T13:34:51.941838+0000","last_active":"2024-03-20T13:36:17.612700+0000","last_peered":"2024-03-20T13:36:17.612700+0000","last_clean":"2024-03-20T13:36:17.612700+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:36:17.612700+0000","last_undegraded":"2024-03-20T13:36:17.612700+0000","last_fullsized":"2024-03-20T13:36:17.612700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990229+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:35:30.990229+0000","last_peered":"2024-03-20T13:35:30.990229+0000","last_clean":"2024-03-20T13:35:30.990229+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:35:30.990229+0000","last_undegraded":"2024-03-20T13:35:30.990229+0000","last_fullsized":"2024-03-20T13:35:30.990229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984981+0000","last_change":"2024-03-20T13:34:53.942038+0000","last_active":"2024-03-20T13:35:30.984981+0000","last_peered":"2024-03-20T13:35:30.984981+0000","last_clean":"2024-03-20T13:35:30.984981+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:35:30.984981+0000","last_undegraded":"2024-03-20T13:35:30.984981+0000","last_fullsized":"2024-03-20T13:35:30.984981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.195026+0000","last_change":"2024-03-20T13:36:48.195079+0000","last_active":"2024-03-20T13:36:48.195026+0000","last_peered":"2024-03-20T13:36:48.195026+0000","last_clean":"2024-03-20T13:36:48.195026+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:48.195026+0000","last_undegraded":"2024-03-20T13:36:48.195026+0000","last_fullsized":"2024-03-20T13:36:48.195026+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.194921+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:26.041799+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":288,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.392964+0000","last_change":"2024-03-20T13:34:57.969445+0000","last_active":"2024-03-20T13:36:31.392964+0000","last_peered":"2024-03-20T13:36:31.392964+0000","last_clean":"2024-03-20T13:36:31.392964+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:31.392964+0000","last_undegraded":"2024-03-20T13:36:31.392964+0000","last_fullsized":"2024-03-20T13:36:31.392964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984006+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:35:30.984006+0000","last_peered":"2024-03-20T13:35:30.984006+0000","last_clean":"2024-03-20T13:35:30.984006+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:35:30.984006+0000","last_undegraded":"2024-03-20T13:35:30.984006+0000","last_fullsized":"2024-03-20T13:35:30.984006+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986787+0000","last_change":"2024-03-20T13:34:51.935109+0000","last_active":"2024-03-20T13:35:30.986787+0000","last_peered":"2024-03-20T13:35:30.986787+0000","last_clean":"2024-03-20T13:35:30.986787+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:35:30.986787+0000","last_undegraded":"2024-03-20T13:35:30.986787+0000","last_fullsized":"2024-03-20T13:35:30.986787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.348448+0000","last_change":"2024-03-20T13:34:49.962872+0000","last_active":"2024-03-20T13:35:34.348448+0000","last_peered":"2024-03-20T13:35:34.348448+0000","last_clean":"2024-03-20T13:35:34.348448+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:35:34.348448+0000","last_undegraded":"2024-03-20T13:35:34.348448+0000","last_fullsized":"2024-03-20T13:35:34.348448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983015+0000","last_change":"2024-03-20T13:34:53.943850+0000","last_active":"2024-03-20T13:35:30.983015+0000","last_peered":"2024-03-20T13:35:30.983015+0000","last_clean":"2024-03-20T13:35:30.983015+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:35:30.983015+0000","last_undegraded":"2024-03-20T13:35:30.983015+0000","last_fullsized":"2024-03-20T13:35:30.983015+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":131,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.148006+0000","last_change":"2024-03-20T13:36:36.148045+0000","last_active":"2024-03-20T13:36:36.148006+0000","last_peered":"2024-03-20T13:36:36.148006+0000","last_clean":"2024-03-20T13:36:36.148006+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:36.148006+0000","last_undegraded":"2024-03-20T13:36:36.148006+0000","last_fullsized":"2024-03-20T13:36:36.148006+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.147906+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:41:00.828075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.497878+0000","last_change":"2024-03-20T13:36:38.497904+0000","last_active":"2024-03-20T13:36:38.497878+0000","last_peered":"2024-03-20T13:36:38.497878+0000","last_clean":"2024-03-20T13:36:38.497878+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:36:38.497878+0000","last_undegraded":"2024-03-20T13:36:38.497878+0000","last_fullsized":"2024-03-20T13:36:38.497878+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.497774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:57.922980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.582790+0000","last_change":"2024-03-20T13:34:59.966660+0000","last_active":"2024-03-20T13:36:23.582790+0000","last_peered":"2024-03-20T13:36:23.582790+0000","last_clean":"2024-03-20T13:36:23.582790+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:36:23.582790+0000","last_undegraded":"2024-03-20T13:36:23.582790+0000","last_fullsized":"2024-03-20T13:36:23.582790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.823575+0000","last_change":"2024-03-20T13:34:51.943562+0000","last_active":"2024-03-20T13:35:34.823575+0000","last_peered":"2024-03-20T13:35:34.823575+0000","last_clean":"2024-03-20T13:35:34.823575+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:35:34.823575+0000","last_undegraded":"2024-03-20T13:35:34.823575+0000","last_fullsized":"2024-03-20T13:35:34.823575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.346933+0000","last_change":"2024-03-20T13:34:49.933792+0000","last_active":"2024-03-20T13:35:34.346933+0000","last_peered":"2024-03-20T13:35:34.346933+0000","last_clean":"2024-03-20T13:35:34.346933+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:35:34.346933+0000","last_undegraded":"2024-03-20T13:35:34.346933+0000","last_fullsized":"2024-03-20T13:35:34.346933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":210,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.170683+0000","last_change":"2024-03-20T13:36:53.170733+0000","last_active":"2024-03-20T13:36:53.170683+0000","last_peered":"2024-03-20T13:36:53.170683+0000","last_clean":"2024-03-20T13:36:53.170683+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:53.170683+0000","last_undegraded":"2024-03-20T13:36:53.170683+0000","last_fullsized":"2024-03-20T13:36:53.170683+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.170592+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:12.595798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.786122+0000","last_change":"2024-03-20T13:36:39.786164+0000","last_active":"2024-03-20T13:36:39.786122+0000","last_peered":"2024-03-20T13:36:39.786122+0000","last_clean":"2024-03-20T13:36:39.786122+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:39.786122+0000","last_undegraded":"2024-03-20T13:36:39.786122+0000","last_fullsized":"2024-03-20T13:36:39.786122+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.786041+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:59.978158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989274+0000","last_change":"2024-03-20T13:34:57.962715+0000","last_active":"2024-03-20T13:35:30.989274+0000","last_peered":"2024-03-20T13:35:30.989274+0000","last_clean":"2024-03-20T13:35:30.989274+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:35:30.989274+0000","last_undegraded":"2024-03-20T13:35:30.989274+0000","last_fullsized":"2024-03-20T13:35:30.989274+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:12.264346+0000","last_change":"2024-03-20T13:34:59.971713+0000","last_active":"2024-03-20T13:36:12.264346+0000","last_peered":"2024-03-20T13:36:12.264346+0000","last_clean":"2024-03-20T13:36:12.264346+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:36:12.264346+0000","last_undegraded":"2024-03-20T13:36:12.264346+0000","last_fullsized":"2024-03-20T13:36:12.264346+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.977082+0000","last_change":"2024-03-20T13:35:30.988681+0000","last_active":"2024-03-20T13:36:17.977082+0000","last_peered":"2024-03-20T13:36:17.977082+0000","last_clean":"2024-03-20T13:36:17.977082+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:36:17.977082+0000","last_undegraded":"2024-03-20T13:36:17.977082+0000","last_fullsized":"2024-03-20T13:36:17.977082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986874+0000","last_change":"2024-03-20T13:34:49.958288+0000","last_active":"2024-03-20T13:35:30.986874+0000","last_peered":"2024-03-20T13:35:30.986874+0000","last_clean":"2024-03-20T13:35:30.986874+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:35:30.986874+0000","last_undegraded":"2024-03-20T13:35:30.986874+0000","last_fullsized":"2024-03-20T13:35:30.986874+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983347+0000","last_change":"2024-03-20T13:34:53.943738+0000","last_active":"2024-03-20T13:35:30.983347+0000","last_peered":"2024-03-20T13:35:30.983347+0000","last_clean":"2024-03-20T13:35:30.983347+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:35:30.983347+0000","last_undegraded":"2024-03-20T13:35:30.983347+0000","last_fullsized":"2024-03-20T13:35:30.983347+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.189207+0000","last_change":"2024-03-20T13:36:52.189274+0000","last_active":"2024-03-20T13:36:52.189207+0000","last_peered":"2024-03-20T13:36:52.189207+0000","last_clean":"2024-03-20T13:36:52.189207+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:52.189207+0000","last_undegraded":"2024-03-20T13:36:52.189207+0000","last_fullsized":"2024-03-20T13:36:52.189207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.189115+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:34:06.835908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":372,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.043888+0000","last_change":"2024-03-20T13:36:36.043936+0000","last_active":"2024-03-20T13:36:36.043888+0000","last_peered":"2024-03-20T13:36:36.043888+0000","last_clean":"2024-03-20T13:36:36.043888+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:36.043888+0000","last_undegraded":"2024-03-20T13:36:36.043888+0000","last_fullsized":"2024-03-20T13:36:36.043888+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.043753+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:45.456154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.984404+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:17.984404+0000","last_peered":"2024-03-20T13:36:17.984404+0000","last_clean":"2024-03-20T13:36:17.984404+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:17.984404+0000","last_undegraded":"2024-03-20T13:36:17.984404+0000","last_fullsized":"2024-03-20T13:36:17.984404+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989546+0000","last_change":"2024-03-20T13:34:51.942028+0000","last_active":"2024-03-20T13:35:30.989546+0000","last_peered":"2024-03-20T13:35:30.989546+0000","last_clean":"2024-03-20T13:35:30.989546+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:35:30.989546+0000","last_undegraded":"2024-03-20T13:35:30.989546+0000","last_fullsized":"2024-03-20T13:35:30.989546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986767+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:35:30.986767+0000","last_peered":"2024-03-20T13:35:30.986767+0000","last_clean":"2024-03-20T13:35:30.986767+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:35:30.986767+0000","last_undegraded":"2024-03-20T13:35:30.986767+0000","last_fullsized":"2024-03-20T13:35:30.986767+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'4","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.891180+0000","last_change":"2024-03-20T13:36:47.891230+0000","last_active":"2024-03-20T13:36:47.891180+0000","last_peered":"2024-03-20T13:36:47.891180+0000","last_clean":"2024-03-20T13:36:47.891180+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:47.891180+0000","last_undegraded":"2024-03-20T13:36:47.891180+0000","last_fullsized":"2024-03-20T13:36:47.891180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.891061+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:18.309754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.146147+0000","last_change":"2024-03-20T13:36:38.146186+0000","last_active":"2024-03-20T13:36:38.146147+0000","last_peered":"2024-03-20T13:36:38.146147+0000","last_clean":"2024-03-20T13:36:38.146147+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:36:38.146147+0000","last_undegraded":"2024-03-20T13:36:38.146147+0000","last_fullsized":"2024-03-20T13:36:38.146147+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.146066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:09.028952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":347,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.789922+0000","last_change":"2024-03-20T13:36:38.789972+0000","last_active":"2024-03-20T13:36:38.789922+0000","last_peered":"2024-03-20T13:36:38.789922+0000","last_clean":"2024-03-20T13:36:38.789922+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:38.789922+0000","last_undegraded":"2024-03-20T13:36:38.789922+0000","last_fullsized":"2024-03-20T13:36:38.789922+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.789823+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:57.247566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984917+0000","last_change":"2024-03-20T13:34:59.973435+0000","last_active":"2024-03-20T13:35:30.984917+0000","last_peered":"2024-03-20T13:35:30.984917+0000","last_clean":"2024-03-20T13:35:30.984917+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:35:30.984917+0000","last_undegraded":"2024-03-20T13:35:30.984917+0000","last_fullsized":"2024-03-20T13:35:30.984917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.880672+0000","last_change":"2024-03-20T13:36:52.880699+0000","last_active":"2024-03-20T13:36:52.880672+0000","last_peered":"2024-03-20T13:36:52.880672+0000","last_clean":"2024-03-20T13:36:52.880672+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:52.880672+0000","last_undegraded":"2024-03-20T13:36:52.880672+0000","last_fullsized":"2024-03-20T13:36:52.880672+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.880575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:24.333852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984318+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:35:30.984318+0000","last_peered":"2024-03-20T13:35:30.984318+0000","last_clean":"2024-03-20T13:35:30.984318+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:35:30.984318+0000","last_undegraded":"2024-03-20T13:35:30.984318+0000","last_fullsized":"2024-03-20T13:35:30.984318+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.116933+0000","last_change":"2024-03-20T13:36:39.116987+0000","last_active":"2024-03-20T13:36:39.116933+0000","last_peered":"2024-03-20T13:36:39.116933+0000","last_clean":"2024-03-20T13:36:39.116933+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:36:39.116933+0000","last_undegraded":"2024-03-20T13:36:39.116933+0000","last_fullsized":"2024-03-20T13:36:39.116933+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.116826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:14:51.320018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":104,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.797673+0000","last_change":"2024-03-20T13:36:37.797716+0000","last_active":"2024-03-20T13:36:37.797673+0000","last_peered":"2024-03-20T13:36:37.797673+0000","last_clean":"2024-03-20T13:36:37.797673+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:37.797673+0000","last_undegraded":"2024-03-20T13:36:37.797673+0000","last_fullsized":"2024-03-20T13:36:37.797673+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.797588+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:30:53.571956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.074168+0000","last_change":"2024-03-20T13:36:39.074189+0000","last_active":"2024-03-20T13:36:39.074168+0000","last_peered":"2024-03-20T13:36:39.074168+0000","last_clean":"2024-03-20T13:36:39.074168+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:36:39.074168+0000","last_undegraded":"2024-03-20T13:36:39.074168+0000","last_fullsized":"2024-03-20T13:36:39.074168+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.074084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:36.877815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.584658+0000","last_change":"2024-03-20T13:34:59.968783+0000","last_active":"2024-03-20T13:36:23.584658+0000","last_peered":"2024-03-20T13:36:23.584658+0000","last_clean":"2024-03-20T13:36:23.584658+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:36:23.584658+0000","last_undegraded":"2024-03-20T13:36:23.584658+0000","last_fullsized":"2024-03-20T13:36:23.584658+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.201469+0000","last_change":"2024-03-20T13:36:53.201510+0000","last_active":"2024-03-20T13:36:53.201469+0000","last_peered":"2024-03-20T13:36:53.201469+0000","last_clean":"2024-03-20T13:36:53.201469+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:36:53.201469+0000","last_undegraded":"2024-03-20T13:36:53.201469+0000","last_fullsized":"2024-03-20T13:36:53.201469+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.201374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:47.204640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.215268+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:36:34.215268+0000","last_peered":"2024-03-20T13:36:34.215268+0000","last_clean":"2024-03-20T13:36:34.215268+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:36:34.215268+0000","last_undegraded":"2024-03-20T13:36:34.215268+0000","last_fullsized":"2024-03-20T13:36:34.215268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592927+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:36:35.592927+0000","last_peered":"2024-03-20T13:36:35.592927+0000","last_clean":"2024-03-20T13:36:35.592927+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:36:35.592927+0000","last_undegraded":"2024-03-20T13:36:35.592927+0000","last_fullsized":"2024-03-20T13:36:35.592927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985957+0000","last_change":"2024-03-20T13:34:49.963030+0000","last_active":"2024-03-20T13:35:30.985957+0000","last_peered":"2024-03-20T13:35:30.985957+0000","last_clean":"2024-03-20T13:35:30.985957+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:35:30.985957+0000","last_undegraded":"2024-03-20T13:35:30.985957+0000","last_fullsized":"2024-03-20T13:35:30.985957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.953525+0000","last_change":"2024-03-20T13:36:49.953552+0000","last_active":"2024-03-20T13:36:49.953525+0000","last_peered":"2024-03-20T13:36:49.953525+0000","last_clean":"2024-03-20T13:36:49.953525+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:36:49.953525+0000","last_undegraded":"2024-03-20T13:36:49.953525+0000","last_fullsized":"2024-03-20T13:36:49.953525+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.953431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:13.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":171,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.123363+0000","last_change":"2024-03-20T13:36:46.123405+0000","last_active":"2024-03-20T13:36:46.123363+0000","last_peered":"2024-03-20T13:36:46.123363+0000","last_clean":"2024-03-20T13:36:46.123363+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:46.123363+0000","last_undegraded":"2024-03-20T13:36:46.123363+0000","last_fullsized":"2024-03-20T13:36:46.123363+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.123283+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:09.527164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.454166+0000","last_change":"2024-03-20T13:36:42.454190+0000","last_active":"2024-03-20T13:36:42.454166+0000","last_peered":"2024-03-20T13:36:42.454166+0000","last_clean":"2024-03-20T13:36:42.454166+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:36:42.454166+0000","last_undegraded":"2024-03-20T13:36:42.454166+0000","last_fullsized":"2024-03-20T13:36:42.454166+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.454069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:47.214837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":120,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.145532+0000","last_change":"2024-03-20T13:36:54.145557+0000","last_active":"2024-03-20T13:36:54.145532+0000","last_peered":"2024-03-20T13:36:54.145532+0000","last_clean":"2024-03-20T13:36:54.145532+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:54.145532+0000","last_undegraded":"2024-03-20T13:36:54.145532+0000","last_fullsized":"2024-03-20T13:36:54.145532+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.145443+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:45.665997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989309+0000","last_change":"2024-03-20T13:34:51.941170+0000","last_active":"2024-03-20T13:35:30.989309+0000","last_peered":"2024-03-20T13:35:30.989309+0000","last_clean":"2024-03-20T13:35:30.989309+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:35:30.989309+0000","last_undegraded":"2024-03-20T13:35:30.989309+0000","last_fullsized":"2024-03-20T13:35:30.989309+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592926+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:36:35.592926+0000","last_peered":"2024-03-20T13:36:35.592926+0000","last_clean":"2024-03-20T13:36:35.592926+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:36:35.592926+0000","last_undegraded":"2024-03-20T13:36:35.592926+0000","last_fullsized":"2024-03-20T13:36:35.592926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982541+0000","last_change":"2024-03-20T13:34:49.941798+0000","last_active":"2024-03-20T13:35:30.982541+0000","last_peered":"2024-03-20T13:35:30.982541+0000","last_clean":"2024-03-20T13:35:30.982541+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:35:30.982541+0000","last_undegraded":"2024-03-20T13:35:30.982541+0000","last_fullsized":"2024-03-20T13:35:30.982541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.083055+0000","last_change":"2024-03-20T13:36:43.083092+0000","last_active":"2024-03-20T13:36:43.083055+0000","last_peered":"2024-03-20T13:36:43.083055+0000","last_clean":"2024-03-20T13:36:43.083055+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:36:43.083055+0000","last_undegraded":"2024-03-20T13:36:43.083055+0000","last_fullsized":"2024-03-20T13:36:43.083055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.082968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:27:06.735401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":447,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.848415+0000","last_change":"2024-03-20T13:36:35.848464+0000","last_active":"2024-03-20T13:36:35.848415+0000","last_peered":"2024-03-20T13:36:35.848415+0000","last_clean":"2024-03-20T13:36:35.848415+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:35.848415+0000","last_undegraded":"2024-03-20T13:36:35.848415+0000","last_fullsized":"2024-03-20T13:36:35.848415+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.848325+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:59:23.551034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988233+0000","last_change":"2024-03-20T13:34:57.964648+0000","last_active":"2024-03-20T13:35:30.988233+0000","last_peered":"2024-03-20T13:35:30.988233+0000","last_clean":"2024-03-20T13:35:30.988233+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:35:30.988233+0000","last_undegraded":"2024-03-20T13:35:30.988233+0000","last_fullsized":"2024-03-20T13:35:30.988233+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.756452+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:17.756452+0000","last_peered":"2024-03-20T13:36:17.756452+0000","last_clean":"2024-03-20T13:36:17.756452+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:17.756452+0000","last_undegraded":"2024-03-20T13:36:17.756452+0000","last_fullsized":"2024-03-20T13:36:17.756452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976700+0000","last_change":"2024-03-20T13:34:51.947812+0000","last_active":"2024-03-20T13:36:17.976700+0000","last_peered":"2024-03-20T13:36:17.976700+0000","last_clean":"2024-03-20T13:36:17.976700+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:36:17.976700+0000","last_undegraded":"2024-03-20T13:36:17.976700+0000","last_fullsized":"2024-03-20T13:36:17.976700+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150431+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:36:35.150431+0000","last_peered":"2024-03-20T13:36:35.150431+0000","last_clean":"2024-03-20T13:36:35.150431+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:36:35.150431+0000","last_undegraded":"2024-03-20T13:36:35.150431+0000","last_fullsized":"2024-03-20T13:36:35.150431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271620+0000","last_change":"2024-03-20T13:34:49.934321+0000","last_active":"2024-03-20T13:36:34.271620+0000","last_peered":"2024-03-20T13:36:34.271620+0000","last_clean":"2024-03-20T13:36:34.271620+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:36:34.271620+0000","last_undegraded":"2024-03-20T13:36:34.271620+0000","last_fullsized":"2024-03-20T13:36:34.271620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"23'1","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988987+0000","last_change":"2024-03-20T13:34:53.943172+0000","last_active":"2024-03-20T13:35:30.988987+0000","last_peered":"2024-03-20T13:35:30.988987+0000","last_clean":"2024-03-20T13:35:30.988987+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:35:30.988987+0000","last_undegraded":"2024-03-20T13:35:30.988987+0000","last_fullsized":"2024-03-20T13:35:30.988987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.214976+0000","last_change":"2024-03-20T13:36:47.215018+0000","last_active":"2024-03-20T13:36:47.214976+0000","last_peered":"2024-03-20T13:36:47.214976+0000","last_clean":"2024-03-20T13:36:47.214976+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:47.214976+0000","last_undegraded":"2024-03-20T13:36:47.214976+0000","last_fullsized":"2024-03-20T13:36:47.214976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.214888+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:24.057007+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.483691+0000","last_change":"2024-03-20T13:36:40.483718+0000","last_active":"2024-03-20T13:36:40.483691+0000","last_peered":"2024-03-20T13:36:40.483691+0000","last_clean":"2024-03-20T13:36:40.483691+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:36:40.483691+0000","last_undegraded":"2024-03-20T13:36:40.483691+0000","last_fullsized":"2024-03-20T13:36:40.483691+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.483604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:15.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986183+0000","last_change":"2024-03-20T13:34:59.970194+0000","last_active":"2024-03-20T13:35:30.986183+0000","last_peered":"2024-03-20T13:35:30.986183+0000","last_clean":"2024-03-20T13:35:30.986183+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:35:30.986183+0000","last_undegraded":"2024-03-20T13:35:30.986183+0000","last_fullsized":"2024-03-20T13:35:30.986183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.575582+0000","last_change":"2024-03-20T13:34:51.937043+0000","last_active":"2024-03-20T13:36:23.575582+0000","last_peered":"2024-03-20T13:36:23.575582+0000","last_clean":"2024-03-20T13:36:23.575582+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:36:23.575582+0000","last_undegraded":"2024-03-20T13:36:23.575582+0000","last_fullsized":"2024-03-20T13:36:23.575582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592922+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:36:35.592922+0000","last_peered":"2024-03-20T13:36:35.592922+0000","last_clean":"2024-03-20T13:36:35.592922+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:36:35.592922+0000","last_undegraded":"2024-03-20T13:36:35.592922+0000","last_fullsized":"2024-03-20T13:36:35.592922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150474+0000","last_change":"2024-03-20T13:34:49.938266+0000","last_active":"2024-03-20T13:36:35.150474+0000","last_peered":"2024-03-20T13:36:35.150474+0000","last_clean":"2024-03-20T13:36:35.150474+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:36:35.150474+0000","last_undegraded":"2024-03-20T13:36:35.150474+0000","last_fullsized":"2024-03-20T13:36:35.150474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984006+0000","last_change":"2024-03-20T13:34:53.942835+0000","last_active":"2024-03-20T13:35:30.984006+0000","last_peered":"2024-03-20T13:35:30.984006+0000","last_clean":"2024-03-20T13:35:30.984006+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:35:30.984006+0000","last_undegraded":"2024-03-20T13:35:30.984006+0000","last_fullsized":"2024-03-20T13:35:30.984006+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'13","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:24.884320+0000","last_change":"2024-03-20T13:34:55.955766+0000","last_active":"2024-03-20T13:36:24.884320+0000","last_peered":"2024-03-20T13:36:24.884320+0000","last_clean":"2024-03-20T13:36:24.884320+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:36:24.884320+0000","last_undegraded":"2024-03-20T13:36:24.884320+0000","last_fullsized":"2024-03-20T13:36:24.884320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989416+0000","last_change":"2024-03-20T13:34:57.962510+0000","last_active":"2024-03-20T13:35:30.989416+0000","last_peered":"2024-03-20T13:35:30.989416+0000","last_clean":"2024-03-20T13:35:30.989416+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:35:30.989416+0000","last_undegraded":"2024-03-20T13:35:30.989416+0000","last_fullsized":"2024-03-20T13:35:30.989416+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.819872+0000","last_change":"2024-03-20T13:34:59.972480+0000","last_active":"2024-03-20T13:35:34.819872+0000","last_peered":"2024-03-20T13:35:34.819872+0000","last_clean":"2024-03-20T13:35:34.819872+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:35:34.819872+0000","last_undegraded":"2024-03-20T13:35:34.819872+0000","last_fullsized":"2024-03-20T13:35:34.819872+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'8","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612982+0000","last_change":"2024-03-20T13:34:51.950770+0000","last_active":"2024-03-20T13:36:17.612982+0000","last_peered":"2024-03-20T13:36:17.612982+0000","last_clean":"2024-03-20T13:36:17.612982+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:17.612982+0000","last_undegraded":"2024-03-20T13:36:17.612982+0000","last_fullsized":"2024-03-20T13:36:17.612982+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150492+0000","last_change":"2024-03-20T13:34:49.936614+0000","last_active":"2024-03-20T13:36:35.150492+0000","last_peered":"2024-03-20T13:36:35.150492+0000","last_clean":"2024-03-20T13:36:35.150492+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:36:35.150492+0000","last_undegraded":"2024-03-20T13:36:35.150492+0000","last_fullsized":"2024-03-20T13:36:35.150492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271675+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:36:34.271675+0000","last_peered":"2024-03-20T13:36:34.271675+0000","last_clean":"2024-03-20T13:36:34.271675+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:36:34.271675+0000","last_undegraded":"2024-03-20T13:36:34.271675+0000","last_fullsized":"2024-03-20T13:36:34.271675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'2","reported_seq":195,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.205549+0000","last_change":"2024-03-20T13:34:53.942462+0000","last_active":"2024-03-20T13:36:31.205549+0000","last_peered":"2024-03-20T13:36:31.205549+0000","last_clean":"2024-03-20T13:36:31.205549+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:31.205549+0000","last_undegraded":"2024-03-20T13:36:31.205549+0000","last_fullsized":"2024-03-20T13:36:31.205549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":143,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.439281+0000","last_change":"2024-03-20T13:36:43.439320+0000","last_active":"2024-03-20T13:36:43.439281+0000","last_peered":"2024-03-20T13:36:43.439281+0000","last_clean":"2024-03-20T13:36:43.439281+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:43.439281+0000","last_undegraded":"2024-03-20T13:36:43.439281+0000","last_fullsized":"2024-03-20T13:36:43.439281+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.439197+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:55.779728+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.107991+0000","last_change":"2024-03-20T13:36:40.108014+0000","last_active":"2024-03-20T13:36:40.107991+0000","last_peered":"2024-03-20T13:36:40.107991+0000","last_clean":"2024-03-20T13:36:40.107991+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:36:40.107991+0000","last_undegraded":"2024-03-20T13:36:40.107991+0000","last_fullsized":"2024-03-20T13:36:40.107991+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.107898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:33.206081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.986151+0000","last_change":"2024-03-20T13:34:59.968897+0000","last_active":"2024-03-20T13:36:17.986151+0000","last_peered":"2024-03-20T13:36:17.986151+0000","last_clean":"2024-03-20T13:36:17.986151+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:36:17.986151+0000","last_undegraded":"2024-03-20T13:36:17.986151+0000","last_fullsized":"2024-03-20T13:36:17.986151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980961+0000","last_change":"2024-03-20T13:34:51.941739+0000","last_active":"2024-03-20T13:35:30.980961+0000","last_peered":"2024-03-20T13:35:30.980961+0000","last_clean":"2024-03-20T13:35:30.980961+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:35:30.980961+0000","last_undegraded":"2024-03-20T13:35:30.980961+0000","last_fullsized":"2024-03-20T13:35:30.980961+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984086+0000","last_change":"2024-03-20T13:34:49.946734+0000","last_active":"2024-03-20T13:35:30.984086+0000","last_peered":"2024-03-20T13:35:30.984086+0000","last_clean":"2024-03-20T13:35:30.984086+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:35:30.984086+0000","last_undegraded":"2024-03-20T13:35:30.984086+0000","last_fullsized":"2024-03-20T13:35:30.984086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592938+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:36:35.592938+0000","last_peered":"2024-03-20T13:36:35.592938+0000","last_clean":"2024-03-20T13:36:35.592938+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:36:35.592938+0000","last_undegraded":"2024-03-20T13:36:35.592938+0000","last_fullsized":"2024-03-20T13:36:35.592938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.129078+0000","last_change":"2024-03-20T13:36:45.129101+0000","last_active":"2024-03-20T13:36:45.129078+0000","last_peered":"2024-03-20T13:36:45.129078+0000","last_clean":"2024-03-20T13:36:45.129078+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:36:45.129078+0000","last_undegraded":"2024-03-20T13:36:45.129078+0000","last_fullsized":"2024-03-20T13:36:45.129078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.128960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:46.746210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.882043+0000","last_change":"2024-03-20T13:36:34.882086+0000","last_active":"2024-03-20T13:36:34.882043+0000","last_peered":"2024-03-20T13:36:34.882043+0000","last_clean":"2024-03-20T13:36:34.882043+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:36:34.882043+0000","last_undegraded":"2024-03-20T13:36:34.882043+0000","last_fullsized":"2024-03-20T13:36:34.882043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.881955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:01.668025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":290,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.888210+0000","last_change":"2024-03-20T13:36:46.888239+0000","last_active":"2024-03-20T13:36:46.888210+0000","last_peered":"2024-03-20T13:36:46.888210+0000","last_clean":"2024-03-20T13:36:46.888210+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:46.888210+0000","last_undegraded":"2024-03-20T13:36:46.888210+0000","last_fullsized":"2024-03-20T13:36:46.888210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.888110+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.228641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.172452+0000","last_change":"2024-03-20T13:34:59.965966+0000","last_active":"2024-03-20T13:35:35.172452+0000","last_peered":"2024-03-20T13:35:35.172452+0000","last_clean":"2024-03-20T13:35:35.172452+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:35:35.172452+0000","last_undegraded":"2024-03-20T13:35:35.172452+0000","last_fullsized":"2024-03-20T13:35:35.172452+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.204303+0000","last_change":"2024-03-20T13:36:51.204303+0000","last_active":"2024-03-20T13:36:51.204303+0000","last_peered":"2024-03-20T13:36:51.204303+0000","last_clean":"2024-03-20T13:36:51.204303+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:36:51.204303+0000","last_undegraded":"2024-03-20T13:36:51.204303+0000","last_fullsized":"2024-03-20T13:36:51.204303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.204192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:38.634547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990341+0000","last_change":"2024-03-20T13:34:49.957658+0000","last_active":"2024-03-20T13:35:30.990341+0000","last_peered":"2024-03-20T13:35:30.990341+0000","last_clean":"2024-03-20T13:35:30.990341+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:35:30.990341+0000","last_undegraded":"2024-03-20T13:35:30.990341+0000","last_fullsized":"2024-03-20T13:35:30.990341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271638+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:36:34.271638+0000","last_peered":"2024-03-20T13:36:34.271638+0000","last_clean":"2024-03-20T13:36:34.271638+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:36:34.271638+0000","last_undegraded":"2024-03-20T13:36:34.271638+0000","last_fullsized":"2024-03-20T13:36:34.271638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.991692+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:35:30.991692+0000","last_peered":"2024-03-20T13:35:30.991692+0000","last_clean":"2024-03-20T13:35:30.991692+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:35:30.991692+0000","last_undegraded":"2024-03-20T13:35:30.991692+0000","last_fullsized":"2024-03-20T13:35:30.991692+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986558+0000","last_change":"2024-03-20T13:34:55.955147+0000","last_active":"2024-03-20T13:35:30.986558+0000","last_peered":"2024-03-20T13:35:30.986558+0000","last_clean":"2024-03-20T13:35:30.986558+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:35:30.986558+0000","last_undegraded":"2024-03-20T13:35:30.986558+0000","last_fullsized":"2024-03-20T13:35:30.986558+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.452526+0000","last_change":"2024-03-20T13:36:45.452554+0000","last_active":"2024-03-20T13:36:45.452526+0000","last_peered":"2024-03-20T13:36:45.452526+0000","last_clean":"2024-03-20T13:36:45.452526+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:45.452526+0000","last_undegraded":"2024-03-20T13:36:45.452526+0000","last_fullsized":"2024-03-20T13:36:45.452526+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.452437+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:06:35.977614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981249+0000","last_change":"2024-03-20T13:34:59.968359+0000","last_active":"2024-03-20T13:35:30.981249+0000","last_peered":"2024-03-20T13:35:30.981249+0000","last_clean":"2024-03-20T13:35:30.981249+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:35:30.981249+0000","last_undegraded":"2024-03-20T13:35:30.981249+0000","last_fullsized":"2024-03-20T13:35:30.981249+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.170856+0000","last_change":"2024-03-20T13:34:51.944433+0000","last_active":"2024-03-20T13:35:35.170856+0000","last_peered":"2024-03-20T13:35:35.170856+0000","last_clean":"2024-03-20T13:35:35.170856+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:35:35.170856+0000","last_undegraded":"2024-03-20T13:35:35.170856+0000","last_fullsized":"2024-03-20T13:35:35.170856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982102+0000","last_change":"2024-03-20T13:34:49.947597+0000","last_active":"2024-03-20T13:35:30.982102+0000","last_peered":"2024-03-20T13:35:30.982102+0000","last_clean":"2024-03-20T13:35:30.982102+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:35:30.982102+0000","last_undegraded":"2024-03-20T13:35:30.982102+0000","last_fullsized":"2024-03-20T13:35:30.982102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592938+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:36:35.592938+0000","last_peered":"2024-03-20T13:36:35.592938+0000","last_clean":"2024-03-20T13:36:35.592938+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:36:35.592938+0000","last_undegraded":"2024-03-20T13:36:35.592938+0000","last_fullsized":"2024-03-20T13:36:35.592938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.105883+0000","last_change":"2024-03-20T13:36:42.105883+0000","last_active":"2024-03-20T13:36:42.105883+0000","last_peered":"2024-03-20T13:36:42.105883+0000","last_clean":"2024-03-20T13:36:42.105883+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:36:42.105883+0000","last_undegraded":"2024-03-20T13:36:42.105883+0000","last_fullsized":"2024-03-20T13:36:42.105883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.105759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:22:49.608123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":183,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.173435+0000","last_change":"2024-03-20T13:36:45.173473+0000","last_active":"2024-03-20T13:36:45.173435+0000","last_peered":"2024-03-20T13:36:45.173435+0000","last_clean":"2024-03-20T13:36:45.173435+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:45.173435+0000","last_undegraded":"2024-03-20T13:36:45.173435+0000","last_fullsized":"2024-03-20T13:36:45.173435+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'91","last_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_deep_scrub":"32'91","last_deep_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.173353+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:11.959423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.486396+0000","last_change":"2024-03-20T13:36:36.486441+0000","last_active":"2024-03-20T13:36:36.486396+0000","last_peered":"2024-03-20T13:36:36.486396+0000","last_clean":"2024-03-20T13:36:36.486396+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:36:36.486396+0000","last_undegraded":"2024-03-20T13:36:36.486396+0000","last_fullsized":"2024-03-20T13:36:36.486396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.486298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:56.678415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.195154+0000","last_change":"2024-03-20T13:36:50.195177+0000","last_active":"2024-03-20T13:36:50.195154+0000","last_peered":"2024-03-20T13:36:50.195154+0000","last_clean":"2024-03-20T13:36:50.195154+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:36:50.195154+0000","last_undegraded":"2024-03-20T13:36:50.195154+0000","last_fullsized":"2024-03-20T13:36:50.195154+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.195066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:08.652809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.162932+0000","last_change":"2024-03-20T13:36:42.162953+0000","last_active":"2024-03-20T13:36:42.162932+0000","last_peered":"2024-03-20T13:36:42.162932+0000","last_clean":"2024-03-20T13:36:42.162932+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:36:42.162932+0000","last_undegraded":"2024-03-20T13:36:42.162932+0000","last_fullsized":"2024-03-20T13:36:42.162932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.162847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:46:25.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.575584+0000","last_change":"2024-03-20T13:34:51.943309+0000","last_active":"2024-03-20T13:36:23.575584+0000","last_peered":"2024-03-20T13:36:23.575584+0000","last_clean":"2024-03-20T13:36:23.575584+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:36:23.575584+0000","last_undegraded":"2024-03-20T13:36:23.575584+0000","last_fullsized":"2024-03-20T13:36:23.575584+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988191+0000","last_change":"2024-03-20T13:34:49.960700+0000","last_active":"2024-03-20T13:35:30.988191+0000","last_peered":"2024-03-20T13:35:30.988191+0000","last_clean":"2024-03-20T13:35:30.988191+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:35:30.988191+0000","last_undegraded":"2024-03-20T13:35:30.988191+0000","last_fullsized":"2024-03-20T13:35:30.988191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.927588+0000","last_change":"2024-03-20T13:36:48.927642+0000","last_active":"2024-03-20T13:36:48.927588+0000","last_peered":"2024-03-20T13:36:48.927588+0000","last_clean":"2024-03-20T13:36:48.927588+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:36:48.927588+0000","last_undegraded":"2024-03-20T13:36:48.927588+0000","last_fullsized":"2024-03-20T13:36:48.927588+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.927492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:31.555602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'33","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.281204+0000","last_change":"2024-03-20T13:34:55.955235+0000","last_active":"2024-03-20T13:36:31.281204+0000","last_peered":"2024-03-20T13:36:31.281204+0000","last_clean":"2024-03-20T13:36:31.281204+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:36:31.281204+0000","last_undegraded":"2024-03-20T13:36:31.281204+0000","last_fullsized":"2024-03-20T13:36:31.281204+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984750+0000","last_change":"2024-03-20T13:34:57.968867+0000","last_active":"2024-03-20T13:35:30.984750+0000","last_peered":"2024-03-20T13:35:30.984750+0000","last_clean":"2024-03-20T13:35:30.984750+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:35:30.984750+0000","last_undegraded":"2024-03-20T13:35:30.984750+0000","last_fullsized":"2024-03-20T13:35:30.984750+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983807+0000","last_change":"2024-03-20T13:34:59.966513+0000","last_active":"2024-03-20T13:35:30.983807+0000","last_peered":"2024-03-20T13:35:30.983807+0000","last_clean":"2024-03-20T13:35:30.983807+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:35:30.983807+0000","last_undegraded":"2024-03-20T13:35:30.983807+0000","last_fullsized":"2024-03-20T13:35:30.983807+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.577962+0000","last_change":"2024-03-20T13:34:51.944041+0000","last_active":"2024-03-20T13:36:23.577962+0000","last_peered":"2024-03-20T13:36:23.577962+0000","last_clean":"2024-03-20T13:36:23.577962+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:36:23.577962+0000","last_undegraded":"2024-03-20T13:36:23.577962+0000","last_fullsized":"2024-03-20T13:36:23.577962+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.566068+0000","last_change":"2024-03-20T13:34:49.950884+0000","last_active":"2024-03-20T13:36:23.566068+0000","last_peered":"2024-03-20T13:36:23.566068+0000","last_clean":"2024-03-20T13:36:23.566068+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:36:23.566068+0000","last_undegraded":"2024-03-20T13:36:23.566068+0000","last_fullsized":"2024-03-20T13:36:23.566068+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.205160+0000","last_change":"2024-03-20T13:35:30.990765+0000","last_active":"2024-03-20T13:35:34.205160+0000","last_peered":"2024-03-20T13:35:34.205160+0000","last_clean":"2024-03-20T13:35:34.205160+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:35:34.205160+0000","last_undegraded":"2024-03-20T13:35:34.205160+0000","last_fullsized":"2024-03-20T13:35:34.205160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.478607+0000","last_change":"2024-03-20T13:36:47.478637+0000","last_active":"2024-03-20T13:36:47.478607+0000","last_peered":"2024-03-20T13:36:47.478607+0000","last_clean":"2024-03-20T13:36:47.478607+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:47.478607+0000","last_undegraded":"2024-03-20T13:36:47.478607+0000","last_fullsized":"2024-03-20T13:36:47.478607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.478507+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:17.900912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.100156+0000","last_change":"2024-03-20T13:36:38.100179+0000","last_active":"2024-03-20T13:36:38.100156+0000","last_peered":"2024-03-20T13:36:38.100156+0000","last_clean":"2024-03-20T13:36:38.100156+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:36:38.100156+0000","last_undegraded":"2024-03-20T13:36:38.100156+0000","last_fullsized":"2024-03-20T13:36:38.100156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.100067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:06:11.567457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983495+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:35:30.983495+0000","last_peered":"2024-03-20T13:35:30.983495+0000","last_clean":"2024-03-20T13:35:30.983495+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:35:30.983495+0000","last_undegraded":"2024-03-20T13:35:30.983495+0000","last_fullsized":"2024-03-20T13:35:30.983495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982921+0000","last_change":"2024-03-20T13:34:51.935236+0000","last_active":"2024-03-20T13:35:30.982921+0000","last_peered":"2024-03-20T13:35:30.982921+0000","last_clean":"2024-03-20T13:35:30.982921+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:35:30.982921+0000","last_undegraded":"2024-03-20T13:35:30.982921+0000","last_fullsized":"2024-03-20T13:35:30.982921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989286+0000","last_change":"2024-03-20T13:34:49.946529+0000","last_active":"2024-03-20T13:35:30.989286+0000","last_peered":"2024-03-20T13:35:30.989286+0000","last_clean":"2024-03-20T13:35:30.989286+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:35:30.989286+0000","last_undegraded":"2024-03-20T13:35:30.989286+0000","last_fullsized":"2024-03-20T13:35:30.989286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985056+0000","last_change":"2024-03-20T13:34:53.944081+0000","last_active":"2024-03-20T13:35:30.985056+0000","last_peered":"2024-03-20T13:35:30.985056+0000","last_clean":"2024-03-20T13:35:30.985056+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:35:30.985056+0000","last_undegraded":"2024-03-20T13:35:30.985056+0000","last_fullsized":"2024-03-20T13:35:30.985056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.407001+0000","last_change":"2024-03-20T13:36:44.407080+0000","last_active":"2024-03-20T13:36:44.407001+0000","last_peered":"2024-03-20T13:36:44.407001+0000","last_clean":"2024-03-20T13:36:44.407001+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:44.407001+0000","last_undegraded":"2024-03-20T13:36:44.407001+0000","last_fullsized":"2024-03-20T13:36:44.407001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.406901+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:14.825593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.839014+0000","last_change":"2024-03-20T13:36:42.839038+0000","last_active":"2024-03-20T13:36:42.839014+0000","last_peered":"2024-03-20T13:36:42.839014+0000","last_clean":"2024-03-20T13:36:42.839014+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:36:42.839014+0000","last_undegraded":"2024-03-20T13:36:42.839014+0000","last_fullsized":"2024-03-20T13:36:42.839014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.838924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:34.359477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988737+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:35:30.988737+0000","last_peered":"2024-03-20T13:35:30.988737+0000","last_clean":"2024-03-20T13:35:30.988737+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:35:30.988737+0000","last_undegraded":"2024-03-20T13:35:30.988737+0000","last_fullsized":"2024-03-20T13:35:30.988737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.196769+0000","last_change":"2024-03-20T13:36:49.196840+0000","last_active":"2024-03-20T13:36:49.196769+0000","last_peered":"2024-03-20T13:36:49.196769+0000","last_clean":"2024-03-20T13:36:49.196769+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:36:49.196769+0000","last_undegraded":"2024-03-20T13:36:49.196769+0000","last_fullsized":"2024-03-20T13:36:49.196769+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.196667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:30.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982723+0000","last_change":"2024-03-20T13:34:49.937900+0000","last_active":"2024-03-20T13:35:30.982723+0000","last_peered":"2024-03-20T13:35:30.982723+0000","last_clean":"2024-03-20T13:35:30.982723+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:35:30.982723+0000","last_undegraded":"2024-03-20T13:35:30.982723+0000","last_fullsized":"2024-03-20T13:35:30.982723+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.120303+0000","last_change":"2024-03-20T13:36:37.120372+0000","last_active":"2024-03-20T13:36:37.120303+0000","last_peered":"2024-03-20T13:36:37.120303+0000","last_clean":"2024-03-20T13:36:37.120303+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:36:37.120303+0000","last_undegraded":"2024-03-20T13:36:37.120303+0000","last_fullsized":"2024-03-20T13:36:37.120303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.120203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.166010+0000","last_change":"2024-03-20T13:36:51.166063+0000","last_active":"2024-03-20T13:36:51.166010+0000","last_peered":"2024-03-20T13:36:51.166010+0000","last_clean":"2024-03-20T13:36:51.166010+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:51.166010+0000","last_undegraded":"2024-03-20T13:36:51.166010+0000","last_fullsized":"2024-03-20T13:36:51.166010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.165931+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:11.358048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.137609+0000","last_change":"2024-03-20T13:36:43.137649+0000","last_active":"2024-03-20T13:36:43.137609+0000","last_peered":"2024-03-20T13:36:43.137609+0000","last_clean":"2024-03-20T13:36:43.137609+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:36:43.137609+0000","last_undegraded":"2024-03-20T13:36:43.137609+0000","last_fullsized":"2024-03-20T13:36:43.137609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.137482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:28.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.937232+0000","last_change":"2024-03-20T13:34:51.944100+0000","last_active":"2024-03-20T13:35:35.937232+0000","last_peered":"2024-03-20T13:35:35.937232+0000","last_clean":"2024-03-20T13:35:35.937232+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:35:35.937232+0000","last_undegraded":"2024-03-20T13:35:35.937232+0000","last_fullsized":"2024-03-20T13:35:35.937232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983909+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:35:30.983909+0000","last_peered":"2024-03-20T13:35:30.983909+0000","last_clean":"2024-03-20T13:35:30.983909+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:35:30.983909+0000","last_undegraded":"2024-03-20T13:35:30.983909+0000","last_fullsized":"2024-03-20T13:35:30.983909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272266+0000","last_change":"2024-03-20T13:34:53.942580+0000","last_active":"2024-03-20T13:36:34.272266+0000","last_peered":"2024-03-20T13:36:34.272266+0000","last_clean":"2024-03-20T13:36:34.272266+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:36:34.272266+0000","last_undegraded":"2024-03-20T13:36:34.272266+0000","last_fullsized":"2024-03-20T13:36:34.272266+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":133,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.434884+0000","last_change":"2024-03-20T13:36:46.434919+0000","last_active":"2024-03-20T13:36:46.434884+0000","last_peered":"2024-03-20T13:36:46.434884+0000","last_clean":"2024-03-20T13:36:46.434884+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:46.434884+0000","last_undegraded":"2024-03-20T13:36:46.434884+0000","last_fullsized":"2024-03-20T13:36:46.434884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.434789+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:21.531106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.142297+0000","last_change":"2024-03-20T13:36:41.142333+0000","last_active":"2024-03-20T13:36:41.142297+0000","last_peered":"2024-03-20T13:36:41.142297+0000","last_clean":"2024-03-20T13:36:41.142297+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:36:41.142297+0000","last_undegraded":"2024-03-20T13:36:41.142297+0000","last_fullsized":"2024-03-20T13:36:41.142297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.142212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:35.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.982703+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:17.982703+0000","last_peered":"2024-03-20T13:36:17.982703+0000","last_clean":"2024-03-20T13:36:17.982703+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:17.982703+0000","last_undegraded":"2024-03-20T13:36:17.982703+0000","last_fullsized":"2024-03-20T13:36:17.982703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'3","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271925+0000","last_change":"2024-03-20T13:34:51.947516+0000","last_active":"2024-03-20T13:36:34.271925+0000","last_peered":"2024-03-20T13:36:34.271925+0000","last_clean":"2024-03-20T13:36:34.271925+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:36:34.271925+0000","last_undegraded":"2024-03-20T13:36:34.271925+0000","last_fullsized":"2024-03-20T13:36:34.271925+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980647+0000","last_change":"2024-03-20T13:34:49.946304+0000","last_active":"2024-03-20T13:35:30.980647+0000","last_peered":"2024-03-20T13:35:30.980647+0000","last_clean":"2024-03-20T13:35:30.980647+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:35:30.980647+0000","last_undegraded":"2024-03-20T13:35:30.980647+0000","last_fullsized":"2024-03-20T13:35:30.980647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.993413+0000","last_change":"2024-03-20T13:35:30.992863+0000","last_active":"2024-03-20T13:35:30.993413+0000","last_peered":"2024-03-20T13:35:30.993413+0000","last_clean":"2024-03-20T13:35:30.993413+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:35:30.993413+0000","last_undegraded":"2024-03-20T13:35:30.993413+0000","last_fullsized":"2024-03-20T13:35:30.993413+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'37","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:31.338986+0000","last_change":"2024-03-20T13:34:55.955358+0000","last_active":"2024-03-20T13:36:31.338986+0000","last_peered":"2024-03-20T13:36:31.338986+0000","last_clean":"2024-03-20T13:36:31.338986+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:36:31.338986+0000","last_undegraded":"2024-03-20T13:36:31.338986+0000","last_fullsized":"2024-03-20T13:36:31.338986+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981382+0000","last_change":"2024-03-20T13:34:57.964942+0000","last_active":"2024-03-20T13:35:30.981382+0000","last_peered":"2024-03-20T13:35:30.981382+0000","last_clean":"2024-03-20T13:35:30.981382+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:35:30.981382+0000","last_undegraded":"2024-03-20T13:35:30.981382+0000","last_fullsized":"2024-03-20T13:35:30.981382+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985344+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:35:30.985344+0000","last_peered":"2024-03-20T13:35:30.985344+0000","last_clean":"2024-03-20T13:35:30.985344+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:35:30.985344+0000","last_undegraded":"2024-03-20T13:35:30.985344+0000","last_fullsized":"2024-03-20T13:35:30.985344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.167722+0000","last_change":"2024-03-20T13:36:50.167768+0000","last_active":"2024-03-20T13:36:50.167722+0000","last_peered":"2024-03-20T13:36:50.167722+0000","last_clean":"2024-03-20T13:36:50.167722+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:36:50.167722+0000","last_undegraded":"2024-03-20T13:36:50.167722+0000","last_fullsized":"2024-03-20T13:36:50.167722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.167623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:36.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981203+0000","last_change":"2024-03-20T13:34:49.948392+0000","last_active":"2024-03-20T13:35:30.981203+0000","last_peered":"2024-03-20T13:35:30.981203+0000","last_clean":"2024-03-20T13:35:30.981203+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:35:30.981203+0000","last_undegraded":"2024-03-20T13:35:30.981203+0000","last_fullsized":"2024-03-20T13:35:30.981203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.992732+0000","last_change":"2024-03-20T13:35:30.991895+0000","last_active":"2024-03-20T13:35:30.992732+0000","last_peered":"2024-03-20T13:35:30.992732+0000","last_clean":"2024-03-20T13:35:30.992732+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:35:30.992732+0000","last_undegraded":"2024-03-20T13:35:30.992732+0000","last_fullsized":"2024-03-20T13:35:30.992732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'37","reported_seq":92,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.430133+0000","last_change":"2024-03-20T13:36:48.430174+0000","last_active":"2024-03-20T13:36:48.430133+0000","last_peered":"2024-03-20T13:36:48.430133+0000","last_clean":"2024-03-20T13:36:48.430133+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:48.430133+0000","last_undegraded":"2024-03-20T13:36:48.430133+0000","last_fullsized":"2024-03-20T13:36:48.430133+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.430044+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:13:05.290246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984160+0000","last_change":"2024-03-20T13:34:57.968260+0000","last_active":"2024-03-20T13:35:30.984160+0000","last_peered":"2024-03-20T13:35:30.984160+0000","last_clean":"2024-03-20T13:35:30.984160+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:35:30.984160+0000","last_undegraded":"2024-03-20T13:35:30.984160+0000","last_fullsized":"2024-03-20T13:35:30.984160+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.573751+0000","last_change":"2024-03-20T13:34:59.970646+0000","last_active":"2024-03-20T13:36:23.573751+0000","last_peered":"2024-03-20T13:36:23.573751+0000","last_clean":"2024-03-20T13:36:23.573751+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:36:23.573751+0000","last_undegraded":"2024-03-20T13:36:23.573751+0000","last_fullsized":"2024-03-20T13:36:23.573751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432949+0000","last_change":"2024-03-20T13:34:51.943110+0000","last_active":"2024-03-20T13:35:35.432949+0000","last_peered":"2024-03-20T13:35:35.432949+0000","last_clean":"2024-03-20T13:35:35.432949+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:35:35.432949+0000","last_undegraded":"2024-03-20T13:35:35.432949+0000","last_fullsized":"2024-03-20T13:35:35.432949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987440+0000","last_change":"2024-03-20T13:34:49.960382+0000","last_active":"2024-03-20T13:35:30.987440+0000","last_peered":"2024-03-20T13:35:30.987440+0000","last_clean":"2024-03-20T13:35:30.987440+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:35:30.987440+0000","last_undegraded":"2024-03-20T13:35:30.987440+0000","last_fullsized":"2024-03-20T13:35:30.987440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.916128+0000","last_change":"2024-03-20T13:36:51.916154+0000","last_active":"2024-03-20T13:36:51.916128+0000","last_peered":"2024-03-20T13:36:51.916128+0000","last_clean":"2024-03-20T13:36:51.916128+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:36:51.916128+0000","last_undegraded":"2024-03-20T13:36:51.916128+0000","last_fullsized":"2024-03-20T13:36:51.916128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.916042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:20.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"30'10","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988442+0000","last_change":"2024-03-20T13:34:55.962070+0000","last_active":"2024-03-20T13:35:30.988442+0000","last_peered":"2024-03-20T13:35:30.988442+0000","last_clean":"2024-03-20T13:35:30.988442+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:35:30.988442+0000","last_undegraded":"2024-03-20T13:35:30.988442+0000","last_fullsized":"2024-03-20T13:35:30.988442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:54.932079+0000","last_clean_scrub_stamp":"2024-03-20T13:34:54.932079+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":305,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.069167+0000","last_change":"2024-03-20T13:36:37.069210+0000","last_active":"2024-03-20T13:36:37.069167+0000","last_peered":"2024-03-20T13:36:37.069167+0000","last_clean":"2024-03-20T13:36:37.069167+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:37.069167+0000","last_undegraded":"2024-03-20T13:36:37.069167+0000","last_fullsized":"2024-03-20T13:36:37.069167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.069055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:28:39.752450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983230+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:35:30.983230+0000","last_peered":"2024-03-20T13:35:30.983230+0000","last_clean":"2024-03-20T13:35:30.983230+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:35:30.983230+0000","last_undegraded":"2024-03-20T13:35:30.983230+0000","last_fullsized":"2024-03-20T13:35:30.983230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.821392+0000","last_change":"2024-03-20T13:34:51.935075+0000","last_active":"2024-03-20T13:35:34.821392+0000","last_peered":"2024-03-20T13:35:34.821392+0000","last_clean":"2024-03-20T13:35:34.821392+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:35:34.821392+0000","last_undegraded":"2024-03-20T13:35:34.821392+0000","last_fullsized":"2024-03-20T13:35:34.821392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982472+0000","last_change":"2024-03-20T13:34:49.939827+0000","last_active":"2024-03-20T13:35:30.982472+0000","last_peered":"2024-03-20T13:35:30.982472+0000","last_clean":"2024-03-20T13:35:30.982472+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:35:30.982472+0000","last_undegraded":"2024-03-20T13:35:30.982472+0000","last_fullsized":"2024-03-20T13:35:30.982472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.882061+0000","last_change":"2024-03-20T13:36:45.882093+0000","last_active":"2024-03-20T13:36:45.882061+0000","last_peered":"2024-03-20T13:36:45.882061+0000","last_clean":"2024-03-20T13:36:45.882061+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:36:45.882061+0000","last_undegraded":"2024-03-20T13:36:45.882061+0000","last_fullsized":"2024-03-20T13:36:45.882061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.881976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:18.667047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.780747+0000","last_change":"2024-03-20T13:36:40.780797+0000","last_active":"2024-03-20T13:36:40.780747+0000","last_peered":"2024-03-20T13:36:40.780747+0000","last_clean":"2024-03-20T13:36:40.780747+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:40.780747+0000","last_undegraded":"2024-03-20T13:36:40.780747+0000","last_fullsized":"2024-03-20T13:36:40.780747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.780669+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:55.427462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.483839+0000","last_change":"2024-03-20T13:36:37.483874+0000","last_active":"2024-03-20T13:36:37.483839+0000","last_peered":"2024-03-20T13:36:37.483839+0000","last_clean":"2024-03-20T13:36:37.483839+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:36:37.483839+0000","last_undegraded":"2024-03-20T13:36:37.483839+0000","last_fullsized":"2024-03-20T13:36:37.483839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.483750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:40.729135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983073+0000","last_change":"2024-03-20T13:34:59.974362+0000","last_active":"2024-03-20T13:35:30.983073+0000","last_peered":"2024-03-20T13:35:30.983073+0000","last_clean":"2024-03-20T13:35:30.983073+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:35:30.983073+0000","last_undegraded":"2024-03-20T13:35:30.983073+0000","last_fullsized":"2024-03-20T13:35:30.983073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.826151+0000","last_change":"2024-03-20T13:34:51.933525+0000","last_active":"2024-03-20T13:35:34.826151+0000","last_peered":"2024-03-20T13:35:34.826151+0000","last_clean":"2024-03-20T13:35:34.826151+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:35:34.826151+0000","last_undegraded":"2024-03-20T13:35:34.826151+0000","last_fullsized":"2024-03-20T13:35:34.826151+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990118+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:35:30.990118+0000","last_peered":"2024-03-20T13:35:30.990118+0000","last_clean":"2024-03-20T13:35:30.990118+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:35:30.990118+0000","last_undegraded":"2024-03-20T13:35:30.990118+0000","last_fullsized":"2024-03-20T13:35:30.990118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987819+0000","last_change":"2024-03-20T13:34:53.944574+0000","last_active":"2024-03-20T13:35:30.987819+0000","last_peered":"2024-03-20T13:35:30.987819+0000","last_clean":"2024-03-20T13:35:30.987819+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:35:30.987819+0000","last_undegraded":"2024-03-20T13:35:30.987819+0000","last_fullsized":"2024-03-20T13:35:30.987819+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.483596+0000","last_change":"2024-03-20T13:36:34.483646+0000","last_active":"2024-03-20T13:36:34.483596+0000","last_peered":"2024-03-20T13:36:34.483596+0000","last_clean":"2024-03-20T13:36:34.483596+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:34.483596+0000","last_undegraded":"2024-03-20T13:36:34.483596+0000","last_fullsized":"2024-03-20T13:36:34.483596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.483533+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:25:29.809601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985298+0000","last_change":"2024-03-20T13:34:57.968928+0000","last_active":"2024-03-20T13:35:30.985298+0000","last_peered":"2024-03-20T13:35:30.985298+0000","last_clean":"2024-03-20T13:35:30.985298+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:35:30.985298+0000","last_undegraded":"2024-03-20T13:35:30.985298+0000","last_fullsized":"2024-03-20T13:35:30.985298+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.941502+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:35:35.941502+0000","last_peered":"2024-03-20T13:35:35.941502+0000","last_clean":"2024-03-20T13:35:35.941502+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:35:35.941502+0000","last_undegraded":"2024-03-20T13:35:35.941502+0000","last_fullsized":"2024-03-20T13:35:35.941502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985719+0000","last_change":"2024-03-20T13:34:51.945209+0000","last_active":"2024-03-20T13:35:30.985719+0000","last_peered":"2024-03-20T13:35:30.985719+0000","last_clean":"2024-03-20T13:35:30.985719+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:35:30.985719+0000","last_undegraded":"2024-03-20T13:35:30.985719+0000","last_fullsized":"2024-03-20T13:35:30.985719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271667+0000","last_change":"2024-03-20T13:34:49.939306+0000","last_active":"2024-03-20T13:36:34.271667+0000","last_peered":"2024-03-20T13:36:34.271667+0000","last_clean":"2024-03-20T13:36:34.271667+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:36:34.271667+0000","last_undegraded":"2024-03-20T13:36:34.271667+0000","last_fullsized":"2024-03-20T13:36:34.271667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.870463+0000","last_change":"2024-03-20T13:36:44.870499+0000","last_active":"2024-03-20T13:36:44.870463+0000","last_peered":"2024-03-20T13:36:44.870463+0000","last_clean":"2024-03-20T13:36:44.870463+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:36:44.870463+0000","last_undegraded":"2024-03-20T13:36:44.870463+0000","last_fullsized":"2024-03-20T13:36:44.870463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:38:54.104546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.096149+0000","last_change":"2024-03-20T13:36:40.096207+0000","last_active":"2024-03-20T13:36:40.096149+0000","last_peered":"2024-03-20T13:36:40.096149+0000","last_clean":"2024-03-20T13:36:40.096149+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:40.096149+0000","last_undegraded":"2024-03-20T13:36:40.096149+0000","last_fullsized":"2024-03-20T13:36:40.096149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.096051+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:22.717936+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985592+0000","last_change":"2024-03-20T13:34:57.968516+0000","last_active":"2024-03-20T13:35:30.985592+0000","last_peered":"2024-03-20T13:35:30.985592+0000","last_clean":"2024-03-20T13:35:30.985592+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:35:30.985592+0000","last_undegraded":"2024-03-20T13:35:30.985592+0000","last_fullsized":"2024-03-20T13:35:30.985592+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:56.940237+0000","last_clean_scrub_stamp":"2024-03-20T13:34:56.940237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988441+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:35:30.988441+0000","last_peered":"2024-03-20T13:35:30.988441+0000","last_clean":"2024-03-20T13:35:30.988441+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:35:30.988441+0000","last_undegraded":"2024-03-20T13:35:30.988441+0000","last_fullsized":"2024-03-20T13:35:30.988441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.170654+0000","last_change":"2024-03-20T13:34:51.933565+0000","last_active":"2024-03-20T13:35:35.170654+0000","last_peered":"2024-03-20T13:35:35.170654+0000","last_clean":"2024-03-20T13:35:35.170654+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:35:35.170654+0000","last_undegraded":"2024-03-20T13:35:35.170654+0000","last_fullsized":"2024-03-20T13:35:35.170654+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711106+0000","last_change":"2024-03-20T13:34:49.937954+0000","last_active":"2024-03-20T13:36:34.711106+0000","last_peered":"2024-03-20T13:36:34.711106+0000","last_clean":"2024-03-20T13:36:34.711106+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:36:34.711106+0000","last_undegraded":"2024-03-20T13:36:34.711106+0000","last_fullsized":"2024-03-20T13:36:34.711106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.791969+0000","last_change":"2024-03-20T13:36:41.792027+0000","last_active":"2024-03-20T13:36:41.791969+0000","last_peered":"2024-03-20T13:36:41.791969+0000","last_clean":"2024-03-20T13:36:41.791969+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:36:41.791969+0000","last_undegraded":"2024-03-20T13:36:41.791969+0000","last_fullsized":"2024-03-20T13:36:41.791969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.791862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:01.217069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.209626+0000","last_change":"2024-03-20T13:36:52.209667+0000","last_active":"2024-03-20T13:36:52.209626+0000","last_peered":"2024-03-20T13:36:52.209626+0000","last_clean":"2024-03-20T13:36:52.209626+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:52.209626+0000","last_undegraded":"2024-03-20T13:36:52.209626+0000","last_fullsized":"2024-03-20T13:36:52.209626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.209539+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:29.303951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.508574+0000","last_change":"2024-03-20T13:36:39.508600+0000","last_active":"2024-03-20T13:36:39.508574+0000","last_peered":"2024-03-20T13:36:39.508574+0000","last_clean":"2024-03-20T13:36:39.508574+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:36:39.508574+0000","last_undegraded":"2024-03-20T13:36:39.508574+0000","last_fullsized":"2024-03-20T13:36:39.508574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.508482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:31.029035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987690+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:35:30.987690+0000","last_peered":"2024-03-20T13:35:30.987690+0000","last_clean":"2024-03-20T13:35:30.987690+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:35:30.987690+0000","last_undegraded":"2024-03-20T13:35:30.987690+0000","last_fullsized":"2024-03-20T13:35:30.987690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.853824+0000","last_change":"2024-03-20T13:36:53.853870+0000","last_active":"2024-03-20T13:36:53.853824+0000","last_peered":"2024-03-20T13:36:53.853824+0000","last_clean":"2024-03-20T13:36:53.853824+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:36:53.853824+0000","last_undegraded":"2024-03-20T13:36:53.853824+0000","last_fullsized":"2024-03-20T13:36:53.853824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.853690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:52.367889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150666+0000","last_change":"2024-03-20T13:34:49.949098+0000","last_active":"2024-03-20T13:36:35.150666+0000","last_peered":"2024-03-20T13:36:35.150666+0000","last_clean":"2024-03-20T13:36:35.150666+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:36:35.150666+0000","last_undegraded":"2024-03-20T13:36:35.150666+0000","last_fullsized":"2024-03-20T13:36:35.150666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984692+0000","last_change":"2024-03-20T13:34:51.943051+0000","last_active":"2024-03-20T13:35:30.984692+0000","last_peered":"2024-03-20T13:35:30.984692+0000","last_clean":"2024-03-20T13:35:30.984692+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:35:30.984692+0000","last_undegraded":"2024-03-20T13:35:30.984692+0000","last_fullsized":"2024-03-20T13:35:30.984692+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.348443+0000","last_change":"2024-03-20T13:34:49.933350+0000","last_active":"2024-03-20T13:35:34.348443+0000","last_peered":"2024-03-20T13:35:34.348443+0000","last_clean":"2024-03-20T13:35:34.348443+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:35:34.348443+0000","last_undegraded":"2024-03-20T13:35:34.348443+0000","last_fullsized":"2024-03-20T13:35:34.348443+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432528+0000","last_change":"2024-03-20T13:34:51.945886+0000","last_active":"2024-03-20T13:35:35.432528+0000","last_peered":"2024-03-20T13:35:35.432528+0000","last_clean":"2024-03-20T13:35:35.432528+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:35:35.432528+0000","last_undegraded":"2024-03-20T13:35:35.432528+0000","last_fullsized":"2024-03-20T13:35:35.432528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985861+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:35:30.985861+0000","last_peered":"2024-03-20T13:35:30.985861+0000","last_clean":"2024-03-20T13:35:30.985861+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:35:30.985861+0000","last_undegraded":"2024-03-20T13:35:30.985861+0000","last_fullsized":"2024-03-20T13:35:30.985861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612665+0000","last_change":"2024-03-20T13:34:51.942923+0000","last_active":"2024-03-20T13:36:17.612665+0000","last_peered":"2024-03-20T13:36:17.612665+0000","last_clean":"2024-03-20T13:36:17.612665+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:36:17.612665+0000","last_undegraded":"2024-03-20T13:36:17.612665+0000","last_fullsized":"2024-03-20T13:36:17.612665+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984266+0000","last_change":"2024-03-20T13:34:49.933497+0000","last_active":"2024-03-20T13:35:30.984266+0000","last_peered":"2024-03-20T13:35:30.984266+0000","last_clean":"2024-03-20T13:35:30.984266+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:35:30.984266+0000","last_undegraded":"2024-03-20T13:35:30.984266+0000","last_fullsized":"2024-03-20T13:35:30.984266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983916+0000","last_change":"2024-03-20T13:34:51.937130+0000","last_active":"2024-03-20T13:35:30.983916+0000","last_peered":"2024-03-20T13:35:30.983916+0000","last_clean":"2024-03-20T13:35:30.983916+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:35:30.983916+0000","last_undegraded":"2024-03-20T13:35:30.983916+0000","last_fullsized":"2024-03-20T13:35:30.983916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984094+0000","last_change":"2024-03-20T13:34:49.946558+0000","last_active":"2024-03-20T13:35:30.984094+0000","last_peered":"2024-03-20T13:35:30.984094+0000","last_clean":"2024-03-20T13:35:30.984094+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:35:30.984094+0000","last_undegraded":"2024-03-20T13:35:30.984094+0000","last_fullsized":"2024-03-20T13:35:30.984094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.576171+0000","last_change":"2024-03-20T13:34:51.953134+0000","last_active":"2024-03-20T13:36:23.576171+0000","last_peered":"2024-03-20T13:36:23.576171+0000","last_clean":"2024-03-20T13:36:23.576171+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:23.576171+0000","last_undegraded":"2024-03-20T13:36:23.576171+0000","last_fullsized":"2024-03-20T13:36:23.576171+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981455+0000","last_change":"2024-03-20T13:34:49.945395+0000","last_active":"2024-03-20T13:35:30.981455+0000","last_peered":"2024-03-20T13:35:30.981455+0000","last_clean":"2024-03-20T13:35:30.981455+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:35:30.981455+0000","last_undegraded":"2024-03-20T13:35:30.981455+0000","last_fullsized":"2024-03-20T13:35:30.981455+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976543+0000","last_change":"2024-03-20T13:34:51.947021+0000","last_active":"2024-03-20T13:36:17.976543+0000","last_peered":"2024-03-20T13:36:17.976543+0000","last_clean":"2024-03-20T13:36:17.976543+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:36:17.976543+0000","last_undegraded":"2024-03-20T13:36:17.976543+0000","last_fullsized":"2024-03-20T13:36:17.976543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.965630+0000","last_change":"2024-03-20T13:34:49.946770+0000","last_active":"2024-03-20T13:36:17.965630+0000","last_peered":"2024-03-20T13:36:17.965630+0000","last_clean":"2024-03-20T13:36:17.965630+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:36:17.965630+0000","last_undegraded":"2024-03-20T13:36:17.965630+0000","last_fullsized":"2024-03-20T13:36:17.965630+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432516+0000","last_change":"2024-03-20T13:34:51.941533+0000","last_active":"2024-03-20T13:35:35.432516+0000","last_peered":"2024-03-20T13:35:35.432516+0000","last_clean":"2024-03-20T13:35:35.432516+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:35:35.432516+0000","last_undegraded":"2024-03-20T13:35:35.432516+0000","last_fullsized":"2024-03-20T13:35:35.432516+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984741+0000","last_change":"2024-03-20T13:34:49.934739+0000","last_active":"2024-03-20T13:35:30.984741+0000","last_peered":"2024-03-20T13:35:30.984741+0000","last_clean":"2024-03-20T13:35:30.984741+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:35:30.984741+0000","last_undegraded":"2024-03-20T13:35:30.984741+0000","last_fullsized":"2024-03-20T13:35:30.984741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983321+0000","last_change":"2024-03-20T13:34:51.948058+0000","last_active":"2024-03-20T13:35:30.983321+0000","last_peered":"2024-03-20T13:35:30.983321+0000","last_clean":"2024-03-20T13:35:30.983321+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:35:30.983321+0000","last_undegraded":"2024-03-20T13:35:30.983321+0000","last_fullsized":"2024-03-20T13:35:30.983321+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.424180+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:35:35.424180+0000","last_peered":"2024-03-20T13:35:35.424180+0000","last_clean":"2024-03-20T13:35:35.424180+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:35:35.424180+0000","last_undegraded":"2024-03-20T13:35:35.424180+0000","last_fullsized":"2024-03-20T13:35:35.424180+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988279+0000","last_change":"2024-03-20T13:34:51.949486+0000","last_active":"2024-03-20T13:35:30.988279+0000","last_peered":"2024-03-20T13:35:30.988279+0000","last_clean":"2024-03-20T13:35:30.988279+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:35:30.988279+0000","last_undegraded":"2024-03-20T13:35:30.988279+0000","last_fullsized":"2024-03-20T13:35:30.988279+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982665+0000","last_change":"2024-03-20T13:34:49.934646+0000","last_active":"2024-03-20T13:35:30.982665+0000","last_peered":"2024-03-20T13:35:30.982665+0000","last_clean":"2024-03-20T13:35:30.982665+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:35:30.982665+0000","last_undegraded":"2024-03-20T13:35:30.982665+0000","last_fullsized":"2024-03-20T13:35:30.982665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":59,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.576134+0000","last_change":"2024-03-20T13:34:51.935272+0000","last_active":"2024-03-20T13:36:23.576134+0000","last_peered":"2024-03-20T13:36:23.576134+0000","last_clean":"2024-03-20T13:36:23.576134+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:36:23.576134+0000","last_undegraded":"2024-03-20T13:36:23.576134+0000","last_fullsized":"2024-03-20T13:36:23.576134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.981755+0000","last_change":"2024-03-20T13:34:49.955817+0000","last_active":"2024-03-20T13:35:30.981755+0000","last_peered":"2024-03-20T13:35:30.981755+0000","last_clean":"2024-03-20T13:35:30.981755+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:35:30.981755+0000","last_undegraded":"2024-03-20T13:35:30.981755+0000","last_fullsized":"2024-03-20T13:35:30.981755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.937390+0000","last_change":"2024-03-20T13:34:51.946963+0000","last_active":"2024-03-20T13:35:35.937390+0000","last_peered":"2024-03-20T13:35:35.937390+0000","last_clean":"2024-03-20T13:35:35.937390+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:35:35.937390+0000","last_undegraded":"2024-03-20T13:35:35.937390+0000","last_fullsized":"2024-03-20T13:35:35.937390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.980844+0000","last_change":"2024-03-20T13:34:49.944556+0000","last_active":"2024-03-20T13:35:30.980844+0000","last_peered":"2024-03-20T13:35:30.980844+0000","last_clean":"2024-03-20T13:35:30.980844+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:35:30.980844+0000","last_undegraded":"2024-03-20T13:35:30.980844+0000","last_fullsized":"2024-03-20T13:35:30.980844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.170673+0000","last_change":"2024-03-20T13:34:51.948336+0000","last_active":"2024-03-20T13:35:35.170673+0000","last_peered":"2024-03-20T13:35:35.170673+0000","last_clean":"2024-03-20T13:35:35.170673+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:35:35.170673+0000","last_undegraded":"2024-03-20T13:35:35.170673+0000","last_fullsized":"2024-03-20T13:35:35.170673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.346579+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:35:34.346579+0000","last_peered":"2024-03-20T13:35:34.346579+0000","last_clean":"2024-03-20T13:35:34.346579+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:35:34.346579+0000","last_undegraded":"2024-03-20T13:35:34.346579+0000","last_fullsized":"2024-03-20T13:35:34.346579+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.576057+0000","last_change":"2024-03-20T13:34:51.950006+0000","last_active":"2024-03-20T13:36:23.576057+0000","last_peered":"2024-03-20T13:36:23.576057+0000","last_clean":"2024-03-20T13:36:23.576057+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:23.576057+0000","last_undegraded":"2024-03-20T13:36:23.576057+0000","last_fullsized":"2024-03-20T13:36:23.576057+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990309+0000","last_change":"2024-03-20T13:34:49.962883+0000","last_active":"2024-03-20T13:35:30.990309+0000","last_peered":"2024-03-20T13:35:30.990309+0000","last_clean":"2024-03-20T13:35:30.990309+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:35:30.990309+0000","last_undegraded":"2024-03-20T13:35:30.990309+0000","last_fullsized":"2024-03-20T13:35:30.990309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.575841+0000","last_change":"2024-03-20T13:34:51.951979+0000","last_active":"2024-03-20T13:36:23.575841+0000","last_peered":"2024-03-20T13:36:23.575841+0000","last_clean":"2024-03-20T13:36:23.575841+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:36:23.575841+0000","last_undegraded":"2024-03-20T13:36:23.575841+0000","last_fullsized":"2024-03-20T13:36:23.575841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.989637+0000","last_change":"2024-03-20T13:34:49.950220+0000","last_active":"2024-03-20T13:35:30.989637+0000","last_peered":"2024-03-20T13:35:30.989637+0000","last_clean":"2024-03-20T13:35:30.989637+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:35:30.989637+0000","last_undegraded":"2024-03-20T13:35:30.989637+0000","last_fullsized":"2024-03-20T13:35:30.989637+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982181+0000","last_change":"2024-03-20T13:34:51.945790+0000","last_active":"2024-03-20T13:35:30.982181+0000","last_peered":"2024-03-20T13:35:30.982181+0000","last_clean":"2024-03-20T13:35:30.982181+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:35:30.982181+0000","last_undegraded":"2024-03-20T13:35:30.982181+0000","last_fullsized":"2024-03-20T13:35:30.982181+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.614993+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:17.614993+0000","last_peered":"2024-03-20T13:36:17.614993+0000","last_clean":"2024-03-20T13:36:17.614993+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:17.614993+0000","last_undegraded":"2024-03-20T13:36:17.614993+0000","last_fullsized":"2024-03-20T13:36:17.614993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984511+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:35:30.984511+0000","last_peered":"2024-03-20T13:35:30.984511+0000","last_clean":"2024-03-20T13:35:30.984511+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:35:30.984511+0000","last_undegraded":"2024-03-20T13:35:30.984511+0000","last_fullsized":"2024-03-20T13:35:30.984511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984894+0000","last_change":"2024-03-20T13:34:51.947552+0000","last_active":"2024-03-20T13:35:30.984894+0000","last_peered":"2024-03-20T13:35:30.984894+0000","last_clean":"2024-03-20T13:35:30.984894+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:35:30.984894+0000","last_undegraded":"2024-03-20T13:35:30.984894+0000","last_fullsized":"2024-03-20T13:35:30.984894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982785+0000","last_change":"2024-03-20T13:34:49.941425+0000","last_active":"2024-03-20T13:35:30.982785+0000","last_peered":"2024-03-20T13:35:30.982785+0000","last_clean":"2024-03-20T13:35:30.982785+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:35:30.982785+0000","last_undegraded":"2024-03-20T13:35:30.982785+0000","last_fullsized":"2024-03-20T13:35:30.982785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'3","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976935+0000","last_change":"2024-03-20T13:34:51.944562+0000","last_active":"2024-03-20T13:36:17.976935+0000","last_peered":"2024-03-20T13:36:17.976935+0000","last_clean":"2024-03-20T13:36:17.976935+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:36:17.976935+0000","last_undegraded":"2024-03-20T13:36:17.976935+0000","last_fullsized":"2024-03-20T13:36:17.976935+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1944,"ondisk_log_size":1944,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1150,"num_omap_keys":6,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1385,"ondisk_log_size":1385,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672993,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.53500000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.30399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.496}]},{"osd":1,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.37,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.40000000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.41799999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.42699999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.439}]}]},{"osd":1,"up_from":10,"seq":42949672992,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.44500000000000001,"15min":0.42699999999999999},"min":{"1min":0.317,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.41199999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.311,"15min":0.31},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.218},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.247}]},{"osd":3,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.502,"15min":0.502},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.27800000000000002}]}]},{"osd":3,"up_from":9,"seq":38654705694,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:34 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:36:39 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.312,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.433},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.32000000000000001},"min":{"1min":0.20899999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.42999999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:36:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.41199999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705696,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.443}]},{"osd":2,"last update":"Wed Mar 20 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed Mar 20 13:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.36699999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:36:56.358 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.358 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.358 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.358 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.359 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.359 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.359 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.359 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.359 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.359 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.360 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.360 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.360 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.360 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.360 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.360 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.361 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.361 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.361 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.361 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.361 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.361 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.362 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.362 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.362 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.362 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.362 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.362 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.363 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.363 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.363 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.363 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.363 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.363 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.364 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.364 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.364 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.364 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.364 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.364 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.365 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.365 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.365 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.365 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.365 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.366 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.366 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.366 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.366 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.366 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.366 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.367 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.367 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.367 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.367 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.367 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.367 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.368 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.368 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.368 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.368 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.368 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.368 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.369 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.369 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.369 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.369 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.369 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.369 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.370 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.370 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-20T13:34:33.883766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=33, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.370 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.370 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.370 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.371 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.371 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.371 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.371 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.371 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.371 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.372 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.372 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.372 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.372 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.372 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.373 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.374 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.374 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.374 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.374 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.374 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.375 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.375 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.375 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.375 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.375 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.375 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.376 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.376 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.376 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.376 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.376 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.376 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.377 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.377 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.377 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.377 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.377 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.377 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.378 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.378 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.378 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.378 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.378 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.379 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.379 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.379 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.379 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.379 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.379 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.380 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.380 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.380 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.380 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.380 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.381 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.381 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.381 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.381 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.381 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.381 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.382 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-03-20T13:34:54.932079+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=54, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.382 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.382 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.382 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.382 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.382 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.383 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.383 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.383 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.383 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.383 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.383 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.384 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-03-20T13:34:56.940237+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=56, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.384 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.384 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.384 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.384 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.385 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.385 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.385 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.385 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.385 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.385 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.386 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.386 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.386 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.386 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.386 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.386 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.387 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.387 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.387 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.387 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.387 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.388 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.389 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.389 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.389 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.389 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.389 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.389 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.390 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.390 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.390 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.390 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.390 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:36:56.390 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:37:16.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:37:16.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe92ec63640 1 Processor -- start 2024-03-20T13:37:16.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe92ec63640 1 -- start start 2024-03-20T13:37:16.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe92ec63640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe928098900 0x7fe928098ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:16.508 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe92ec63640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92809dc90 con 0x7fe928099220 2024-03-20T13:37:16.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe92ec63640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92809a360 con 0x7fe928098900 2024-03-20T13:37:16.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe92c9ff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe928098900 0x7fe928098ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:16.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe91ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe928099220 0x7fe928096580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:40734/0 (socket says 172.21.15.28:40734) 2024-03-20T13:37:16.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.505+0000 7fe91ffff640 1 -- 172.21.15.28:0/915410709 learned_addr learned my addr 172.21.15.28:0/915410709 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:37:16.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.506+0000 7fe92c9ff640 1 -- 172.21.15.28:0/915410709 >> v1:172.21.15.28:6789/0 conn(0x7fe928099220 legacy=0x7fe928096580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:16.509 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.506+0000 7fe92c9ff640 1 -- 172.21.15.28:0/915410709 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928099d30 con 0x7fe928098900 2024-03-20T13:37:16.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.506+0000 7fe92c9ff640 1 --2- 172.21.15.28:0/915410709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928098ce0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe924009720 tx=0x7fe92402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bee1433472a4ad1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:16.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe91f7fe640 1 -- 172.21.15.28:0/915410709 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe92402e070 con 0x7fe928098900 2024-03-20T13:37:16.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe91f7fe640 1 -- 172.21.15.28:0/915410709 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9240316d0 con 0x7fe928098900 2024-03-20T13:37:16.510 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe91f7fe640 1 -- 172.21.15.28:0/915410709 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe924031990 con 0x7fe928098900 2024-03-20T13:37:16.513 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 -- 172.21.15.28:0/915410709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 msgr2=0x7fe928098ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:16.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 --2- 172.21.15.28:0/915410709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928098ce0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe924009720 tx=0x7fe92402b840 comp rx=0 tx=0).stop 2024-03-20T13:37:16.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 -- 172.21.15.28:0/915410709 shutdown_connections 2024-03-20T13:37:16.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 --2- 172.21.15.28:0/915410709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928098ce0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:16.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 -- 172.21.15.28:0/915410709 >> 172.21.15.28:0/915410709 conn(0x7fe9280a0a20 msgr2=0x7fe92809cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:16.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 -- 172.21.15.28:0/915410709 shutdown_connections 2024-03-20T13:37:16.514 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.507+0000 7fe92ec63640 1 -- 172.21.15.28:0/915410709 wait complete. 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.508+0000 7fe92ec63640 1 Processor -- start 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.508+0000 7fe92ec63640 1 -- start start 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92ec63640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928129df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92ec63640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe928072150 con 0x7fe928098900 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92c9ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928129df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92c9ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928129df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46156/0 (socket says 172.21.15.28:46156) 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92c9ff640 1 -- 172.21.15.28:0/1722441857 learned_addr learned my addr 172.21.15.28:0/1722441857 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:37:16.515 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92c9ff640 1 -- 172.21.15.28:0/1722441857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe924009400 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe92c9ff640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928129df0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe924034040 tx=0x7fe9240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe924032830 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.509+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe924032990 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.510+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92812b5f0 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.510+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe924032c50 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.510+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92806c7d0 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.511+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fe92404d3f0 con 0x7fe928098900 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.511+0000 7fe91d7fa640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe914037ea0 0x7fe91403a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:16.516 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.511+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fe92406d2b0 con 0x7fe928098900 2024-03-20T13:37:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.511+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9280627b0 con 0x7fe928098900 2024-03-20T13:37:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.511+0000 7fe91ffff640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe914037ea0 0x7fe91403a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.512+0000 7fe91ffff640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe914037ea0 0x7fe91403a360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe918007fd0 tx=0x7fe918007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:16.517 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.516+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fe92404d6a0 con 0x7fe928098900 2024-03-20T13:37:16.693 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.692+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe92809d7e0 con 0x7fe914037ea0 2024-03-20T13:37:16.708 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.707+0000 7fe91d7fa640 1 -- 172.21.15.28:0/1722441857 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+669585 (secure 0 0 0) 0x7fe9180012f0 con 0x7fe914037ea0 2024-03-20T13:37:16.717 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:37:16.722 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:37:16.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe914037ea0 msgr2=0x7fe91403a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:16.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe914037ea0 0x7fe91403a360 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe918007fd0 tx=0x7fe918007ac0 comp rx=0 tx=0).stop 2024-03-20T13:37:16.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 msgr2=0x7fe928129df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:16.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928129df0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe924034040 tx=0x7fe9240046c0 comp rx=0 tx=0).stop 2024-03-20T13:37:16.725 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 shutdown_connections 2024-03-20T13:37:16.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fe914037ea0 0x7fe91403a360 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:16.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 --2- 172.21.15.28:0/1722441857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe928098900 0x7fe928129df0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:16.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 >> 172.21.15.28:0/1722441857 conn(0x7fe9280a0a20 msgr2=0x7fe928126510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:16.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 shutdown_connections 2024-03-20T13:37:16.726 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:16.712+0000 7fe92ec63640 1 -- 172.21.15.28:0/1722441857 wait complete. 2024-03-20T13:37:16.727 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":110,"stamp":"2024-03-20T13:37:15.184866+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4002,"num_read_kb":3648,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1709,"num_omap_keys":9,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3956,"ondisk_log_size":3956,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003802"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150747+0000","last_change":"2024-03-20T13:34:49.945378+0000","last_active":"2024-03-20T13:36:35.150747+0000","last_peered":"2024-03-20T13:36:35.150747+0000","last_clean":"2024-03-20T13:36:35.150747+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:36:35.150747+0000","last_undegraded":"2024-03-20T13:36:35.150747+0000","last_fullsized":"2024-03-20T13:36:35.150747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.734582+0000","last_change":"2024-03-20T13:37:00.734610+0000","last_active":"2024-03-20T13:37:00.734582+0000","last_peered":"2024-03-20T13:37:00.734582+0000","last_clean":"2024-03-20T13:37:00.734582+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:37:00.734582+0000","last_undegraded":"2024-03-20T13:37:00.734582+0000","last_fullsized":"2024-03-20T13:37:00.734582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.734488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:43.356373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271743+0000","last_change":"2024-03-20T13:34:49.933462+0000","last_active":"2024-03-20T13:36:34.271743+0000","last_peered":"2024-03-20T13:36:34.271743+0000","last_clean":"2024-03-20T13:36:34.271743+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:36:34.271743+0000","last_undegraded":"2024-03-20T13:36:34.271743+0000","last_fullsized":"2024-03-20T13:36:34.271743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.578010+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.578010+0000","last_peered":"2024-03-20T13:36:23.578010+0000","last_clean":"2024-03-20T13:36:23.578010+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.578010+0000","last_undegraded":"2024-03-20T13:36:23.578010+0000","last_fullsized":"2024-03-20T13:36:23.578010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593389+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:36:35.593389+0000","last_peered":"2024-03-20T13:36:35.593389+0000","last_clean":"2024-03-20T13:36:35.593389+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:36:35.593389+0000","last_undegraded":"2024-03-20T13:36:35.593389+0000","last_fullsized":"2024-03-20T13:36:35.593389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.198729+0000","last_change":"2024-03-20T13:37:13.198759+0000","last_active":"2024-03-20T13:37:13.198729+0000","last_peered":"2024-03-20T13:37:13.198729+0000","last_clean":"2024-03-20T13:37:13.198729+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:37:13.198729+0000","last_undegraded":"2024-03-20T13:37:13.198729+0000","last_fullsized":"2024-03-20T13:37:13.198729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.198622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:38.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.216682+0000","last_change":"2024-03-20T13:37:07.216726+0000","last_active":"2024-03-20T13:37:07.216682+0000","last_peered":"2024-03-20T13:37:07.216682+0000","last_clean":"2024-03-20T13:37:07.216682+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:37:07.216682+0000","last_undegraded":"2024-03-20T13:37:07.216682+0000","last_fullsized":"2024-03-20T13:37:07.216682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.216575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:56.080233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612905+0000","last_change":"2024-03-20T13:35:30.996431+0000","last_active":"2024-03-20T13:36:17.612905+0000","last_peered":"2024-03-20T13:36:17.612905+0000","last_clean":"2024-03-20T13:36:17.612905+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:36:17.612905+0000","last_undegraded":"2024-03-20T13:36:17.612905+0000","last_fullsized":"2024-03-20T13:36:17.612905+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987600+0000","last_change":"2024-03-20T13:34:49.959192+0000","last_active":"2024-03-20T13:35:30.987600+0000","last_peered":"2024-03-20T13:35:30.987600+0000","last_clean":"2024-03-20T13:35:30.987600+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:35:30.987600+0000","last_undegraded":"2024-03-20T13:35:30.987600+0000","last_fullsized":"2024-03-20T13:35:30.987600+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'1","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711612+0000","last_change":"2024-03-20T13:34:51.946953+0000","last_active":"2024-03-20T13:36:34.711612+0000","last_peered":"2024-03-20T13:36:34.711612+0000","last_clean":"2024-03-20T13:36:34.711612+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:36:34.711612+0000","last_undegraded":"2024-03-20T13:36:34.711612+0000","last_fullsized":"2024-03-20T13:36:34.711612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.176237+0000","last_change":"2024-03-20T13:37:05.176263+0000","last_active":"2024-03-20T13:37:05.176237+0000","last_peered":"2024-03-20T13:37:05.176237+0000","last_clean":"2024-03-20T13:37:05.176237+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:37:05.176237+0000","last_undegraded":"2024-03-20T13:37:05.176237+0000","last_fullsized":"2024-03-20T13:37:05.176237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.176117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:22:03.690315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.278090+0000","last_change":"2024-03-20T13:37:07.278147+0000","last_active":"2024-03-20T13:37:07.278090+0000","last_peered":"2024-03-20T13:37:07.278090+0000","last_clean":"2024-03-20T13:37:07.278090+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:37:07.278090+0000","last_undegraded":"2024-03-20T13:37:07.278090+0000","last_fullsized":"2024-03-20T13:37:07.278090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.277994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:07.944110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986150+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:35:30.986150+0000","last_peered":"2024-03-20T13:35:30.986150+0000","last_clean":"2024-03-20T13:35:30.986150+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:35:30.986150+0000","last_undegraded":"2024-03-20T13:35:30.986150+0000","last_fullsized":"2024-03-20T13:35:30.986150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.168771+0000","last_change":"2024-03-20T13:36:59.168771+0000","last_active":"2024-03-20T13:36:59.168771+0000","last_peered":"2024-03-20T13:36:59.168771+0000","last_clean":"2024-03-20T13:36:59.168771+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:59.168771+0000","last_undegraded":"2024-03-20T13:36:59.168771+0000","last_fullsized":"2024-03-20T13:36:59.168771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.168659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:29.587352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982474+0000","last_change":"2024-03-20T13:34:49.940856+0000","last_active":"2024-03-20T13:35:30.982474+0000","last_peered":"2024-03-20T13:35:30.982474+0000","last_clean":"2024-03-20T13:35:30.982474+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:35:30.982474+0000","last_undegraded":"2024-03-20T13:35:30.982474+0000","last_fullsized":"2024-03-20T13:35:30.982474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'5","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.151081+0000","last_change":"2024-03-20T13:34:51.945268+0000","last_active":"2024-03-20T13:36:35.151081+0000","last_peered":"2024-03-20T13:36:35.151081+0000","last_clean":"2024-03-20T13:36:35.151081+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:36:35.151081+0000","last_undegraded":"2024-03-20T13:36:35.151081+0000","last_fullsized":"2024-03-20T13:36:35.151081+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.256576+0000","last_change":"2024-03-20T13:37:11.256576+0000","last_active":"2024-03-20T13:37:11.256576+0000","last_peered":"2024-03-20T13:37:11.256576+0000","last_clean":"2024-03-20T13:37:11.256576+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:37:11.256576+0000","last_undegraded":"2024-03-20T13:37:11.256576+0000","last_fullsized":"2024-03-20T13:37:11.256576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.256453+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:24.080007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711292+0000","last_change":"2024-03-20T13:34:49.945284+0000","last_active":"2024-03-20T13:36:34.711292+0000","last_peered":"2024-03-20T13:36:34.711292+0000","last_clean":"2024-03-20T13:36:34.711292+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:36:34.711292+0000","last_undegraded":"2024-03-20T13:36:34.711292+0000","last_fullsized":"2024-03-20T13:36:34.711292+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.780265+0000","last_change":"2024-03-20T13:36:59.780265+0000","last_active":"2024-03-20T13:36:59.780265+0000","last_peered":"2024-03-20T13:36:59.780265+0000","last_clean":"2024-03-20T13:36:59.780265+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:59.780265+0000","last_undegraded":"2024-03-20T13:36:59.780265+0000","last_fullsized":"2024-03-20T13:36:59.780265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.780140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:43.003558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.218269+0000","last_change":"2024-03-20T13:37:11.218269+0000","last_active":"2024-03-20T13:37:11.218269+0000","last_peered":"2024-03-20T13:37:11.218269+0000","last_clean":"2024-03-20T13:37:11.218269+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:37:11.218269+0000","last_undegraded":"2024-03-20T13:37:11.218269+0000","last_fullsized":"2024-03-20T13:37:11.218269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.218156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:54.441574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711483+0000","last_change":"2024-03-20T13:34:51.947958+0000","last_active":"2024-03-20T13:36:34.711483+0000","last_peered":"2024-03-20T13:36:34.711483+0000","last_clean":"2024-03-20T13:36:34.711483+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:36:34.711483+0000","last_undegraded":"2024-03-20T13:36:34.711483+0000","last_fullsized":"2024-03-20T13:36:34.711483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711239+0000","last_change":"2024-03-20T13:34:49.946510+0000","last_active":"2024-03-20T13:36:34.711239+0000","last_peered":"2024-03-20T13:36:34.711239+0000","last_clean":"2024-03-20T13:36:34.711239+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:36:34.711239+0000","last_undegraded":"2024-03-20T13:36:34.711239+0000","last_fullsized":"2024-03-20T13:36:34.711239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.823524+0000","last_change":"2024-03-20T13:34:51.937387+0000","last_active":"2024-03-20T13:35:34.823524+0000","last_peered":"2024-03-20T13:35:34.823524+0000","last_clean":"2024-03-20T13:35:34.823524+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:35:34.823524+0000","last_undegraded":"2024-03-20T13:35:34.823524+0000","last_fullsized":"2024-03-20T13:35:34.823524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.725707+0000","last_change":"2024-03-20T13:37:11.725707+0000","last_active":"2024-03-20T13:37:11.725707+0000","last_peered":"2024-03-20T13:37:11.725707+0000","last_clean":"2024-03-20T13:37:11.725707+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:37:11.725707+0000","last_undegraded":"2024-03-20T13:37:11.725707+0000","last_fullsized":"2024-03-20T13:37:11.725707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.725594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:22.505463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.174760+0000","last_change":"2024-03-20T13:37:06.174785+0000","last_active":"2024-03-20T13:37:06.174760+0000","last_peered":"2024-03-20T13:37:06.174760+0000","last_clean":"2024-03-20T13:37:06.174760+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:37:06.174760+0000","last_undegraded":"2024-03-20T13:37:06.174760+0000","last_fullsized":"2024-03-20T13:37:06.174760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.174669+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:35.706277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.984390+0000","last_change":"2024-03-20T13:34:49.934846+0000","last_active":"2024-03-20T13:35:30.984390+0000","last_peered":"2024-03-20T13:35:30.984390+0000","last_clean":"2024-03-20T13:35:30.984390+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:35:30.984390+0000","last_undegraded":"2024-03-20T13:35:30.984390+0000","last_fullsized":"2024-03-20T13:35:30.984390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.750621+0000","last_change":"2024-03-20T13:37:01.750652+0000","last_active":"2024-03-20T13:37:01.750621+0000","last_peered":"2024-03-20T13:37:01.750621+0000","last_clean":"2024-03-20T13:37:01.750621+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:37:01.750621+0000","last_undegraded":"2024-03-20T13:37:01.750621+0000","last_fullsized":"2024-03-20T13:37:01.750621+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.750537+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:27.000513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593307+0000","last_change":"2024-03-20T13:34:49.959590+0000","last_active":"2024-03-20T13:36:35.593307+0000","last_peered":"2024-03-20T13:36:35.593307+0000","last_clean":"2024-03-20T13:36:35.593307+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:36:35.593307+0000","last_undegraded":"2024-03-20T13:36:35.593307+0000","last_fullsized":"2024-03-20T13:36:35.593307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":76,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.587959+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:23.587959+0000","last_peered":"2024-03-20T13:36:23.587959+0000","last_clean":"2024-03-20T13:36:23.587959+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:23.587959+0000","last_undegraded":"2024-03-20T13:36:23.587959+0000","last_fullsized":"2024-03-20T13:36:23.587959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":15,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.205213+0000","last_change":"2024-03-20T13:35:30.994560+0000","last_active":"2024-03-20T13:35:34.205213+0000","last_peered":"2024-03-20T13:35:34.205213+0000","last_clean":"2024-03-20T13:35:34.205213+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:35:34.205213+0000","last_undegraded":"2024-03-20T13:35:34.205213+0000","last_fullsized":"2024-03-20T13:35:34.205213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593182+0000","last_change":"2024-03-20T13:34:49.959439+0000","last_active":"2024-03-20T13:36:35.593182+0000","last_peered":"2024-03-20T13:36:35.593182+0000","last_clean":"2024-03-20T13:36:35.593182+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:36:35.593182+0000","last_undegraded":"2024-03-20T13:36:35.593182+0000","last_fullsized":"2024-03-20T13:36:35.593182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.127793+0000","last_change":"2024-03-20T13:36:41.127878+0000","last_active":"2024-03-20T13:36:41.127793+0000","last_peered":"2024-03-20T13:36:41.127793+0000","last_clean":"2024-03-20T13:36:41.127793+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:36:41.127793+0000","last_undegraded":"2024-03-20T13:36:41.127793+0000","last_fullsized":"2024-03-20T13:36:41.127793+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.127679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:24.954726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.230680+0000","last_change":"2024-03-20T13:37:03.230716+0000","last_active":"2024-03-20T13:37:03.230680+0000","last_peered":"2024-03-20T13:37:03.230680+0000","last_clean":"2024-03-20T13:37:03.230680+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:37:03.230680+0000","last_undegraded":"2024-03-20T13:37:03.230680+0000","last_fullsized":"2024-03-20T13:37:03.230680+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.230582+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:19.216621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.930551+0000","last_change":"2024-03-20T13:36:50.930574+0000","last_active":"2024-03-20T13:36:50.930551+0000","last_peered":"2024-03-20T13:36:50.930551+0000","last_clean":"2024-03-20T13:36:50.930551+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:36:50.930551+0000","last_undegraded":"2024-03-20T13:36:50.930551+0000","last_fullsized":"2024-03-20T13:36:50.930551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.930463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:21.352868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.758171+0000","last_change":"2024-03-20T13:34:59.969467+0000","last_active":"2024-03-20T13:36:17.758171+0000","last_peered":"2024-03-20T13:36:17.758171+0000","last_clean":"2024-03-20T13:36:17.758171+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:36:17.758171+0000","last_undegraded":"2024-03-20T13:36:17.758171+0000","last_fullsized":"2024-03-20T13:36:17.758171+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.612698+0000","last_change":"2024-03-20T13:34:51.943450+0000","last_active":"2024-03-20T13:36:17.612698+0000","last_peered":"2024-03-20T13:36:17.612698+0000","last_clean":"2024-03-20T13:36:17.612698+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:36:17.612698+0000","last_undegraded":"2024-03-20T13:36:17.612698+0000","last_fullsized":"2024-03-20T13:36:17.612698+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.247358+0000","last_change":"2024-03-20T13:37:03.247358+0000","last_active":"2024-03-20T13:37:03.247358+0000","last_peered":"2024-03-20T13:37:03.247358+0000","last_clean":"2024-03-20T13:37:03.247358+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:37:03.247358+0000","last_undegraded":"2024-03-20T13:37:03.247358+0000","last_fullsized":"2024-03-20T13:37:03.247358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.247246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:31.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.442856+0000","last_change":"2024-03-20T13:36:50.442856+0000","last_active":"2024-03-20T13:36:50.442856+0000","last_peered":"2024-03-20T13:36:50.442856+0000","last_clean":"2024-03-20T13:36:50.442856+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:36:50.442856+0000","last_undegraded":"2024-03-20T13:36:50.442856+0000","last_fullsized":"2024-03-20T13:36:50.442856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.442744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:21.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.832854+0000","last_change":"2024-03-20T13:36:36.832911+0000","last_active":"2024-03-20T13:36:36.832854+0000","last_peered":"2024-03-20T13:36:36.832854+0000","last_clean":"2024-03-20T13:36:36.832854+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:36:36.832854+0000","last_undegraded":"2024-03-20T13:36:36.832854+0000","last_fullsized":"2024-03-20T13:36:36.832854+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.832759+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:49.042157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.813995+0000","last_change":"2024-03-20T13:36:58.814020+0000","last_active":"2024-03-20T13:36:58.813995+0000","last_peered":"2024-03-20T13:36:58.813995+0000","last_clean":"2024-03-20T13:36:58.813995+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:36:58.813995+0000","last_undegraded":"2024-03-20T13:36:58.813995+0000","last_fullsized":"2024-03-20T13:36:58.813995+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.813903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:48.477979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.975009+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:17.975009+0000","last_peered":"2024-03-20T13:36:17.975009+0000","last_clean":"2024-03-20T13:36:17.975009+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:17.975009+0000","last_undegraded":"2024-03-20T13:36:17.975009+0000","last_fullsized":"2024-03-20T13:36:17.975009+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.976572+0000","last_change":"2024-03-20T13:34:51.940751+0000","last_active":"2024-03-20T13:36:17.976572+0000","last_peered":"2024-03-20T13:36:17.976572+0000","last_clean":"2024-03-20T13:36:17.976572+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:36:17.976572+0000","last_undegraded":"2024-03-20T13:36:17.976572+0000","last_fullsized":"2024-03-20T13:36:17.976572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593161+0000","last_change":"2024-03-20T13:34:49.959865+0000","last_active":"2024-03-20T13:36:35.593161+0000","last_peered":"2024-03-20T13:36:35.593161+0000","last_clean":"2024-03-20T13:36:35.593161+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:36:35.593161+0000","last_undegraded":"2024-03-20T13:36:35.593161+0000","last_fullsized":"2024-03-20T13:36:35.593161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.419235+0000","last_change":"2024-03-20T13:36:51.419261+0000","last_active":"2024-03-20T13:36:51.419235+0000","last_peered":"2024-03-20T13:36:51.419235+0000","last_clean":"2024-03-20T13:36:51.419235+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:36:51.419235+0000","last_undegraded":"2024-03-20T13:36:51.419235+0000","last_fullsized":"2024-03-20T13:36:51.419235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.419143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:49.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.226149+0000","last_change":"2024-03-20T13:36:49.226186+0000","last_active":"2024-03-20T13:36:49.226149+0000","last_peered":"2024-03-20T13:36:49.226149+0000","last_clean":"2024-03-20T13:36:49.226149+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:36:49.226149+0000","last_undegraded":"2024-03-20T13:36:49.226149+0000","last_fullsized":"2024-03-20T13:36:49.226149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.226058+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:05.000426+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":329,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.289552+0000","last_change":"2024-03-20T13:37:08.289581+0000","last_active":"2024-03-20T13:37:08.289552+0000","last_peered":"2024-03-20T13:37:08.289552+0000","last_clean":"2024-03-20T13:37:08.289552+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:37:08.289552+0000","last_undegraded":"2024-03-20T13:37:08.289552+0000","last_fullsized":"2024-03-20T13:37:08.289552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.289461+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:24:47.727403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.208740+0000","last_change":"2024-03-20T13:36:46.208783+0000","last_active":"2024-03-20T13:36:46.208740+0000","last_peered":"2024-03-20T13:36:46.208740+0000","last_clean":"2024-03-20T13:36:46.208740+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:36:46.208740+0000","last_undegraded":"2024-03-20T13:36:46.208740+0000","last_fullsized":"2024-03-20T13:36:46.208740+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.208641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:45.085668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":57,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.498426+0000","last_change":"2024-03-20T13:37:02.498473+0000","last_active":"2024-03-20T13:37:02.498426+0000","last_peered":"2024-03-20T13:37:02.498426+0000","last_clean":"2024-03-20T13:37:02.498426+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:37:02.498426+0000","last_undegraded":"2024-03-20T13:37:02.498426+0000","last_fullsized":"2024-03-20T13:37:02.498426+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.498327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:43.010962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711015+0000","last_change":"2024-03-20T13:34:49.943444+0000","last_active":"2024-03-20T13:36:34.711015+0000","last_peered":"2024-03-20T13:36:34.711015+0000","last_clean":"2024-03-20T13:36:34.711015+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:36:34.711015+0000","last_undegraded":"2024-03-20T13:36:34.711015+0000","last_fullsized":"2024-03-20T13:36:34.711015+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.164505+0000","last_change":"2024-03-20T13:36:47.164527+0000","last_active":"2024-03-20T13:36:47.164505+0000","last_peered":"2024-03-20T13:36:47.164505+0000","last_clean":"2024-03-20T13:36:47.164505+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:36:47.164505+0000","last_undegraded":"2024-03-20T13:36:47.164505+0000","last_fullsized":"2024-03-20T13:36:47.164505+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.164416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:15.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.124342+0000","last_change":"2024-03-20T13:36:44.124403+0000","last_active":"2024-03-20T13:36:44.124342+0000","last_peered":"2024-03-20T13:36:44.124342+0000","last_clean":"2024-03-20T13:36:44.124342+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:44.124342+0000","last_undegraded":"2024-03-20T13:36:44.124342+0000","last_fullsized":"2024-03-20T13:36:44.124342+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.124221+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:07.675114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.427126+0000","last_change":"2024-03-20T13:36:49.427157+0000","last_active":"2024-03-20T13:36:49.427126+0000","last_peered":"2024-03-20T13:36:49.427126+0000","last_clean":"2024-03-20T13:36:49.427126+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:49.427126+0000","last_undegraded":"2024-03-20T13:36:49.427126+0000","last_fullsized":"2024-03-20T13:36:49.427126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.427037+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:05:56.566896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.240751+0000","last_change":"2024-03-20T13:37:06.240821+0000","last_active":"2024-03-20T13:37:06.240751+0000","last_peered":"2024-03-20T13:37:06.240751+0000","last_clean":"2024-03-20T13:37:06.240751+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:37:06.240751+0000","last_undegraded":"2024-03-20T13:37:06.240751+0000","last_fullsized":"2024-03-20T13:37:06.240751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.240654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:12.903523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150489+0000","last_change":"2024-03-20T13:34:49.944500+0000","last_active":"2024-03-20T13:36:35.150489+0000","last_peered":"2024-03-20T13:36:35.150489+0000","last_clean":"2024-03-20T13:36:35.150489+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:36:35.150489+0000","last_undegraded":"2024-03-20T13:36:35.150489+0000","last_fullsized":"2024-03-20T13:36:35.150489+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.819999+0000","last_change":"2024-03-20T13:36:43.819999+0000","last_active":"2024-03-20T13:36:43.819999+0000","last_peered":"2024-03-20T13:36:43.819999+0000","last_clean":"2024-03-20T13:36:43.819999+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:36:43.819999+0000","last_undegraded":"2024-03-20T13:36:43.819999+0000","last_fullsized":"2024-03-20T13:36:43.819999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.819876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:18.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.190487+0000","last_change":"2024-03-20T13:36:48.190487+0000","last_active":"2024-03-20T13:36:48.190487+0000","last_peered":"2024-03-20T13:36:48.190487+0000","last_clean":"2024-03-20T13:36:48.190487+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:48.190487+0000","last_undegraded":"2024-03-20T13:36:48.190487+0000","last_fullsized":"2024-03-20T13:36:48.190487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.190343+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:33:34.104031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.451320+0000","last_change":"2024-03-20T13:36:41.451320+0000","last_active":"2024-03-20T13:36:41.451320+0000","last_peered":"2024-03-20T13:36:41.451320+0000","last_clean":"2024-03-20T13:36:41.451320+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:36:41.451320+0000","last_undegraded":"2024-03-20T13:36:41.451320+0000","last_fullsized":"2024-03-20T13:36:41.451320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.451207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:01.674365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.151488+0000","last_change":"2024-03-20T13:34:59.974067+0000","last_active":"2024-03-20T13:36:35.151488+0000","last_peered":"2024-03-20T13:36:35.151488+0000","last_clean":"2024-03-20T13:36:35.151488+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:36:35.151488+0000","last_undegraded":"2024-03-20T13:36:35.151488+0000","last_fullsized":"2024-03-20T13:36:35.151488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.706447+0000","last_change":"2024-03-20T13:37:04.706474+0000","last_active":"2024-03-20T13:37:04.706447+0000","last_peered":"2024-03-20T13:37:04.706447+0000","last_clean":"2024-03-20T13:37:04.706447+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:37:04.706447+0000","last_undegraded":"2024-03-20T13:37:04.706447+0000","last_fullsized":"2024-03-20T13:37:04.706447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.706331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:10.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150492+0000","last_change":"2024-03-20T13:34:49.939109+0000","last_active":"2024-03-20T13:36:35.150492+0000","last_peered":"2024-03-20T13:36:35.150492+0000","last_clean":"2024-03-20T13:36:35.150492+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:36:35.150492+0000","last_undegraded":"2024-03-20T13:36:35.150492+0000","last_fullsized":"2024-03-20T13:36:35.150492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.409281+0000","last_change":"2024-03-20T13:36:52.409281+0000","last_active":"2024-03-20T13:36:52.409281+0000","last_peered":"2024-03-20T13:36:52.409281+0000","last_clean":"2024-03-20T13:36:52.409281+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:36:52.409281+0000","last_undegraded":"2024-03-20T13:36:52.409281+0000","last_fullsized":"2024-03-20T13:36:52.409281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.409171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:56:42.443923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.099051+0000","last_change":"2024-03-20T13:36:44.099051+0000","last_active":"2024-03-20T13:36:44.099051+0000","last_peered":"2024-03-20T13:36:44.099051+0000","last_clean":"2024-03-20T13:36:44.099051+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:44.099051+0000","last_undegraded":"2024-03-20T13:36:44.099051+0000","last_fullsized":"2024-03-20T13:36:44.099051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.098880+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:38.576272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.461685+0000","last_change":"2024-03-20T13:36:35.461685+0000","last_active":"2024-03-20T13:36:35.461685+0000","last_peered":"2024-03-20T13:36:35.461685+0000","last_clean":"2024-03-20T13:36:35.461685+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:36:35.461685+0000","last_undegraded":"2024-03-20T13:36:35.461685+0000","last_fullsized":"2024-03-20T13:36:35.461685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.461582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:53.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.712022+0000","last_change":"2024-03-20T13:34:59.972444+0000","last_active":"2024-03-20T13:36:34.712022+0000","last_peered":"2024-03-20T13:36:34.712022+0000","last_clean":"2024-03-20T13:36:34.712022+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:36:34.712022+0000","last_undegraded":"2024-03-20T13:36:34.712022+0000","last_fullsized":"2024-03-20T13:36:34.712022+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.238190+0000","last_change":"2024-03-20T13:37:08.238221+0000","last_active":"2024-03-20T13:37:08.238190+0000","last_peered":"2024-03-20T13:37:08.238190+0000","last_clean":"2024-03-20T13:37:08.238190+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:37:08.238190+0000","last_undegraded":"2024-03-20T13:37:08.238190+0000","last_fullsized":"2024-03-20T13:37:08.238190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.238084+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:21.795359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593112+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:36:35.593112+0000","last_peered":"2024-03-20T13:36:35.593112+0000","last_clean":"2024-03-20T13:36:35.593112+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:36:35.593112+0000","last_undegraded":"2024-03-20T13:36:35.593112+0000","last_fullsized":"2024-03-20T13:36:35.593112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.423979+0000","last_change":"2024-03-20T13:37:00.423979+0000","last_active":"2024-03-20T13:37:00.423979+0000","last_peered":"2024-03-20T13:37:00.423979+0000","last_clean":"2024-03-20T13:37:00.423979+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:37:00.423979+0000","last_undegraded":"2024-03-20T13:37:00.423979+0000","last_fullsized":"2024-03-20T13:37:00.423979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.423821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:07.953451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.195079+0000","last_change":"2024-03-20T13:36:48.195079+0000","last_active":"2024-03-20T13:36:48.195079+0000","last_peered":"2024-03-20T13:36:48.195079+0000","last_clean":"2024-03-20T13:36:48.195079+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:48.195079+0000","last_undegraded":"2024-03-20T13:36:48.195079+0000","last_fullsized":"2024-03-20T13:36:48.195079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.194921+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:26.041799+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.482065+0000","last_change":"2024-03-20T13:36:57.482065+0000","last_active":"2024-03-20T13:36:57.482065+0000","last_peered":"2024-03-20T13:36:57.482065+0000","last_clean":"2024-03-20T13:36:57.482065+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:57.482065+0000","last_undegraded":"2024-03-20T13:36:57.482065+0000","last_fullsized":"2024-03-20T13:36:57.482065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.481947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:40.705365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272674+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:36:34.272674+0000","last_peered":"2024-03-20T13:36:34.272674+0000","last_clean":"2024-03-20T13:36:34.272674+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:36:34.272674+0000","last_undegraded":"2024-03-20T13:36:34.272674+0000","last_fullsized":"2024-03-20T13:36:34.272674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.208881+0000","last_change":"2024-03-20T13:37:04.208881+0000","last_active":"2024-03-20T13:37:04.208881+0000","last_peered":"2024-03-20T13:37:04.208881+0000","last_clean":"2024-03-20T13:37:04.208881+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:37:04.208881+0000","last_undegraded":"2024-03-20T13:37:04.208881+0000","last_fullsized":"2024-03-20T13:37:04.208881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.208708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:35.661985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593074+0000","last_change":"2024-03-20T13:34:49.962872+0000","last_active":"2024-03-20T13:36:35.593074+0000","last_peered":"2024-03-20T13:36:35.593074+0000","last_clean":"2024-03-20T13:36:35.593074+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:36:35.593074+0000","last_undegraded":"2024-03-20T13:36:35.593074+0000","last_fullsized":"2024-03-20T13:36:35.593074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.462228+0000","last_change":"2024-03-20T13:36:54.462228+0000","last_active":"2024-03-20T13:36:54.462228+0000","last_peered":"2024-03-20T13:36:54.462228+0000","last_clean":"2024-03-20T13:36:54.462228+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:36:54.462228+0000","last_undegraded":"2024-03-20T13:36:54.462228+0000","last_fullsized":"2024-03-20T13:36:54.462228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.462112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:08.019387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.148045+0000","last_change":"2024-03-20T13:36:36.148045+0000","last_active":"2024-03-20T13:36:36.148045+0000","last_peered":"2024-03-20T13:36:36.148045+0000","last_clean":"2024-03-20T13:36:36.148045+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:36.148045+0000","last_undegraded":"2024-03-20T13:36:36.148045+0000","last_fullsized":"2024-03-20T13:36:36.148045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.147906+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:41:00.828075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.497904+0000","last_change":"2024-03-20T13:36:38.497904+0000","last_active":"2024-03-20T13:36:38.497904+0000","last_peered":"2024-03-20T13:36:38.497904+0000","last_clean":"2024-03-20T13:36:38.497904+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:36:38.497904+0000","last_undegraded":"2024-03-20T13:36:38.497904+0000","last_fullsized":"2024-03-20T13:36:38.497904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.497774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:57.922980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.478488+0000","last_change":"2024-03-20T13:37:05.478488+0000","last_active":"2024-03-20T13:37:05.478488+0000","last_peered":"2024-03-20T13:37:05.478488+0000","last_clean":"2024-03-20T13:37:05.478488+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:37:05.478488+0000","last_undegraded":"2024-03-20T13:37:05.478488+0000","last_fullsized":"2024-03-20T13:37:05.478488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.478357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:33.942722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.735341+0000","last_change":"2024-03-20T13:37:06.735341+0000","last_active":"2024-03-20T13:37:06.735341+0000","last_peered":"2024-03-20T13:37:06.735341+0000","last_clean":"2024-03-20T13:37:06.735341+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:37:06.735341+0000","last_undegraded":"2024-03-20T13:37:06.735341+0000","last_fullsized":"2024-03-20T13:37:06.735341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.735167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:30.139049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271623+0000","last_change":"2024-03-20T13:34:49.933792+0000","last_active":"2024-03-20T13:36:34.271623+0000","last_peered":"2024-03-20T13:36:34.271623+0000","last_clean":"2024-03-20T13:36:34.271623+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:36:34.271623+0000","last_undegraded":"2024-03-20T13:36:34.271623+0000","last_fullsized":"2024-03-20T13:36:34.271623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.170733+0000","last_change":"2024-03-20T13:36:53.170733+0000","last_active":"2024-03-20T13:36:53.170733+0000","last_peered":"2024-03-20T13:36:53.170733+0000","last_clean":"2024-03-20T13:36:53.170733+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:53.170733+0000","last_undegraded":"2024-03-20T13:36:53.170733+0000","last_fullsized":"2024-03-20T13:36:53.170733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.170592+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:12.595798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.786164+0000","last_change":"2024-03-20T13:36:39.786164+0000","last_active":"2024-03-20T13:36:39.786164+0000","last_peered":"2024-03-20T13:36:39.786164+0000","last_clean":"2024-03-20T13:36:39.786164+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:39.786164+0000","last_undegraded":"2024-03-20T13:36:39.786164+0000","last_fullsized":"2024-03-20T13:36:39.786164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.786041+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:59.978158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.192708+0000","last_change":"2024-03-20T13:36:55.192708+0000","last_active":"2024-03-20T13:36:55.192708+0000","last_peered":"2024-03-20T13:36:55.192708+0000","last_clean":"2024-03-20T13:36:55.192708+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:36:55.192708+0000","last_undegraded":"2024-03-20T13:36:55.192708+0000","last_fullsized":"2024-03-20T13:36:55.192708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.192599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:09.415889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594311+0000","last_change":"2024-03-20T13:34:59.971713+0000","last_active":"2024-03-20T13:36:35.594311+0000","last_peered":"2024-03-20T13:36:35.594311+0000","last_clean":"2024-03-20T13:36:35.594311+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:36:35.594311+0000","last_undegraded":"2024-03-20T13:36:35.594311+0000","last_fullsized":"2024-03-20T13:36:35.594311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.977082+0000","last_change":"2024-03-20T13:35:30.988681+0000","last_active":"2024-03-20T13:36:17.977082+0000","last_peered":"2024-03-20T13:36:17.977082+0000","last_clean":"2024-03-20T13:36:17.977082+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:36:17.977082+0000","last_undegraded":"2024-03-20T13:36:17.977082+0000","last_fullsized":"2024-03-20T13:36:17.977082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593057+0000","last_change":"2024-03-20T13:34:49.958288+0000","last_active":"2024-03-20T13:36:35.593057+0000","last_peered":"2024-03-20T13:36:35.593057+0000","last_clean":"2024-03-20T13:36:35.593057+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:36:35.593057+0000","last_undegraded":"2024-03-20T13:36:35.593057+0000","last_fullsized":"2024-03-20T13:36:35.593057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.492572+0000","last_change":"2024-03-20T13:36:55.492572+0000","last_active":"2024-03-20T13:36:55.492572+0000","last_peered":"2024-03-20T13:36:55.492572+0000","last_clean":"2024-03-20T13:36:55.492572+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:36:55.492572+0000","last_undegraded":"2024-03-20T13:36:55.492572+0000","last_fullsized":"2024-03-20T13:36:55.492572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.492425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:40.395733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.189274+0000","last_change":"2024-03-20T13:36:52.189274+0000","last_active":"2024-03-20T13:36:52.189274+0000","last_peered":"2024-03-20T13:36:52.189274+0000","last_clean":"2024-03-20T13:36:52.189274+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:52.189274+0000","last_undegraded":"2024-03-20T13:36:52.189274+0000","last_fullsized":"2024-03-20T13:36:52.189274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.189115+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:34:06.835908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.043936+0000","last_change":"2024-03-20T13:36:36.043936+0000","last_active":"2024-03-20T13:36:36.043936+0000","last_peered":"2024-03-20T13:36:36.043936+0000","last_clean":"2024-03-20T13:36:36.043936+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:36.043936+0000","last_undegraded":"2024-03-20T13:36:36.043936+0000","last_fullsized":"2024-03-20T13:36:36.043936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.043753+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:45.456154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272666+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:34.272666+0000","last_peered":"2024-03-20T13:36:34.272666+0000","last_clean":"2024-03-20T13:36:34.272666+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:34.272666+0000","last_undegraded":"2024-03-20T13:36:34.272666+0000","last_fullsized":"2024-03-20T13:36:34.272666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.215988+0000","last_change":"2024-03-20T13:37:10.216028+0000","last_active":"2024-03-20T13:37:10.215988+0000","last_peered":"2024-03-20T13:37:10.215988+0000","last_clean":"2024-03-20T13:37:10.215988+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:37:10.215988+0000","last_undegraded":"2024-03-20T13:37:10.215988+0000","last_fullsized":"2024-03-20T13:37:10.215988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.215883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.879959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593055+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:36:35.593055+0000","last_peered":"2024-03-20T13:36:35.593055+0000","last_clean":"2024-03-20T13:36:35.593055+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:36:35.593055+0000","last_undegraded":"2024-03-20T13:36:35.593055+0000","last_fullsized":"2024-03-20T13:36:35.593055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'4","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.891230+0000","last_change":"2024-03-20T13:36:47.891230+0000","last_active":"2024-03-20T13:36:47.891230+0000","last_peered":"2024-03-20T13:36:47.891230+0000","last_clean":"2024-03-20T13:36:47.891230+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:47.891230+0000","last_undegraded":"2024-03-20T13:36:47.891230+0000","last_fullsized":"2024-03-20T13:36:47.891230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.891061+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:18.309754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.146186+0000","last_change":"2024-03-20T13:36:38.146186+0000","last_active":"2024-03-20T13:36:38.146186+0000","last_peered":"2024-03-20T13:36:38.146186+0000","last_clean":"2024-03-20T13:36:38.146186+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:36:38.146186+0000","last_undegraded":"2024-03-20T13:36:38.146186+0000","last_fullsized":"2024-03-20T13:36:38.146186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.146066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:09.028952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.789972+0000","last_change":"2024-03-20T13:36:38.789972+0000","last_active":"2024-03-20T13:36:38.789972+0000","last_peered":"2024-03-20T13:36:38.789972+0000","last_clean":"2024-03-20T13:36:38.789972+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:38.789972+0000","last_undegraded":"2024-03-20T13:36:38.789972+0000","last_fullsized":"2024-03-20T13:36:38.789972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.789823+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:57.247566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.194544+0000","last_change":"2024-03-20T13:36:58.194544+0000","last_active":"2024-03-20T13:36:58.194544+0000","last_peered":"2024-03-20T13:36:58.194544+0000","last_clean":"2024-03-20T13:36:58.194544+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:36:58.194544+0000","last_undegraded":"2024-03-20T13:36:58.194544+0000","last_fullsized":"2024-03-20T13:36:58.194544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.194424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:10.534956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.880699+0000","last_change":"2024-03-20T13:36:52.880699+0000","last_active":"2024-03-20T13:36:52.880699+0000","last_peered":"2024-03-20T13:36:52.880699+0000","last_clean":"2024-03-20T13:36:52.880699+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:52.880699+0000","last_undegraded":"2024-03-20T13:36:52.880699+0000","last_fullsized":"2024-03-20T13:36:52.880699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.880575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:24.333852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593044+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:36:35.593044+0000","last_peered":"2024-03-20T13:36:35.593044+0000","last_clean":"2024-03-20T13:36:35.593044+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:36:35.593044+0000","last_undegraded":"2024-03-20T13:36:35.593044+0000","last_fullsized":"2024-03-20T13:36:35.593044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.116987+0000","last_change":"2024-03-20T13:36:39.116987+0000","last_active":"2024-03-20T13:36:39.116987+0000","last_peered":"2024-03-20T13:36:39.116987+0000","last_clean":"2024-03-20T13:36:39.116987+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:36:39.116987+0000","last_undegraded":"2024-03-20T13:36:39.116987+0000","last_fullsized":"2024-03-20T13:36:39.116987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.116826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:14:51.320018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.797716+0000","last_change":"2024-03-20T13:36:37.797716+0000","last_active":"2024-03-20T13:36:37.797716+0000","last_peered":"2024-03-20T13:36:37.797716+0000","last_clean":"2024-03-20T13:36:37.797716+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:37.797716+0000","last_undegraded":"2024-03-20T13:36:37.797716+0000","last_fullsized":"2024-03-20T13:36:37.797716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.797588+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:30:53.571956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.074189+0000","last_change":"2024-03-20T13:36:39.074189+0000","last_active":"2024-03-20T13:36:39.074189+0000","last_peered":"2024-03-20T13:36:39.074189+0000","last_clean":"2024-03-20T13:36:39.074189+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:36:39.074189+0000","last_undegraded":"2024-03-20T13:36:39.074189+0000","last_fullsized":"2024-03-20T13:36:39.074189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.074084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:36.877815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.712028+0000","last_change":"2024-03-20T13:34:59.968783+0000","last_active":"2024-03-20T13:36:34.712028+0000","last_peered":"2024-03-20T13:36:34.712028+0000","last_clean":"2024-03-20T13:36:34.712028+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:36:34.712028+0000","last_undegraded":"2024-03-20T13:36:34.712028+0000","last_fullsized":"2024-03-20T13:36:34.712028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.201510+0000","last_change":"2024-03-20T13:36:53.201510+0000","last_active":"2024-03-20T13:36:53.201510+0000","last_peered":"2024-03-20T13:36:53.201510+0000","last_clean":"2024-03-20T13:36:53.201510+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:36:53.201510+0000","last_undegraded":"2024-03-20T13:36:53.201510+0000","last_fullsized":"2024-03-20T13:36:53.201510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.201374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:47.204640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"11'117","reported_seq":204,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.215268+0000","last_change":"2024-03-20T13:34:35.123517+0000","last_active":"2024-03-20T13:36:34.215268+0000","last_peered":"2024-03-20T13:36:34.215268+0000","last_clean":"2024-03-20T13:36:34.215268+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:36:34.215268+0000","last_undegraded":"2024-03-20T13:36:34.215268+0000","last_fullsized":"2024-03-20T13:36:34.215268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:33.883766+0000","last_clean_scrub_stamp":"2024-03-20T13:34:33.883766+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592927+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:36:35.592927+0000","last_peered":"2024-03-20T13:36:35.592927+0000","last_clean":"2024-03-20T13:36:35.592927+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:36:35.592927+0000","last_undegraded":"2024-03-20T13:36:35.592927+0000","last_fullsized":"2024-03-20T13:36:35.592927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593021+0000","last_change":"2024-03-20T13:34:49.963030+0000","last_active":"2024-03-20T13:36:35.593021+0000","last_peered":"2024-03-20T13:36:35.593021+0000","last_clean":"2024-03-20T13:36:35.593021+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:36:35.593021+0000","last_undegraded":"2024-03-20T13:36:35.593021+0000","last_fullsized":"2024-03-20T13:36:35.593021+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.953552+0000","last_change":"2024-03-20T13:36:49.953552+0000","last_active":"2024-03-20T13:36:49.953552+0000","last_peered":"2024-03-20T13:36:49.953552+0000","last_clean":"2024-03-20T13:36:49.953552+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:36:49.953552+0000","last_undegraded":"2024-03-20T13:36:49.953552+0000","last_fullsized":"2024-03-20T13:36:49.953552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.953431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:13.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.123405+0000","last_change":"2024-03-20T13:36:46.123405+0000","last_active":"2024-03-20T13:36:46.123405+0000","last_peered":"2024-03-20T13:36:46.123405+0000","last_clean":"2024-03-20T13:36:46.123405+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:46.123405+0000","last_undegraded":"2024-03-20T13:36:46.123405+0000","last_fullsized":"2024-03-20T13:36:46.123405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.123283+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:09.527164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.454190+0000","last_change":"2024-03-20T13:36:42.454190+0000","last_active":"2024-03-20T13:36:42.454190+0000","last_peered":"2024-03-20T13:36:42.454190+0000","last_clean":"2024-03-20T13:36:42.454190+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:36:42.454190+0000","last_undegraded":"2024-03-20T13:36:42.454190+0000","last_fullsized":"2024-03-20T13:36:42.454190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.454069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:47.214837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.145557+0000","last_change":"2024-03-20T13:36:54.145557+0000","last_active":"2024-03-20T13:36:54.145557+0000","last_peered":"2024-03-20T13:36:54.145557+0000","last_clean":"2024-03-20T13:36:54.145557+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:54.145557+0000","last_undegraded":"2024-03-20T13:36:54.145557+0000","last_fullsized":"2024-03-20T13:36:54.145557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.145443+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:45.665997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593509+0000","last_change":"2024-03-20T13:34:51.941170+0000","last_active":"2024-03-20T13:36:35.593509+0000","last_peered":"2024-03-20T13:36:35.593509+0000","last_clean":"2024-03-20T13:36:35.593509+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:36:35.593509+0000","last_undegraded":"2024-03-20T13:36:35.593509+0000","last_fullsized":"2024-03-20T13:36:35.593509+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592926+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:36:35.592926+0000","last_peered":"2024-03-20T13:36:35.592926+0000","last_clean":"2024-03-20T13:36:35.592926+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:36:35.592926+0000","last_undegraded":"2024-03-20T13:36:35.592926+0000","last_fullsized":"2024-03-20T13:36:35.592926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.440517+0000","last_change":"2024-03-20T13:37:12.440569+0000","last_active":"2024-03-20T13:37:12.440517+0000","last_peered":"2024-03-20T13:37:12.440517+0000","last_clean":"2024-03-20T13:37:12.440517+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:37:12.440517+0000","last_undegraded":"2024-03-20T13:37:12.440517+0000","last_fullsized":"2024-03-20T13:37:12.440517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.440412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:23.449890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.083092+0000","last_change":"2024-03-20T13:36:43.083092+0000","last_active":"2024-03-20T13:36:43.083092+0000","last_peered":"2024-03-20T13:36:43.083092+0000","last_clean":"2024-03-20T13:36:43.083092+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:36:43.083092+0000","last_undegraded":"2024-03-20T13:36:43.083092+0000","last_fullsized":"2024-03-20T13:36:43.083092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.082968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:27:06.735401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.848464+0000","last_change":"2024-03-20T13:36:35.848464+0000","last_active":"2024-03-20T13:36:35.848464+0000","last_peered":"2024-03-20T13:36:35.848464+0000","last_clean":"2024-03-20T13:36:35.848464+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:35.848464+0000","last_undegraded":"2024-03-20T13:36:35.848464+0000","last_fullsized":"2024-03-20T13:36:35.848464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.848325+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:59:23.551034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.158892+0000","last_change":"2024-03-20T13:36:54.158892+0000","last_active":"2024-03-20T13:36:54.158892+0000","last_peered":"2024-03-20T13:36:54.158892+0000","last_clean":"2024-03-20T13:36:54.158892+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:36:54.158892+0000","last_undegraded":"2024-03-20T13:36:54.158892+0000","last_fullsized":"2024-03-20T13:36:54.158892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.158747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:05.168226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.712060+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:34.712060+0000","last_peered":"2024-03-20T13:36:34.712060+0000","last_clean":"2024-03-20T13:36:34.712060+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:34.712060+0000","last_undegraded":"2024-03-20T13:36:34.712060+0000","last_fullsized":"2024-03-20T13:36:34.712060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.542586+0000","last_change":"2024-03-20T13:37:03.542621+0000","last_active":"2024-03-20T13:37:03.542586+0000","last_peered":"2024-03-20T13:37:03.542586+0000","last_clean":"2024-03-20T13:37:03.542586+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:37:03.542586+0000","last_undegraded":"2024-03-20T13:37:03.542586+0000","last_fullsized":"2024-03-20T13:37:03.542586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.542501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:05.159751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150431+0000","last_change":"2024-03-20T13:34:41.903981+0000","last_active":"2024-03-20T13:36:35.150431+0000","last_peered":"2024-03-20T13:36:35.150431+0000","last_clean":"2024-03-20T13:36:35.150431+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:36:35.150431+0000","last_undegraded":"2024-03-20T13:36:35.150431+0000","last_fullsized":"2024-03-20T13:36:35.150431+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271620+0000","last_change":"2024-03-20T13:34:49.934321+0000","last_active":"2024-03-20T13:36:34.271620+0000","last_peered":"2024-03-20T13:36:34.271620+0000","last_clean":"2024-03-20T13:36:34.271620+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:36:34.271620+0000","last_undegraded":"2024-03-20T13:36:34.271620+0000","last_fullsized":"2024-03-20T13:36:34.271620+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.148343+0000","last_change":"2024-03-20T13:36:57.148343+0000","last_active":"2024-03-20T13:36:57.148343+0000","last_peered":"2024-03-20T13:36:57.148343+0000","last_clean":"2024-03-20T13:36:57.148343+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:36:57.148343+0000","last_undegraded":"2024-03-20T13:36:57.148343+0000","last_fullsized":"2024-03-20T13:36:57.148343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.148192+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:29.933263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.215018+0000","last_change":"2024-03-20T13:36:47.215018+0000","last_active":"2024-03-20T13:36:47.215018+0000","last_peered":"2024-03-20T13:36:47.215018+0000","last_clean":"2024-03-20T13:36:47.215018+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:47.215018+0000","last_undegraded":"2024-03-20T13:36:47.215018+0000","last_fullsized":"2024-03-20T13:36:47.215018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.214888+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:24.057007+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.483718+0000","last_change":"2024-03-20T13:36:40.483718+0000","last_active":"2024-03-20T13:36:40.483718+0000","last_peered":"2024-03-20T13:36:40.483718+0000","last_clean":"2024-03-20T13:36:40.483718+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:36:40.483718+0000","last_undegraded":"2024-03-20T13:36:40.483718+0000","last_fullsized":"2024-03-20T13:36:40.483718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.483604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:15.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.986183+0000","last_change":"2024-03-20T13:34:59.970194+0000","last_active":"2024-03-20T13:35:30.986183+0000","last_peered":"2024-03-20T13:35:30.986183+0000","last_clean":"2024-03-20T13:35:30.986183+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:35:30.986183+0000","last_undegraded":"2024-03-20T13:35:30.986183+0000","last_fullsized":"2024-03-20T13:35:30.986183+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.482307+0000","last_change":"2024-03-20T13:37:11.482376+0000","last_active":"2024-03-20T13:37:11.482307+0000","last_peered":"2024-03-20T13:37:11.482307+0000","last_clean":"2024-03-20T13:37:11.482307+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:37:11.482307+0000","last_undegraded":"2024-03-20T13:37:11.482307+0000","last_fullsized":"2024-03-20T13:37:11.482307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.482209+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:05.485475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592922+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:36:35.592922+0000","last_peered":"2024-03-20T13:36:35.592922+0000","last_clean":"2024-03-20T13:36:35.592922+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:36:35.592922+0000","last_undegraded":"2024-03-20T13:36:35.592922+0000","last_fullsized":"2024-03-20T13:36:35.592922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150474+0000","last_change":"2024-03-20T13:34:49.938266+0000","last_active":"2024-03-20T13:36:35.150474+0000","last_peered":"2024-03-20T13:36:35.150474+0000","last_clean":"2024-03-20T13:36:35.150474+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:36:35.150474+0000","last_undegraded":"2024-03-20T13:36:35.150474+0000","last_fullsized":"2024-03-20T13:36:35.150474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.507511+0000","last_change":"2024-03-20T13:36:56.507511+0000","last_active":"2024-03-20T13:36:56.507511+0000","last_peered":"2024-03-20T13:36:56.507511+0000","last_clean":"2024-03-20T13:36:56.507511+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:36:56.507511+0000","last_undegraded":"2024-03-20T13:36:56.507511+0000","last_fullsized":"2024-03-20T13:36:56.507511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.507374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:27.390260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.226545+0000","last_change":"2024-03-20T13:36:59.226545+0000","last_active":"2024-03-20T13:36:59.226545+0000","last_peered":"2024-03-20T13:36:59.226545+0000","last_clean":"2024-03-20T13:36:59.226545+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:36:59.226545+0000","last_undegraded":"2024-03-20T13:36:59.226545+0000","last_fullsized":"2024-03-20T13:36:59.226545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.226391+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:17.073932+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.194396+0000","last_change":"2024-03-20T13:36:57.194396+0000","last_active":"2024-03-20T13:36:57.194396+0000","last_peered":"2024-03-20T13:36:57.194396+0000","last_clean":"2024-03-20T13:36:57.194396+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:36:57.194396+0000","last_undegraded":"2024-03-20T13:36:57.194396+0000","last_fullsized":"2024-03-20T13:36:57.194396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.194286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:57.106173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.712036+0000","last_change":"2024-03-20T13:34:59.972480+0000","last_active":"2024-03-20T13:36:34.712036+0000","last_peered":"2024-03-20T13:36:34.712036+0000","last_clean":"2024-03-20T13:36:34.712036+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:36:34.712036+0000","last_undegraded":"2024-03-20T13:36:34.712036+0000","last_fullsized":"2024-03-20T13:36:34.712036+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.850116+0000","last_change":"2024-03-20T13:36:56.850116+0000","last_active":"2024-03-20T13:36:56.850116+0000","last_peered":"2024-03-20T13:36:56.850116+0000","last_clean":"2024-03-20T13:36:56.850116+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:56.850116+0000","last_undegraded":"2024-03-20T13:36:56.850116+0000","last_fullsized":"2024-03-20T13:36:56.850116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.849978+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:10.407253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150492+0000","last_change":"2024-03-20T13:34:49.936614+0000","last_active":"2024-03-20T13:36:35.150492+0000","last_peered":"2024-03-20T13:36:35.150492+0000","last_clean":"2024-03-20T13:36:35.150492+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:36:35.150492+0000","last_undegraded":"2024-03-20T13:36:35.150492+0000","last_fullsized":"2024-03-20T13:36:35.150492+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271675+0000","last_change":"2024-03-20T13:34:41.904782+0000","last_active":"2024-03-20T13:36:34.271675+0000","last_peered":"2024-03-20T13:36:34.271675+0000","last_clean":"2024-03-20T13:36:34.271675+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:36:34.271675+0000","last_undegraded":"2024-03-20T13:36:34.271675+0000","last_fullsized":"2024-03-20T13:36:34.271675+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'3","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.474223+0000","last_change":"2024-03-20T13:36:59.474249+0000","last_active":"2024-03-20T13:36:59.474223+0000","last_peered":"2024-03-20T13:36:59.474223+0000","last_clean":"2024-03-20T13:36:59.474223+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:59.474223+0000","last_undegraded":"2024-03-20T13:36:59.474223+0000","last_fullsized":"2024-03-20T13:36:59.474223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.474149+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:43.301196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.439320+0000","last_change":"2024-03-20T13:36:43.439320+0000","last_active":"2024-03-20T13:36:43.439320+0000","last_peered":"2024-03-20T13:36:43.439320+0000","last_clean":"2024-03-20T13:36:43.439320+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:43.439320+0000","last_undegraded":"2024-03-20T13:36:43.439320+0000","last_fullsized":"2024-03-20T13:36:43.439320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.439197+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:55.779728+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.108014+0000","last_change":"2024-03-20T13:36:40.108014+0000","last_active":"2024-03-20T13:36:40.108014+0000","last_peered":"2024-03-20T13:36:40.108014+0000","last_clean":"2024-03-20T13:36:40.108014+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:36:40.108014+0000","last_undegraded":"2024-03-20T13:36:40.108014+0000","last_fullsized":"2024-03-20T13:36:40.108014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.107898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:33.206081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.986151+0000","last_change":"2024-03-20T13:34:59.968897+0000","last_active":"2024-03-20T13:36:17.986151+0000","last_peered":"2024-03-20T13:36:17.986151+0000","last_clean":"2024-03-20T13:36:17.986151+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:36:17.986151+0000","last_undegraded":"2024-03-20T13:36:17.986151+0000","last_fullsized":"2024-03-20T13:36:17.986151+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.747290+0000","last_change":"2024-03-20T13:37:05.747316+0000","last_active":"2024-03-20T13:37:05.747290+0000","last_peered":"2024-03-20T13:37:05.747290+0000","last_clean":"2024-03-20T13:37:05.747290+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:37:05.747290+0000","last_undegraded":"2024-03-20T13:37:05.747290+0000","last_fullsized":"2024-03-20T13:37:05.747290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.747166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:55.045115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.428580+0000","last_change":"2024-03-20T13:37:08.428609+0000","last_active":"2024-03-20T13:37:08.428580+0000","last_peered":"2024-03-20T13:37:08.428580+0000","last_clean":"2024-03-20T13:37:08.428580+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:37:08.428580+0000","last_undegraded":"2024-03-20T13:37:08.428580+0000","last_fullsized":"2024-03-20T13:37:08.428580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.428489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:55.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592938+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:36:35.592938+0000","last_peered":"2024-03-20T13:36:35.592938+0000","last_clean":"2024-03-20T13:36:35.592938+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:36:35.592938+0000","last_undegraded":"2024-03-20T13:36:35.592938+0000","last_fullsized":"2024-03-20T13:36:35.592938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.129101+0000","last_change":"2024-03-20T13:36:45.129101+0000","last_active":"2024-03-20T13:36:45.129101+0000","last_peered":"2024-03-20T13:36:45.129101+0000","last_clean":"2024-03-20T13:36:45.129101+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:36:45.129101+0000","last_undegraded":"2024-03-20T13:36:45.129101+0000","last_fullsized":"2024-03-20T13:36:45.129101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.128960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:46.746210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.882086+0000","last_change":"2024-03-20T13:36:34.882086+0000","last_active":"2024-03-20T13:36:34.882086+0000","last_peered":"2024-03-20T13:36:34.882086+0000","last_clean":"2024-03-20T13:36:34.882086+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:36:34.882086+0000","last_undegraded":"2024-03-20T13:36:34.882086+0000","last_fullsized":"2024-03-20T13:36:34.882086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.881955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:01.668025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":291,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.888239+0000","last_change":"2024-03-20T13:36:46.888239+0000","last_active":"2024-03-20T13:36:46.888239+0000","last_peered":"2024-03-20T13:36:46.888239+0000","last_clean":"2024-03-20T13:36:46.888239+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:46.888239+0000","last_undegraded":"2024-03-20T13:36:46.888239+0000","last_fullsized":"2024-03-20T13:36:46.888239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.888110+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.228641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.247218+0000","last_change":"2024-03-20T13:37:12.247268+0000","last_active":"2024-03-20T13:37:12.247218+0000","last_peered":"2024-03-20T13:37:12.247218+0000","last_clean":"2024-03-20T13:37:12.247218+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:37:12.247218+0000","last_undegraded":"2024-03-20T13:37:12.247218+0000","last_fullsized":"2024-03-20T13:37:12.247218+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.247124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:39:43.039748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.204303+0000","last_change":"2024-03-20T13:36:51.204303+0000","last_active":"2024-03-20T13:36:51.204303+0000","last_peered":"2024-03-20T13:36:51.204303+0000","last_clean":"2024-03-20T13:36:51.204303+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:36:51.204303+0000","last_undegraded":"2024-03-20T13:36:51.204303+0000","last_fullsized":"2024-03-20T13:36:51.204303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.204192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:38.634547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593114+0000","last_change":"2024-03-20T13:34:49.957658+0000","last_active":"2024-03-20T13:36:35.593114+0000","last_peered":"2024-03-20T13:36:35.593114+0000","last_clean":"2024-03-20T13:36:35.593114+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:36:35.593114+0000","last_undegraded":"2024-03-20T13:36:35.593114+0000","last_fullsized":"2024-03-20T13:36:35.593114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271638+0000","last_change":"2024-03-20T13:34:41.904807+0000","last_active":"2024-03-20T13:36:34.271638+0000","last_peered":"2024-03-20T13:36:34.271638+0000","last_clean":"2024-03-20T13:36:34.271638+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:36:34.271638+0000","last_undegraded":"2024-03-20T13:36:34.271638+0000","last_fullsized":"2024-03-20T13:36:34.271638+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593727+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:36:35.593727+0000","last_peered":"2024-03-20T13:36:35.593727+0000","last_clean":"2024-03-20T13:36:35.593727+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:36:35.593727+0000","last_undegraded":"2024-03-20T13:36:35.593727+0000","last_fullsized":"2024-03-20T13:36:35.593727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.215859+0000","last_change":"2024-03-20T13:37:05.215894+0000","last_active":"2024-03-20T13:37:05.215859+0000","last_peered":"2024-03-20T13:37:05.215859+0000","last_clean":"2024-03-20T13:37:05.215859+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:37:05.215859+0000","last_undegraded":"2024-03-20T13:37:05.215859+0000","last_fullsized":"2024-03-20T13:37:05.215859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.215760+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:50.554560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.452554+0000","last_change":"2024-03-20T13:36:45.452554+0000","last_active":"2024-03-20T13:36:45.452554+0000","last_peered":"2024-03-20T13:36:45.452554+0000","last_clean":"2024-03-20T13:36:45.452554+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:45.452554+0000","last_undegraded":"2024-03-20T13:36:45.452554+0000","last_fullsized":"2024-03-20T13:36:45.452554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.452437+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:06:35.977614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.722337+0000","last_change":"2024-03-20T13:37:02.722337+0000","last_active":"2024-03-20T13:37:02.722337+0000","last_peered":"2024-03-20T13:37:02.722337+0000","last_clean":"2024-03-20T13:37:02.722337+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:37:02.722337+0000","last_undegraded":"2024-03-20T13:37:02.722337+0000","last_fullsized":"2024-03-20T13:37:02.722337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.722217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:10.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150753+0000","last_change":"2024-03-20T13:34:51.944433+0000","last_active":"2024-03-20T13:36:35.150753+0000","last_peered":"2024-03-20T13:36:35.150753+0000","last_clean":"2024-03-20T13:36:35.150753+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:36:35.150753+0000","last_undegraded":"2024-03-20T13:36:35.150753+0000","last_fullsized":"2024-03-20T13:36:35.150753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.710999+0000","last_change":"2024-03-20T13:34:49.947597+0000","last_active":"2024-03-20T13:36:34.710999+0000","last_peered":"2024-03-20T13:36:34.710999+0000","last_clean":"2024-03-20T13:36:34.710999+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:36:34.710999+0000","last_undegraded":"2024-03-20T13:36:34.710999+0000","last_fullsized":"2024-03-20T13:36:34.710999+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592938+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:36:35.592938+0000","last_peered":"2024-03-20T13:36:35.592938+0000","last_clean":"2024-03-20T13:36:35.592938+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:36:35.592938+0000","last_undegraded":"2024-03-20T13:36:35.592938+0000","last_fullsized":"2024-03-20T13:36:35.592938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.105883+0000","last_change":"2024-03-20T13:36:42.105883+0000","last_active":"2024-03-20T13:36:42.105883+0000","last_peered":"2024-03-20T13:36:42.105883+0000","last_clean":"2024-03-20T13:36:42.105883+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:36:42.105883+0000","last_undegraded":"2024-03-20T13:36:42.105883+0000","last_fullsized":"2024-03-20T13:36:42.105883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.105759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:22:49.608123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":184,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.173473+0000","last_change":"2024-03-20T13:36:45.173473+0000","last_active":"2024-03-20T13:36:45.173473+0000","last_peered":"2024-03-20T13:36:45.173473+0000","last_clean":"2024-03-20T13:36:45.173473+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:45.173473+0000","last_undegraded":"2024-03-20T13:36:45.173473+0000","last_fullsized":"2024-03-20T13:36:45.173473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'91","last_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_deep_scrub":"32'91","last_deep_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.173353+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:11.959423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.486441+0000","last_change":"2024-03-20T13:36:36.486441+0000","last_active":"2024-03-20T13:36:36.486441+0000","last_peered":"2024-03-20T13:36:36.486441+0000","last_clean":"2024-03-20T13:36:36.486441+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:36:36.486441+0000","last_undegraded":"2024-03-20T13:36:36.486441+0000","last_fullsized":"2024-03-20T13:36:36.486441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.486298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:56.678415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.195177+0000","last_change":"2024-03-20T13:36:50.195177+0000","last_active":"2024-03-20T13:36:50.195177+0000","last_peered":"2024-03-20T13:36:50.195177+0000","last_clean":"2024-03-20T13:36:50.195177+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:36:50.195177+0000","last_undegraded":"2024-03-20T13:36:50.195177+0000","last_fullsized":"2024-03-20T13:36:50.195177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.195066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:08.652809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.162953+0000","last_change":"2024-03-20T13:36:42.162953+0000","last_active":"2024-03-20T13:36:42.162953+0000","last_peered":"2024-03-20T13:36:42.162953+0000","last_clean":"2024-03-20T13:36:42.162953+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:36:42.162953+0000","last_undegraded":"2024-03-20T13:36:42.162953+0000","last_fullsized":"2024-03-20T13:36:42.162953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.162847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:46:25.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.237627+0000","last_change":"2024-03-20T13:37:12.237627+0000","last_active":"2024-03-20T13:37:12.237627+0000","last_peered":"2024-03-20T13:37:12.237627+0000","last_clean":"2024-03-20T13:37:12.237627+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:37:12.237627+0000","last_undegraded":"2024-03-20T13:37:12.237627+0000","last_fullsized":"2024-03-20T13:37:12.237627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.237514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:54.859398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593187+0000","last_change":"2024-03-20T13:34:49.960700+0000","last_active":"2024-03-20T13:36:35.593187+0000","last_peered":"2024-03-20T13:36:35.593187+0000","last_clean":"2024-03-20T13:36:35.593187+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:36:35.593187+0000","last_undegraded":"2024-03-20T13:36:35.593187+0000","last_fullsized":"2024-03-20T13:36:35.593187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.927642+0000","last_change":"2024-03-20T13:36:48.927642+0000","last_active":"2024-03-20T13:36:48.927642+0000","last_peered":"2024-03-20T13:36:48.927642+0000","last_clean":"2024-03-20T13:36:48.927642+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:36:48.927642+0000","last_undegraded":"2024-03-20T13:36:48.927642+0000","last_fullsized":"2024-03-20T13:36:48.927642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.927492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:31.555602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.228464+0000","last_change":"2024-03-20T13:37:02.228501+0000","last_active":"2024-03-20T13:37:02.228464+0000","last_peered":"2024-03-20T13:37:02.228464+0000","last_clean":"2024-03-20T13:37:02.228464+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:37:02.228464+0000","last_undegraded":"2024-03-20T13:37:02.228464+0000","last_fullsized":"2024-03-20T13:37:02.228464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.228382+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:57.609818+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.213438+0000","last_change":"2024-03-20T13:37:00.213463+0000","last_active":"2024-03-20T13:37:00.213438+0000","last_peered":"2024-03-20T13:37:00.213438+0000","last_clean":"2024-03-20T13:37:00.213438+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:37:00.213438+0000","last_undegraded":"2024-03-20T13:37:00.213438+0000","last_fullsized":"2024-03-20T13:37:00.213438+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.213347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:55.768317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.470905+0000","last_change":"2024-03-20T13:37:01.470905+0000","last_active":"2024-03-20T13:37:01.470905+0000","last_peered":"2024-03-20T13:37:01.470905+0000","last_clean":"2024-03-20T13:37:01.470905+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:37:01.470905+0000","last_undegraded":"2024-03-20T13:37:01.470905+0000","last_fullsized":"2024-03-20T13:37:01.470905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.470772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:39.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.740422+0000","last_change":"2024-03-20T13:37:08.740422+0000","last_active":"2024-03-20T13:37:08.740422+0000","last_peered":"2024-03-20T13:37:08.740422+0000","last_clean":"2024-03-20T13:37:08.740422+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:37:08.740422+0000","last_undegraded":"2024-03-20T13:37:08.740422+0000","last_fullsized":"2024-03-20T13:37:08.740422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.740297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:41.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.243856+0000","last_change":"2024-03-20T13:37:09.243856+0000","last_active":"2024-03-20T13:37:09.243856+0000","last_peered":"2024-03-20T13:37:09.243856+0000","last_clean":"2024-03-20T13:37:09.243856+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:37:09.243856+0000","last_undegraded":"2024-03-20T13:37:09.243856+0000","last_fullsized":"2024-03-20T13:37:09.243856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.243729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:38.730937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:34.205160+0000","last_change":"2024-03-20T13:35:30.990765+0000","last_active":"2024-03-20T13:35:34.205160+0000","last_peered":"2024-03-20T13:35:34.205160+0000","last_clean":"2024-03-20T13:35:34.205160+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:35:34.205160+0000","last_undegraded":"2024-03-20T13:35:34.205160+0000","last_fullsized":"2024-03-20T13:35:34.205160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.478607+0000","last_change":"2024-03-20T13:36:47.478637+0000","last_active":"2024-03-20T13:36:47.478607+0000","last_peered":"2024-03-20T13:36:47.478607+0000","last_clean":"2024-03-20T13:36:47.478607+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:47.478607+0000","last_undegraded":"2024-03-20T13:36:47.478607+0000","last_fullsized":"2024-03-20T13:36:47.478607+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.478507+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:17.900912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.100156+0000","last_change":"2024-03-20T13:36:38.100179+0000","last_active":"2024-03-20T13:36:38.100156+0000","last_peered":"2024-03-20T13:36:38.100156+0000","last_clean":"2024-03-20T13:36:38.100156+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:36:38.100156+0000","last_undegraded":"2024-03-20T13:36:38.100156+0000","last_fullsized":"2024-03-20T13:36:38.100156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.100067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:06:11.567457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983495+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:35:30.983495+0000","last_peered":"2024-03-20T13:35:30.983495+0000","last_clean":"2024-03-20T13:35:30.983495+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:35:30.983495+0000","last_undegraded":"2024-03-20T13:35:30.983495+0000","last_fullsized":"2024-03-20T13:35:30.983495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.461142+0000","last_change":"2024-03-20T13:37:07.461142+0000","last_active":"2024-03-20T13:37:07.461142+0000","last_peered":"2024-03-20T13:37:07.461142+0000","last_clean":"2024-03-20T13:37:07.461142+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:37:07.461142+0000","last_undegraded":"2024-03-20T13:37:07.461142+0000","last_fullsized":"2024-03-20T13:37:07.461142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.461017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:49.260164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150569+0000","last_change":"2024-03-20T13:34:49.946529+0000","last_active":"2024-03-20T13:36:35.150569+0000","last_peered":"2024-03-20T13:36:35.150569+0000","last_clean":"2024-03-20T13:36:35.150569+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:36:35.150569+0000","last_undegraded":"2024-03-20T13:36:35.150569+0000","last_fullsized":"2024-03-20T13:36:35.150569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.112735+0000","last_change":"2024-03-20T13:36:56.112735+0000","last_active":"2024-03-20T13:36:56.112735+0000","last_peered":"2024-03-20T13:36:56.112735+0000","last_clean":"2024-03-20T13:36:56.112735+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:36:56.112735+0000","last_undegraded":"2024-03-20T13:36:56.112735+0000","last_fullsized":"2024-03-20T13:36:56.112735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.112607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:05.346785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.407001+0000","last_change":"2024-03-20T13:36:44.407080+0000","last_active":"2024-03-20T13:36:44.407001+0000","last_peered":"2024-03-20T13:36:44.407001+0000","last_clean":"2024-03-20T13:36:44.407001+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:44.407001+0000","last_undegraded":"2024-03-20T13:36:44.407001+0000","last_fullsized":"2024-03-20T13:36:44.407001+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.406901+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:14.825593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.839014+0000","last_change":"2024-03-20T13:36:42.839038+0000","last_active":"2024-03-20T13:36:42.839014+0000","last_peered":"2024-03-20T13:36:42.839014+0000","last_clean":"2024-03-20T13:36:42.839014+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:36:42.839014+0000","last_undegraded":"2024-03-20T13:36:42.839014+0000","last_fullsized":"2024-03-20T13:36:42.839014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.838924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:34.359477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988737+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:35:30.988737+0000","last_peered":"2024-03-20T13:35:30.988737+0000","last_clean":"2024-03-20T13:35:30.988737+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:35:30.988737+0000","last_undegraded":"2024-03-20T13:35:30.988737+0000","last_fullsized":"2024-03-20T13:35:30.988737+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.196840+0000","last_change":"2024-03-20T13:36:49.196840+0000","last_active":"2024-03-20T13:36:49.196840+0000","last_peered":"2024-03-20T13:36:49.196840+0000","last_clean":"2024-03-20T13:36:49.196840+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:36:49.196840+0000","last_undegraded":"2024-03-20T13:36:49.196840+0000","last_fullsized":"2024-03-20T13:36:49.196840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.196667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:30.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711035+0000","last_change":"2024-03-20T13:34:49.937900+0000","last_active":"2024-03-20T13:36:34.711035+0000","last_peered":"2024-03-20T13:36:34.711035+0000","last_clean":"2024-03-20T13:36:34.711035+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:36:34.711035+0000","last_undegraded":"2024-03-20T13:36:34.711035+0000","last_fullsized":"2024-03-20T13:36:34.711035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.120372+0000","last_change":"2024-03-20T13:36:37.120372+0000","last_active":"2024-03-20T13:36:37.120372+0000","last_peered":"2024-03-20T13:36:37.120372+0000","last_clean":"2024-03-20T13:36:37.120372+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:36:37.120372+0000","last_undegraded":"2024-03-20T13:36:37.120372+0000","last_fullsized":"2024-03-20T13:36:37.120372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.120203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":88,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.166010+0000","last_change":"2024-03-20T13:36:51.166063+0000","last_active":"2024-03-20T13:36:51.166010+0000","last_peered":"2024-03-20T13:36:51.166010+0000","last_clean":"2024-03-20T13:36:51.166010+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:51.166010+0000","last_undegraded":"2024-03-20T13:36:51.166010+0000","last_fullsized":"2024-03-20T13:36:51.166010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.165931+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:11.358048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.137609+0000","last_change":"2024-03-20T13:36:43.137649+0000","last_active":"2024-03-20T13:36:43.137609+0000","last_peered":"2024-03-20T13:36:43.137609+0000","last_clean":"2024-03-20T13:36:43.137609+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:36:43.137609+0000","last_undegraded":"2024-03-20T13:36:43.137609+0000","last_fullsized":"2024-03-20T13:36:43.137609+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.137482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:28.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593603+0000","last_change":"2024-03-20T13:34:51.944100+0000","last_active":"2024-03-20T13:36:35.593603+0000","last_peered":"2024-03-20T13:36:35.593603+0000","last_clean":"2024-03-20T13:36:35.593603+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:36:35.593603+0000","last_undegraded":"2024-03-20T13:36:35.593603+0000","last_fullsized":"2024-03-20T13:36:35.593603+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983909+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:35:30.983909+0000","last_peered":"2024-03-20T13:35:30.983909+0000","last_clean":"2024-03-20T13:35:30.983909+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:35:30.983909+0000","last_undegraded":"2024-03-20T13:35:30.983909+0000","last_fullsized":"2024-03-20T13:35:30.983909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.515662+0000","last_change":"2024-03-20T13:36:58.515701+0000","last_active":"2024-03-20T13:36:58.515662+0000","last_peered":"2024-03-20T13:36:58.515662+0000","last_clean":"2024-03-20T13:36:58.515662+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:36:58.515662+0000","last_undegraded":"2024-03-20T13:36:58.515662+0000","last_fullsized":"2024-03-20T13:36:58.515662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.515568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:41.137452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":133,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.434884+0000","last_change":"2024-03-20T13:36:46.434919+0000","last_active":"2024-03-20T13:36:46.434884+0000","last_peered":"2024-03-20T13:36:46.434884+0000","last_clean":"2024-03-20T13:36:46.434884+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:46.434884+0000","last_undegraded":"2024-03-20T13:36:46.434884+0000","last_fullsized":"2024-03-20T13:36:46.434884+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.434789+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:21.531106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.142297+0000","last_change":"2024-03-20T13:36:41.142333+0000","last_active":"2024-03-20T13:36:41.142297+0000","last_peered":"2024-03-20T13:36:41.142297+0000","last_clean":"2024-03-20T13:36:41.142297+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:36:41.142297+0000","last_undegraded":"2024-03-20T13:36:41.142297+0000","last_fullsized":"2024-03-20T13:36:41.142297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.142212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:35.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:17.982703+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:17.982703+0000","last_peered":"2024-03-20T13:36:17.982703+0000","last_clean":"2024-03-20T13:36:17.982703+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:17.982703+0000","last_undegraded":"2024-03-20T13:36:17.982703+0000","last_fullsized":"2024-03-20T13:36:17.982703+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.496484+0000","last_change":"2024-03-20T13:37:04.496531+0000","last_active":"2024-03-20T13:37:04.496484+0000","last_peered":"2024-03-20T13:37:04.496484+0000","last_clean":"2024-03-20T13:37:04.496484+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:37:04.496484+0000","last_undegraded":"2024-03-20T13:37:04.496484+0000","last_fullsized":"2024-03-20T13:37:04.496484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.496373+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:27.900255+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711049+0000","last_change":"2024-03-20T13:34:49.946304+0000","last_active":"2024-03-20T13:36:34.711049+0000","last_peered":"2024-03-20T13:36:34.711049+0000","last_clean":"2024-03-20T13:36:34.711049+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:36:34.711049+0000","last_undegraded":"2024-03-20T13:36:34.711049+0000","last_fullsized":"2024-03-20T13:36:34.711049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.151145+0000","last_change":"2024-03-20T13:35:30.992863+0000","last_active":"2024-03-20T13:36:35.151145+0000","last_peered":"2024-03-20T13:36:35.151145+0000","last_clean":"2024-03-20T13:36:35.151145+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:36:35.151145+0000","last_undegraded":"2024-03-20T13:36:35.151145+0000","last_fullsized":"2024-03-20T13:36:35.151145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.193488+0000","last_change":"2024-03-20T13:37:01.193532+0000","last_active":"2024-03-20T13:37:01.193488+0000","last_peered":"2024-03-20T13:37:01.193488+0000","last_clean":"2024-03-20T13:37:01.193488+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:37:01.193488+0000","last_undegraded":"2024-03-20T13:37:01.193488+0000","last_fullsized":"2024-03-20T13:37:01.193488+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.193395+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:18.727953+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.825343+0000","last_change":"2024-03-20T13:36:54.825368+0000","last_active":"2024-03-20T13:36:54.825343+0000","last_peered":"2024-03-20T13:36:54.825343+0000","last_clean":"2024-03-20T13:36:54.825343+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:36:54.825343+0000","last_undegraded":"2024-03-20T13:36:54.825343+0000","last_fullsized":"2024-03-20T13:36:54.825343+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.825258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:24.356866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985344+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:35:30.985344+0000","last_peered":"2024-03-20T13:35:30.985344+0000","last_clean":"2024-03-20T13:35:30.985344+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:35:30.985344+0000","last_undegraded":"2024-03-20T13:35:30.985344+0000","last_fullsized":"2024-03-20T13:35:30.985344+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.167722+0000","last_change":"2024-03-20T13:36:50.167768+0000","last_active":"2024-03-20T13:36:50.167722+0000","last_peered":"2024-03-20T13:36:50.167722+0000","last_clean":"2024-03-20T13:36:50.167722+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:36:50.167722+0000","last_undegraded":"2024-03-20T13:36:50.167722+0000","last_fullsized":"2024-03-20T13:36:50.167722+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.167623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:36.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.755752+0000","last_change":"2024-03-20T13:37:13.755783+0000","last_active":"2024-03-20T13:37:13.755752+0000","last_peered":"2024-03-20T13:37:13.755752+0000","last_clean":"2024-03-20T13:37:13.755752+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:37:13.755752+0000","last_undegraded":"2024-03-20T13:37:13.755752+0000","last_fullsized":"2024-03-20T13:37:13.755752+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.755656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:44.151919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.992732+0000","last_change":"2024-03-20T13:35:30.991895+0000","last_active":"2024-03-20T13:35:30.992732+0000","last_peered":"2024-03-20T13:35:30.992732+0000","last_clean":"2024-03-20T13:35:30.992732+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:35:30.992732+0000","last_undegraded":"2024-03-20T13:35:30.992732+0000","last_fullsized":"2024-03-20T13:35:30.992732+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.430174+0000","last_change":"2024-03-20T13:36:48.430174+0000","last_active":"2024-03-20T13:36:48.430174+0000","last_peered":"2024-03-20T13:36:48.430174+0000","last_clean":"2024-03-20T13:36:48.430174+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:48.430174+0000","last_undegraded":"2024-03-20T13:36:48.430174+0000","last_fullsized":"2024-03-20T13:36:48.430174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.430044+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:13:05.290246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.424720+0000","last_change":"2024-03-20T13:36:53.424720+0000","last_active":"2024-03-20T13:36:53.424720+0000","last_peered":"2024-03-20T13:36:53.424720+0000","last_clean":"2024-03-20T13:36:53.424720+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:36:53.424720+0000","last_undegraded":"2024-03-20T13:36:53.424720+0000","last_fullsized":"2024-03-20T13:36:53.424720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.424599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:42.288257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.573751+0000","last_change":"2024-03-20T13:34:59.970646+0000","last_active":"2024-03-20T13:36:23.573751+0000","last_peered":"2024-03-20T13:36:23.573751+0000","last_clean":"2024-03-20T13:36:23.573751+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:36:23.573751+0000","last_undegraded":"2024-03-20T13:36:23.573751+0000","last_fullsized":"2024-03-20T13:36:23.573751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.432949+0000","last_change":"2024-03-20T13:34:51.943110+0000","last_active":"2024-03-20T13:35:35.432949+0000","last_peered":"2024-03-20T13:35:35.432949+0000","last_clean":"2024-03-20T13:35:35.432949+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:35:35.432949+0000","last_undegraded":"2024-03-20T13:35:35.432949+0000","last_fullsized":"2024-03-20T13:35:35.432949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987440+0000","last_change":"2024-03-20T13:34:49.960382+0000","last_active":"2024-03-20T13:35:30.987440+0000","last_peered":"2024-03-20T13:35:30.987440+0000","last_clean":"2024-03-20T13:35:30.987440+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:35:30.987440+0000","last_undegraded":"2024-03-20T13:35:30.987440+0000","last_fullsized":"2024-03-20T13:35:30.987440+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.916128+0000","last_change":"2024-03-20T13:36:51.916154+0000","last_active":"2024-03-20T13:36:51.916128+0000","last_peered":"2024-03-20T13:36:51.916128+0000","last_clean":"2024-03-20T13:36:51.916128+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:36:51.916128+0000","last_undegraded":"2024-03-20T13:36:51.916128+0000","last_fullsized":"2024-03-20T13:36:51.916128+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.916042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:20.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.240981+0000","last_change":"2024-03-20T13:36:58.241018+0000","last_active":"2024-03-20T13:36:58.240981+0000","last_peered":"2024-03-20T13:36:58.240981+0000","last_clean":"2024-03-20T13:36:58.240981+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:36:58.240981+0000","last_undegraded":"2024-03-20T13:36:58.240981+0000","last_fullsized":"2024-03-20T13:36:58.240981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.240881+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:38.665383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":306,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.069210+0000","last_change":"2024-03-20T13:36:37.069210+0000","last_active":"2024-03-20T13:36:37.069210+0000","last_peered":"2024-03-20T13:36:37.069210+0000","last_clean":"2024-03-20T13:36:37.069210+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:37.069210+0000","last_undegraded":"2024-03-20T13:36:37.069210+0000","last_fullsized":"2024-03-20T13:36:37.069210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.069055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:28:39.752450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983230+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:35:30.983230+0000","last_peered":"2024-03-20T13:35:30.983230+0000","last_clean":"2024-03-20T13:35:30.983230+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:35:30.983230+0000","last_undegraded":"2024-03-20T13:35:30.983230+0000","last_fullsized":"2024-03-20T13:35:30.983230+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":61,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.292252+0000","last_change":"2024-03-20T13:37:02.292302+0000","last_active":"2024-03-20T13:37:02.292252+0000","last_peered":"2024-03-20T13:37:02.292252+0000","last_clean":"2024-03-20T13:37:02.292252+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:37:02.292252+0000","last_undegraded":"2024-03-20T13:37:02.292252+0000","last_fullsized":"2024-03-20T13:37:02.292252+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.292156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:32.714561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.982472+0000","last_change":"2024-03-20T13:34:49.939827+0000","last_active":"2024-03-20T13:35:30.982472+0000","last_peered":"2024-03-20T13:35:30.982472+0000","last_clean":"2024-03-20T13:35:30.982472+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:35:30.982472+0000","last_undegraded":"2024-03-20T13:35:30.982472+0000","last_fullsized":"2024-03-20T13:35:30.982472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.882061+0000","last_change":"2024-03-20T13:36:45.882093+0000","last_active":"2024-03-20T13:36:45.882061+0000","last_peered":"2024-03-20T13:36:45.882061+0000","last_clean":"2024-03-20T13:36:45.882061+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:36:45.882061+0000","last_undegraded":"2024-03-20T13:36:45.882061+0000","last_fullsized":"2024-03-20T13:36:45.882061+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.881976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:18.667047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":100,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.780747+0000","last_change":"2024-03-20T13:36:40.780797+0000","last_active":"2024-03-20T13:36:40.780747+0000","last_peered":"2024-03-20T13:36:40.780747+0000","last_clean":"2024-03-20T13:36:40.780747+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:40.780747+0000","last_undegraded":"2024-03-20T13:36:40.780747+0000","last_fullsized":"2024-03-20T13:36:40.780747+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.780669+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:55.427462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.483839+0000","last_change":"2024-03-20T13:36:37.483874+0000","last_active":"2024-03-20T13:36:37.483839+0000","last_peered":"2024-03-20T13:36:37.483839+0000","last_clean":"2024-03-20T13:36:37.483839+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:36:37.483839+0000","last_undegraded":"2024-03-20T13:36:37.483839+0000","last_fullsized":"2024-03-20T13:36:37.483839+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.483750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:40.729135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.983073+0000","last_change":"2024-03-20T13:34:59.974362+0000","last_active":"2024-03-20T13:35:30.983073+0000","last_peered":"2024-03-20T13:35:30.983073+0000","last_clean":"2024-03-20T13:35:30.983073+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:35:30.983073+0000","last_undegraded":"2024-03-20T13:35:30.983073+0000","last_fullsized":"2024-03-20T13:35:30.983073+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":69,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.259886+0000","last_change":"2024-03-20T13:37:01.259918+0000","last_active":"2024-03-20T13:37:01.259886+0000","last_peered":"2024-03-20T13:37:01.259886+0000","last_clean":"2024-03-20T13:37:01.259886+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:37:01.259886+0000","last_undegraded":"2024-03-20T13:37:01.259886+0000","last_fullsized":"2024-03-20T13:37:01.259886+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.259780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:24.962382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.990118+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:35:30.990118+0000","last_peered":"2024-03-20T13:35:30.990118+0000","last_clean":"2024-03-20T13:35:30.990118+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:35:30.990118+0000","last_undegraded":"2024-03-20T13:35:30.990118+0000","last_fullsized":"2024-03-20T13:35:30.990118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.111615+0000","last_change":"2024-03-20T13:36:55.111639+0000","last_active":"2024-03-20T13:36:55.111615+0000","last_peered":"2024-03-20T13:36:55.111615+0000","last_clean":"2024-03-20T13:36:55.111615+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:36:55.111615+0000","last_undegraded":"2024-03-20T13:36:55.111615+0000","last_fullsized":"2024-03-20T13:36:55.111615+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.111514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:29.756932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.483596+0000","last_change":"2024-03-20T13:36:34.483646+0000","last_active":"2024-03-20T13:36:34.483596+0000","last_peered":"2024-03-20T13:36:34.483596+0000","last_clean":"2024-03-20T13:36:34.483596+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:34.483596+0000","last_undegraded":"2024-03-20T13:36:34.483596+0000","last_fullsized":"2024-03-20T13:36:34.483596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.483533+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:25:29.809601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.258973+0000","last_change":"2024-03-20T13:37:04.258997+0000","last_active":"2024-03-20T13:37:04.258973+0000","last_peered":"2024-03-20T13:37:04.258973+0000","last_clean":"2024-03-20T13:37:04.258973+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:37:04.258973+0000","last_undegraded":"2024-03-20T13:37:04.258973+0000","last_fullsized":"2024-03-20T13:37:04.258973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.258885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:14:48.115373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:35.941502+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:35:35.941502+0000","last_peered":"2024-03-20T13:35:35.941502+0000","last_clean":"2024-03-20T13:35:35.941502+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:35:35.941502+0000","last_undegraded":"2024-03-20T13:35:35.941502+0000","last_fullsized":"2024-03-20T13:35:35.941502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.985719+0000","last_change":"2024-03-20T13:34:51.945209+0000","last_active":"2024-03-20T13:35:30.985719+0000","last_peered":"2024-03-20T13:35:30.985719+0000","last_clean":"2024-03-20T13:35:30.985719+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:35:30.985719+0000","last_undegraded":"2024-03-20T13:35:30.985719+0000","last_fullsized":"2024-03-20T13:35:30.985719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271667+0000","last_change":"2024-03-20T13:34:49.939306+0000","last_active":"2024-03-20T13:36:34.271667+0000","last_peered":"2024-03-20T13:36:34.271667+0000","last_clean":"2024-03-20T13:36:34.271667+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:36:34.271667+0000","last_undegraded":"2024-03-20T13:36:34.271667+0000","last_fullsized":"2024-03-20T13:36:34.271667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.870463+0000","last_change":"2024-03-20T13:36:44.870499+0000","last_active":"2024-03-20T13:36:44.870463+0000","last_peered":"2024-03-20T13:36:44.870463+0000","last_clean":"2024-03-20T13:36:44.870463+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:36:44.870463+0000","last_undegraded":"2024-03-20T13:36:44.870463+0000","last_fullsized":"2024-03-20T13:36:44.870463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:38:54.104546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":80,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.096149+0000","last_change":"2024-03-20T13:36:40.096207+0000","last_active":"2024-03-20T13:36:40.096149+0000","last_peered":"2024-03-20T13:36:40.096149+0000","last_clean":"2024-03-20T13:36:40.096149+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:40.096149+0000","last_undegraded":"2024-03-20T13:36:40.096149+0000","last_fullsized":"2024-03-20T13:36:40.096149+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.096051+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:22.717936+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.230553+0000","last_change":"2024-03-20T13:36:56.230574+0000","last_active":"2024-03-20T13:36:56.230553+0000","last_peered":"2024-03-20T13:36:56.230553+0000","last_clean":"2024-03-20T13:36:56.230553+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:36:56.230553+0000","last_undegraded":"2024-03-20T13:36:56.230553+0000","last_fullsized":"2024-03-20T13:36:56.230553+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.230465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:30.142163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.988441+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:35:30.988441+0000","last_peered":"2024-03-20T13:35:30.988441+0000","last_clean":"2024-03-20T13:35:30.988441+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:35:30.988441+0000","last_undegraded":"2024-03-20T13:35:30.988441+0000","last_fullsized":"2024-03-20T13:35:30.988441+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.219338+0000","last_change":"2024-03-20T13:37:00.219367+0000","last_active":"2024-03-20T13:37:00.219338+0000","last_peered":"2024-03-20T13:37:00.219338+0000","last_clean":"2024-03-20T13:37:00.219338+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:37:00.219338+0000","last_undegraded":"2024-03-20T13:37:00.219338+0000","last_fullsized":"2024-03-20T13:37:00.219338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.219255+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:42.847366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711106+0000","last_change":"2024-03-20T13:34:49.937954+0000","last_active":"2024-03-20T13:36:34.711106+0000","last_peered":"2024-03-20T13:36:34.711106+0000","last_clean":"2024-03-20T13:36:34.711106+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:36:34.711106+0000","last_undegraded":"2024-03-20T13:36:34.711106+0000","last_fullsized":"2024-03-20T13:36:34.711106+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.791969+0000","last_change":"2024-03-20T13:36:41.792027+0000","last_active":"2024-03-20T13:36:41.791969+0000","last_peered":"2024-03-20T13:36:41.791969+0000","last_clean":"2024-03-20T13:36:41.791969+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:36:41.791969+0000","last_undegraded":"2024-03-20T13:36:41.791969+0000","last_fullsized":"2024-03-20T13:36:41.791969+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.791862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:01.217069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.209626+0000","last_change":"2024-03-20T13:36:52.209667+0000","last_active":"2024-03-20T13:36:52.209626+0000","last_peered":"2024-03-20T13:36:52.209626+0000","last_clean":"2024-03-20T13:36:52.209626+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:52.209626+0000","last_undegraded":"2024-03-20T13:36:52.209626+0000","last_fullsized":"2024-03-20T13:36:52.209626+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.209539+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:29.303951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.508574+0000","last_change":"2024-03-20T13:36:39.508600+0000","last_active":"2024-03-20T13:36:39.508574+0000","last_peered":"2024-03-20T13:36:39.508574+0000","last_clean":"2024-03-20T13:36:39.508574+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:36:39.508574+0000","last_undegraded":"2024-03-20T13:36:39.508574+0000","last_fullsized":"2024-03-20T13:36:39.508574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.508482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:31.029035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:35:30.987690+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:35:30.987690+0000","last_peered":"2024-03-20T13:35:30.987690+0000","last_clean":"2024-03-20T13:35:30.987690+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:35:30.987690+0000","last_undegraded":"2024-03-20T13:35:30.987690+0000","last_fullsized":"2024-03-20T13:35:30.987690+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.853870+0000","last_change":"2024-03-20T13:36:53.853870+0000","last_active":"2024-03-20T13:36:53.853870+0000","last_peered":"2024-03-20T13:36:53.853870+0000","last_clean":"2024-03-20T13:36:53.853870+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:36:53.853870+0000","last_undegraded":"2024-03-20T13:36:53.853870+0000","last_fullsized":"2024-03-20T13:36:53.853870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.853690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:52.367889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150666+0000","last_change":"2024-03-20T13:34:49.949098+0000","last_active":"2024-03-20T13:36:35.150666+0000","last_peered":"2024-03-20T13:36:35.150666+0000","last_clean":"2024-03-20T13:36:35.150666+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:36:35.150666+0000","last_undegraded":"2024-03-20T13:36:35.150666+0000","last_fullsized":"2024-03-20T13:36:35.150666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272012+0000","last_change":"2024-03-20T13:34:51.943051+0000","last_active":"2024-03-20T13:36:34.272012+0000","last_peered":"2024-03-20T13:36:34.272012+0000","last_clean":"2024-03-20T13:36:34.272012+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:36:34.272012+0000","last_undegraded":"2024-03-20T13:36:34.272012+0000","last_fullsized":"2024-03-20T13:36:34.272012+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271670+0000","last_change":"2024-03-20T13:34:49.933350+0000","last_active":"2024-03-20T13:36:34.271670+0000","last_peered":"2024-03-20T13:36:34.271670+0000","last_clean":"2024-03-20T13:36:34.271670+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:36:34.271670+0000","last_undegraded":"2024-03-20T13:36:34.271670+0000","last_fullsized":"2024-03-20T13:36:34.271670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593638+0000","last_change":"2024-03-20T13:34:51.945886+0000","last_active":"2024-03-20T13:36:35.593638+0000","last_peered":"2024-03-20T13:36:35.593638+0000","last_clean":"2024-03-20T13:36:35.593638+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:36:35.593638+0000","last_undegraded":"2024-03-20T13:36:35.593638+0000","last_fullsized":"2024-03-20T13:36:35.593638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593248+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:36:35.593248+0000","last_peered":"2024-03-20T13:36:35.593248+0000","last_clean":"2024-03-20T13:36:35.593248+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:36:35.593248+0000","last_undegraded":"2024-03-20T13:36:35.593248+0000","last_fullsized":"2024-03-20T13:36:35.593248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'3","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272004+0000","last_change":"2024-03-20T13:34:51.942923+0000","last_active":"2024-03-20T13:36:34.272004+0000","last_peered":"2024-03-20T13:36:34.272004+0000","last_clean":"2024-03-20T13:36:34.272004+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:36:34.272004+0000","last_undegraded":"2024-03-20T13:36:34.272004+0000","last_fullsized":"2024-03-20T13:36:34.272004+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271701+0000","last_change":"2024-03-20T13:34:49.933497+0000","last_active":"2024-03-20T13:36:34.271701+0000","last_peered":"2024-03-20T13:36:34.271701+0000","last_clean":"2024-03-20T13:36:34.271701+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:36:34.271701+0000","last_undegraded":"2024-03-20T13:36:34.271701+0000","last_fullsized":"2024-03-20T13:36:34.271701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271956+0000","last_change":"2024-03-20T13:34:51.937130+0000","last_active":"2024-03-20T13:36:34.271956+0000","last_peered":"2024-03-20T13:36:34.271956+0000","last_clean":"2024-03-20T13:36:34.271956+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:36:34.271956+0000","last_undegraded":"2024-03-20T13:36:34.271956+0000","last_fullsized":"2024-03-20T13:36:34.271956+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.470748+0000","last_change":"2024-03-20T13:37:10.470774+0000","last_active":"2024-03-20T13:37:10.470748+0000","last_peered":"2024-03-20T13:37:10.470748+0000","last_clean":"2024-03-20T13:37:10.470748+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:37:10.470748+0000","last_undegraded":"2024-03-20T13:37:10.470748+0000","last_fullsized":"2024-03-20T13:37:10.470748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.470658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:47.565070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.807076+0000","last_change":"2024-03-20T13:36:55.807076+0000","last_active":"2024-03-20T13:36:55.807076+0000","last_peered":"2024-03-20T13:36:55.807076+0000","last_clean":"2024-03-20T13:36:55.807076+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:55.807076+0000","last_undegraded":"2024-03-20T13:36:55.807076+0000","last_fullsized":"2024-03-20T13:36:55.807076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.806960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:44.670617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711092+0000","last_change":"2024-03-20T13:34:49.945395+0000","last_active":"2024-03-20T13:36:34.711092+0000","last_peered":"2024-03-20T13:36:34.711092+0000","last_clean":"2024-03-20T13:36:34.711092+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:36:34.711092+0000","last_undegraded":"2024-03-20T13:36:34.711092+0000","last_fullsized":"2024-03-20T13:36:34.711092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271922+0000","last_change":"2024-03-20T13:34:51.947021+0000","last_active":"2024-03-20T13:36:34.271922+0000","last_peered":"2024-03-20T13:36:34.271922+0000","last_clean":"2024-03-20T13:36:34.271922+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:36:34.271922+0000","last_undegraded":"2024-03-20T13:36:34.271922+0000","last_fullsized":"2024-03-20T13:36:34.271922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.150663+0000","last_change":"2024-03-20T13:34:49.946770+0000","last_active":"2024-03-20T13:36:35.150663+0000","last_peered":"2024-03-20T13:36:35.150663+0000","last_clean":"2024-03-20T13:36:35.150663+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:36:35.150663+0000","last_undegraded":"2024-03-20T13:36:35.150663+0000","last_fullsized":"2024-03-20T13:36:35.150663+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.770943+0000","last_change":"2024-03-20T13:37:07.770971+0000","last_active":"2024-03-20T13:37:07.770943+0000","last_peered":"2024-03-20T13:37:07.770943+0000","last_clean":"2024-03-20T13:37:07.770943+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:37:07.770943+0000","last_undegraded":"2024-03-20T13:37:07.770943+0000","last_fullsized":"2024-03-20T13:37:07.770943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.770860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:00.706350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271671+0000","last_change":"2024-03-20T13:34:49.934739+0000","last_active":"2024-03-20T13:36:34.271671+0000","last_peered":"2024-03-20T13:36:34.271671+0000","last_clean":"2024-03-20T13:36:34.271671+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:36:34.271671+0000","last_undegraded":"2024-03-20T13:36:34.271671+0000","last_fullsized":"2024-03-20T13:36:34.271671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":34,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711507+0000","last_change":"2024-03-20T13:34:51.948058+0000","last_active":"2024-03-20T13:36:34.711507+0000","last_peered":"2024-03-20T13:36:34.711507+0000","last_clean":"2024-03-20T13:36:34.711507+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:36:34.711507+0000","last_undegraded":"2024-03-20T13:36:34.711507+0000","last_fullsized":"2024-03-20T13:36:34.711507+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593284+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:36:35.593284+0000","last_peered":"2024-03-20T13:36:35.593284+0000","last_clean":"2024-03-20T13:36:35.593284+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:36:35.593284+0000","last_undegraded":"2024-03-20T13:36:35.593284+0000","last_fullsized":"2024-03-20T13:36:35.593284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.249034+0000","last_change":"2024-03-20T13:37:10.249034+0000","last_active":"2024-03-20T13:37:10.249034+0000","last_peered":"2024-03-20T13:37:10.249034+0000","last_clean":"2024-03-20T13:37:10.249034+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:37:10.249034+0000","last_undegraded":"2024-03-20T13:37:10.249034+0000","last_fullsized":"2024-03-20T13:37:10.249034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.248909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:39.054592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271804+0000","last_change":"2024-03-20T13:34:49.934646+0000","last_active":"2024-03-20T13:36:34.271804+0000","last_peered":"2024-03-20T13:36:34.271804+0000","last_clean":"2024-03-20T13:36:34.271804+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:36:34.271804+0000","last_undegraded":"2024-03-20T13:36:34.271804+0000","last_fullsized":"2024-03-20T13:36:34.271804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.472298+0000","last_change":"2024-03-20T13:37:09.472360+0000","last_active":"2024-03-20T13:37:09.472298+0000","last_peered":"2024-03-20T13:37:09.472298+0000","last_clean":"2024-03-20T13:37:09.472298+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:37:09.472298+0000","last_undegraded":"2024-03-20T13:37:09.472298+0000","last_fullsized":"2024-03-20T13:37:09.472298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.472199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:56.902554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.779854+0000","last_change":"2024-03-20T13:37:09.779881+0000","last_active":"2024-03-20T13:37:09.779854+0000","last_peered":"2024-03-20T13:37:09.779854+0000","last_clean":"2024-03-20T13:37:09.779854+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:37:09.779854+0000","last_undegraded":"2024-03-20T13:37:09.779854+0000","last_fullsized":"2024-03-20T13:37:09.779854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.779734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:12.306761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711536+0000","last_change":"2024-03-20T13:34:51.946963+0000","last_active":"2024-03-20T13:36:34.711536+0000","last_peered":"2024-03-20T13:36:34.711536+0000","last_clean":"2024-03-20T13:36:34.711536+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:36:34.711536+0000","last_undegraded":"2024-03-20T13:36:34.711536+0000","last_fullsized":"2024-03-20T13:36:34.711536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.711129+0000","last_change":"2024-03-20T13:34:49.944556+0000","last_active":"2024-03-20T13:36:34.711129+0000","last_peered":"2024-03-20T13:36:34.711129+0000","last_clean":"2024-03-20T13:36:34.711129+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:36:34.711129+0000","last_undegraded":"2024-03-20T13:36:34.711129+0000","last_fullsized":"2024-03-20T13:36:34.711129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.698955+0000","last_change":"2024-03-20T13:37:03.698955+0000","last_active":"2024-03-20T13:37:03.698955+0000","last_peered":"2024-03-20T13:37:03.698955+0000","last_clean":"2024-03-20T13:37:03.698955+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:37:03.698955+0000","last_undegraded":"2024-03-20T13:37:03.698955+0000","last_fullsized":"2024-03-20T13:37:03.698955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.698845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:41.623595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593377+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:36:35.593377+0000","last_peered":"2024-03-20T13:36:35.593377+0000","last_clean":"2024-03-20T13:36:35.593377+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:36:35.593377+0000","last_undegraded":"2024-03-20T13:36:35.593377+0000","last_fullsized":"2024-03-20T13:36:35.593377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.838638+0000","last_change":"2024-03-20T13:36:57.838638+0000","last_active":"2024-03-20T13:36:57.838638+0000","last_peered":"2024-03-20T13:36:57.838638+0000","last_clean":"2024-03-20T13:36:57.838638+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:57.838638+0000","last_undegraded":"2024-03-20T13:36:57.838638+0000","last_fullsized":"2024-03-20T13:36:57.838638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.838471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:27.325680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593308+0000","last_change":"2024-03-20T13:34:49.962883+0000","last_active":"2024-03-20T13:36:35.593308+0000","last_peered":"2024-03-20T13:36:35.593308+0000","last_clean":"2024-03-20T13:36:35.593308+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:36:35.593308+0000","last_undegraded":"2024-03-20T13:36:35.593308+0000","last_fullsized":"2024-03-20T13:36:35.593308+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.259174+0000","last_change":"2024-03-20T13:37:09.259202+0000","last_active":"2024-03-20T13:37:09.259174+0000","last_peered":"2024-03-20T13:37:09.259174+0000","last_clean":"2024-03-20T13:37:09.259174+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:37:09.259174+0000","last_undegraded":"2024-03-20T13:37:09.259174+0000","last_fullsized":"2024-03-20T13:37:09.259174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.259090+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:24.956485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.241472+0000","last_change":"2024-03-20T13:37:13.241520+0000","last_active":"2024-03-20T13:37:13.241472+0000","last_peered":"2024-03-20T13:37:13.241472+0000","last_clean":"2024-03-20T13:37:13.241472+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:37:13.241472+0000","last_undegraded":"2024-03-20T13:37:13.241472+0000","last_fullsized":"2024-03-20T13:37:13.241472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.241356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:38.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.758880+0000","last_change":"2024-03-20T13:37:12.758905+0000","last_active":"2024-03-20T13:37:12.758880+0000","last_peered":"2024-03-20T13:37:12.758880+0000","last_clean":"2024-03-20T13:37:12.758880+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:37:12.758880+0000","last_undegraded":"2024-03-20T13:37:12.758880+0000","last_fullsized":"2024-03-20T13:37:12.758880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.758780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:41.146374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593286+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:35.593286+0000","last_peered":"2024-03-20T13:36:35.593286+0000","last_clean":"2024-03-20T13:36:35.593286+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:35.593286+0000","last_undegraded":"2024-03-20T13:36:35.593286+0000","last_fullsized":"2024-03-20T13:36:35.593286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593372+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:36:35.593372+0000","last_peered":"2024-03-20T13:36:35.593372+0000","last_clean":"2024-03-20T13:36:35.593372+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:36:35.593372+0000","last_undegraded":"2024-03-20T13:36:35.593372+0000","last_fullsized":"2024-03-20T13:36:35.593372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.431575+0000","last_change":"2024-03-20T13:37:06.431612+0000","last_active":"2024-03-20T13:37:06.431575+0000","last_peered":"2024-03-20T13:37:06.431575+0000","last_clean":"2024-03-20T13:37:06.431575+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:37:06.431575+0000","last_undegraded":"2024-03-20T13:37:06.431575+0000","last_fullsized":"2024-03-20T13:37:06.431575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.431483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:44.278362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.271819+0000","last_change":"2024-03-20T13:34:49.941425+0000","last_active":"2024-03-20T13:36:34.271819+0000","last_peered":"2024-03-20T13:36:34.271819+0000","last_clean":"2024-03-20T13:36:34.271819+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:36:34.271819+0000","last_undegraded":"2024-03-20T13:36:34.271819+0000","last_fullsized":"2024-03-20T13:36:34.271819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.765594+0000","last_change":"2024-03-20T13:37:10.765626+0000","last_active":"2024-03-20T13:37:10.765594+0000","last_peered":"2024-03-20T13:37:10.765594+0000","last_clean":"2024-03-20T13:37:10.765594+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:37:10.765594+0000","last_undegraded":"2024-03-20T13:37:10.765594+0000","last_fullsized":"2024-03-20T13:37:10.765594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.765500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:58.195856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":147,"ondisk_log_size":147,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1417,"ondisk_log_size":1417,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":271,"ondisk_log_size":271,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949672997,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.53500000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.30399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":0.32900000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.37,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.40000000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.27700000000000002}]},{"osd":3,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.42699999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.318,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.36499999999999999}]}]},{"osd":1,"up_from":10,"seq":42949672996,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.44500000000000001,"15min":0.42699999999999999},"min":{"1min":0.317,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.49099999999999999}]},{"osd":2,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.311,"15min":0.31},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.502,"15min":0.502},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.44400000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705698,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:34 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52800000000000002}]},{"osd":1,"last update":"Wed Mar 20 13:36:39 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.312,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.32000000000000001},"min":{"1min":0.20899999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.42999999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28000000000000003}]},{"osd":2,"last update":"Wed Mar 20 13:36:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.31}]}]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.52200000000000002}]},{"osd":2,"last update":"Wed Mar 20 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.41999999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.47399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:37:16.738 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.738 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.739 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.739 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.739 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.739 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.739 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.739 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.740 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.740 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.740 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.740 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.740 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.740 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.741 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.741 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.741 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.741 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.741 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.742 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.742 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.742 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.742 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.742 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.742 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.743 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.743 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.743 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.743 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.743 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.744 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.744 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.744 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.744 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.744 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.744 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.745 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.745 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.745 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.745 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.745 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-20T13:34:33.883766+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=33, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.746 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.746 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.746 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.746 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.746 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.746 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.747 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.747 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.747 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.747 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.747 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.748 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.748 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.748 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.748 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.748 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.749 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.749 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.749 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.749 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.749 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.749 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.750 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.750 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.750 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.750 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.751 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.751 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.751 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.751 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.751 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.752 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.752 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.752 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.752 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.752 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.752 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.753 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.753 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.753 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.753 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.753 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.754 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.754 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.754 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.754 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.754 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.755 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.755 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.755 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.755 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.755 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.755 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.756 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.756 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.756 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.756 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.756 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.756 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.757 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.757 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.757 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.757 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.757 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.757 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.758 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.758 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.758 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.758 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:16.758 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:37:36.759 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:37:36.873 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.870+0000 7fd041a25640 1 Processor -- start 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.870+0000 7fd041a25640 1 -- start start 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd041a25640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd03c096ac0 0x7fd03c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd041a25640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd03c06ecc0 con 0x7fd03c06e110 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd041a25640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd03c067100 con 0x7fd03c096ac0 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd03affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd03c096ac0 0x7fd03c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd03a7fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd03c06e110 0x7fd03c06d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50162/0 (socket says 172.21.15.28:50162) 2024-03-20T13:37:36.874 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd03a7fc640 1 -- 172.21.15.28:0/1881319906 learned_addr learned my addr 172.21.15.28:0/1881319906 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:37:36.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd03affd640 1 -- 172.21.15.28:0/1881319906 >> v1:172.21.15.28:6789/0 conn(0x7fd03c06e110 legacy=0x7fd03c06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:36.875 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.871+0000 7fd03affd640 1 -- 172.21.15.28:0/1881319906 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd03c066b50 con 0x7fd03c096ac0 2024-03-20T13:37:36.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.872+0000 7fd03affd640 1 --2- 172.21.15.28:0/1881319906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c096ac0 0x7fd03c06ce00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd034009720 tx=0x7fd03402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4abb250b5e416fe server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:36.877 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.872+0000 7fd039ffb640 1 -- 172.21.15.28:0/1881319906 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd03402e070 con 0x7fd03c096ac0 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.872+0000 7fd039ffb640 1 -- 172.21.15.28:0/1881319906 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0340316d0 con 0x7fd03c096ac0 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.872+0000 7fd039ffb640 1 -- 172.21.15.28:0/1881319906 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd034031990 con 0x7fd03c096ac0 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 -- 172.21.15.28:0/1881319906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c096ac0 msgr2=0x7fd03c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 --2- 172.21.15.28:0/1881319906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c096ac0 0x7fd03c06ce00 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fd034009720 tx=0x7fd03402b840 comp rx=0 tx=0).stop 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 -- 172.21.15.28:0/1881319906 shutdown_connections 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 --2- 172.21.15.28:0/1881319906 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c096ac0 0x7fd03c06ce00 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:36.878 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 -- 172.21.15.28:0/1881319906 >> 172.21.15.28:0/1881319906 conn(0x7fd03c0974b0 msgr2=0x7fd03c0978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 -- 172.21.15.28:0/1881319906 shutdown_connections 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.873+0000 7fd041a25640 1 -- 172.21.15.28:0/1881319906 wait complete. 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd041a25640 1 Processor -- start 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd041a25640 1 -- start start 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd041a25640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 0x7fd03c0920f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd041a25640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd03c095900 con 0x7fd03c06e110 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd03affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 0x7fd03c0920f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd03affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 0x7fd03c0920f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42530/0 (socket says 172.21.15.28:42530) 2024-03-20T13:37:36.879 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.874+0000 7fd03affd640 1 -- 172.21.15.28:0/598656638 learned_addr learned my addr 172.21.15.28:0/598656638 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd03affd640 1 -- 172.21.15.28:0/598656638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009400 con 0x7fd03c06e110 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd03affd640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 0x7fd03c0920f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd034009840 tx=0x7fd0340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd0340328b0 con 0x7fd03c06e110 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd034032a10 con 0x7fd03c06e110 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd03c094940 con 0x7fd03c06e110 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd034032cf0 con 0x7fd03c06e110 2024-03-20T13:37:36.880 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.875+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd03c095c10 con 0x7fd03c06e110 2024-03-20T13:37:36.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.876+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fd03404d3f0 con 0x7fd03c06e110 2024-03-20T13:37:36.881 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.876+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd03c0627b0 con 0x7fd03c06e110 2024-03-20T13:37:36.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.876+0000 7fd033fff640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fd01c037ef0 0x7fd01c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:36.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.876+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fd03406d3f0 con 0x7fd03c06e110 2024-03-20T13:37:36.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.877+0000 7fd03a7fc640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fd01c037ef0 0x7fd01c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:36.882 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.877+0000 7fd03a7fc640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fd01c037ef0 0x7fd01c03a3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd024007fd0 tx=0x7fd024007ac0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:36.881+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fd0340306b0 con 0x7fd03c06e110 2024-03-20T13:37:37.058 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.056+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd03c09b770 con 0x7fd01c037ef0 2024-03-20T13:37:37.074 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.072+0000 7fd033fff640 1 -- 172.21.15.28:0/598656638 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+672496 (secure 0 0 0) 0x7fd03c09b770 con 0x7fd01c037ef0 2024-03-20T13:37:37.082 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:37:37.088 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.076+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fd01c037ef0 msgr2=0x7fd01c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.076+0000 7fd041a25640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fd01c037ef0 0x7fd01c03a3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd024007fd0 tx=0x7fd024007ac0 comp rx=0 tx=0).stop 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.076+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 msgr2=0x7fd03c0920f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 0x7fd03c0920f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fd034009840 tx=0x7fd0340046c0 comp rx=0 tx=0).stop 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 shutdown_connections 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fd01c037ef0 0x7fd01c03a3b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:37.091 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 --2- 172.21.15.28:0/598656638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd03c06e110 0x7fd03c0920f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:37.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 >> 172.21.15.28:0/598656638 conn(0x7fd03c0974b0 msgr2=0x7fd03c130e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:37.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 shutdown_connections 2024-03-20T13:37:37.092 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:37.077+0000 7fd041a25640 1 -- 172.21.15.28:0/598656638 wait complete. 2024-03-20T13:37:37.092 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":120,"stamp":"2024-03-20T13:37:35.191839+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4002,"num_read_kb":3648,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3965,"ondisk_log_size":3965,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003977"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.273131+0000","last_change":"2024-03-20T13:37:21.273157+0000","last_active":"2024-03-20T13:37:21.273131+0000","last_peered":"2024-03-20T13:37:21.273131+0000","last_clean":"2024-03-20T13:37:21.273131+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:37:21.273131+0000","last_undegraded":"2024-03-20T13:37:21.273131+0000","last_fullsized":"2024-03-20T13:37:21.273131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:21.273041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:21.273041+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.273041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:23.800069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.734610+0000","last_change":"2024-03-20T13:37:00.734610+0000","last_active":"2024-03-20T13:37:00.734610+0000","last_peered":"2024-03-20T13:37:00.734610+0000","last_clean":"2024-03-20T13:37:00.734610+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:37:00.734610+0000","last_undegraded":"2024-03-20T13:37:00.734610+0000","last_fullsized":"2024-03-20T13:37:00.734610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.734488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:43.356373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.547724+0000","last_change":"2024-03-20T13:37:26.547753+0000","last_active":"2024-03-20T13:37:26.547724+0000","last_peered":"2024-03-20T13:37:26.547724+0000","last_clean":"2024-03-20T13:37:26.547724+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:37:26.547724+0000","last_undegraded":"2024-03-20T13:37:26.547724+0000","last_fullsized":"2024-03-20T13:37:26.547724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:26.547630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:26.547630+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.547630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:42.245026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:23.578010+0000","last_change":"2024-03-20T13:35:30.990390+0000","last_active":"2024-03-20T13:36:23.578010+0000","last_peered":"2024-03-20T13:36:23.578010+0000","last_clean":"2024-03-20T13:36:23.578010+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:36:23.578010+0000","last_undegraded":"2024-03-20T13:36:23.578010+0000","last_fullsized":"2024-03-20T13:36:23.578010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:50.918271+0000","last_clean_scrub_stamp":"2024-03-20T13:34:50.918271+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593389+0000","last_change":"2024-03-20T13:34:49.962175+0000","last_active":"2024-03-20T13:36:35.593389+0000","last_peered":"2024-03-20T13:36:35.593389+0000","last_clean":"2024-03-20T13:36:35.593389+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:36:35.593389+0000","last_undegraded":"2024-03-20T13:36:35.593389+0000","last_fullsized":"2024-03-20T13:36:35.593389+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.198759+0000","last_change":"2024-03-20T13:37:13.198759+0000","last_active":"2024-03-20T13:37:13.198759+0000","last_peered":"2024-03-20T13:37:13.198759+0000","last_clean":"2024-03-20T13:37:13.198759+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:37:13.198759+0000","last_undegraded":"2024-03-20T13:37:13.198759+0000","last_fullsized":"2024-03-20T13:37:13.198759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.198622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:38.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.216682+0000","last_change":"2024-03-20T13:37:07.216726+0000","last_active":"2024-03-20T13:37:07.216682+0000","last_peered":"2024-03-20T13:37:07.216682+0000","last_clean":"2024-03-20T13:37:07.216682+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:37:07.216682+0000","last_undegraded":"2024-03-20T13:37:07.216682+0000","last_fullsized":"2024-03-20T13:37:07.216682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.216575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:56.080233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.266532+0000","last_change":"2024-03-20T13:37:31.266558+0000","last_active":"2024-03-20T13:37:31.266532+0000","last_peered":"2024-03-20T13:37:31.266532+0000","last_clean":"2024-03-20T13:37:31.266532+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:37:31.266532+0000","last_undegraded":"2024-03-20T13:37:31.266532+0000","last_fullsized":"2024-03-20T13:37:31.266532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:31.266427+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:31.266427+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.266427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:33:00.988878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.149754+0000","last_change":"2024-03-20T13:37:29.149781+0000","last_active":"2024-03-20T13:37:29.149754+0000","last_peered":"2024-03-20T13:37:29.149754+0000","last_clean":"2024-03-20T13:37:29.149754+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:37:29.149754+0000","last_undegraded":"2024-03-20T13:37:29.149754+0000","last_fullsized":"2024-03-20T13:37:29.149754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:29.149651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:29.149651+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.149651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:32.566590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.711944+0000","last_change":"2024-03-20T13:37:14.711972+0000","last_active":"2024-03-20T13:37:14.711944+0000","last_peered":"2024-03-20T13:37:14.711944+0000","last_clean":"2024-03-20T13:37:14.711944+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:37:14.711944+0000","last_undegraded":"2024-03-20T13:37:14.711944+0000","last_fullsized":"2024-03-20T13:37:14.711944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:14.711857+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:14.711857+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.711857+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:41.121171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.176263+0000","last_change":"2024-03-20T13:37:05.176263+0000","last_active":"2024-03-20T13:37:05.176263+0000","last_peered":"2024-03-20T13:37:05.176263+0000","last_clean":"2024-03-20T13:37:05.176263+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:37:05.176263+0000","last_undegraded":"2024-03-20T13:37:05.176263+0000","last_fullsized":"2024-03-20T13:37:05.176263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.176117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:22:03.690315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.278090+0000","last_change":"2024-03-20T13:37:07.278147+0000","last_active":"2024-03-20T13:37:07.278090+0000","last_peered":"2024-03-20T13:37:07.278090+0000","last_clean":"2024-03-20T13:37:07.278090+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:37:07.278090+0000","last_undegraded":"2024-03-20T13:37:07.278090+0000","last_fullsized":"2024-03-20T13:37:07.278090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.277994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:07.944110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593336+0000","last_change":"2024-03-20T13:34:49.955283+0000","last_active":"2024-03-20T13:36:35.593336+0000","last_peered":"2024-03-20T13:36:35.593336+0000","last_clean":"2024-03-20T13:36:35.593336+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:36:35.593336+0000","last_undegraded":"2024-03-20T13:36:35.593336+0000","last_fullsized":"2024-03-20T13:36:35.593336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.168771+0000","last_change":"2024-03-20T13:36:59.168771+0000","last_active":"2024-03-20T13:36:59.168771+0000","last_peered":"2024-03-20T13:36:59.168771+0000","last_clean":"2024-03-20T13:36:59.168771+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:59.168771+0000","last_undegraded":"2024-03-20T13:36:59.168771+0000","last_fullsized":"2024-03-20T13:36:59.168771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.168659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:29.587352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.461791+0000","last_change":"2024-03-20T13:37:16.461791+0000","last_active":"2024-03-20T13:37:16.461791+0000","last_peered":"2024-03-20T13:37:16.461791+0000","last_clean":"2024-03-20T13:37:16.461791+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:37:16.461791+0000","last_undegraded":"2024-03-20T13:37:16.461791+0000","last_fullsized":"2024-03-20T13:37:16.461791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.461652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.461652+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.461652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:56.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.245850+0000","last_change":"2024-03-20T13:37:24.245894+0000","last_active":"2024-03-20T13:37:24.245850+0000","last_peered":"2024-03-20T13:37:24.245850+0000","last_clean":"2024-03-20T13:37:24.245850+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:37:24.245850+0000","last_undegraded":"2024-03-20T13:37:24.245850+0000","last_fullsized":"2024-03-20T13:37:24.245850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:24.245736+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:24.245736+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.245736+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:52.633330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.256576+0000","last_change":"2024-03-20T13:37:11.256576+0000","last_active":"2024-03-20T13:37:11.256576+0000","last_peered":"2024-03-20T13:37:11.256576+0000","last_clean":"2024-03-20T13:37:11.256576+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:37:11.256576+0000","last_undegraded":"2024-03-20T13:37:11.256576+0000","last_fullsized":"2024-03-20T13:37:11.256576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.256453+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:24.080007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.729110+0000","last_change":"2024-03-20T13:37:26.729154+0000","last_active":"2024-03-20T13:37:26.729110+0000","last_peered":"2024-03-20T13:37:26.729110+0000","last_clean":"2024-03-20T13:37:26.729110+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:37:26.729110+0000","last_undegraded":"2024-03-20T13:37:26.729110+0000","last_fullsized":"2024-03-20T13:37:26.729110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:26.729021+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:26.729021+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.729021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:27.395137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.780265+0000","last_change":"2024-03-20T13:36:59.780265+0000","last_active":"2024-03-20T13:36:59.780265+0000","last_peered":"2024-03-20T13:36:59.780265+0000","last_clean":"2024-03-20T13:36:59.780265+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:59.780265+0000","last_undegraded":"2024-03-20T13:36:59.780265+0000","last_fullsized":"2024-03-20T13:36:59.780265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.780140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:43.003558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.218269+0000","last_change":"2024-03-20T13:37:11.218269+0000","last_active":"2024-03-20T13:37:11.218269+0000","last_peered":"2024-03-20T13:37:11.218269+0000","last_clean":"2024-03-20T13:37:11.218269+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:37:11.218269+0000","last_undegraded":"2024-03-20T13:37:11.218269+0000","last_fullsized":"2024-03-20T13:37:11.218269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.218156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:54.441574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.671523+0000","last_change":"2024-03-20T13:37:18.671551+0000","last_active":"2024-03-20T13:37:18.671523+0000","last_peered":"2024-03-20T13:37:18.671523+0000","last_clean":"2024-03-20T13:37:18.671523+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:37:18.671523+0000","last_undegraded":"2024-03-20T13:37:18.671523+0000","last_fullsized":"2024-03-20T13:37:18.671523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:18.671437+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:18.671437+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.671437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:36.640507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.684833+0000","last_change":"2024-03-20T13:37:17.684875+0000","last_active":"2024-03-20T13:37:17.684833+0000","last_peered":"2024-03-20T13:37:17.684833+0000","last_clean":"2024-03-20T13:37:17.684833+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:37:17.684833+0000","last_undegraded":"2024-03-20T13:37:17.684833+0000","last_fullsized":"2024-03-20T13:37:17.684833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:17.684738+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:17.684738+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.684738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:33.915049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.437229+0000","last_change":"2024-03-20T13:37:15.437229+0000","last_active":"2024-03-20T13:37:15.437229+0000","last_peered":"2024-03-20T13:37:15.437229+0000","last_clean":"2024-03-20T13:37:15.437229+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:37:15.437229+0000","last_undegraded":"2024-03-20T13:37:15.437229+0000","last_fullsized":"2024-03-20T13:37:15.437229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:15.437078+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:15.437078+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.437078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:15.348966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.725707+0000","last_change":"2024-03-20T13:37:11.725707+0000","last_active":"2024-03-20T13:37:11.725707+0000","last_peered":"2024-03-20T13:37:11.725707+0000","last_clean":"2024-03-20T13:37:11.725707+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:37:11.725707+0000","last_undegraded":"2024-03-20T13:37:11.725707+0000","last_fullsized":"2024-03-20T13:37:11.725707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.725594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:22.505463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.174785+0000","last_change":"2024-03-20T13:37:06.174785+0000","last_active":"2024-03-20T13:37:06.174785+0000","last_peered":"2024-03-20T13:37:06.174785+0000","last_clean":"2024-03-20T13:37:06.174785+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:37:06.174785+0000","last_undegraded":"2024-03-20T13:37:06.174785+0000","last_fullsized":"2024-03-20T13:37:06.174785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.174669+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:35.706277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.509348+0000","last_change":"2024-03-20T13:37:20.509376+0000","last_active":"2024-03-20T13:37:20.509348+0000","last_peered":"2024-03-20T13:37:20.509348+0000","last_clean":"2024-03-20T13:37:20.509348+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:37:20.509348+0000","last_undegraded":"2024-03-20T13:37:20.509348+0000","last_fullsized":"2024-03-20T13:37:20.509348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:20.509258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:20.509258+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.509258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:54.696170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.750652+0000","last_change":"2024-03-20T13:37:01.750652+0000","last_active":"2024-03-20T13:37:01.750652+0000","last_peered":"2024-03-20T13:37:01.750652+0000","last_clean":"2024-03-20T13:37:01.750652+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:37:01.750652+0000","last_undegraded":"2024-03-20T13:37:01.750652+0000","last_fullsized":"2024-03-20T13:37:01.750652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.750537+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:27.000513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.227968+0000","last_change":"2024-03-20T13:37:26.227994+0000","last_active":"2024-03-20T13:37:26.227968+0000","last_peered":"2024-03-20T13:37:26.227968+0000","last_clean":"2024-03-20T13:37:26.227968+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:37:26.227968+0000","last_undegraded":"2024-03-20T13:37:26.227968+0000","last_fullsized":"2024-03-20T13:37:26.227968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:26.227867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:26.227867+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.227867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:15.426533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'17","reported_seq":77,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.712092+0000","last_change":"2024-03-20T13:34:59.976541+0000","last_active":"2024-03-20T13:36:34.712092+0000","last_peered":"2024-03-20T13:36:34.712092+0000","last_clean":"2024-03-20T13:36:34.712092+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:36:34.712092+0000","last_undegraded":"2024-03-20T13:36:34.712092+0000","last_fullsized":"2024-03-20T13:36:34.712092+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.312958+0000","last_change":"2024-03-20T13:37:30.312980+0000","last_active":"2024-03-20T13:37:30.312958+0000","last_peered":"2024-03-20T13:37:30.312958+0000","last_clean":"2024-03-20T13:37:30.312958+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:37:30.312958+0000","last_undegraded":"2024-03-20T13:37:30.312958+0000","last_fullsized":"2024-03-20T13:37:30.312958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:30.312873+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:30.312873+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.312873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:48.281943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.194714+0000","last_change":"2024-03-20T13:37:27.194741+0000","last_active":"2024-03-20T13:37:27.194714+0000","last_peered":"2024-03-20T13:37:27.194714+0000","last_clean":"2024-03-20T13:37:27.194714+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:37:27.194714+0000","last_undegraded":"2024-03-20T13:37:27.194714+0000","last_fullsized":"2024-03-20T13:37:27.194714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.194628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.194628+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.194628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:19:59.581273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.127878+0000","last_change":"2024-03-20T13:36:41.127878+0000","last_active":"2024-03-20T13:36:41.127878+0000","last_peered":"2024-03-20T13:36:41.127878+0000","last_clean":"2024-03-20T13:36:41.127878+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:36:41.127878+0000","last_undegraded":"2024-03-20T13:36:41.127878+0000","last_fullsized":"2024-03-20T13:36:41.127878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.127679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:24.954726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.230716+0000","last_change":"2024-03-20T13:37:03.230716+0000","last_active":"2024-03-20T13:37:03.230716+0000","last_peered":"2024-03-20T13:37:03.230716+0000","last_clean":"2024-03-20T13:37:03.230716+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:37:03.230716+0000","last_undegraded":"2024-03-20T13:37:03.230716+0000","last_fullsized":"2024-03-20T13:37:03.230716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.230582+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:19.216621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.930574+0000","last_change":"2024-03-20T13:36:50.930574+0000","last_active":"2024-03-20T13:36:50.930574+0000","last_peered":"2024-03-20T13:36:50.930574+0000","last_clean":"2024-03-20T13:36:50.930574+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:36:50.930574+0000","last_undegraded":"2024-03-20T13:36:50.930574+0000","last_fullsized":"2024-03-20T13:36:50.930574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.930463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:21.352868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.746110+0000","last_change":"2024-03-20T13:37:30.746158+0000","last_active":"2024-03-20T13:37:30.746110+0000","last_peered":"2024-03-20T13:37:30.746110+0000","last_clean":"2024-03-20T13:37:30.746110+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:37:30.746110+0000","last_undegraded":"2024-03-20T13:37:30.746110+0000","last_fullsized":"2024-03-20T13:37:30.746110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:30.746014+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:30.746014+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.746014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:43.569568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.243276+0000","last_change":"2024-03-20T13:37:18.243303+0000","last_active":"2024-03-20T13:37:18.243276+0000","last_peered":"2024-03-20T13:37:18.243276+0000","last_clean":"2024-03-20T13:37:18.243276+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:37:18.243276+0000","last_undegraded":"2024-03-20T13:37:18.243276+0000","last_fullsized":"2024-03-20T13:37:18.243276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:18.243199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:18.243199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.243199+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:48.434148+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.247358+0000","last_change":"2024-03-20T13:37:03.247358+0000","last_active":"2024-03-20T13:37:03.247358+0000","last_peered":"2024-03-20T13:37:03.247358+0000","last_clean":"2024-03-20T13:37:03.247358+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:37:03.247358+0000","last_undegraded":"2024-03-20T13:37:03.247358+0000","last_fullsized":"2024-03-20T13:37:03.247358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.247246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:31.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.442856+0000","last_change":"2024-03-20T13:36:50.442856+0000","last_active":"2024-03-20T13:36:50.442856+0000","last_peered":"2024-03-20T13:36:50.442856+0000","last_clean":"2024-03-20T13:36:50.442856+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:36:50.442856+0000","last_undegraded":"2024-03-20T13:36:50.442856+0000","last_fullsized":"2024-03-20T13:36:50.442856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.442744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:21.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.832911+0000","last_change":"2024-03-20T13:36:36.832911+0000","last_active":"2024-03-20T13:36:36.832911+0000","last_peered":"2024-03-20T13:36:36.832911+0000","last_clean":"2024-03-20T13:36:36.832911+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:36:36.832911+0000","last_undegraded":"2024-03-20T13:36:36.832911+0000","last_fullsized":"2024-03-20T13:36:36.832911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.832759+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:49.042157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.814020+0000","last_change":"2024-03-20T13:36:58.814020+0000","last_active":"2024-03-20T13:36:58.814020+0000","last_peered":"2024-03-20T13:36:58.814020+0000","last_clean":"2024-03-20T13:36:58.814020+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:36:58.814020+0000","last_undegraded":"2024-03-20T13:36:58.814020+0000","last_fullsized":"2024-03-20T13:36:58.814020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.813903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:48.477979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272712+0000","last_change":"2024-03-20T13:34:59.974850+0000","last_active":"2024-03-20T13:36:34.272712+0000","last_peered":"2024-03-20T13:36:34.272712+0000","last_clean":"2024-03-20T13:36:34.272712+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:36:34.272712+0000","last_undegraded":"2024-03-20T13:36:34.272712+0000","last_fullsized":"2024-03-20T13:36:34.272712+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.154069+0000","last_change":"2024-03-20T13:37:21.154094+0000","last_active":"2024-03-20T13:37:21.154069+0000","last_peered":"2024-03-20T13:37:21.154069+0000","last_clean":"2024-03-20T13:37:21.154069+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:37:21.154069+0000","last_undegraded":"2024-03-20T13:37:21.154069+0000","last_fullsized":"2024-03-20T13:37:21.154069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:21.153982+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:21.153982+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.153982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:49:58.336139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.171553+0000","last_change":"2024-03-20T13:37:28.171579+0000","last_active":"2024-03-20T13:37:28.171553+0000","last_peered":"2024-03-20T13:37:28.171553+0000","last_clean":"2024-03-20T13:37:28.171553+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:37:28.171553+0000","last_undegraded":"2024-03-20T13:37:28.171553+0000","last_fullsized":"2024-03-20T13:37:28.171553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.171464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.171464+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.171464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:08:43.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.419261+0000","last_change":"2024-03-20T13:36:51.419261+0000","last_active":"2024-03-20T13:36:51.419261+0000","last_peered":"2024-03-20T13:36:51.419261+0000","last_clean":"2024-03-20T13:36:51.419261+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:36:51.419261+0000","last_undegraded":"2024-03-20T13:36:51.419261+0000","last_fullsized":"2024-03-20T13:36:51.419261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.419143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:49.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.226186+0000","last_change":"2024-03-20T13:36:49.226186+0000","last_active":"2024-03-20T13:36:49.226186+0000","last_peered":"2024-03-20T13:36:49.226186+0000","last_clean":"2024-03-20T13:36:49.226186+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:36:49.226186+0000","last_undegraded":"2024-03-20T13:36:49.226186+0000","last_fullsized":"2024-03-20T13:36:49.226186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.226058+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:05.000426+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.289581+0000","last_change":"2024-03-20T13:37:08.289581+0000","last_active":"2024-03-20T13:37:08.289581+0000","last_peered":"2024-03-20T13:37:08.289581+0000","last_clean":"2024-03-20T13:37:08.289581+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:37:08.289581+0000","last_undegraded":"2024-03-20T13:37:08.289581+0000","last_fullsized":"2024-03-20T13:37:08.289581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.289461+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:24:47.727403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.208783+0000","last_change":"2024-03-20T13:36:46.208783+0000","last_active":"2024-03-20T13:36:46.208783+0000","last_peered":"2024-03-20T13:36:46.208783+0000","last_clean":"2024-03-20T13:36:46.208783+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:36:46.208783+0000","last_undegraded":"2024-03-20T13:36:46.208783+0000","last_fullsized":"2024-03-20T13:36:46.208783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.208641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:45.085668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.498473+0000","last_change":"2024-03-20T13:37:02.498473+0000","last_active":"2024-03-20T13:37:02.498473+0000","last_peered":"2024-03-20T13:37:02.498473+0000","last_clean":"2024-03-20T13:37:02.498473+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:37:02.498473+0000","last_undegraded":"2024-03-20T13:37:02.498473+0000","last_fullsized":"2024-03-20T13:37:02.498473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.498327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:43.010962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.714650+0000","last_change":"2024-03-20T13:37:24.714673+0000","last_active":"2024-03-20T13:37:24.714650+0000","last_peered":"2024-03-20T13:37:24.714650+0000","last_clean":"2024-03-20T13:37:24.714650+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:37:24.714650+0000","last_undegraded":"2024-03-20T13:37:24.714650+0000","last_fullsized":"2024-03-20T13:37:24.714650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:24.714562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:24.714562+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.714562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:10.053361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.164527+0000","last_change":"2024-03-20T13:36:47.164527+0000","last_active":"2024-03-20T13:36:47.164527+0000","last_peered":"2024-03-20T13:36:47.164527+0000","last_clean":"2024-03-20T13:36:47.164527+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:36:47.164527+0000","last_undegraded":"2024-03-20T13:36:47.164527+0000","last_fullsized":"2024-03-20T13:36:47.164527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.164416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:15.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.124403+0000","last_change":"2024-03-20T13:36:44.124403+0000","last_active":"2024-03-20T13:36:44.124403+0000","last_peered":"2024-03-20T13:36:44.124403+0000","last_clean":"2024-03-20T13:36:44.124403+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:44.124403+0000","last_undegraded":"2024-03-20T13:36:44.124403+0000","last_fullsized":"2024-03-20T13:36:44.124403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.124221+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:07.675114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.427157+0000","last_change":"2024-03-20T13:36:49.427157+0000","last_active":"2024-03-20T13:36:49.427157+0000","last_peered":"2024-03-20T13:36:49.427157+0000","last_clean":"2024-03-20T13:36:49.427157+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:49.427157+0000","last_undegraded":"2024-03-20T13:36:49.427157+0000","last_fullsized":"2024-03-20T13:36:49.427157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.427037+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:05:56.566896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.240751+0000","last_change":"2024-03-20T13:37:06.240821+0000","last_active":"2024-03-20T13:37:06.240751+0000","last_peered":"2024-03-20T13:37:06.240751+0000","last_clean":"2024-03-20T13:37:06.240751+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:37:06.240751+0000","last_undegraded":"2024-03-20T13:37:06.240751+0000","last_fullsized":"2024-03-20T13:37:06.240751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.240654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:12.903523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.251632+0000","last_change":"2024-03-20T13:37:20.251666+0000","last_active":"2024-03-20T13:37:20.251632+0000","last_peered":"2024-03-20T13:37:20.251632+0000","last_clean":"2024-03-20T13:37:20.251632+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:37:20.251632+0000","last_undegraded":"2024-03-20T13:37:20.251632+0000","last_fullsized":"2024-03-20T13:37:20.251632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:20.251541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:20.251541+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.251541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:53.391499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.819999+0000","last_change":"2024-03-20T13:36:43.819999+0000","last_active":"2024-03-20T13:36:43.819999+0000","last_peered":"2024-03-20T13:36:43.819999+0000","last_clean":"2024-03-20T13:36:43.819999+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:36:43.819999+0000","last_undegraded":"2024-03-20T13:36:43.819999+0000","last_fullsized":"2024-03-20T13:36:43.819999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.819876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:18.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.190487+0000","last_change":"2024-03-20T13:36:48.190487+0000","last_active":"2024-03-20T13:36:48.190487+0000","last_peered":"2024-03-20T13:36:48.190487+0000","last_clean":"2024-03-20T13:36:48.190487+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:48.190487+0000","last_undegraded":"2024-03-20T13:36:48.190487+0000","last_fullsized":"2024-03-20T13:36:48.190487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.190343+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:33:34.104031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.451320+0000","last_change":"2024-03-20T13:36:41.451320+0000","last_active":"2024-03-20T13:36:41.451320+0000","last_peered":"2024-03-20T13:36:41.451320+0000","last_clean":"2024-03-20T13:36:41.451320+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:36:41.451320+0000","last_undegraded":"2024-03-20T13:36:41.451320+0000","last_fullsized":"2024-03-20T13:36:41.451320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.451207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:01.674365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.271317+0000","last_change":"2024-03-20T13:37:25.271359+0000","last_active":"2024-03-20T13:37:25.271317+0000","last_peered":"2024-03-20T13:37:25.271317+0000","last_clean":"2024-03-20T13:37:25.271317+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:37:25.271317+0000","last_undegraded":"2024-03-20T13:37:25.271317+0000","last_fullsized":"2024-03-20T13:37:25.271317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:37:25.271197+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:37:25.271197+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.271197+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:55.667460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.706447+0000","last_change":"2024-03-20T13:37:04.706474+0000","last_active":"2024-03-20T13:37:04.706447+0000","last_peered":"2024-03-20T13:37:04.706447+0000","last_clean":"2024-03-20T13:37:04.706447+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:37:04.706447+0000","last_undegraded":"2024-03-20T13:37:04.706447+0000","last_fullsized":"2024-03-20T13:37:04.706447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.706331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:10.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.258412+0000","last_change":"2024-03-20T13:37:19.258440+0000","last_active":"2024-03-20T13:37:19.258412+0000","last_peered":"2024-03-20T13:37:19.258412+0000","last_clean":"2024-03-20T13:37:19.258412+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:37:19.258412+0000","last_undegraded":"2024-03-20T13:37:19.258412+0000","last_fullsized":"2024-03-20T13:37:19.258412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:19.258326+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:19.258326+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.258326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:12.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.409281+0000","last_change":"2024-03-20T13:36:52.409281+0000","last_active":"2024-03-20T13:36:52.409281+0000","last_peered":"2024-03-20T13:36:52.409281+0000","last_clean":"2024-03-20T13:36:52.409281+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:36:52.409281+0000","last_undegraded":"2024-03-20T13:36:52.409281+0000","last_fullsized":"2024-03-20T13:36:52.409281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.409171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:56:42.443923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.099051+0000","last_change":"2024-03-20T13:36:44.099051+0000","last_active":"2024-03-20T13:36:44.099051+0000","last_peered":"2024-03-20T13:36:44.099051+0000","last_clean":"2024-03-20T13:36:44.099051+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:44.099051+0000","last_undegraded":"2024-03-20T13:36:44.099051+0000","last_fullsized":"2024-03-20T13:36:44.099051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.098880+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:38.576272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.461685+0000","last_change":"2024-03-20T13:36:35.461685+0000","last_active":"2024-03-20T13:36:35.461685+0000","last_peered":"2024-03-20T13:36:35.461685+0000","last_clean":"2024-03-20T13:36:35.461685+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:36:35.461685+0000","last_undegraded":"2024-03-20T13:36:35.461685+0000","last_fullsized":"2024-03-20T13:36:35.461685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.461582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:53.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.780610+0000","last_change":"2024-03-20T13:37:31.780639+0000","last_active":"2024-03-20T13:37:31.780610+0000","last_peered":"2024-03-20T13:37:31.780610+0000","last_clean":"2024-03-20T13:37:31.780610+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:37:31.780610+0000","last_undegraded":"2024-03-20T13:37:31.780610+0000","last_fullsized":"2024-03-20T13:37:31.780610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:31.780528+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:31.780528+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.780528+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:40:02.573152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.238190+0000","last_change":"2024-03-20T13:37:08.238221+0000","last_active":"2024-03-20T13:37:08.238190+0000","last_peered":"2024-03-20T13:37:08.238190+0000","last_clean":"2024-03-20T13:37:08.238190+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:37:08.238190+0000","last_undegraded":"2024-03-20T13:37:08.238190+0000","last_fullsized":"2024-03-20T13:37:08.238190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.238084+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:21.795359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593112+0000","last_change":"2024-03-20T13:34:49.957001+0000","last_active":"2024-03-20T13:36:35.593112+0000","last_peered":"2024-03-20T13:36:35.593112+0000","last_clean":"2024-03-20T13:36:35.593112+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:36:35.593112+0000","last_undegraded":"2024-03-20T13:36:35.593112+0000","last_fullsized":"2024-03-20T13:36:35.593112+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.423979+0000","last_change":"2024-03-20T13:37:00.423979+0000","last_active":"2024-03-20T13:37:00.423979+0000","last_peered":"2024-03-20T13:37:00.423979+0000","last_clean":"2024-03-20T13:37:00.423979+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:37:00.423979+0000","last_undegraded":"2024-03-20T13:37:00.423979+0000","last_fullsized":"2024-03-20T13:37:00.423979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.423821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:07.953451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.195079+0000","last_change":"2024-03-20T13:36:48.195079+0000","last_active":"2024-03-20T13:36:48.195079+0000","last_peered":"2024-03-20T13:36:48.195079+0000","last_clean":"2024-03-20T13:36:48.195079+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:48.195079+0000","last_undegraded":"2024-03-20T13:36:48.195079+0000","last_fullsized":"2024-03-20T13:36:48.195079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.194921+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:26.041799+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.482065+0000","last_change":"2024-03-20T13:36:57.482065+0000","last_active":"2024-03-20T13:36:57.482065+0000","last_peered":"2024-03-20T13:36:57.482065+0000","last_clean":"2024-03-20T13:36:57.482065+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:57.482065+0000","last_undegraded":"2024-03-20T13:36:57.482065+0000","last_fullsized":"2024-03-20T13:36:57.482065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.481947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:40.705365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272674+0000","last_change":"2024-03-20T13:34:59.976052+0000","last_active":"2024-03-20T13:36:34.272674+0000","last_peered":"2024-03-20T13:36:34.272674+0000","last_clean":"2024-03-20T13:36:34.272674+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:36:34.272674+0000","last_undegraded":"2024-03-20T13:36:34.272674+0000","last_fullsized":"2024-03-20T13:36:34.272674+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.208881+0000","last_change":"2024-03-20T13:37:04.208881+0000","last_active":"2024-03-20T13:37:04.208881+0000","last_peered":"2024-03-20T13:37:04.208881+0000","last_clean":"2024-03-20T13:37:04.208881+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:37:04.208881+0000","last_undegraded":"2024-03-20T13:37:04.208881+0000","last_fullsized":"2024-03-20T13:37:04.208881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.208708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:35.661985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.180303+0000","last_change":"2024-03-20T13:37:25.180355+0000","last_active":"2024-03-20T13:37:25.180303+0000","last_peered":"2024-03-20T13:37:25.180303+0000","last_clean":"2024-03-20T13:37:25.180303+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:37:25.180303+0000","last_undegraded":"2024-03-20T13:37:25.180303+0000","last_fullsized":"2024-03-20T13:37:25.180303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:25.180191+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:25.180191+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.180191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:05:43.586233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.462228+0000","last_change":"2024-03-20T13:36:54.462228+0000","last_active":"2024-03-20T13:36:54.462228+0000","last_peered":"2024-03-20T13:36:54.462228+0000","last_clean":"2024-03-20T13:36:54.462228+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:36:54.462228+0000","last_undegraded":"2024-03-20T13:36:54.462228+0000","last_fullsized":"2024-03-20T13:36:54.462228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.462112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:08.019387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.148045+0000","last_change":"2024-03-20T13:36:36.148045+0000","last_active":"2024-03-20T13:36:36.148045+0000","last_peered":"2024-03-20T13:36:36.148045+0000","last_clean":"2024-03-20T13:36:36.148045+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:36.148045+0000","last_undegraded":"2024-03-20T13:36:36.148045+0000","last_fullsized":"2024-03-20T13:36:36.148045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.147906+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:41:00.828075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.497904+0000","last_change":"2024-03-20T13:36:38.497904+0000","last_active":"2024-03-20T13:36:38.497904+0000","last_peered":"2024-03-20T13:36:38.497904+0000","last_clean":"2024-03-20T13:36:38.497904+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:36:38.497904+0000","last_undegraded":"2024-03-20T13:36:38.497904+0000","last_fullsized":"2024-03-20T13:36:38.497904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.497774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:57.922980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.478488+0000","last_change":"2024-03-20T13:37:05.478488+0000","last_active":"2024-03-20T13:37:05.478488+0000","last_peered":"2024-03-20T13:37:05.478488+0000","last_clean":"2024-03-20T13:37:05.478488+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:37:05.478488+0000","last_undegraded":"2024-03-20T13:37:05.478488+0000","last_fullsized":"2024-03-20T13:37:05.478488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.478357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:33.942722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.735341+0000","last_change":"2024-03-20T13:37:06.735341+0000","last_active":"2024-03-20T13:37:06.735341+0000","last_peered":"2024-03-20T13:37:06.735341+0000","last_clean":"2024-03-20T13:37:06.735341+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:37:06.735341+0000","last_undegraded":"2024-03-20T13:37:06.735341+0000","last_fullsized":"2024-03-20T13:37:06.735341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.735167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:30.139049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.574580+0000","last_change":"2024-03-20T13:37:28.574608+0000","last_active":"2024-03-20T13:37:28.574580+0000","last_peered":"2024-03-20T13:37:28.574580+0000","last_clean":"2024-03-20T13:37:28.574580+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:37:28.574580+0000","last_undegraded":"2024-03-20T13:37:28.574580+0000","last_fullsized":"2024-03-20T13:37:28.574580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:28.574489+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:28.574489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.574489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:41.398042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.170733+0000","last_change":"2024-03-20T13:36:53.170733+0000","last_active":"2024-03-20T13:36:53.170733+0000","last_peered":"2024-03-20T13:36:53.170733+0000","last_clean":"2024-03-20T13:36:53.170733+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:53.170733+0000","last_undegraded":"2024-03-20T13:36:53.170733+0000","last_fullsized":"2024-03-20T13:36:53.170733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.170592+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:12.595798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.786164+0000","last_change":"2024-03-20T13:36:39.786164+0000","last_active":"2024-03-20T13:36:39.786164+0000","last_peered":"2024-03-20T13:36:39.786164+0000","last_clean":"2024-03-20T13:36:39.786164+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:39.786164+0000","last_undegraded":"2024-03-20T13:36:39.786164+0000","last_fullsized":"2024-03-20T13:36:39.786164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.786041+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:59.978158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.192708+0000","last_change":"2024-03-20T13:36:55.192708+0000","last_active":"2024-03-20T13:36:55.192708+0000","last_peered":"2024-03-20T13:36:55.192708+0000","last_clean":"2024-03-20T13:36:55.192708+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:36:55.192708+0000","last_undegraded":"2024-03-20T13:36:55.192708+0000","last_fullsized":"2024-03-20T13:36:55.192708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.192599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:09.415889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.217757+0000","last_change":"2024-03-20T13:37:24.217819+0000","last_active":"2024-03-20T13:37:24.217757+0000","last_peered":"2024-03-20T13:37:24.217757+0000","last_clean":"2024-03-20T13:37:24.217757+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:37:24.217757+0000","last_undegraded":"2024-03-20T13:37:24.217757+0000","last_fullsized":"2024-03-20T13:37:24.217757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:37:24.217670+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:37:24.217670+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.217670+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:37.258253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.267470+0000","last_change":"2024-03-20T13:37:26.267495+0000","last_active":"2024-03-20T13:37:26.267470+0000","last_peered":"2024-03-20T13:37:26.267470+0000","last_clean":"2024-03-20T13:37:26.267470+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:37:26.267470+0000","last_undegraded":"2024-03-20T13:37:26.267470+0000","last_fullsized":"2024-03-20T13:37:26.267470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:26.267387+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:26.267387+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.267387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:52.676700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.134100+0000","last_change":"2024-03-20T13:37:31.134127+0000","last_active":"2024-03-20T13:37:31.134100+0000","last_peered":"2024-03-20T13:37:31.134100+0000","last_clean":"2024-03-20T13:37:31.134100+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:37:31.134100+0000","last_undegraded":"2024-03-20T13:37:31.134100+0000","last_fullsized":"2024-03-20T13:37:31.134100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:31.134014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:31.134014+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.134014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:55.956000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.492572+0000","last_change":"2024-03-20T13:36:55.492572+0000","last_active":"2024-03-20T13:36:55.492572+0000","last_peered":"2024-03-20T13:36:55.492572+0000","last_clean":"2024-03-20T13:36:55.492572+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:36:55.492572+0000","last_undegraded":"2024-03-20T13:36:55.492572+0000","last_fullsized":"2024-03-20T13:36:55.492572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.492425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:40.395733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.189274+0000","last_change":"2024-03-20T13:36:52.189274+0000","last_active":"2024-03-20T13:36:52.189274+0000","last_peered":"2024-03-20T13:36:52.189274+0000","last_clean":"2024-03-20T13:36:52.189274+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:52.189274+0000","last_undegraded":"2024-03-20T13:36:52.189274+0000","last_fullsized":"2024-03-20T13:36:52.189274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.189115+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:34:06.835908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.043936+0000","last_change":"2024-03-20T13:36:36.043936+0000","last_active":"2024-03-20T13:36:36.043936+0000","last_peered":"2024-03-20T13:36:36.043936+0000","last_clean":"2024-03-20T13:36:36.043936+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:36.043936+0000","last_undegraded":"2024-03-20T13:36:36.043936+0000","last_fullsized":"2024-03-20T13:36:36.043936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.043753+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:45.456154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272666+0000","last_change":"2024-03-20T13:34:59.974514+0000","last_active":"2024-03-20T13:36:34.272666+0000","last_peered":"2024-03-20T13:36:34.272666+0000","last_clean":"2024-03-20T13:36:34.272666+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:36:34.272666+0000","last_undegraded":"2024-03-20T13:36:34.272666+0000","last_fullsized":"2024-03-20T13:36:34.272666+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.215988+0000","last_change":"2024-03-20T13:37:10.216028+0000","last_active":"2024-03-20T13:37:10.215988+0000","last_peered":"2024-03-20T13:37:10.215988+0000","last_clean":"2024-03-20T13:37:10.215988+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:37:10.215988+0000","last_undegraded":"2024-03-20T13:37:10.215988+0000","last_fullsized":"2024-03-20T13:37:10.215988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.215883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.879959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593055+0000","last_change":"2024-03-20T13:34:49.961370+0000","last_active":"2024-03-20T13:36:35.593055+0000","last_peered":"2024-03-20T13:36:35.593055+0000","last_clean":"2024-03-20T13:36:35.593055+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:36:35.593055+0000","last_undegraded":"2024-03-20T13:36:35.593055+0000","last_fullsized":"2024-03-20T13:36:35.593055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'4","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.891230+0000","last_change":"2024-03-20T13:36:47.891230+0000","last_active":"2024-03-20T13:36:47.891230+0000","last_peered":"2024-03-20T13:36:47.891230+0000","last_clean":"2024-03-20T13:36:47.891230+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:47.891230+0000","last_undegraded":"2024-03-20T13:36:47.891230+0000","last_fullsized":"2024-03-20T13:36:47.891230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.891061+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:18.309754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.146186+0000","last_change":"2024-03-20T13:36:38.146186+0000","last_active":"2024-03-20T13:36:38.146186+0000","last_peered":"2024-03-20T13:36:38.146186+0000","last_clean":"2024-03-20T13:36:38.146186+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:36:38.146186+0000","last_undegraded":"2024-03-20T13:36:38.146186+0000","last_fullsized":"2024-03-20T13:36:38.146186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.146066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:09.028952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.789972+0000","last_change":"2024-03-20T13:36:38.789972+0000","last_active":"2024-03-20T13:36:38.789972+0000","last_peered":"2024-03-20T13:36:38.789972+0000","last_clean":"2024-03-20T13:36:38.789972+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:38.789972+0000","last_undegraded":"2024-03-20T13:36:38.789972+0000","last_fullsized":"2024-03-20T13:36:38.789972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.789823+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:57.247566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.194544+0000","last_change":"2024-03-20T13:36:58.194544+0000","last_active":"2024-03-20T13:36:58.194544+0000","last_peered":"2024-03-20T13:36:58.194544+0000","last_clean":"2024-03-20T13:36:58.194544+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:36:58.194544+0000","last_undegraded":"2024-03-20T13:36:58.194544+0000","last_fullsized":"2024-03-20T13:36:58.194544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.194424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:10.534956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.880699+0000","last_change":"2024-03-20T13:36:52.880699+0000","last_active":"2024-03-20T13:36:52.880699+0000","last_peered":"2024-03-20T13:36:52.880699+0000","last_clean":"2024-03-20T13:36:52.880699+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:52.880699+0000","last_undegraded":"2024-03-20T13:36:52.880699+0000","last_fullsized":"2024-03-20T13:36:52.880699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.880575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:24.333852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593044+0000","last_change":"2024-03-20T13:34:49.956636+0000","last_active":"2024-03-20T13:36:35.593044+0000","last_peered":"2024-03-20T13:36:35.593044+0000","last_clean":"2024-03-20T13:36:35.593044+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:36:35.593044+0000","last_undegraded":"2024-03-20T13:36:35.593044+0000","last_fullsized":"2024-03-20T13:36:35.593044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.116987+0000","last_change":"2024-03-20T13:36:39.116987+0000","last_active":"2024-03-20T13:36:39.116987+0000","last_peered":"2024-03-20T13:36:39.116987+0000","last_clean":"2024-03-20T13:36:39.116987+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:36:39.116987+0000","last_undegraded":"2024-03-20T13:36:39.116987+0000","last_fullsized":"2024-03-20T13:36:39.116987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.116826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:14:51.320018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.797716+0000","last_change":"2024-03-20T13:36:37.797716+0000","last_active":"2024-03-20T13:36:37.797716+0000","last_peered":"2024-03-20T13:36:37.797716+0000","last_clean":"2024-03-20T13:36:37.797716+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:37.797716+0000","last_undegraded":"2024-03-20T13:36:37.797716+0000","last_fullsized":"2024-03-20T13:36:37.797716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.797588+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:30:53.571956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.074189+0000","last_change":"2024-03-20T13:36:39.074189+0000","last_active":"2024-03-20T13:36:39.074189+0000","last_peered":"2024-03-20T13:36:39.074189+0000","last_clean":"2024-03-20T13:36:39.074189+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:36:39.074189+0000","last_undegraded":"2024-03-20T13:36:39.074189+0000","last_fullsized":"2024-03-20T13:36:39.074189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.074084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:36.877815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.759650+0000","last_change":"2024-03-20T13:37:29.759699+0000","last_active":"2024-03-20T13:37:29.759650+0000","last_peered":"2024-03-20T13:37:29.759650+0000","last_clean":"2024-03-20T13:37:29.759650+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:37:29.759650+0000","last_undegraded":"2024-03-20T13:37:29.759650+0000","last_fullsized":"2024-03-20T13:37:29.759650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:29.759542+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:29.759542+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.759542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:58.565225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.201510+0000","last_change":"2024-03-20T13:36:53.201510+0000","last_active":"2024-03-20T13:36:53.201510+0000","last_peered":"2024-03-20T13:36:53.201510+0000","last_clean":"2024-03-20T13:36:53.201510+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:36:53.201510+0000","last_undegraded":"2024-03-20T13:36:53.201510+0000","last_fullsized":"2024-03-20T13:36:53.201510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.201374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:47.204640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.638719+0000","last_change":"2024-03-20T13:37:20.638758+0000","last_active":"2024-03-20T13:37:20.638719+0000","last_peered":"2024-03-20T13:37:20.638719+0000","last_clean":"2024-03-20T13:37:20.638719+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:37:20.638719+0000","last_undegraded":"2024-03-20T13:37:20.638719+0000","last_fullsized":"2024-03-20T13:37:20.638719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-03-20T13:37:20.638623+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-03-20T13:37:20.638623+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.638623+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:38.173181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592927+0000","last_change":"2024-03-20T13:34:41.903052+0000","last_active":"2024-03-20T13:36:35.592927+0000","last_peered":"2024-03-20T13:36:35.592927+0000","last_clean":"2024-03-20T13:36:35.592927+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:36:35.592927+0000","last_undegraded":"2024-03-20T13:36:35.592927+0000","last_fullsized":"2024-03-20T13:36:35.592927+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.185264+0000","last_change":"2024-03-20T13:37:22.185291+0000","last_active":"2024-03-20T13:37:22.185264+0000","last_peered":"2024-03-20T13:37:22.185264+0000","last_clean":"2024-03-20T13:37:22.185264+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:37:22.185264+0000","last_undegraded":"2024-03-20T13:37:22.185264+0000","last_fullsized":"2024-03-20T13:37:22.185264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.185170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.185170+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.185170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:52:26.780533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.953552+0000","last_change":"2024-03-20T13:36:49.953552+0000","last_active":"2024-03-20T13:36:49.953552+0000","last_peered":"2024-03-20T13:36:49.953552+0000","last_clean":"2024-03-20T13:36:49.953552+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:36:49.953552+0000","last_undegraded":"2024-03-20T13:36:49.953552+0000","last_fullsized":"2024-03-20T13:36:49.953552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.953431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:13.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.123405+0000","last_change":"2024-03-20T13:36:46.123405+0000","last_active":"2024-03-20T13:36:46.123405+0000","last_peered":"2024-03-20T13:36:46.123405+0000","last_clean":"2024-03-20T13:36:46.123405+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:46.123405+0000","last_undegraded":"2024-03-20T13:36:46.123405+0000","last_fullsized":"2024-03-20T13:36:46.123405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.123283+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:09.527164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.454190+0000","last_change":"2024-03-20T13:36:42.454190+0000","last_active":"2024-03-20T13:36:42.454190+0000","last_peered":"2024-03-20T13:36:42.454190+0000","last_clean":"2024-03-20T13:36:42.454190+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:36:42.454190+0000","last_undegraded":"2024-03-20T13:36:42.454190+0000","last_fullsized":"2024-03-20T13:36:42.454190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.454069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:47.214837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.145557+0000","last_change":"2024-03-20T13:36:54.145557+0000","last_active":"2024-03-20T13:36:54.145557+0000","last_peered":"2024-03-20T13:36:54.145557+0000","last_clean":"2024-03-20T13:36:54.145557+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:54.145557+0000","last_undegraded":"2024-03-20T13:36:54.145557+0000","last_fullsized":"2024-03-20T13:36:54.145557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.145443+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:45.665997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.225779+0000","last_change":"2024-03-20T13:37:19.225803+0000","last_active":"2024-03-20T13:37:19.225779+0000","last_peered":"2024-03-20T13:37:19.225779+0000","last_clean":"2024-03-20T13:37:19.225779+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:37:19.225779+0000","last_undegraded":"2024-03-20T13:37:19.225779+0000","last_fullsized":"2024-03-20T13:37:19.225779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.225641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.225641+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.225641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:50.649161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592926+0000","last_change":"2024-03-20T13:34:41.904090+0000","last_active":"2024-03-20T13:36:35.592926+0000","last_peered":"2024-03-20T13:36:35.592926+0000","last_clean":"2024-03-20T13:36:35.592926+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:36:35.592926+0000","last_undegraded":"2024-03-20T13:36:35.592926+0000","last_fullsized":"2024-03-20T13:36:35.592926+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.440517+0000","last_change":"2024-03-20T13:37:12.440569+0000","last_active":"2024-03-20T13:37:12.440517+0000","last_peered":"2024-03-20T13:37:12.440517+0000","last_clean":"2024-03-20T13:37:12.440517+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:37:12.440517+0000","last_undegraded":"2024-03-20T13:37:12.440517+0000","last_fullsized":"2024-03-20T13:37:12.440517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.440412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:23.449890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.083092+0000","last_change":"2024-03-20T13:36:43.083092+0000","last_active":"2024-03-20T13:36:43.083092+0000","last_peered":"2024-03-20T13:36:43.083092+0000","last_clean":"2024-03-20T13:36:43.083092+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:36:43.083092+0000","last_undegraded":"2024-03-20T13:36:43.083092+0000","last_fullsized":"2024-03-20T13:36:43.083092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.082968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:27:06.735401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.848464+0000","last_change":"2024-03-20T13:36:35.848464+0000","last_active":"2024-03-20T13:36:35.848464+0000","last_peered":"2024-03-20T13:36:35.848464+0000","last_clean":"2024-03-20T13:36:35.848464+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:35.848464+0000","last_undegraded":"2024-03-20T13:36:35.848464+0000","last_fullsized":"2024-03-20T13:36:35.848464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.848325+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:59:23.551034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.158892+0000","last_change":"2024-03-20T13:36:54.158892+0000","last_active":"2024-03-20T13:36:54.158892+0000","last_peered":"2024-03-20T13:36:54.158892+0000","last_clean":"2024-03-20T13:36:54.158892+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:36:54.158892+0000","last_undegraded":"2024-03-20T13:36:54.158892+0000","last_fullsized":"2024-03-20T13:36:54.158892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.158747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:05.168226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.712060+0000","last_change":"2024-03-20T13:34:59.974640+0000","last_active":"2024-03-20T13:36:34.712060+0000","last_peered":"2024-03-20T13:36:34.712060+0000","last_clean":"2024-03-20T13:36:34.712060+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:36:34.712060+0000","last_undegraded":"2024-03-20T13:36:34.712060+0000","last_fullsized":"2024-03-20T13:36:34.712060+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.542586+0000","last_change":"2024-03-20T13:37:03.542621+0000","last_active":"2024-03-20T13:37:03.542586+0000","last_peered":"2024-03-20T13:37:03.542586+0000","last_clean":"2024-03-20T13:37:03.542586+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:37:03.542586+0000","last_undegraded":"2024-03-20T13:37:03.542586+0000","last_fullsized":"2024-03-20T13:37:03.542586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.542501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:05.159751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.239165+0000","last_change":"2024-03-20T13:37:16.239193+0000","last_active":"2024-03-20T13:37:16.239165+0000","last_peered":"2024-03-20T13:37:16.239165+0000","last_clean":"2024-03-20T13:37:16.239165+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:37:16.239165+0000","last_undegraded":"2024-03-20T13:37:16.239165+0000","last_fullsized":"2024-03-20T13:37:16.239165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.239082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.239082+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.239082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:22.371725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.535422+0000","last_change":"2024-03-20T13:37:29.535448+0000","last_active":"2024-03-20T13:37:29.535422+0000","last_peered":"2024-03-20T13:37:29.535422+0000","last_clean":"2024-03-20T13:37:29.535422+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:37:29.535422+0000","last_undegraded":"2024-03-20T13:37:29.535422+0000","last_fullsized":"2024-03-20T13:37:29.535422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:29.535328+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:29.535328+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.535328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:40:00.327953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.148343+0000","last_change":"2024-03-20T13:36:57.148343+0000","last_active":"2024-03-20T13:36:57.148343+0000","last_peered":"2024-03-20T13:36:57.148343+0000","last_clean":"2024-03-20T13:36:57.148343+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:36:57.148343+0000","last_undegraded":"2024-03-20T13:36:57.148343+0000","last_fullsized":"2024-03-20T13:36:57.148343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.148192+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:29.933263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.215018+0000","last_change":"2024-03-20T13:36:47.215018+0000","last_active":"2024-03-20T13:36:47.215018+0000","last_peered":"2024-03-20T13:36:47.215018+0000","last_clean":"2024-03-20T13:36:47.215018+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:47.215018+0000","last_undegraded":"2024-03-20T13:36:47.215018+0000","last_fullsized":"2024-03-20T13:36:47.215018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.214888+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:24.057007+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.483718+0000","last_change":"2024-03-20T13:36:40.483718+0000","last_active":"2024-03-20T13:36:40.483718+0000","last_peered":"2024-03-20T13:36:40.483718+0000","last_clean":"2024-03-20T13:36:40.483718+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:36:40.483718+0000","last_undegraded":"2024-03-20T13:36:40.483718+0000","last_fullsized":"2024-03-20T13:36:40.483718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.483604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:15.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.236869+0000","last_change":"2024-03-20T13:37:16.236869+0000","last_active":"2024-03-20T13:37:16.236869+0000","last_peered":"2024-03-20T13:37:16.236869+0000","last_clean":"2024-03-20T13:37:16.236869+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:37:16.236869+0000","last_undegraded":"2024-03-20T13:37:16.236869+0000","last_fullsized":"2024-03-20T13:37:16.236869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.236742+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:03.762906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.482307+0000","last_change":"2024-03-20T13:37:11.482376+0000","last_active":"2024-03-20T13:37:11.482307+0000","last_peered":"2024-03-20T13:37:11.482307+0000","last_clean":"2024-03-20T13:37:11.482307+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:37:11.482307+0000","last_undegraded":"2024-03-20T13:37:11.482307+0000","last_fullsized":"2024-03-20T13:37:11.482307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.482209+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:05.485475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592922+0000","last_change":"2024-03-20T13:34:41.903775+0000","last_active":"2024-03-20T13:36:35.592922+0000","last_peered":"2024-03-20T13:36:35.592922+0000","last_clean":"2024-03-20T13:36:35.592922+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:36:35.592922+0000","last_undegraded":"2024-03-20T13:36:35.592922+0000","last_fullsized":"2024-03-20T13:36:35.592922+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.240052+0000","last_change":"2024-03-20T13:37:18.240078+0000","last_active":"2024-03-20T13:37:18.240052+0000","last_peered":"2024-03-20T13:37:18.240052+0000","last_clean":"2024-03-20T13:37:18.240052+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:37:18.240052+0000","last_undegraded":"2024-03-20T13:37:18.240052+0000","last_fullsized":"2024-03-20T13:37:18.240052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:18.239966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:18.239966+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.239966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:41.643848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.507511+0000","last_change":"2024-03-20T13:36:56.507511+0000","last_active":"2024-03-20T13:36:56.507511+0000","last_peered":"2024-03-20T13:36:56.507511+0000","last_clean":"2024-03-20T13:36:56.507511+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:36:56.507511+0000","last_undegraded":"2024-03-20T13:36:56.507511+0000","last_fullsized":"2024-03-20T13:36:56.507511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.507374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:27.390260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.226545+0000","last_change":"2024-03-20T13:36:59.226545+0000","last_active":"2024-03-20T13:36:59.226545+0000","last_peered":"2024-03-20T13:36:59.226545+0000","last_clean":"2024-03-20T13:36:59.226545+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:36:59.226545+0000","last_undegraded":"2024-03-20T13:36:59.226545+0000","last_fullsized":"2024-03-20T13:36:59.226545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.226391+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:17.073932+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.194396+0000","last_change":"2024-03-20T13:36:57.194396+0000","last_active":"2024-03-20T13:36:57.194396+0000","last_peered":"2024-03-20T13:36:57.194396+0000","last_clean":"2024-03-20T13:36:57.194396+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:36:57.194396+0000","last_undegraded":"2024-03-20T13:36:57.194396+0000","last_fullsized":"2024-03-20T13:36:57.194396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.194286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:57.106173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.784884+0000","last_change":"2024-03-20T13:37:32.784934+0000","last_active":"2024-03-20T13:37:32.784884+0000","last_peered":"2024-03-20T13:37:32.784884+0000","last_clean":"2024-03-20T13:37:32.784884+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:37:32.784884+0000","last_undegraded":"2024-03-20T13:37:32.784884+0000","last_fullsized":"2024-03-20T13:37:32.784884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:32.784765+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:32.784765+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.784765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:58.540981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.850116+0000","last_change":"2024-03-20T13:36:56.850116+0000","last_active":"2024-03-20T13:36:56.850116+0000","last_peered":"2024-03-20T13:36:56.850116+0000","last_clean":"2024-03-20T13:36:56.850116+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:56.850116+0000","last_undegraded":"2024-03-20T13:36:56.850116+0000","last_fullsized":"2024-03-20T13:36:56.850116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.849978+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:10.407253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.230500+0000","last_change":"2024-03-20T13:37:17.230526+0000","last_active":"2024-03-20T13:37:17.230500+0000","last_peered":"2024-03-20T13:37:17.230500+0000","last_clean":"2024-03-20T13:37:17.230500+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:37:17.230500+0000","last_undegraded":"2024-03-20T13:37:17.230500+0000","last_fullsized":"2024-03-20T13:37:17.230500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:17.230413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:17.230413+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.230413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:06.528362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.516806+0000","last_change":"2024-03-20T13:37:23.516853+0000","last_active":"2024-03-20T13:37:23.516806+0000","last_peered":"2024-03-20T13:37:23.516806+0000","last_clean":"2024-03-20T13:37:23.516806+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:37:23.516806+0000","last_undegraded":"2024-03-20T13:37:23.516806+0000","last_fullsized":"2024-03-20T13:37:23.516806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.516709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.516709+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.516709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:30.179578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'3","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.474223+0000","last_change":"2024-03-20T13:36:59.474249+0000","last_active":"2024-03-20T13:36:59.474223+0000","last_peered":"2024-03-20T13:36:59.474223+0000","last_clean":"2024-03-20T13:36:59.474223+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:59.474223+0000","last_undegraded":"2024-03-20T13:36:59.474223+0000","last_fullsized":"2024-03-20T13:36:59.474223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.474149+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:43.301196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.439320+0000","last_change":"2024-03-20T13:36:43.439320+0000","last_active":"2024-03-20T13:36:43.439320+0000","last_peered":"2024-03-20T13:36:43.439320+0000","last_clean":"2024-03-20T13:36:43.439320+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:43.439320+0000","last_undegraded":"2024-03-20T13:36:43.439320+0000","last_fullsized":"2024-03-20T13:36:43.439320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.439197+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:55.779728+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.108014+0000","last_change":"2024-03-20T13:36:40.108014+0000","last_active":"2024-03-20T13:36:40.108014+0000","last_peered":"2024-03-20T13:36:40.108014+0000","last_clean":"2024-03-20T13:36:40.108014+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:36:40.108014+0000","last_undegraded":"2024-03-20T13:36:40.108014+0000","last_fullsized":"2024-03-20T13:36:40.108014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.107898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:33.206081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.604388+0000","last_change":"2024-03-20T13:37:32.604430+0000","last_active":"2024-03-20T13:37:32.604388+0000","last_peered":"2024-03-20T13:37:32.604388+0000","last_clean":"2024-03-20T13:37:32.604388+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:37:32.604388+0000","last_undegraded":"2024-03-20T13:37:32.604388+0000","last_fullsized":"2024-03-20T13:37:32.604388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-03-20T13:37:32.604297+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-03-20T13:37:32.604297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.604297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:50.926186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.747290+0000","last_change":"2024-03-20T13:37:05.747316+0000","last_active":"2024-03-20T13:37:05.747290+0000","last_peered":"2024-03-20T13:37:05.747290+0000","last_clean":"2024-03-20T13:37:05.747290+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:37:05.747290+0000","last_undegraded":"2024-03-20T13:37:05.747290+0000","last_fullsized":"2024-03-20T13:37:05.747290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.747166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:55.045115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.428580+0000","last_change":"2024-03-20T13:37:08.428609+0000","last_active":"2024-03-20T13:37:08.428580+0000","last_peered":"2024-03-20T13:37:08.428580+0000","last_clean":"2024-03-20T13:37:08.428580+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:37:08.428580+0000","last_undegraded":"2024-03-20T13:37:08.428580+0000","last_fullsized":"2024-03-20T13:37:08.428580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.428489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:55.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592938+0000","last_change":"2024-03-20T13:34:41.904004+0000","last_active":"2024-03-20T13:36:35.592938+0000","last_peered":"2024-03-20T13:36:35.592938+0000","last_clean":"2024-03-20T13:36:35.592938+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:36:35.592938+0000","last_undegraded":"2024-03-20T13:36:35.592938+0000","last_fullsized":"2024-03-20T13:36:35.592938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.129101+0000","last_change":"2024-03-20T13:36:45.129101+0000","last_active":"2024-03-20T13:36:45.129101+0000","last_peered":"2024-03-20T13:36:45.129101+0000","last_clean":"2024-03-20T13:36:45.129101+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:36:45.129101+0000","last_undegraded":"2024-03-20T13:36:45.129101+0000","last_fullsized":"2024-03-20T13:36:45.129101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.128960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:46.746210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.882086+0000","last_change":"2024-03-20T13:36:34.882086+0000","last_active":"2024-03-20T13:36:34.882086+0000","last_peered":"2024-03-20T13:36:34.882086+0000","last_clean":"2024-03-20T13:36:34.882086+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:36:34.882086+0000","last_undegraded":"2024-03-20T13:36:34.882086+0000","last_fullsized":"2024-03-20T13:36:34.882086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.881955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:01.668025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":291,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.888239+0000","last_change":"2024-03-20T13:36:46.888239+0000","last_active":"2024-03-20T13:36:46.888239+0000","last_peered":"2024-03-20T13:36:46.888239+0000","last_clean":"2024-03-20T13:36:46.888239+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:46.888239+0000","last_undegraded":"2024-03-20T13:36:46.888239+0000","last_fullsized":"2024-03-20T13:36:46.888239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.888110+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.228641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.247268+0000","last_change":"2024-03-20T13:37:12.247268+0000","last_active":"2024-03-20T13:37:12.247268+0000","last_peered":"2024-03-20T13:37:12.247268+0000","last_clean":"2024-03-20T13:37:12.247268+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:37:12.247268+0000","last_undegraded":"2024-03-20T13:37:12.247268+0000","last_fullsized":"2024-03-20T13:37:12.247268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.247124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:39:43.039748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.204303+0000","last_change":"2024-03-20T13:36:51.204303+0000","last_active":"2024-03-20T13:36:51.204303+0000","last_peered":"2024-03-20T13:36:51.204303+0000","last_clean":"2024-03-20T13:36:51.204303+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:36:51.204303+0000","last_undegraded":"2024-03-20T13:36:51.204303+0000","last_fullsized":"2024-03-20T13:36:51.204303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.204192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:38.634547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.084564+0000","last_change":"2024-03-20T13:37:33.084587+0000","last_active":"2024-03-20T13:37:33.084564+0000","last_peered":"2024-03-20T13:37:33.084564+0000","last_clean":"2024-03-20T13:37:33.084564+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:37:33.084564+0000","last_undegraded":"2024-03-20T13:37:33.084564+0000","last_fullsized":"2024-03-20T13:37:33.084564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:33.084477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:33.084477+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.084477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:23:10.286935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.493735+0000","last_change":"2024-03-20T13:37:24.493773+0000","last_active":"2024-03-20T13:37:24.493735+0000","last_peered":"2024-03-20T13:37:24.493735+0000","last_clean":"2024-03-20T13:37:24.493735+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:37:24.493735+0000","last_undegraded":"2024-03-20T13:37:24.493735+0000","last_fullsized":"2024-03-20T13:37:24.493735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:24.493644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:24.493644+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.493644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:52.922127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593727+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:36:35.593727+0000","last_peered":"2024-03-20T13:36:35.593727+0000","last_clean":"2024-03-20T13:36:35.593727+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:36:35.593727+0000","last_undegraded":"2024-03-20T13:36:35.593727+0000","last_fullsized":"2024-03-20T13:36:35.593727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.215859+0000","last_change":"2024-03-20T13:37:05.215894+0000","last_active":"2024-03-20T13:37:05.215859+0000","last_peered":"2024-03-20T13:37:05.215859+0000","last_clean":"2024-03-20T13:37:05.215859+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:37:05.215859+0000","last_undegraded":"2024-03-20T13:37:05.215859+0000","last_fullsized":"2024-03-20T13:37:05.215859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.215760+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:50.554560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.452554+0000","last_change":"2024-03-20T13:36:45.452554+0000","last_active":"2024-03-20T13:36:45.452554+0000","last_peered":"2024-03-20T13:36:45.452554+0000","last_clean":"2024-03-20T13:36:45.452554+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:45.452554+0000","last_undegraded":"2024-03-20T13:36:45.452554+0000","last_fullsized":"2024-03-20T13:36:45.452554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.452437+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:06:35.977614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.722337+0000","last_change":"2024-03-20T13:37:02.722337+0000","last_active":"2024-03-20T13:37:02.722337+0000","last_peered":"2024-03-20T13:37:02.722337+0000","last_clean":"2024-03-20T13:37:02.722337+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:37:02.722337+0000","last_undegraded":"2024-03-20T13:37:02.722337+0000","last_fullsized":"2024-03-20T13:37:02.722337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.722217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:10.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.238524+0000","last_change":"2024-03-20T13:37:14.238550+0000","last_active":"2024-03-20T13:37:14.238524+0000","last_peered":"2024-03-20T13:37:14.238524+0000","last_clean":"2024-03-20T13:37:14.238524+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:37:14.238524+0000","last_undegraded":"2024-03-20T13:37:14.238524+0000","last_fullsized":"2024-03-20T13:37:14.238524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:14.238438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:14.238438+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.238438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:21.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.714031+0000","last_change":"2024-03-20T13:37:15.714057+0000","last_active":"2024-03-20T13:37:15.714031+0000","last_peered":"2024-03-20T13:37:15.714031+0000","last_clean":"2024-03-20T13:37:15.714031+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:37:15.714031+0000","last_undegraded":"2024-03-20T13:37:15.714031+0000","last_fullsized":"2024-03-20T13:37:15.714031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.713941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.713941+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.713941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:56:51.973415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.592938+0000","last_change":"2024-03-20T13:34:41.948256+0000","last_active":"2024-03-20T13:36:35.592938+0000","last_peered":"2024-03-20T13:36:35.592938+0000","last_clean":"2024-03-20T13:36:35.592938+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:36:35.592938+0000","last_undegraded":"2024-03-20T13:36:35.592938+0000","last_fullsized":"2024-03-20T13:36:35.592938+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:40.892081+0000","last_clean_scrub_stamp":"2024-03-20T13:34:40.892081+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.105883+0000","last_change":"2024-03-20T13:36:42.105883+0000","last_active":"2024-03-20T13:36:42.105883+0000","last_peered":"2024-03-20T13:36:42.105883+0000","last_clean":"2024-03-20T13:36:42.105883+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:36:42.105883+0000","last_undegraded":"2024-03-20T13:36:42.105883+0000","last_fullsized":"2024-03-20T13:36:42.105883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.105759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:22:49.608123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":184,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.173473+0000","last_change":"2024-03-20T13:36:45.173473+0000","last_active":"2024-03-20T13:36:45.173473+0000","last_peered":"2024-03-20T13:36:45.173473+0000","last_clean":"2024-03-20T13:36:45.173473+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:45.173473+0000","last_undegraded":"2024-03-20T13:36:45.173473+0000","last_fullsized":"2024-03-20T13:36:45.173473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'91","last_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_deep_scrub":"32'91","last_deep_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.173353+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:11.959423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.486441+0000","last_change":"2024-03-20T13:36:36.486441+0000","last_active":"2024-03-20T13:36:36.486441+0000","last_peered":"2024-03-20T13:36:36.486441+0000","last_clean":"2024-03-20T13:36:36.486441+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:36:36.486441+0000","last_undegraded":"2024-03-20T13:36:36.486441+0000","last_fullsized":"2024-03-20T13:36:36.486441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.486298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:56.678415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.195177+0000","last_change":"2024-03-20T13:36:50.195177+0000","last_active":"2024-03-20T13:36:50.195177+0000","last_peered":"2024-03-20T13:36:50.195177+0000","last_clean":"2024-03-20T13:36:50.195177+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:36:50.195177+0000","last_undegraded":"2024-03-20T13:36:50.195177+0000","last_fullsized":"2024-03-20T13:36:50.195177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.195066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:08.652809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.162953+0000","last_change":"2024-03-20T13:36:42.162953+0000","last_active":"2024-03-20T13:36:42.162953+0000","last_peered":"2024-03-20T13:36:42.162953+0000","last_clean":"2024-03-20T13:36:42.162953+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:36:42.162953+0000","last_undegraded":"2024-03-20T13:36:42.162953+0000","last_fullsized":"2024-03-20T13:36:42.162953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.162847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:46:25.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.237627+0000","last_change":"2024-03-20T13:37:12.237627+0000","last_active":"2024-03-20T13:37:12.237627+0000","last_peered":"2024-03-20T13:37:12.237627+0000","last_clean":"2024-03-20T13:37:12.237627+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:37:12.237627+0000","last_undegraded":"2024-03-20T13:37:12.237627+0000","last_fullsized":"2024-03-20T13:37:12.237627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.237514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:54.859398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.094362+0000","last_change":"2024-03-20T13:37:32.094389+0000","last_active":"2024-03-20T13:37:32.094362+0000","last_peered":"2024-03-20T13:37:32.094362+0000","last_clean":"2024-03-20T13:37:32.094362+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:37:32.094362+0000","last_undegraded":"2024-03-20T13:37:32.094362+0000","last_fullsized":"2024-03-20T13:37:32.094362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:32.094255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:32.094255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.094255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:24.944029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.927642+0000","last_change":"2024-03-20T13:36:48.927642+0000","last_active":"2024-03-20T13:36:48.927642+0000","last_peered":"2024-03-20T13:36:48.927642+0000","last_clean":"2024-03-20T13:36:48.927642+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:36:48.927642+0000","last_undegraded":"2024-03-20T13:36:48.927642+0000","last_fullsized":"2024-03-20T13:36:48.927642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.927492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:31.555602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.228501+0000","last_change":"2024-03-20T13:37:02.228501+0000","last_active":"2024-03-20T13:37:02.228501+0000","last_peered":"2024-03-20T13:37:02.228501+0000","last_clean":"2024-03-20T13:37:02.228501+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:37:02.228501+0000","last_undegraded":"2024-03-20T13:37:02.228501+0000","last_fullsized":"2024-03-20T13:37:02.228501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.228382+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:57.609818+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.213463+0000","last_change":"2024-03-20T13:37:00.213463+0000","last_active":"2024-03-20T13:37:00.213463+0000","last_peered":"2024-03-20T13:37:00.213463+0000","last_clean":"2024-03-20T13:37:00.213463+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:37:00.213463+0000","last_undegraded":"2024-03-20T13:37:00.213463+0000","last_fullsized":"2024-03-20T13:37:00.213463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.213347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:55.768317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.470905+0000","last_change":"2024-03-20T13:37:01.470905+0000","last_active":"2024-03-20T13:37:01.470905+0000","last_peered":"2024-03-20T13:37:01.470905+0000","last_clean":"2024-03-20T13:37:01.470905+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:37:01.470905+0000","last_undegraded":"2024-03-20T13:37:01.470905+0000","last_fullsized":"2024-03-20T13:37:01.470905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.470772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:39.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.740422+0000","last_change":"2024-03-20T13:37:08.740422+0000","last_active":"2024-03-20T13:37:08.740422+0000","last_peered":"2024-03-20T13:37:08.740422+0000","last_clean":"2024-03-20T13:37:08.740422+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:37:08.740422+0000","last_undegraded":"2024-03-20T13:37:08.740422+0000","last_fullsized":"2024-03-20T13:37:08.740422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.740297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:41.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.243856+0000","last_change":"2024-03-20T13:37:09.243856+0000","last_active":"2024-03-20T13:37:09.243856+0000","last_peered":"2024-03-20T13:37:09.243856+0000","last_clean":"2024-03-20T13:37:09.243856+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:37:09.243856+0000","last_undegraded":"2024-03-20T13:37:09.243856+0000","last_fullsized":"2024-03-20T13:37:09.243856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.243729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:38.730937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.295145+0000","last_change":"2024-03-20T13:37:27.295167+0000","last_active":"2024-03-20T13:37:27.295145+0000","last_peered":"2024-03-20T13:37:27.295145+0000","last_clean":"2024-03-20T13:37:27.295145+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:37:27.295145+0000","last_undegraded":"2024-03-20T13:37:27.295145+0000","last_fullsized":"2024-03-20T13:37:27.295145+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.295064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.295064+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.295064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:01.206762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.478637+0000","last_change":"2024-03-20T13:36:47.478637+0000","last_active":"2024-03-20T13:36:47.478637+0000","last_peered":"2024-03-20T13:36:47.478637+0000","last_clean":"2024-03-20T13:36:47.478637+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:47.478637+0000","last_undegraded":"2024-03-20T13:36:47.478637+0000","last_fullsized":"2024-03-20T13:36:47.478637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.478507+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:17.900912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.100179+0000","last_change":"2024-03-20T13:36:38.100179+0000","last_active":"2024-03-20T13:36:38.100179+0000","last_peered":"2024-03-20T13:36:38.100179+0000","last_clean":"2024-03-20T13:36:38.100179+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:36:38.100179+0000","last_undegraded":"2024-03-20T13:36:38.100179+0000","last_fullsized":"2024-03-20T13:36:38.100179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.100067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:06:11.567457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272720+0000","last_change":"2024-03-20T13:34:59.974839+0000","last_active":"2024-03-20T13:36:34.272720+0000","last_peered":"2024-03-20T13:36:34.272720+0000","last_clean":"2024-03-20T13:36:34.272720+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:36:34.272720+0000","last_undegraded":"2024-03-20T13:36:34.272720+0000","last_fullsized":"2024-03-20T13:36:34.272720+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.461142+0000","last_change":"2024-03-20T13:37:07.461142+0000","last_active":"2024-03-20T13:37:07.461142+0000","last_peered":"2024-03-20T13:37:07.461142+0000","last_clean":"2024-03-20T13:37:07.461142+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:37:07.461142+0000","last_undegraded":"2024-03-20T13:37:07.461142+0000","last_fullsized":"2024-03-20T13:37:07.461142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.461017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:49.260164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.238017+0000","last_change":"2024-03-20T13:37:22.238044+0000","last_active":"2024-03-20T13:37:22.238017+0000","last_peered":"2024-03-20T13:37:22.238017+0000","last_clean":"2024-03-20T13:37:22.238017+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:37:22.238017+0000","last_undegraded":"2024-03-20T13:37:22.238017+0000","last_fullsized":"2024-03-20T13:37:22.238017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.237932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.237932+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.237932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:09.668288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.112735+0000","last_change":"2024-03-20T13:36:56.112735+0000","last_active":"2024-03-20T13:36:56.112735+0000","last_peered":"2024-03-20T13:36:56.112735+0000","last_clean":"2024-03-20T13:36:56.112735+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:36:56.112735+0000","last_undegraded":"2024-03-20T13:36:56.112735+0000","last_fullsized":"2024-03-20T13:36:56.112735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.112607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:05.346785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.407080+0000","last_change":"2024-03-20T13:36:44.407080+0000","last_active":"2024-03-20T13:36:44.407080+0000","last_peered":"2024-03-20T13:36:44.407080+0000","last_clean":"2024-03-20T13:36:44.407080+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:44.407080+0000","last_undegraded":"2024-03-20T13:36:44.407080+0000","last_fullsized":"2024-03-20T13:36:44.407080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.406901+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:14.825593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.839038+0000","last_change":"2024-03-20T13:36:42.839038+0000","last_active":"2024-03-20T13:36:42.839038+0000","last_peered":"2024-03-20T13:36:42.839038+0000","last_clean":"2024-03-20T13:36:42.839038+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:36:42.839038+0000","last_undegraded":"2024-03-20T13:36:42.839038+0000","last_fullsized":"2024-03-20T13:36:42.839038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.838924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:34.359477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594451+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:36:35.594451+0000","last_peered":"2024-03-20T13:36:35.594451+0000","last_clean":"2024-03-20T13:36:35.594451+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:36:35.594451+0000","last_undegraded":"2024-03-20T13:36:35.594451+0000","last_fullsized":"2024-03-20T13:36:35.594451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.196840+0000","last_change":"2024-03-20T13:36:49.196840+0000","last_active":"2024-03-20T13:36:49.196840+0000","last_peered":"2024-03-20T13:36:49.196840+0000","last_clean":"2024-03-20T13:36:49.196840+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:36:49.196840+0000","last_undegraded":"2024-03-20T13:36:49.196840+0000","last_fullsized":"2024-03-20T13:36:49.196840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.196667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:30.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.613025+0000","last_change":"2024-03-20T13:37:21.613053+0000","last_active":"2024-03-20T13:37:21.613025+0000","last_peered":"2024-03-20T13:37:21.613025+0000","last_clean":"2024-03-20T13:37:21.613025+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:37:21.613025+0000","last_undegraded":"2024-03-20T13:37:21.613025+0000","last_fullsized":"2024-03-20T13:37:21.613025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:21.612935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:21.612935+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.612935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:55.799847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.120372+0000","last_change":"2024-03-20T13:36:37.120372+0000","last_active":"2024-03-20T13:36:37.120372+0000","last_peered":"2024-03-20T13:36:37.120372+0000","last_clean":"2024-03-20T13:36:37.120372+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:36:37.120372+0000","last_undegraded":"2024-03-20T13:36:37.120372+0000","last_fullsized":"2024-03-20T13:36:37.120372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.120203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.166063+0000","last_change":"2024-03-20T13:36:51.166063+0000","last_active":"2024-03-20T13:36:51.166063+0000","last_peered":"2024-03-20T13:36:51.166063+0000","last_clean":"2024-03-20T13:36:51.166063+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:51.166063+0000","last_undegraded":"2024-03-20T13:36:51.166063+0000","last_fullsized":"2024-03-20T13:36:51.166063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.165931+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:11.358048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.137649+0000","last_change":"2024-03-20T13:36:43.137649+0000","last_active":"2024-03-20T13:36:43.137649+0000","last_peered":"2024-03-20T13:36:43.137649+0000","last_clean":"2024-03-20T13:36:43.137649+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:36:43.137649+0000","last_undegraded":"2024-03-20T13:36:43.137649+0000","last_fullsized":"2024-03-20T13:36:43.137649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.137482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:28.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.205951+0000","last_change":"2024-03-20T13:37:17.205976+0000","last_active":"2024-03-20T13:37:17.205951+0000","last_peered":"2024-03-20T13:37:17.205951+0000","last_clean":"2024-03-20T13:37:17.205951+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:37:17.205951+0000","last_undegraded":"2024-03-20T13:37:17.205951+0000","last_fullsized":"2024-03-20T13:37:17.205951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-03-20T13:37:17.205804+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-03-20T13:37:17.205804+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.205804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:53.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593202+0000","last_change":"2024-03-20T13:34:49.954978+0000","last_active":"2024-03-20T13:36:35.593202+0000","last_peered":"2024-03-20T13:36:35.593202+0000","last_clean":"2024-03-20T13:36:35.593202+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:36:35.593202+0000","last_undegraded":"2024-03-20T13:36:35.593202+0000","last_fullsized":"2024-03-20T13:36:35.593202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.515662+0000","last_change":"2024-03-20T13:36:58.515701+0000","last_active":"2024-03-20T13:36:58.515662+0000","last_peered":"2024-03-20T13:36:58.515662+0000","last_clean":"2024-03-20T13:36:58.515662+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:36:58.515662+0000","last_undegraded":"2024-03-20T13:36:58.515662+0000","last_fullsized":"2024-03-20T13:36:58.515662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.515568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:41.137452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.434919+0000","last_change":"2024-03-20T13:36:46.434919+0000","last_active":"2024-03-20T13:36:46.434919+0000","last_peered":"2024-03-20T13:36:46.434919+0000","last_clean":"2024-03-20T13:36:46.434919+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:46.434919+0000","last_undegraded":"2024-03-20T13:36:46.434919+0000","last_fullsized":"2024-03-20T13:36:46.434919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.434789+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:21.531106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.142333+0000","last_change":"2024-03-20T13:36:41.142333+0000","last_active":"2024-03-20T13:36:41.142333+0000","last_peered":"2024-03-20T13:36:41.142333+0000","last_clean":"2024-03-20T13:36:41.142333+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:36:41.142333+0000","last_undegraded":"2024-03-20T13:36:41.142333+0000","last_fullsized":"2024-03-20T13:36:41.142333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.142212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:35.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.272771+0000","last_change":"2024-03-20T13:34:59.974788+0000","last_active":"2024-03-20T13:36:34.272771+0000","last_peered":"2024-03-20T13:36:34.272771+0000","last_clean":"2024-03-20T13:36:34.272771+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:36:34.272771+0000","last_undegraded":"2024-03-20T13:36:34.272771+0000","last_fullsized":"2024-03-20T13:36:34.272771+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.496484+0000","last_change":"2024-03-20T13:37:04.496531+0000","last_active":"2024-03-20T13:37:04.496484+0000","last_peered":"2024-03-20T13:37:04.496484+0000","last_clean":"2024-03-20T13:37:04.496484+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:37:04.496484+0000","last_undegraded":"2024-03-20T13:37:04.496484+0000","last_fullsized":"2024-03-20T13:37:04.496484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.496373+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:27.900255+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.643299+0000","last_change":"2024-03-20T13:37:19.643323+0000","last_active":"2024-03-20T13:37:19.643299+0000","last_peered":"2024-03-20T13:37:19.643299+0000","last_clean":"2024-03-20T13:37:19.643299+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:37:19.643299+0000","last_undegraded":"2024-03-20T13:37:19.643299+0000","last_fullsized":"2024-03-20T13:37:19.643299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.643213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.643213+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.643213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:21:15.198184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.344616+0000","last_change":"2024-03-20T13:37:29.344639+0000","last_active":"2024-03-20T13:37:29.344616+0000","last_peered":"2024-03-20T13:37:29.344616+0000","last_clean":"2024-03-20T13:37:29.344616+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:37:29.344616+0000","last_undegraded":"2024-03-20T13:37:29.344616+0000","last_fullsized":"2024-03-20T13:37:29.344616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:29.344529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:29.344529+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.344529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:45.574840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.193532+0000","last_change":"2024-03-20T13:37:01.193532+0000","last_active":"2024-03-20T13:37:01.193532+0000","last_peered":"2024-03-20T13:37:01.193532+0000","last_clean":"2024-03-20T13:37:01.193532+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:37:01.193532+0000","last_undegraded":"2024-03-20T13:37:01.193532+0000","last_fullsized":"2024-03-20T13:37:01.193532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.193395+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:18.727953+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.825368+0000","last_change":"2024-03-20T13:36:54.825368+0000","last_active":"2024-03-20T13:36:54.825368+0000","last_peered":"2024-03-20T13:36:54.825368+0000","last_clean":"2024-03-20T13:36:54.825368+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:36:54.825368+0000","last_undegraded":"2024-03-20T13:36:54.825368+0000","last_fullsized":"2024-03-20T13:36:54.825368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.825258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:24.356866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594428+0000","last_change":"2024-03-20T13:34:59.972198+0000","last_active":"2024-03-20T13:36:35.594428+0000","last_peered":"2024-03-20T13:36:35.594428+0000","last_clean":"2024-03-20T13:36:35.594428+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:36:35.594428+0000","last_undegraded":"2024-03-20T13:36:35.594428+0000","last_fullsized":"2024-03-20T13:36:35.594428+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.167768+0000","last_change":"2024-03-20T13:36:50.167768+0000","last_active":"2024-03-20T13:36:50.167768+0000","last_peered":"2024-03-20T13:36:50.167768+0000","last_clean":"2024-03-20T13:36:50.167768+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:36:50.167768+0000","last_undegraded":"2024-03-20T13:36:50.167768+0000","last_fullsized":"2024-03-20T13:36:50.167768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.167623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:36.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.755783+0000","last_change":"2024-03-20T13:37:13.755783+0000","last_active":"2024-03-20T13:37:13.755783+0000","last_peered":"2024-03-20T13:37:13.755783+0000","last_clean":"2024-03-20T13:37:13.755783+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:37:13.755783+0000","last_undegraded":"2024-03-20T13:37:13.755783+0000","last_fullsized":"2024-03-20T13:37:13.755783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.755656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:44.151919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.319660+0000","last_change":"2024-03-20T13:37:28.319682+0000","last_active":"2024-03-20T13:37:28.319660+0000","last_peered":"2024-03-20T13:37:28.319660+0000","last_clean":"2024-03-20T13:37:28.319660+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:37:28.319660+0000","last_undegraded":"2024-03-20T13:37:28.319660+0000","last_fullsized":"2024-03-20T13:37:28.319660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.319581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.319581+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.319581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:28.231469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.430174+0000","last_change":"2024-03-20T13:36:48.430174+0000","last_active":"2024-03-20T13:36:48.430174+0000","last_peered":"2024-03-20T13:36:48.430174+0000","last_clean":"2024-03-20T13:36:48.430174+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:48.430174+0000","last_undegraded":"2024-03-20T13:36:48.430174+0000","last_fullsized":"2024-03-20T13:36:48.430174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.430044+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:13:05.290246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.424720+0000","last_change":"2024-03-20T13:36:53.424720+0000","last_active":"2024-03-20T13:36:53.424720+0000","last_peered":"2024-03-20T13:36:53.424720+0000","last_clean":"2024-03-20T13:36:53.424720+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:36:53.424720+0000","last_undegraded":"2024-03-20T13:36:53.424720+0000","last_fullsized":"2024-03-20T13:36:53.424720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.424599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:42.288257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.194266+0000","last_change":"2024-03-20T13:37:20.194266+0000","last_active":"2024-03-20T13:37:20.194266+0000","last_peered":"2024-03-20T13:37:20.194266+0000","last_clean":"2024-03-20T13:37:20.194266+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:37:20.194266+0000","last_undegraded":"2024-03-20T13:37:20.194266+0000","last_fullsized":"2024-03-20T13:37:20.194266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:20.194129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:20.194129+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.194129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:24:20.046133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.549325+0000","last_change":"2024-03-20T13:37:21.549325+0000","last_active":"2024-03-20T13:37:21.549325+0000","last_peered":"2024-03-20T13:37:21.549325+0000","last_clean":"2024-03-20T13:37:21.549325+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:37:21.549325+0000","last_undegraded":"2024-03-20T13:37:21.549325+0000","last_fullsized":"2024-03-20T13:37:21.549325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:21.549211+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:21.549211+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.549211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:37.535250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.182023+0000","last_change":"2024-03-20T13:37:30.182049+0000","last_active":"2024-03-20T13:37:30.182023+0000","last_peered":"2024-03-20T13:37:30.182023+0000","last_clean":"2024-03-20T13:37:30.182023+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:37:30.182023+0000","last_undegraded":"2024-03-20T13:37:30.182023+0000","last_fullsized":"2024-03-20T13:37:30.182023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:30.181902+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:30.181902+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.181902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:12:23.621237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.916154+0000","last_change":"2024-03-20T13:36:51.916154+0000","last_active":"2024-03-20T13:36:51.916154+0000","last_peered":"2024-03-20T13:36:51.916154+0000","last_clean":"2024-03-20T13:36:51.916154+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:36:51.916154+0000","last_undegraded":"2024-03-20T13:36:51.916154+0000","last_fullsized":"2024-03-20T13:36:51.916154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.916042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:20.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.240981+0000","last_change":"2024-03-20T13:36:58.241018+0000","last_active":"2024-03-20T13:36:58.240981+0000","last_peered":"2024-03-20T13:36:58.240981+0000","last_clean":"2024-03-20T13:36:58.240981+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:36:58.240981+0000","last_undegraded":"2024-03-20T13:36:58.240981+0000","last_fullsized":"2024-03-20T13:36:58.240981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.240881+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:38.665383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":306,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.069210+0000","last_change":"2024-03-20T13:36:37.069210+0000","last_active":"2024-03-20T13:36:37.069210+0000","last_peered":"2024-03-20T13:36:37.069210+0000","last_clean":"2024-03-20T13:36:37.069210+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:37.069210+0000","last_undegraded":"2024-03-20T13:36:37.069210+0000","last_fullsized":"2024-03-20T13:36:37.069210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.069055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:28:39.752450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594368+0000","last_change":"2024-03-20T13:34:59.971959+0000","last_active":"2024-03-20T13:36:35.594368+0000","last_peered":"2024-03-20T13:36:35.594368+0000","last_clean":"2024-03-20T13:36:35.594368+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:36:35.594368+0000","last_undegraded":"2024-03-20T13:36:35.594368+0000","last_fullsized":"2024-03-20T13:36:35.594368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.292302+0000","last_change":"2024-03-20T13:37:02.292302+0000","last_active":"2024-03-20T13:37:02.292302+0000","last_peered":"2024-03-20T13:37:02.292302+0000","last_clean":"2024-03-20T13:37:02.292302+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:37:02.292302+0000","last_undegraded":"2024-03-20T13:37:02.292302+0000","last_fullsized":"2024-03-20T13:37:02.292302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.292156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:32.714561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.691120+0000","last_change":"2024-03-20T13:37:23.691147+0000","last_active":"2024-03-20T13:37:23.691120+0000","last_peered":"2024-03-20T13:37:23.691120+0000","last_clean":"2024-03-20T13:37:23.691120+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:37:23.691120+0000","last_undegraded":"2024-03-20T13:37:23.691120+0000","last_fullsized":"2024-03-20T13:37:23.691120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.691036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.691036+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.691036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:21.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.882093+0000","last_change":"2024-03-20T13:36:45.882093+0000","last_active":"2024-03-20T13:36:45.882093+0000","last_peered":"2024-03-20T13:36:45.882093+0000","last_clean":"2024-03-20T13:36:45.882093+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:36:45.882093+0000","last_undegraded":"2024-03-20T13:36:45.882093+0000","last_fullsized":"2024-03-20T13:36:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.881976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:18.667047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.780797+0000","last_change":"2024-03-20T13:36:40.780797+0000","last_active":"2024-03-20T13:36:40.780797+0000","last_peered":"2024-03-20T13:36:40.780797+0000","last_clean":"2024-03-20T13:36:40.780797+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:40.780797+0000","last_undegraded":"2024-03-20T13:36:40.780797+0000","last_fullsized":"2024-03-20T13:36:40.780797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.780669+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:55.427462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.483874+0000","last_change":"2024-03-20T13:36:37.483874+0000","last_active":"2024-03-20T13:36:37.483874+0000","last_peered":"2024-03-20T13:36:37.483874+0000","last_clean":"2024-03-20T13:36:37.483874+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:36:37.483874+0000","last_undegraded":"2024-03-20T13:36:37.483874+0000","last_fullsized":"2024-03-20T13:36:37.483874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.483750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:40.729135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.753378+0000","last_change":"2024-03-20T13:37:33.753408+0000","last_active":"2024-03-20T13:37:33.753378+0000","last_peered":"2024-03-20T13:37:33.753378+0000","last_clean":"2024-03-20T13:37:33.753378+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:37:33.753378+0000","last_undegraded":"2024-03-20T13:37:33.753378+0000","last_fullsized":"2024-03-20T13:37:33.753378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:33.753268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:33.753268+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.753268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:17.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.259918+0000","last_change":"2024-03-20T13:37:01.259918+0000","last_active":"2024-03-20T13:37:01.259918+0000","last_peered":"2024-03-20T13:37:01.259918+0000","last_clean":"2024-03-20T13:37:01.259918+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:37:01.259918+0000","last_undegraded":"2024-03-20T13:37:01.259918+0000","last_fullsized":"2024-03-20T13:37:01.259918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.259780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:24.962382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593227+0000","last_change":"2024-03-20T13:34:49.962715+0000","last_active":"2024-03-20T13:36:35.593227+0000","last_peered":"2024-03-20T13:36:35.593227+0000","last_clean":"2024-03-20T13:36:35.593227+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:36:35.593227+0000","last_undegraded":"2024-03-20T13:36:35.593227+0000","last_fullsized":"2024-03-20T13:36:35.593227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.111639+0000","last_change":"2024-03-20T13:36:55.111639+0000","last_active":"2024-03-20T13:36:55.111639+0000","last_peered":"2024-03-20T13:36:55.111639+0000","last_clean":"2024-03-20T13:36:55.111639+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:36:55.111639+0000","last_undegraded":"2024-03-20T13:36:55.111639+0000","last_fullsized":"2024-03-20T13:36:55.111639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.111514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:29.756932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.483646+0000","last_change":"2024-03-20T13:36:34.483646+0000","last_active":"2024-03-20T13:36:34.483646+0000","last_peered":"2024-03-20T13:36:34.483646+0000","last_clean":"2024-03-20T13:36:34.483646+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:34.483646+0000","last_undegraded":"2024-03-20T13:36:34.483646+0000","last_fullsized":"2024-03-20T13:36:34.483646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.483533+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:25:29.809601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.258997+0000","last_change":"2024-03-20T13:37:04.258997+0000","last_active":"2024-03-20T13:37:04.258997+0000","last_peered":"2024-03-20T13:37:04.258997+0000","last_clean":"2024-03-20T13:37:04.258997+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:37:04.258997+0000","last_undegraded":"2024-03-20T13:37:04.258997+0000","last_fullsized":"2024-03-20T13:37:04.258997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.258885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:14:48.115373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594468+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:36:35.594468+0000","last_peered":"2024-03-20T13:36:35.594468+0000","last_clean":"2024-03-20T13:36:35.594468+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:36:35.594468+0000","last_undegraded":"2024-03-20T13:36:35.594468+0000","last_fullsized":"2024-03-20T13:36:35.594468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.231760+0000","last_change":"2024-03-20T13:37:15.231760+0000","last_active":"2024-03-20T13:37:15.231760+0000","last_peered":"2024-03-20T13:37:15.231760+0000","last_clean":"2024-03-20T13:37:15.231760+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:37:15.231760+0000","last_undegraded":"2024-03-20T13:37:15.231760+0000","last_fullsized":"2024-03-20T13:37:15.231760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.231613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.231613+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.231613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:33.553502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.482913+0000","last_change":"2024-03-20T13:37:18.482957+0000","last_active":"2024-03-20T13:37:18.482913+0000","last_peered":"2024-03-20T13:37:18.482913+0000","last_clean":"2024-03-20T13:37:18.482913+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:37:18.482913+0000","last_undegraded":"2024-03-20T13:37:18.482913+0000","last_fullsized":"2024-03-20T13:37:18.482913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:18.482773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:18.482773+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.482773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:21:14.037744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.870499+0000","last_change":"2024-03-20T13:36:44.870499+0000","last_active":"2024-03-20T13:36:44.870499+0000","last_peered":"2024-03-20T13:36:44.870499+0000","last_clean":"2024-03-20T13:36:44.870499+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:36:44.870499+0000","last_undegraded":"2024-03-20T13:36:44.870499+0000","last_fullsized":"2024-03-20T13:36:44.870499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:38:54.104546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.096207+0000","last_change":"2024-03-20T13:36:40.096207+0000","last_active":"2024-03-20T13:36:40.096207+0000","last_peered":"2024-03-20T13:36:40.096207+0000","last_clean":"2024-03-20T13:36:40.096207+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:40.096207+0000","last_undegraded":"2024-03-20T13:36:40.096207+0000","last_fullsized":"2024-03-20T13:36:40.096207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.096051+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:22.717936+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.230574+0000","last_change":"2024-03-20T13:36:56.230574+0000","last_active":"2024-03-20T13:36:56.230574+0000","last_peered":"2024-03-20T13:36:56.230574+0000","last_clean":"2024-03-20T13:36:56.230574+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:36:56.230574+0000","last_undegraded":"2024-03-20T13:36:56.230574+0000","last_fullsized":"2024-03-20T13:36:56.230574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.230465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:30.142163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594429+0000","last_change":"2024-03-20T13:34:59.974837+0000","last_active":"2024-03-20T13:36:35.594429+0000","last_peered":"2024-03-20T13:36:35.594429+0000","last_clean":"2024-03-20T13:36:35.594429+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:36:35.594429+0000","last_undegraded":"2024-03-20T13:36:35.594429+0000","last_fullsized":"2024-03-20T13:36:35.594429+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.219367+0000","last_change":"2024-03-20T13:37:00.219367+0000","last_active":"2024-03-20T13:37:00.219367+0000","last_peered":"2024-03-20T13:37:00.219367+0000","last_clean":"2024-03-20T13:37:00.219367+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:37:00.219367+0000","last_undegraded":"2024-03-20T13:37:00.219367+0000","last_fullsized":"2024-03-20T13:37:00.219367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.219255+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:42.847366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.655514+0000","last_change":"2024-03-20T13:37:22.655562+0000","last_active":"2024-03-20T13:37:22.655514+0000","last_peered":"2024-03-20T13:37:22.655514+0000","last_clean":"2024-03-20T13:37:22.655514+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:37:22.655514+0000","last_undegraded":"2024-03-20T13:37:22.655514+0000","last_fullsized":"2024-03-20T13:37:22.655514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.655413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.655413+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.655413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:13:19.814687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.792027+0000","last_change":"2024-03-20T13:36:41.792027+0000","last_active":"2024-03-20T13:36:41.792027+0000","last_peered":"2024-03-20T13:36:41.792027+0000","last_clean":"2024-03-20T13:36:41.792027+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:36:41.792027+0000","last_undegraded":"2024-03-20T13:36:41.792027+0000","last_fullsized":"2024-03-20T13:36:41.792027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.791862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:01.217069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.209667+0000","last_change":"2024-03-20T13:36:52.209667+0000","last_active":"2024-03-20T13:36:52.209667+0000","last_peered":"2024-03-20T13:36:52.209667+0000","last_clean":"2024-03-20T13:36:52.209667+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:52.209667+0000","last_undegraded":"2024-03-20T13:36:52.209667+0000","last_fullsized":"2024-03-20T13:36:52.209667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.209539+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:29.303951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.508600+0000","last_change":"2024-03-20T13:36:39.508600+0000","last_active":"2024-03-20T13:36:39.508600+0000","last_peered":"2024-03-20T13:36:39.508600+0000","last_clean":"2024-03-20T13:36:39.508600+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:36:39.508600+0000","last_undegraded":"2024-03-20T13:36:39.508600+0000","last_fullsized":"2024-03-20T13:36:39.508600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.508482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:31.029035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594422+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:36:35.594422+0000","last_peered":"2024-03-20T13:36:35.594422+0000","last_clean":"2024-03-20T13:36:35.594422+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:36:35.594422+0000","last_undegraded":"2024-03-20T13:36:35.594422+0000","last_fullsized":"2024-03-20T13:36:35.594422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.853870+0000","last_change":"2024-03-20T13:36:53.853870+0000","last_active":"2024-03-20T13:36:53.853870+0000","last_peered":"2024-03-20T13:36:53.853870+0000","last_clean":"2024-03-20T13:36:53.853870+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:36:53.853870+0000","last_undegraded":"2024-03-20T13:36:53.853870+0000","last_fullsized":"2024-03-20T13:36:53.853870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.853690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:52.367889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.226235+0000","last_change":"2024-03-20T13:37:15.226284+0000","last_active":"2024-03-20T13:37:15.226235+0000","last_peered":"2024-03-20T13:37:15.226235+0000","last_clean":"2024-03-20T13:37:15.226235+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:37:15.226235+0000","last_undegraded":"2024-03-20T13:37:15.226235+0000","last_fullsized":"2024-03-20T13:37:15.226235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.226132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.226132+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.226132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:53.150881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.508390+0000","last_change":"2024-03-20T13:37:19.508412+0000","last_active":"2024-03-20T13:37:19.508390+0000","last_peered":"2024-03-20T13:37:19.508390+0000","last_clean":"2024-03-20T13:37:19.508390+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:37:19.508390+0000","last_undegraded":"2024-03-20T13:37:19.508390+0000","last_fullsized":"2024-03-20T13:37:19.508390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.508305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.508305+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.508305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:37.042863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.513345+0000","last_change":"2024-03-20T13:37:25.513374+0000","last_active":"2024-03-20T13:37:25.513345+0000","last_peered":"2024-03-20T13:37:25.513345+0000","last_clean":"2024-03-20T13:37:25.513345+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:37:25.513345+0000","last_undegraded":"2024-03-20T13:37:25.513345+0000","last_fullsized":"2024-03-20T13:37:25.513345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:25.513252+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:25.513252+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.513252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:04.951193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.225063+0000","last_change":"2024-03-20T13:37:14.225110+0000","last_active":"2024-03-20T13:37:14.225063+0000","last_peered":"2024-03-20T13:37:14.225063+0000","last_clean":"2024-03-20T13:37:14.225063+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:37:14.225063+0000","last_undegraded":"2024-03-20T13:37:14.225063+0000","last_fullsized":"2024-03-20T13:37:14.225063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:14.224966+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:14.224966+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.224966+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:58.359943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593248+0000","last_change":"2024-03-20T13:34:49.962252+0000","last_active":"2024-03-20T13:36:35.593248+0000","last_peered":"2024-03-20T13:36:35.593248+0000","last_clean":"2024-03-20T13:36:35.593248+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:36:35.593248+0000","last_undegraded":"2024-03-20T13:36:35.593248+0000","last_fullsized":"2024-03-20T13:36:35.593248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.453355+0000","last_change":"2024-03-20T13:37:17.453385+0000","last_active":"2024-03-20T13:37:17.453355+0000","last_peered":"2024-03-20T13:37:17.453355+0000","last_clean":"2024-03-20T13:37:17.453355+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:37:17.453355+0000","last_undegraded":"2024-03-20T13:37:17.453355+0000","last_fullsized":"2024-03-20T13:37:17.453355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:17.453269+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:17.453269+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.453269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:35.300810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.549703+0000","last_change":"2024-03-20T13:37:27.549726+0000","last_active":"2024-03-20T13:37:27.549703+0000","last_peered":"2024-03-20T13:37:27.549703+0000","last_clean":"2024-03-20T13:37:27.549703+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:37:27.549703+0000","last_undegraded":"2024-03-20T13:37:27.549703+0000","last_fullsized":"2024-03-20T13:37:27.549703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.549627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.549627+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.549627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:56.355311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.465825+0000","last_change":"2024-03-20T13:37:13.465849+0000","last_active":"2024-03-20T13:37:13.465825+0000","last_peered":"2024-03-20T13:37:13.465825+0000","last_clean":"2024-03-20T13:37:13.465825+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:37:13.465825+0000","last_undegraded":"2024-03-20T13:37:13.465825+0000","last_fullsized":"2024-03-20T13:37:13.465825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.465734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.465734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.465734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:27.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.470748+0000","last_change":"2024-03-20T13:37:10.470774+0000","last_active":"2024-03-20T13:37:10.470748+0000","last_peered":"2024-03-20T13:37:10.470748+0000","last_clean":"2024-03-20T13:37:10.470748+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:37:10.470748+0000","last_undegraded":"2024-03-20T13:37:10.470748+0000","last_fullsized":"2024-03-20T13:37:10.470748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.470658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:47.565070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.807076+0000","last_change":"2024-03-20T13:36:55.807076+0000","last_active":"2024-03-20T13:36:55.807076+0000","last_peered":"2024-03-20T13:36:55.807076+0000","last_clean":"2024-03-20T13:36:55.807076+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:55.807076+0000","last_undegraded":"2024-03-20T13:36:55.807076+0000","last_fullsized":"2024-03-20T13:36:55.807076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.806960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:44.670617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.762037+0000","last_change":"2024-03-20T13:37:27.762086+0000","last_active":"2024-03-20T13:37:27.762037+0000","last_peered":"2024-03-20T13:37:27.762037+0000","last_clean":"2024-03-20T13:37:27.762037+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:37:27.762037+0000","last_undegraded":"2024-03-20T13:37:27.762037+0000","last_fullsized":"2024-03-20T13:37:27.762037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.761939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.761939+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.761939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:07.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.580860+0000","last_change":"2024-03-20T13:37:31.580894+0000","last_active":"2024-03-20T13:37:31.580860+0000","last_peered":"2024-03-20T13:37:31.580860+0000","last_clean":"2024-03-20T13:37:31.580860+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:37:31.580860+0000","last_undegraded":"2024-03-20T13:37:31.580860+0000","last_fullsized":"2024-03-20T13:37:31.580860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:31.580773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:31.580773+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.580773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:15.715751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.232063+0000","last_change":"2024-03-20T13:37:23.232120+0000","last_active":"2024-03-20T13:37:23.232063+0000","last_peered":"2024-03-20T13:37:23.232063+0000","last_clean":"2024-03-20T13:37:23.232063+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:37:23.232063+0000","last_undegraded":"2024-03-20T13:37:23.232063+0000","last_fullsized":"2024-03-20T13:37:23.232063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:23.231964+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:23.231964+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.231964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:34.011833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.770943+0000","last_change":"2024-03-20T13:37:07.770971+0000","last_active":"2024-03-20T13:37:07.770943+0000","last_peered":"2024-03-20T13:37:07.770943+0000","last_clean":"2024-03-20T13:37:07.770943+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:37:07.770943+0000","last_undegraded":"2024-03-20T13:37:07.770943+0000","last_fullsized":"2024-03-20T13:37:07.770943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.770860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:00.706350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.535234+0000","last_change":"2024-03-20T13:37:22.535259+0000","last_active":"2024-03-20T13:37:22.535234+0000","last_peered":"2024-03-20T13:37:22.535234+0000","last_clean":"2024-03-20T13:37:22.535234+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:37:22.535234+0000","last_undegraded":"2024-03-20T13:37:22.535234+0000","last_fullsized":"2024-03-20T13:37:22.535234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.535142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.535142+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.535142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:17:18.418163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.807590+0000","last_change":"2024-03-20T13:37:28.807616+0000","last_active":"2024-03-20T13:37:28.807590+0000","last_peered":"2024-03-20T13:37:28.807590+0000","last_clean":"2024-03-20T13:37:28.807590+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:37:28.807590+0000","last_undegraded":"2024-03-20T13:37:28.807590+0000","last_fullsized":"2024-03-20T13:37:28.807590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.807509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.807509+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.807509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:44.504905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593284+0000","last_change":"2024-03-20T13:34:49.944709+0000","last_active":"2024-03-20T13:36:35.593284+0000","last_peered":"2024-03-20T13:36:35.593284+0000","last_clean":"2024-03-20T13:36:35.593284+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:36:35.593284+0000","last_undegraded":"2024-03-20T13:36:35.593284+0000","last_fullsized":"2024-03-20T13:36:35.593284+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.249034+0000","last_change":"2024-03-20T13:37:10.249034+0000","last_active":"2024-03-20T13:37:10.249034+0000","last_peered":"2024-03-20T13:37:10.249034+0000","last_clean":"2024-03-20T13:37:10.249034+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:37:10.249034+0000","last_undegraded":"2024-03-20T13:37:10.249034+0000","last_fullsized":"2024-03-20T13:37:10.249034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.248909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:39.054592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.543243+0000","last_change":"2024-03-20T13:37:30.543269+0000","last_active":"2024-03-20T13:37:30.543243+0000","last_peered":"2024-03-20T13:37:30.543243+0000","last_clean":"2024-03-20T13:37:30.543243+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:37:30.543243+0000","last_undegraded":"2024-03-20T13:37:30.543243+0000","last_fullsized":"2024-03-20T13:37:30.543243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:30.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:30.543149+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:56.299365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.472298+0000","last_change":"2024-03-20T13:37:09.472360+0000","last_active":"2024-03-20T13:37:09.472298+0000","last_peered":"2024-03-20T13:37:09.472298+0000","last_clean":"2024-03-20T13:37:09.472298+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:37:09.472298+0000","last_undegraded":"2024-03-20T13:37:09.472298+0000","last_fullsized":"2024-03-20T13:37:09.472298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.472199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:56.902554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.779854+0000","last_change":"2024-03-20T13:37:09.779881+0000","last_active":"2024-03-20T13:37:09.779854+0000","last_peered":"2024-03-20T13:37:09.779854+0000","last_clean":"2024-03-20T13:37:09.779854+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:37:09.779854+0000","last_undegraded":"2024-03-20T13:37:09.779854+0000","last_fullsized":"2024-03-20T13:37:09.779854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.779734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:12.306761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.713221+0000","last_change":"2024-03-20T13:37:16.713248+0000","last_active":"2024-03-20T13:37:16.713221+0000","last_peered":"2024-03-20T13:37:16.713221+0000","last_clean":"2024-03-20T13:37:16.713221+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:37:16.713221+0000","last_undegraded":"2024-03-20T13:37:16.713221+0000","last_fullsized":"2024-03-20T13:37:16.713221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:16.713135+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:16.713135+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.713135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:16.625022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.717631+0000","last_change":"2024-03-20T13:37:25.717657+0000","last_active":"2024-03-20T13:37:25.717631+0000","last_peered":"2024-03-20T13:37:25.717631+0000","last_clean":"2024-03-20T13:37:25.717631+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:37:25.717631+0000","last_undegraded":"2024-03-20T13:37:25.717631+0000","last_fullsized":"2024-03-20T13:37:25.717631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:25.717548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:25.717548+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.717548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:32.380417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.698955+0000","last_change":"2024-03-20T13:37:03.698955+0000","last_active":"2024-03-20T13:37:03.698955+0000","last_peered":"2024-03-20T13:37:03.698955+0000","last_clean":"2024-03-20T13:37:03.698955+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:37:03.698955+0000","last_undegraded":"2024-03-20T13:37:03.698955+0000","last_fullsized":"2024-03-20T13:37:03.698955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.698845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:41.623595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593377+0000","last_change":"2024-03-20T13:34:49.955757+0000","last_active":"2024-03-20T13:36:35.593377+0000","last_peered":"2024-03-20T13:36:35.593377+0000","last_clean":"2024-03-20T13:36:35.593377+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:36:35.593377+0000","last_undegraded":"2024-03-20T13:36:35.593377+0000","last_fullsized":"2024-03-20T13:36:35.593377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.838638+0000","last_change":"2024-03-20T13:36:57.838638+0000","last_active":"2024-03-20T13:36:57.838638+0000","last_peered":"2024-03-20T13:36:57.838638+0000","last_clean":"2024-03-20T13:36:57.838638+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:57.838638+0000","last_undegraded":"2024-03-20T13:36:57.838638+0000","last_fullsized":"2024-03-20T13:36:57.838638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.838471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:27.325680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.213067+0000","last_change":"2024-03-20T13:37:23.213109+0000","last_active":"2024-03-20T13:37:23.213067+0000","last_peered":"2024-03-20T13:37:23.213067+0000","last_clean":"2024-03-20T13:37:23.213067+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:37:23.213067+0000","last_undegraded":"2024-03-20T13:37:23.213067+0000","last_fullsized":"2024-03-20T13:37:23.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.212970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.212970+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.212970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:19:18.200331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.259174+0000","last_change":"2024-03-20T13:37:09.259202+0000","last_active":"2024-03-20T13:37:09.259174+0000","last_peered":"2024-03-20T13:37:09.259174+0000","last_clean":"2024-03-20T13:37:09.259174+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:37:09.259174+0000","last_undegraded":"2024-03-20T13:37:09.259174+0000","last_fullsized":"2024-03-20T13:37:09.259174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.259090+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:24.956485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.241472+0000","last_change":"2024-03-20T13:37:13.241520+0000","last_active":"2024-03-20T13:37:13.241472+0000","last_peered":"2024-03-20T13:37:13.241472+0000","last_clean":"2024-03-20T13:37:13.241472+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:37:13.241472+0000","last_undegraded":"2024-03-20T13:37:13.241472+0000","last_fullsized":"2024-03-20T13:37:13.241472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.241356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:38.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.758880+0000","last_change":"2024-03-20T13:37:12.758905+0000","last_active":"2024-03-20T13:37:12.758880+0000","last_peered":"2024-03-20T13:37:12.758880+0000","last_clean":"2024-03-20T13:37:12.758880+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:37:12.758880+0000","last_undegraded":"2024-03-20T13:37:12.758880+0000","last_fullsized":"2024-03-20T13:37:12.758880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.758780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:41.146374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593286+0000","last_change":"2024-03-20T13:34:49.961552+0000","last_active":"2024-03-20T13:36:35.593286+0000","last_peered":"2024-03-20T13:36:35.593286+0000","last_clean":"2024-03-20T13:36:35.593286+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:36:35.593286+0000","last_undegraded":"2024-03-20T13:36:35.593286+0000","last_fullsized":"2024-03-20T13:36:35.593286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593372+0000","last_change":"2024-03-20T13:34:49.944428+0000","last_active":"2024-03-20T13:36:35.593372+0000","last_peered":"2024-03-20T13:36:35.593372+0000","last_clean":"2024-03-20T13:36:35.593372+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:36:35.593372+0000","last_undegraded":"2024-03-20T13:36:35.593372+0000","last_fullsized":"2024-03-20T13:36:35.593372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:48.910932+0000","last_clean_scrub_stamp":"2024-03-20T13:34:48.910932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.431612+0000","last_change":"2024-03-20T13:37:06.431612+0000","last_active":"2024-03-20T13:37:06.431612+0000","last_peered":"2024-03-20T13:37:06.431612+0000","last_clean":"2024-03-20T13:37:06.431612+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:37:06.431612+0000","last_undegraded":"2024-03-20T13:37:06.431612+0000","last_fullsized":"2024-03-20T13:37:06.431612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.431483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:44.278362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.426490+0000","last_change":"2024-03-20T13:37:14.426517+0000","last_active":"2024-03-20T13:37:14.426490+0000","last_peered":"2024-03-20T13:37:14.426490+0000","last_clean":"2024-03-20T13:37:14.426490+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:37:14.426490+0000","last_undegraded":"2024-03-20T13:37:14.426490+0000","last_fullsized":"2024-03-20T13:37:14.426490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:14.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:14.426401+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:48.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.765626+0000","last_change":"2024-03-20T13:37:10.765626+0000","last_active":"2024-03-20T13:37:10.765626+0000","last_peered":"2024-03-20T13:37:10.765626+0000","last_clean":"2024-03-20T13:37:10.765626+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:37:10.765626+0000","last_undegraded":"2024-03-20T13:37:10.765626+0000","last_fullsized":"2024-03-20T13:37:10.765626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.765500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:58.195856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1417,"ondisk_log_size":1417,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673001,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.45400000000000001,"15min":0.46200000000000002},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.53500000000000003,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.41999999999999998,"15min":0.41799999999999998},"min":{"1min":0.30399999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"last":1.343}]},{"osd":1,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.32000000000000001,"15min":0.32100000000000001},"min":{"1min":0.25,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.37,"5min":0.45500000000000002,"15min":0.45500000000000002},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.31900000000000001,"15min":0.32400000000000001},"min":{"1min":0.20300000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.40000000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.23200000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:36:37 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.32900000000000001,"15min":0.33100000000000002},"min":{"1min":0.26600000000000001,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.42699999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.253},{"interface":"front","average":{"1min":0.318,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.39600000000000002,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.308}]}]},{"osd":1,"up_from":10,"seq":42949673000,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.44500000000000001,"15min":0.42699999999999999},"min":{"1min":0.317,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":1.228,"5min":1.228,"15min":1.228},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.47899999999999998,"15min":0.47099999999999997},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.442}]},{"osd":2,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.311,"15min":0.31},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42999999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.33800000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.496,"5min":0.496,"15min":0.496},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Mar 20 13:36:36 2024","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.45600000000000002,"5min":0.502,"15min":0.502},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.33600000000000002,"15min":0.33500000000000002},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.51600000000000001,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.34899999999999998}]}]},{"osd":3,"up_from":9,"seq":38654705702,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:36:34 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.47999999999999998,"15min":0.48799999999999999},"min":{"1min":0.28199999999999997,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45800000000000002,"5min":0.503,"15min":0.51100000000000001},"min":{"1min":0.316,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":1.3160000000000001}]},{"osd":1,"last update":"Wed Mar 20 13:36:39 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.312,"15min":0.311},"min":{"1min":0.22600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.222},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.317,"15min":0.32000000000000001},"min":{"1min":0.20899999999999999,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.42999999999999999,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.26100000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:36:39 2024","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.47399999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.33500000000000002,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.246,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.45600000000000002,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.28399999999999997}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.58799999999999997,"15min":0.59399999999999997},"min":{"1min":0.33500000000000002,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.198,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.58299999999999996,"15min":0.58699999999999997},"min":{"1min":0.35799999999999998,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed Mar 20 13:36:41 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.52400000000000002,"15min":0.52200000000000002},"min":{"1min":0.314,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.51000000000000001,"15min":0.51400000000000001},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.28699999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:36:38 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":1.593,"5min":1.593,"15min":1.593},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.502,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.32200000000000001,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.2410000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.30199999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:37:37.104 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-03-20T13:34:50.918271+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=50, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.104 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.104 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.104 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.105 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.105 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.105 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.106 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.106 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.107 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.107 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.107 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.107 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.108 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.109 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.110 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.110 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-03-20T13:34:40.892081+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=40, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.110 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.111 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.111 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.111 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.111 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.112 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.112 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.112 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.113 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.113 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.113 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.113 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.114 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.114 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.114 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-03-20T13:34:48.910932+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=48, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:37.114 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:37:57.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:37:57.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3cd2ff6640 1 Processor -- start 2024-03-20T13:37:57.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3cd2ff6640 1 -- start start 2024-03-20T13:37:57.237 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3cd2ff6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ccc06cd10 0x7f3ccc06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3cd2ff6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ccc067090 con 0x7f3ccc06d630 2024-03-20T13:37:57.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3cd2ff6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ccc070ca0 con 0x7f3ccc06cd10 2024-03-20T13:37:57.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3cd0d92640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ccc06cd10 0x7f3ccc06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.238 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3ccbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3ccc06d630 0x7f3ccc0960b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:38422/0 (socket says 172.21.15.28:38422) 2024-03-20T13:37:57.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.228+0000 7f3ccbfff640 1 -- 172.21.15.28:0/3503304867 learned_addr learned my addr 172.21.15.28:0/3503304867 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:37:57.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.229+0000 7f3ccb7fe640 1 -- 172.21.15.28:0/3503304867 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2234582790 0 0) 0x7f3ccc067090 con 0x7f3ccc06d630 2024-03-20T13:37:57.239 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.229+0000 7f3ccb7fe640 1 -- 172.21.15.28:0/3503304867 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3cbc003520 con 0x7f3ccc06d630 2024-03-20T13:37:57.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.229+0000 7f3cd0d92640 1 -- 172.21.15.28:0/3503304867 >> v1:172.21.15.28:6789/0 conn(0x7f3ccc06d630 legacy=0x7f3ccc0960b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.229+0000 7f3cd0d92640 1 -- 172.21.15.28:0/3503304867 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ccc070670 con 0x7f3ccc06cd10 2024-03-20T13:37:57.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.229+0000 7f3cd0d92640 1 --2- 172.21.15.28:0/3503304867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06d0f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009720 tx=0x7f3cc002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4390e2d6abf6a168 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.240 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3ccb7fe640 1 -- 172.21.15.28:0/3503304867 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc002e070 con 0x7f3ccc06cd10 2024-03-20T13:37:57.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3ccb7fe640 1 -- 172.21.15.28:0/3503304867 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00316d0 con 0x7f3ccc06cd10 2024-03-20T13:37:57.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3ccb7fe640 1 -- 172.21.15.28:0/3503304867 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0031970 con 0x7f3ccc06cd10 2024-03-20T13:37:57.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3503304867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 msgr2=0x7f3ccc06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 --2- 172.21.15.28:0/3503304867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06d0f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f3cc0009720 tx=0x7f3cc002b840 comp rx=0 tx=0).stop 2024-03-20T13:37:57.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3503304867 shutdown_connections 2024-03-20T13:37:57.241 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 --2- 172.21.15.28:0/3503304867 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06d0f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3503304867 >> 172.21.15.28:0/3503304867 conn(0x7f3ccc0974b0 msgr2=0x7f3ccc0978c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:57.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3503304867 shutdown_connections 2024-03-20T13:37:57.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.230+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3503304867 wait complete. 2024-03-20T13:37:57.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.231+0000 7f3cd2ff6640 1 Processor -- start 2024-03-20T13:37:57.242 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.231+0000 7f3cd2ff6640 1 -- start start 2024-03-20T13:37:57.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.231+0000 7f3cd2ff6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd2ff6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ccc1263a0 con 0x7f3ccc06cd10 2024-03-20T13:37:57.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd0d92640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd0d92640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35842/0 (socket says 172.21.15.28:35842) 2024-03-20T13:37:57.243 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd0d92640 1 -- 172.21.15.28:0/3733749163 learned_addr learned my addr 172.21.15.28:0/3733749163 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:37:57.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd0d92640 1 -- 172.21.15.28:0/3733749163 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cc0009400 con 0x7f3ccc06cd10 2024-03-20T13:37:57.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd0d92640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06de60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3cc002b880 tx=0x7f3cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0032770 con 0x7f3ccc06cd10 2024-03-20T13:37:57.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cc00328d0 con 0x7f3ccc06cd10 2024-03-20T13:37:57.244 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3cc0032b90 con 0x7f3ccc06cd10 2024-03-20T13:37:57.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ccc06fc40 con 0x7f3ccc06cd10 2024-03-20T13:37:57.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.232+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ccc126a30 con 0x7f3ccc06cd10 2024-03-20T13:37:57.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.233+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3cc0032d40 con 0x7f3ccc06cd10 2024-03-20T13:37:57.245 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.233+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ccc126180 con 0x7f3ccc06cd10 2024-03-20T13:37:57.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.234+0000 7f3cc97fa640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3cb0037ed0 0x7f3cb003a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:37:57.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.234+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f3cc006d1b0 con 0x7f3ccc06cd10 2024-03-20T13:37:57.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.234+0000 7f3ccbfff640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3cb0037ed0 0x7f3cb003a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:37:57.246 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.234+0000 7f3ccbfff640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3cb0037ed0 0x7f3cb003a390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8001610 tx=0x7f3cb8007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:37:57.247 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.238+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3cc0030700 con 0x7f3ccc06cd10 2024-03-20T13:37:57.415 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.414+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3ccc095fd0 con 0x7f3cb0037ed0 2024-03-20T13:37:57.430 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.429+0000 7f3cc97fa640 1 -- 172.21.15.28:0/3733749163 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673546 (secure 0 0 0) 0x7f3ccc095fd0 con 0x7f3cb0037ed0 2024-03-20T13:37:57.439 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:37:57.445 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:37:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3cb0037ed0 msgr2=0x7f3cb003a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3cb0037ed0 0x7f3cb003a390 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3cb8001610 tx=0x7f3cb8007970 comp rx=0 tx=0).stop 2024-03-20T13:37:57.448 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 msgr2=0x7f3ccc06de60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06de60 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f3cc002b880 tx=0x7f3cc00046c0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 shutdown_connections 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3cb0037ed0 0x7f3cb003a390 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 --2- 172.21.15.28:0/3733749163 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ccc06cd10 0x7f3ccc06de60 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 >> 172.21.15.28:0/3733749163 conn(0x7f3ccc0974b0 msgr2=0x7f3ccc09a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 shutdown_connections 2024-03-20T13:37:57.449 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:37:57.434+0000 7f3cd2ff6640 1 -- 172.21.15.28:0/3733749163 wait complete. 2024-03-20T13:37:57.450 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2024-03-20T13:37:57.199720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4002,"num_read_kb":3648,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004445"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.273131+0000","last_change":"2024-03-20T13:37:21.273157+0000","last_active":"2024-03-20T13:37:21.273131+0000","last_peered":"2024-03-20T13:37:21.273131+0000","last_clean":"2024-03-20T13:37:21.273131+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:37:21.273131+0000","last_undegraded":"2024-03-20T13:37:21.273131+0000","last_fullsized":"2024-03-20T13:37:21.273131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:21.273041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:21.273041+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.273041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:23.800069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.734610+0000","last_change":"2024-03-20T13:37:00.734610+0000","last_active":"2024-03-20T13:37:00.734610+0000","last_peered":"2024-03-20T13:37:00.734610+0000","last_clean":"2024-03-20T13:37:00.734610+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:37:00.734610+0000","last_undegraded":"2024-03-20T13:37:00.734610+0000","last_fullsized":"2024-03-20T13:37:00.734610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.734488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:43.356373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.547724+0000","last_change":"2024-03-20T13:37:26.547753+0000","last_active":"2024-03-20T13:37:26.547724+0000","last_peered":"2024-03-20T13:37:26.547724+0000","last_clean":"2024-03-20T13:37:26.547724+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:37:26.547724+0000","last_undegraded":"2024-03-20T13:37:26.547724+0000","last_fullsized":"2024-03-20T13:37:26.547724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:26.547630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:26.547630+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.547630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:42.245026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:38.533959+0000","last_change":"2024-03-20T13:37:38.533984+0000","last_active":"2024-03-20T13:37:38.533959+0000","last_peered":"2024-03-20T13:37:38.533959+0000","last_clean":"2024-03-20T13:37:38.533959+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:37:38.533959+0000","last_undegraded":"2024-03-20T13:37:38.533959+0000","last_fullsized":"2024-03-20T13:37:38.533959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:38.533844+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:38.533844+0000","last_clean_scrub_stamp":"2024-03-20T13:37:38.533844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:50:15.716001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:38.198030+0000","last_change":"2024-03-20T13:37:38.198058+0000","last_active":"2024-03-20T13:37:38.198030+0000","last_peered":"2024-03-20T13:37:38.198030+0000","last_clean":"2024-03-20T13:37:38.198030+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:37:38.198030+0000","last_undegraded":"2024-03-20T13:37:38.198030+0000","last_fullsized":"2024-03-20T13:37:38.198030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:38.197941+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:38.197941+0000","last_clean_scrub_stamp":"2024-03-20T13:37:38.197941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:29.071340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.198759+0000","last_change":"2024-03-20T13:37:13.198759+0000","last_active":"2024-03-20T13:37:13.198759+0000","last_peered":"2024-03-20T13:37:13.198759+0000","last_clean":"2024-03-20T13:37:13.198759+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:37:13.198759+0000","last_undegraded":"2024-03-20T13:37:13.198759+0000","last_fullsized":"2024-03-20T13:37:13.198759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.198622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:38.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.216682+0000","last_change":"2024-03-20T13:37:07.216726+0000","last_active":"2024-03-20T13:37:07.216682+0000","last_peered":"2024-03-20T13:37:07.216682+0000","last_clean":"2024-03-20T13:37:07.216682+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:37:07.216682+0000","last_undegraded":"2024-03-20T13:37:07.216682+0000","last_fullsized":"2024-03-20T13:37:07.216682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.216575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:56.080233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.266532+0000","last_change":"2024-03-20T13:37:31.266558+0000","last_active":"2024-03-20T13:37:31.266532+0000","last_peered":"2024-03-20T13:37:31.266532+0000","last_clean":"2024-03-20T13:37:31.266532+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:37:31.266532+0000","last_undegraded":"2024-03-20T13:37:31.266532+0000","last_fullsized":"2024-03-20T13:37:31.266532+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:31.266427+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:31.266427+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.266427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:33:00.988878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.149754+0000","last_change":"2024-03-20T13:37:29.149781+0000","last_active":"2024-03-20T13:37:29.149754+0000","last_peered":"2024-03-20T13:37:29.149754+0000","last_clean":"2024-03-20T13:37:29.149754+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:37:29.149754+0000","last_undegraded":"2024-03-20T13:37:29.149754+0000","last_fullsized":"2024-03-20T13:37:29.149754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:29.149651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:29.149651+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.149651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:32.566590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.711944+0000","last_change":"2024-03-20T13:37:14.711972+0000","last_active":"2024-03-20T13:37:14.711944+0000","last_peered":"2024-03-20T13:37:14.711944+0000","last_clean":"2024-03-20T13:37:14.711944+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:37:14.711944+0000","last_undegraded":"2024-03-20T13:37:14.711944+0000","last_fullsized":"2024-03-20T13:37:14.711944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:14.711857+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:14.711857+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.711857+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:41.121171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.176263+0000","last_change":"2024-03-20T13:37:05.176263+0000","last_active":"2024-03-20T13:37:05.176263+0000","last_peered":"2024-03-20T13:37:05.176263+0000","last_clean":"2024-03-20T13:37:05.176263+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:37:05.176263+0000","last_undegraded":"2024-03-20T13:37:05.176263+0000","last_fullsized":"2024-03-20T13:37:05.176263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.176117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:22:03.690315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.278090+0000","last_change":"2024-03-20T13:37:07.278147+0000","last_active":"2024-03-20T13:37:07.278090+0000","last_peered":"2024-03-20T13:37:07.278090+0000","last_clean":"2024-03-20T13:37:07.278090+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:37:07.278090+0000","last_undegraded":"2024-03-20T13:37:07.278090+0000","last_fullsized":"2024-03-20T13:37:07.278090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.277994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:07.944110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:41.220861+0000","last_change":"2024-03-20T13:37:41.220893+0000","last_active":"2024-03-20T13:37:41.220861+0000","last_peered":"2024-03-20T13:37:41.220861+0000","last_clean":"2024-03-20T13:37:41.220861+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:37:41.220861+0000","last_undegraded":"2024-03-20T13:37:41.220861+0000","last_fullsized":"2024-03-20T13:37:41.220861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:41.220727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:41.220727+0000","last_clean_scrub_stamp":"2024-03-20T13:37:41.220727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:37.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.168771+0000","last_change":"2024-03-20T13:36:59.168771+0000","last_active":"2024-03-20T13:36:59.168771+0000","last_peered":"2024-03-20T13:36:59.168771+0000","last_clean":"2024-03-20T13:36:59.168771+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:59.168771+0000","last_undegraded":"2024-03-20T13:36:59.168771+0000","last_fullsized":"2024-03-20T13:36:59.168771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.168659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:29.587352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.461791+0000","last_change":"2024-03-20T13:37:16.461791+0000","last_active":"2024-03-20T13:37:16.461791+0000","last_peered":"2024-03-20T13:37:16.461791+0000","last_clean":"2024-03-20T13:37:16.461791+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:37:16.461791+0000","last_undegraded":"2024-03-20T13:37:16.461791+0000","last_fullsized":"2024-03-20T13:37:16.461791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.461652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.461652+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.461652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:56.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.245850+0000","last_change":"2024-03-20T13:37:24.245894+0000","last_active":"2024-03-20T13:37:24.245850+0000","last_peered":"2024-03-20T13:37:24.245850+0000","last_clean":"2024-03-20T13:37:24.245850+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:37:24.245850+0000","last_undegraded":"2024-03-20T13:37:24.245850+0000","last_fullsized":"2024-03-20T13:37:24.245850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:24.245736+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:24.245736+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.245736+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:52.633330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.256576+0000","last_change":"2024-03-20T13:37:11.256576+0000","last_active":"2024-03-20T13:37:11.256576+0000","last_peered":"2024-03-20T13:37:11.256576+0000","last_clean":"2024-03-20T13:37:11.256576+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:37:11.256576+0000","last_undegraded":"2024-03-20T13:37:11.256576+0000","last_fullsized":"2024-03-20T13:37:11.256576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.256453+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:24.080007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.729110+0000","last_change":"2024-03-20T13:37:26.729154+0000","last_active":"2024-03-20T13:37:26.729110+0000","last_peered":"2024-03-20T13:37:26.729110+0000","last_clean":"2024-03-20T13:37:26.729110+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:37:26.729110+0000","last_undegraded":"2024-03-20T13:37:26.729110+0000","last_fullsized":"2024-03-20T13:37:26.729110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:26.729021+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:26.729021+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.729021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:27.395137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.780265+0000","last_change":"2024-03-20T13:36:59.780265+0000","last_active":"2024-03-20T13:36:59.780265+0000","last_peered":"2024-03-20T13:36:59.780265+0000","last_clean":"2024-03-20T13:36:59.780265+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:59.780265+0000","last_undegraded":"2024-03-20T13:36:59.780265+0000","last_fullsized":"2024-03-20T13:36:59.780265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.780140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:43.003558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.218269+0000","last_change":"2024-03-20T13:37:11.218269+0000","last_active":"2024-03-20T13:37:11.218269+0000","last_peered":"2024-03-20T13:37:11.218269+0000","last_clean":"2024-03-20T13:37:11.218269+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:37:11.218269+0000","last_undegraded":"2024-03-20T13:37:11.218269+0000","last_fullsized":"2024-03-20T13:37:11.218269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.218156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:54.441574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.671523+0000","last_change":"2024-03-20T13:37:18.671551+0000","last_active":"2024-03-20T13:37:18.671523+0000","last_peered":"2024-03-20T13:37:18.671523+0000","last_clean":"2024-03-20T13:37:18.671523+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:37:18.671523+0000","last_undegraded":"2024-03-20T13:37:18.671523+0000","last_fullsized":"2024-03-20T13:37:18.671523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:18.671437+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:18.671437+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.671437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:36.640507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.684833+0000","last_change":"2024-03-20T13:37:17.684875+0000","last_active":"2024-03-20T13:37:17.684833+0000","last_peered":"2024-03-20T13:37:17.684833+0000","last_clean":"2024-03-20T13:37:17.684833+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:37:17.684833+0000","last_undegraded":"2024-03-20T13:37:17.684833+0000","last_fullsized":"2024-03-20T13:37:17.684833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:17.684738+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:17.684738+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.684738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:33.915049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.437229+0000","last_change":"2024-03-20T13:37:15.437229+0000","last_active":"2024-03-20T13:37:15.437229+0000","last_peered":"2024-03-20T13:37:15.437229+0000","last_clean":"2024-03-20T13:37:15.437229+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:37:15.437229+0000","last_undegraded":"2024-03-20T13:37:15.437229+0000","last_fullsized":"2024-03-20T13:37:15.437229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:15.437078+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:15.437078+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.437078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:15.348966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.725707+0000","last_change":"2024-03-20T13:37:11.725707+0000","last_active":"2024-03-20T13:37:11.725707+0000","last_peered":"2024-03-20T13:37:11.725707+0000","last_clean":"2024-03-20T13:37:11.725707+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:37:11.725707+0000","last_undegraded":"2024-03-20T13:37:11.725707+0000","last_fullsized":"2024-03-20T13:37:11.725707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.725594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:22.505463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.174785+0000","last_change":"2024-03-20T13:37:06.174785+0000","last_active":"2024-03-20T13:37:06.174785+0000","last_peered":"2024-03-20T13:37:06.174785+0000","last_clean":"2024-03-20T13:37:06.174785+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:37:06.174785+0000","last_undegraded":"2024-03-20T13:37:06.174785+0000","last_fullsized":"2024-03-20T13:37:06.174785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.174669+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:35.706277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.509348+0000","last_change":"2024-03-20T13:37:20.509376+0000","last_active":"2024-03-20T13:37:20.509348+0000","last_peered":"2024-03-20T13:37:20.509348+0000","last_clean":"2024-03-20T13:37:20.509348+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:37:20.509348+0000","last_undegraded":"2024-03-20T13:37:20.509348+0000","last_fullsized":"2024-03-20T13:37:20.509348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:20.509258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:20.509258+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.509258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:54.696170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.750652+0000","last_change":"2024-03-20T13:37:01.750652+0000","last_active":"2024-03-20T13:37:01.750652+0000","last_peered":"2024-03-20T13:37:01.750652+0000","last_clean":"2024-03-20T13:37:01.750652+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:37:01.750652+0000","last_undegraded":"2024-03-20T13:37:01.750652+0000","last_fullsized":"2024-03-20T13:37:01.750652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.750537+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:27.000513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.227968+0000","last_change":"2024-03-20T13:37:26.227994+0000","last_active":"2024-03-20T13:37:26.227968+0000","last_peered":"2024-03-20T13:37:26.227968+0000","last_clean":"2024-03-20T13:37:26.227968+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:37:26.227968+0000","last_undegraded":"2024-03-20T13:37:26.227968+0000","last_fullsized":"2024-03-20T13:37:26.227968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:26.227867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:26.227867+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.227867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:15.426533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:35.783932+0000","last_change":"2024-03-20T13:37:35.783959+0000","last_active":"2024-03-20T13:37:35.783932+0000","last_peered":"2024-03-20T13:37:35.783932+0000","last_clean":"2024-03-20T13:37:35.783932+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:37:35.783932+0000","last_undegraded":"2024-03-20T13:37:35.783932+0000","last_fullsized":"2024-03-20T13:37:35.783932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-20T13:37:35.783852+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-20T13:37:35.783852+0000","last_clean_scrub_stamp":"2024-03-20T13:37:35.783852+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:23.310016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.312980+0000","last_change":"2024-03-20T13:37:30.312980+0000","last_active":"2024-03-20T13:37:30.312980+0000","last_peered":"2024-03-20T13:37:30.312980+0000","last_clean":"2024-03-20T13:37:30.312980+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:37:30.312980+0000","last_undegraded":"2024-03-20T13:37:30.312980+0000","last_fullsized":"2024-03-20T13:37:30.312980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:30.312873+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:30.312873+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.312873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:48.281943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.194714+0000","last_change":"2024-03-20T13:37:27.194741+0000","last_active":"2024-03-20T13:37:27.194714+0000","last_peered":"2024-03-20T13:37:27.194714+0000","last_clean":"2024-03-20T13:37:27.194714+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:37:27.194714+0000","last_undegraded":"2024-03-20T13:37:27.194714+0000","last_fullsized":"2024-03-20T13:37:27.194714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.194628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.194628+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.194628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:19:59.581273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.127878+0000","last_change":"2024-03-20T13:36:41.127878+0000","last_active":"2024-03-20T13:36:41.127878+0000","last_peered":"2024-03-20T13:36:41.127878+0000","last_clean":"2024-03-20T13:36:41.127878+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:36:41.127878+0000","last_undegraded":"2024-03-20T13:36:41.127878+0000","last_fullsized":"2024-03-20T13:36:41.127878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.127679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:24.954726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.230716+0000","last_change":"2024-03-20T13:37:03.230716+0000","last_active":"2024-03-20T13:37:03.230716+0000","last_peered":"2024-03-20T13:37:03.230716+0000","last_clean":"2024-03-20T13:37:03.230716+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:37:03.230716+0000","last_undegraded":"2024-03-20T13:37:03.230716+0000","last_fullsized":"2024-03-20T13:37:03.230716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.230582+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:19.216621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.930574+0000","last_change":"2024-03-20T13:36:50.930574+0000","last_active":"2024-03-20T13:36:50.930574+0000","last_peered":"2024-03-20T13:36:50.930574+0000","last_clean":"2024-03-20T13:36:50.930574+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:36:50.930574+0000","last_undegraded":"2024-03-20T13:36:50.930574+0000","last_fullsized":"2024-03-20T13:36:50.930574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.930463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:21.352868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.746110+0000","last_change":"2024-03-20T13:37:30.746158+0000","last_active":"2024-03-20T13:37:30.746110+0000","last_peered":"2024-03-20T13:37:30.746110+0000","last_clean":"2024-03-20T13:37:30.746110+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:37:30.746110+0000","last_undegraded":"2024-03-20T13:37:30.746110+0000","last_fullsized":"2024-03-20T13:37:30.746110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:30.746014+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:30.746014+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.746014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:43.569568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.243276+0000","last_change":"2024-03-20T13:37:18.243303+0000","last_active":"2024-03-20T13:37:18.243276+0000","last_peered":"2024-03-20T13:37:18.243276+0000","last_clean":"2024-03-20T13:37:18.243276+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:37:18.243276+0000","last_undegraded":"2024-03-20T13:37:18.243276+0000","last_fullsized":"2024-03-20T13:37:18.243276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:18.243199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:18.243199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.243199+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:48.434148+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.247358+0000","last_change":"2024-03-20T13:37:03.247358+0000","last_active":"2024-03-20T13:37:03.247358+0000","last_peered":"2024-03-20T13:37:03.247358+0000","last_clean":"2024-03-20T13:37:03.247358+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:37:03.247358+0000","last_undegraded":"2024-03-20T13:37:03.247358+0000","last_fullsized":"2024-03-20T13:37:03.247358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.247246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:31.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.442856+0000","last_change":"2024-03-20T13:36:50.442856+0000","last_active":"2024-03-20T13:36:50.442856+0000","last_peered":"2024-03-20T13:36:50.442856+0000","last_clean":"2024-03-20T13:36:50.442856+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:36:50.442856+0000","last_undegraded":"2024-03-20T13:36:50.442856+0000","last_fullsized":"2024-03-20T13:36:50.442856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.442744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:21.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.832911+0000","last_change":"2024-03-20T13:36:36.832911+0000","last_active":"2024-03-20T13:36:36.832911+0000","last_peered":"2024-03-20T13:36:36.832911+0000","last_clean":"2024-03-20T13:36:36.832911+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:36:36.832911+0000","last_undegraded":"2024-03-20T13:36:36.832911+0000","last_fullsized":"2024-03-20T13:36:36.832911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.832759+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:49.042157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.814020+0000","last_change":"2024-03-20T13:36:58.814020+0000","last_active":"2024-03-20T13:36:58.814020+0000","last_peered":"2024-03-20T13:36:58.814020+0000","last_clean":"2024-03-20T13:36:58.814020+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:36:58.814020+0000","last_undegraded":"2024-03-20T13:36:58.814020+0000","last_fullsized":"2024-03-20T13:36:58.814020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.813903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:48.477979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:35.556856+0000","last_change":"2024-03-20T13:37:35.556909+0000","last_active":"2024-03-20T13:37:35.556856+0000","last_peered":"2024-03-20T13:37:35.556856+0000","last_clean":"2024-03-20T13:37:35.556856+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:37:35.556856+0000","last_undegraded":"2024-03-20T13:37:35.556856+0000","last_fullsized":"2024-03-20T13:37:35.556856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:35.556772+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:35.556772+0000","last_clean_scrub_stamp":"2024-03-20T13:37:35.556772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:59:05.747721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.154069+0000","last_change":"2024-03-20T13:37:21.154094+0000","last_active":"2024-03-20T13:37:21.154069+0000","last_peered":"2024-03-20T13:37:21.154069+0000","last_clean":"2024-03-20T13:37:21.154069+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:37:21.154069+0000","last_undegraded":"2024-03-20T13:37:21.154069+0000","last_fullsized":"2024-03-20T13:37:21.154069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:21.153982+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:21.153982+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.153982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:49:58.336139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.171553+0000","last_change":"2024-03-20T13:37:28.171579+0000","last_active":"2024-03-20T13:37:28.171553+0000","last_peered":"2024-03-20T13:37:28.171553+0000","last_clean":"2024-03-20T13:37:28.171553+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:37:28.171553+0000","last_undegraded":"2024-03-20T13:37:28.171553+0000","last_fullsized":"2024-03-20T13:37:28.171553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.171464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.171464+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.171464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:08:43.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.419261+0000","last_change":"2024-03-20T13:36:51.419261+0000","last_active":"2024-03-20T13:36:51.419261+0000","last_peered":"2024-03-20T13:36:51.419261+0000","last_clean":"2024-03-20T13:36:51.419261+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:36:51.419261+0000","last_undegraded":"2024-03-20T13:36:51.419261+0000","last_fullsized":"2024-03-20T13:36:51.419261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.419143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:49.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.226186+0000","last_change":"2024-03-20T13:36:49.226186+0000","last_active":"2024-03-20T13:36:49.226186+0000","last_peered":"2024-03-20T13:36:49.226186+0000","last_clean":"2024-03-20T13:36:49.226186+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:36:49.226186+0000","last_undegraded":"2024-03-20T13:36:49.226186+0000","last_fullsized":"2024-03-20T13:36:49.226186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.226058+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:05.000426+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.289581+0000","last_change":"2024-03-20T13:37:08.289581+0000","last_active":"2024-03-20T13:37:08.289581+0000","last_peered":"2024-03-20T13:37:08.289581+0000","last_clean":"2024-03-20T13:37:08.289581+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:37:08.289581+0000","last_undegraded":"2024-03-20T13:37:08.289581+0000","last_fullsized":"2024-03-20T13:37:08.289581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.289461+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:24:47.727403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.208783+0000","last_change":"2024-03-20T13:36:46.208783+0000","last_active":"2024-03-20T13:36:46.208783+0000","last_peered":"2024-03-20T13:36:46.208783+0000","last_clean":"2024-03-20T13:36:46.208783+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:36:46.208783+0000","last_undegraded":"2024-03-20T13:36:46.208783+0000","last_fullsized":"2024-03-20T13:36:46.208783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.208641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:45.085668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.498473+0000","last_change":"2024-03-20T13:37:02.498473+0000","last_active":"2024-03-20T13:37:02.498473+0000","last_peered":"2024-03-20T13:37:02.498473+0000","last_clean":"2024-03-20T13:37:02.498473+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:37:02.498473+0000","last_undegraded":"2024-03-20T13:37:02.498473+0000","last_fullsized":"2024-03-20T13:37:02.498473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.498327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:43.010962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.714650+0000","last_change":"2024-03-20T13:37:24.714673+0000","last_active":"2024-03-20T13:37:24.714650+0000","last_peered":"2024-03-20T13:37:24.714650+0000","last_clean":"2024-03-20T13:37:24.714650+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:37:24.714650+0000","last_undegraded":"2024-03-20T13:37:24.714650+0000","last_fullsized":"2024-03-20T13:37:24.714650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:24.714562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:24.714562+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.714562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:10.053361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.164527+0000","last_change":"2024-03-20T13:36:47.164527+0000","last_active":"2024-03-20T13:36:47.164527+0000","last_peered":"2024-03-20T13:36:47.164527+0000","last_clean":"2024-03-20T13:36:47.164527+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:36:47.164527+0000","last_undegraded":"2024-03-20T13:36:47.164527+0000","last_fullsized":"2024-03-20T13:36:47.164527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.164416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:15.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.124403+0000","last_change":"2024-03-20T13:36:44.124403+0000","last_active":"2024-03-20T13:36:44.124403+0000","last_peered":"2024-03-20T13:36:44.124403+0000","last_clean":"2024-03-20T13:36:44.124403+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:44.124403+0000","last_undegraded":"2024-03-20T13:36:44.124403+0000","last_fullsized":"2024-03-20T13:36:44.124403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.124221+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:07.675114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.427157+0000","last_change":"2024-03-20T13:36:49.427157+0000","last_active":"2024-03-20T13:36:49.427157+0000","last_peered":"2024-03-20T13:36:49.427157+0000","last_clean":"2024-03-20T13:36:49.427157+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:49.427157+0000","last_undegraded":"2024-03-20T13:36:49.427157+0000","last_fullsized":"2024-03-20T13:36:49.427157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.427037+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:05:56.566896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.240751+0000","last_change":"2024-03-20T13:37:06.240821+0000","last_active":"2024-03-20T13:37:06.240751+0000","last_peered":"2024-03-20T13:37:06.240751+0000","last_clean":"2024-03-20T13:37:06.240751+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:37:06.240751+0000","last_undegraded":"2024-03-20T13:37:06.240751+0000","last_fullsized":"2024-03-20T13:37:06.240751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.240654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:12.903523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.251632+0000","last_change":"2024-03-20T13:37:20.251666+0000","last_active":"2024-03-20T13:37:20.251632+0000","last_peered":"2024-03-20T13:37:20.251632+0000","last_clean":"2024-03-20T13:37:20.251632+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:37:20.251632+0000","last_undegraded":"2024-03-20T13:37:20.251632+0000","last_fullsized":"2024-03-20T13:37:20.251632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:20.251541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:20.251541+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.251541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:53.391499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.819999+0000","last_change":"2024-03-20T13:36:43.819999+0000","last_active":"2024-03-20T13:36:43.819999+0000","last_peered":"2024-03-20T13:36:43.819999+0000","last_clean":"2024-03-20T13:36:43.819999+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:36:43.819999+0000","last_undegraded":"2024-03-20T13:36:43.819999+0000","last_fullsized":"2024-03-20T13:36:43.819999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.819876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:18.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.190487+0000","last_change":"2024-03-20T13:36:48.190487+0000","last_active":"2024-03-20T13:36:48.190487+0000","last_peered":"2024-03-20T13:36:48.190487+0000","last_clean":"2024-03-20T13:36:48.190487+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:48.190487+0000","last_undegraded":"2024-03-20T13:36:48.190487+0000","last_fullsized":"2024-03-20T13:36:48.190487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.190343+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:33:34.104031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.451320+0000","last_change":"2024-03-20T13:36:41.451320+0000","last_active":"2024-03-20T13:36:41.451320+0000","last_peered":"2024-03-20T13:36:41.451320+0000","last_clean":"2024-03-20T13:36:41.451320+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:36:41.451320+0000","last_undegraded":"2024-03-20T13:36:41.451320+0000","last_fullsized":"2024-03-20T13:36:41.451320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.451207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:01.674365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.271317+0000","last_change":"2024-03-20T13:37:25.271359+0000","last_active":"2024-03-20T13:37:25.271317+0000","last_peered":"2024-03-20T13:37:25.271317+0000","last_clean":"2024-03-20T13:37:25.271317+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:37:25.271317+0000","last_undegraded":"2024-03-20T13:37:25.271317+0000","last_fullsized":"2024-03-20T13:37:25.271317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:37:25.271197+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:37:25.271197+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.271197+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:55.667460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.706447+0000","last_change":"2024-03-20T13:37:04.706474+0000","last_active":"2024-03-20T13:37:04.706447+0000","last_peered":"2024-03-20T13:37:04.706447+0000","last_clean":"2024-03-20T13:37:04.706447+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:37:04.706447+0000","last_undegraded":"2024-03-20T13:37:04.706447+0000","last_fullsized":"2024-03-20T13:37:04.706447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.706331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:10.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.258412+0000","last_change":"2024-03-20T13:37:19.258440+0000","last_active":"2024-03-20T13:37:19.258412+0000","last_peered":"2024-03-20T13:37:19.258412+0000","last_clean":"2024-03-20T13:37:19.258412+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:37:19.258412+0000","last_undegraded":"2024-03-20T13:37:19.258412+0000","last_fullsized":"2024-03-20T13:37:19.258412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:19.258326+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:19.258326+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.258326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:12.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.409281+0000","last_change":"2024-03-20T13:36:52.409281+0000","last_active":"2024-03-20T13:36:52.409281+0000","last_peered":"2024-03-20T13:36:52.409281+0000","last_clean":"2024-03-20T13:36:52.409281+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:36:52.409281+0000","last_undegraded":"2024-03-20T13:36:52.409281+0000","last_fullsized":"2024-03-20T13:36:52.409281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.409171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:56:42.443923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.099051+0000","last_change":"2024-03-20T13:36:44.099051+0000","last_active":"2024-03-20T13:36:44.099051+0000","last_peered":"2024-03-20T13:36:44.099051+0000","last_clean":"2024-03-20T13:36:44.099051+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:44.099051+0000","last_undegraded":"2024-03-20T13:36:44.099051+0000","last_fullsized":"2024-03-20T13:36:44.099051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.098880+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:38.576272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.461685+0000","last_change":"2024-03-20T13:36:35.461685+0000","last_active":"2024-03-20T13:36:35.461685+0000","last_peered":"2024-03-20T13:36:35.461685+0000","last_clean":"2024-03-20T13:36:35.461685+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:36:35.461685+0000","last_undegraded":"2024-03-20T13:36:35.461685+0000","last_fullsized":"2024-03-20T13:36:35.461685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.461582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:53.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.780610+0000","last_change":"2024-03-20T13:37:31.780639+0000","last_active":"2024-03-20T13:37:31.780610+0000","last_peered":"2024-03-20T13:37:31.780610+0000","last_clean":"2024-03-20T13:37:31.780610+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:37:31.780610+0000","last_undegraded":"2024-03-20T13:37:31.780610+0000","last_fullsized":"2024-03-20T13:37:31.780610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:31.780528+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:31.780528+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.780528+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:40:02.573152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.238190+0000","last_change":"2024-03-20T13:37:08.238221+0000","last_active":"2024-03-20T13:37:08.238190+0000","last_peered":"2024-03-20T13:37:08.238190+0000","last_clean":"2024-03-20T13:37:08.238190+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:37:08.238190+0000","last_undegraded":"2024-03-20T13:37:08.238190+0000","last_fullsized":"2024-03-20T13:37:08.238190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.238084+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:21.795359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:35.141162+0000","last_change":"2024-03-20T13:37:35.141186+0000","last_active":"2024-03-20T13:37:35.141162+0000","last_peered":"2024-03-20T13:37:35.141162+0000","last_clean":"2024-03-20T13:37:35.141162+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:37:35.141162+0000","last_undegraded":"2024-03-20T13:37:35.141162+0000","last_fullsized":"2024-03-20T13:37:35.141162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:35.141073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:35.141073+0000","last_clean_scrub_stamp":"2024-03-20T13:37:35.141073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:10.528527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.423979+0000","last_change":"2024-03-20T13:37:00.423979+0000","last_active":"2024-03-20T13:37:00.423979+0000","last_peered":"2024-03-20T13:37:00.423979+0000","last_clean":"2024-03-20T13:37:00.423979+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:37:00.423979+0000","last_undegraded":"2024-03-20T13:37:00.423979+0000","last_fullsized":"2024-03-20T13:37:00.423979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.423821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:07.953451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.195079+0000","last_change":"2024-03-20T13:36:48.195079+0000","last_active":"2024-03-20T13:36:48.195079+0000","last_peered":"2024-03-20T13:36:48.195079+0000","last_clean":"2024-03-20T13:36:48.195079+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:48.195079+0000","last_undegraded":"2024-03-20T13:36:48.195079+0000","last_fullsized":"2024-03-20T13:36:48.195079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.194921+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:26.041799+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.482065+0000","last_change":"2024-03-20T13:36:57.482065+0000","last_active":"2024-03-20T13:36:57.482065+0000","last_peered":"2024-03-20T13:36:57.482065+0000","last_clean":"2024-03-20T13:36:57.482065+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:57.482065+0000","last_undegraded":"2024-03-20T13:36:57.482065+0000","last_fullsized":"2024-03-20T13:36:57.482065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.481947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:40.705365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:37.553362+0000","last_change":"2024-03-20T13:37:37.553392+0000","last_active":"2024-03-20T13:37:37.553362+0000","last_peered":"2024-03-20T13:37:37.553362+0000","last_clean":"2024-03-20T13:37:37.553362+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:37:37.553362+0000","last_undegraded":"2024-03-20T13:37:37.553362+0000","last_fullsized":"2024-03-20T13:37:37.553362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:37.553270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:37.553270+0000","last_clean_scrub_stamp":"2024-03-20T13:37:37.553270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:24:37.405274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.208881+0000","last_change":"2024-03-20T13:37:04.208881+0000","last_active":"2024-03-20T13:37:04.208881+0000","last_peered":"2024-03-20T13:37:04.208881+0000","last_clean":"2024-03-20T13:37:04.208881+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:37:04.208881+0000","last_undegraded":"2024-03-20T13:37:04.208881+0000","last_fullsized":"2024-03-20T13:37:04.208881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.208708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:35.661985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.180303+0000","last_change":"2024-03-20T13:37:25.180355+0000","last_active":"2024-03-20T13:37:25.180303+0000","last_peered":"2024-03-20T13:37:25.180303+0000","last_clean":"2024-03-20T13:37:25.180303+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:37:25.180303+0000","last_undegraded":"2024-03-20T13:37:25.180303+0000","last_fullsized":"2024-03-20T13:37:25.180303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:25.180191+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:25.180191+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.180191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:05:43.586233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.462228+0000","last_change":"2024-03-20T13:36:54.462228+0000","last_active":"2024-03-20T13:36:54.462228+0000","last_peered":"2024-03-20T13:36:54.462228+0000","last_clean":"2024-03-20T13:36:54.462228+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:36:54.462228+0000","last_undegraded":"2024-03-20T13:36:54.462228+0000","last_fullsized":"2024-03-20T13:36:54.462228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.462112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:08.019387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.148045+0000","last_change":"2024-03-20T13:36:36.148045+0000","last_active":"2024-03-20T13:36:36.148045+0000","last_peered":"2024-03-20T13:36:36.148045+0000","last_clean":"2024-03-20T13:36:36.148045+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:36.148045+0000","last_undegraded":"2024-03-20T13:36:36.148045+0000","last_fullsized":"2024-03-20T13:36:36.148045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.147906+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:41:00.828075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.497904+0000","last_change":"2024-03-20T13:36:38.497904+0000","last_active":"2024-03-20T13:36:38.497904+0000","last_peered":"2024-03-20T13:36:38.497904+0000","last_clean":"2024-03-20T13:36:38.497904+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:36:38.497904+0000","last_undegraded":"2024-03-20T13:36:38.497904+0000","last_fullsized":"2024-03-20T13:36:38.497904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.497774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:57.922980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.478488+0000","last_change":"2024-03-20T13:37:05.478488+0000","last_active":"2024-03-20T13:37:05.478488+0000","last_peered":"2024-03-20T13:37:05.478488+0000","last_clean":"2024-03-20T13:37:05.478488+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:37:05.478488+0000","last_undegraded":"2024-03-20T13:37:05.478488+0000","last_fullsized":"2024-03-20T13:37:05.478488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.478357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:33.942722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.735341+0000","last_change":"2024-03-20T13:37:06.735341+0000","last_active":"2024-03-20T13:37:06.735341+0000","last_peered":"2024-03-20T13:37:06.735341+0000","last_clean":"2024-03-20T13:37:06.735341+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:37:06.735341+0000","last_undegraded":"2024-03-20T13:37:06.735341+0000","last_fullsized":"2024-03-20T13:37:06.735341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.735167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:30.139049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.574580+0000","last_change":"2024-03-20T13:37:28.574608+0000","last_active":"2024-03-20T13:37:28.574580+0000","last_peered":"2024-03-20T13:37:28.574580+0000","last_clean":"2024-03-20T13:37:28.574580+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:37:28.574580+0000","last_undegraded":"2024-03-20T13:37:28.574580+0000","last_fullsized":"2024-03-20T13:37:28.574580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:28.574489+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:28.574489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.574489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:41.398042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.170733+0000","last_change":"2024-03-20T13:36:53.170733+0000","last_active":"2024-03-20T13:36:53.170733+0000","last_peered":"2024-03-20T13:36:53.170733+0000","last_clean":"2024-03-20T13:36:53.170733+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:53.170733+0000","last_undegraded":"2024-03-20T13:36:53.170733+0000","last_fullsized":"2024-03-20T13:36:53.170733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.170592+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:12.595798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.786164+0000","last_change":"2024-03-20T13:36:39.786164+0000","last_active":"2024-03-20T13:36:39.786164+0000","last_peered":"2024-03-20T13:36:39.786164+0000","last_clean":"2024-03-20T13:36:39.786164+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:39.786164+0000","last_undegraded":"2024-03-20T13:36:39.786164+0000","last_fullsized":"2024-03-20T13:36:39.786164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.786041+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:59.978158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.192708+0000","last_change":"2024-03-20T13:36:55.192708+0000","last_active":"2024-03-20T13:36:55.192708+0000","last_peered":"2024-03-20T13:36:55.192708+0000","last_clean":"2024-03-20T13:36:55.192708+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:36:55.192708+0000","last_undegraded":"2024-03-20T13:36:55.192708+0000","last_fullsized":"2024-03-20T13:36:55.192708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.192599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:09.415889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.217757+0000","last_change":"2024-03-20T13:37:24.217819+0000","last_active":"2024-03-20T13:37:24.217757+0000","last_peered":"2024-03-20T13:37:24.217757+0000","last_clean":"2024-03-20T13:37:24.217757+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:37:24.217757+0000","last_undegraded":"2024-03-20T13:37:24.217757+0000","last_fullsized":"2024-03-20T13:37:24.217757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:37:24.217670+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:37:24.217670+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.217670+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:37.258253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.267495+0000","last_change":"2024-03-20T13:37:26.267495+0000","last_active":"2024-03-20T13:37:26.267495+0000","last_peered":"2024-03-20T13:37:26.267495+0000","last_clean":"2024-03-20T13:37:26.267495+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:37:26.267495+0000","last_undegraded":"2024-03-20T13:37:26.267495+0000","last_fullsized":"2024-03-20T13:37:26.267495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:26.267387+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:26.267387+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.267387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:52.676700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.134100+0000","last_change":"2024-03-20T13:37:31.134127+0000","last_active":"2024-03-20T13:37:31.134100+0000","last_peered":"2024-03-20T13:37:31.134100+0000","last_clean":"2024-03-20T13:37:31.134100+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:37:31.134100+0000","last_undegraded":"2024-03-20T13:37:31.134100+0000","last_fullsized":"2024-03-20T13:37:31.134100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:31.134014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:31.134014+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.134014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:55.956000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.492572+0000","last_change":"2024-03-20T13:36:55.492572+0000","last_active":"2024-03-20T13:36:55.492572+0000","last_peered":"2024-03-20T13:36:55.492572+0000","last_clean":"2024-03-20T13:36:55.492572+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:36:55.492572+0000","last_undegraded":"2024-03-20T13:36:55.492572+0000","last_fullsized":"2024-03-20T13:36:55.492572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.492425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:40.395733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.189274+0000","last_change":"2024-03-20T13:36:52.189274+0000","last_active":"2024-03-20T13:36:52.189274+0000","last_peered":"2024-03-20T13:36:52.189274+0000","last_clean":"2024-03-20T13:36:52.189274+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:52.189274+0000","last_undegraded":"2024-03-20T13:36:52.189274+0000","last_fullsized":"2024-03-20T13:36:52.189274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.189115+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:34:06.835908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.043936+0000","last_change":"2024-03-20T13:36:36.043936+0000","last_active":"2024-03-20T13:36:36.043936+0000","last_peered":"2024-03-20T13:36:36.043936+0000","last_clean":"2024-03-20T13:36:36.043936+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:36.043936+0000","last_undegraded":"2024-03-20T13:36:36.043936+0000","last_fullsized":"2024-03-20T13:36:36.043936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.043753+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:45.456154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.581097+0000","last_change":"2024-03-20T13:37:33.581149+0000","last_active":"2024-03-20T13:37:33.581097+0000","last_peered":"2024-03-20T13:37:33.581097+0000","last_clean":"2024-03-20T13:37:33.581097+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:37:33.581097+0000","last_undegraded":"2024-03-20T13:37:33.581097+0000","last_fullsized":"2024-03-20T13:37:33.581097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:33.580998+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:33.580998+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.580998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:21.107161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.215988+0000","last_change":"2024-03-20T13:37:10.216028+0000","last_active":"2024-03-20T13:37:10.215988+0000","last_peered":"2024-03-20T13:37:10.215988+0000","last_clean":"2024-03-20T13:37:10.215988+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:37:10.215988+0000","last_undegraded":"2024-03-20T13:37:10.215988+0000","last_fullsized":"2024-03-20T13:37:10.215988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.215883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.879959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:34.097525+0000","last_change":"2024-03-20T13:37:34.097560+0000","last_active":"2024-03-20T13:37:34.097525+0000","last_peered":"2024-03-20T13:37:34.097525+0000","last_clean":"2024-03-20T13:37:34.097525+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:37:34.097525+0000","last_undegraded":"2024-03-20T13:37:34.097525+0000","last_fullsized":"2024-03-20T13:37:34.097525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:34.097435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:34.097435+0000","last_clean_scrub_stamp":"2024-03-20T13:37:34.097435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:56.386962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'4","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.891230+0000","last_change":"2024-03-20T13:36:47.891230+0000","last_active":"2024-03-20T13:36:47.891230+0000","last_peered":"2024-03-20T13:36:47.891230+0000","last_clean":"2024-03-20T13:36:47.891230+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:47.891230+0000","last_undegraded":"2024-03-20T13:36:47.891230+0000","last_fullsized":"2024-03-20T13:36:47.891230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.891061+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:18.309754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.146186+0000","last_change":"2024-03-20T13:36:38.146186+0000","last_active":"2024-03-20T13:36:38.146186+0000","last_peered":"2024-03-20T13:36:38.146186+0000","last_clean":"2024-03-20T13:36:38.146186+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:36:38.146186+0000","last_undegraded":"2024-03-20T13:36:38.146186+0000","last_fullsized":"2024-03-20T13:36:38.146186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.146066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:09.028952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.789972+0000","last_change":"2024-03-20T13:36:38.789972+0000","last_active":"2024-03-20T13:36:38.789972+0000","last_peered":"2024-03-20T13:36:38.789972+0000","last_clean":"2024-03-20T13:36:38.789972+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:38.789972+0000","last_undegraded":"2024-03-20T13:36:38.789972+0000","last_fullsized":"2024-03-20T13:36:38.789972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.789823+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:57.247566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.194544+0000","last_change":"2024-03-20T13:36:58.194544+0000","last_active":"2024-03-20T13:36:58.194544+0000","last_peered":"2024-03-20T13:36:58.194544+0000","last_clean":"2024-03-20T13:36:58.194544+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:36:58.194544+0000","last_undegraded":"2024-03-20T13:36:58.194544+0000","last_fullsized":"2024-03-20T13:36:58.194544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.194424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:10.534956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.880699+0000","last_change":"2024-03-20T13:36:52.880699+0000","last_active":"2024-03-20T13:36:52.880699+0000","last_peered":"2024-03-20T13:36:52.880699+0000","last_clean":"2024-03-20T13:36:52.880699+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:52.880699+0000","last_undegraded":"2024-03-20T13:36:52.880699+0000","last_fullsized":"2024-03-20T13:36:52.880699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.880575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:24.333852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:37.159346+0000","last_change":"2024-03-20T13:37:37.159375+0000","last_active":"2024-03-20T13:37:37.159346+0000","last_peered":"2024-03-20T13:37:37.159346+0000","last_clean":"2024-03-20T13:37:37.159346+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:37:37.159346+0000","last_undegraded":"2024-03-20T13:37:37.159346+0000","last_fullsized":"2024-03-20T13:37:37.159346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:37.159252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:37.159252+0000","last_clean_scrub_stamp":"2024-03-20T13:37:37.159252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:00:48.819331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.116987+0000","last_change":"2024-03-20T13:36:39.116987+0000","last_active":"2024-03-20T13:36:39.116987+0000","last_peered":"2024-03-20T13:36:39.116987+0000","last_clean":"2024-03-20T13:36:39.116987+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:36:39.116987+0000","last_undegraded":"2024-03-20T13:36:39.116987+0000","last_fullsized":"2024-03-20T13:36:39.116987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.116826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:14:51.320018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.797716+0000","last_change":"2024-03-20T13:36:37.797716+0000","last_active":"2024-03-20T13:36:37.797716+0000","last_peered":"2024-03-20T13:36:37.797716+0000","last_clean":"2024-03-20T13:36:37.797716+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:37.797716+0000","last_undegraded":"2024-03-20T13:36:37.797716+0000","last_fullsized":"2024-03-20T13:36:37.797716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.797588+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:30:53.571956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.074189+0000","last_change":"2024-03-20T13:36:39.074189+0000","last_active":"2024-03-20T13:36:39.074189+0000","last_peered":"2024-03-20T13:36:39.074189+0000","last_clean":"2024-03-20T13:36:39.074189+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:36:39.074189+0000","last_undegraded":"2024-03-20T13:36:39.074189+0000","last_fullsized":"2024-03-20T13:36:39.074189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.074084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:36.877815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.759650+0000","last_change":"2024-03-20T13:37:29.759699+0000","last_active":"2024-03-20T13:37:29.759650+0000","last_peered":"2024-03-20T13:37:29.759650+0000","last_clean":"2024-03-20T13:37:29.759650+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:37:29.759650+0000","last_undegraded":"2024-03-20T13:37:29.759650+0000","last_fullsized":"2024-03-20T13:37:29.759650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:29.759542+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:29.759542+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.759542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:58.565225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.201510+0000","last_change":"2024-03-20T13:36:53.201510+0000","last_active":"2024-03-20T13:36:53.201510+0000","last_peered":"2024-03-20T13:36:53.201510+0000","last_clean":"2024-03-20T13:36:53.201510+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:36:53.201510+0000","last_undegraded":"2024-03-20T13:36:53.201510+0000","last_fullsized":"2024-03-20T13:36:53.201510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.201374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:47.204640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.638719+0000","last_change":"2024-03-20T13:37:20.638758+0000","last_active":"2024-03-20T13:37:20.638719+0000","last_peered":"2024-03-20T13:37:20.638719+0000","last_clean":"2024-03-20T13:37:20.638719+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:37:20.638719+0000","last_undegraded":"2024-03-20T13:37:20.638719+0000","last_fullsized":"2024-03-20T13:37:20.638719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-03-20T13:37:20.638623+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-03-20T13:37:20.638623+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.638623+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:38.173181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:42.172548+0000","last_change":"2024-03-20T13:37:42.172573+0000","last_active":"2024-03-20T13:37:42.172548+0000","last_peered":"2024-03-20T13:37:42.172548+0000","last_clean":"2024-03-20T13:37:42.172548+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:37:42.172548+0000","last_undegraded":"2024-03-20T13:37:42.172548+0000","last_fullsized":"2024-03-20T13:37:42.172548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:42.172457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:42.172457+0000","last_clean_scrub_stamp":"2024-03-20T13:37:42.172457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:51:43.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.185264+0000","last_change":"2024-03-20T13:37:22.185291+0000","last_active":"2024-03-20T13:37:22.185264+0000","last_peered":"2024-03-20T13:37:22.185264+0000","last_clean":"2024-03-20T13:37:22.185264+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:37:22.185264+0000","last_undegraded":"2024-03-20T13:37:22.185264+0000","last_fullsized":"2024-03-20T13:37:22.185264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.185170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.185170+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.185170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:52:26.780533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.953552+0000","last_change":"2024-03-20T13:36:49.953552+0000","last_active":"2024-03-20T13:36:49.953552+0000","last_peered":"2024-03-20T13:36:49.953552+0000","last_clean":"2024-03-20T13:36:49.953552+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:36:49.953552+0000","last_undegraded":"2024-03-20T13:36:49.953552+0000","last_fullsized":"2024-03-20T13:36:49.953552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.953431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:13.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.123405+0000","last_change":"2024-03-20T13:36:46.123405+0000","last_active":"2024-03-20T13:36:46.123405+0000","last_peered":"2024-03-20T13:36:46.123405+0000","last_clean":"2024-03-20T13:36:46.123405+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:46.123405+0000","last_undegraded":"2024-03-20T13:36:46.123405+0000","last_fullsized":"2024-03-20T13:36:46.123405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.123283+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:09.527164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.454190+0000","last_change":"2024-03-20T13:36:42.454190+0000","last_active":"2024-03-20T13:36:42.454190+0000","last_peered":"2024-03-20T13:36:42.454190+0000","last_clean":"2024-03-20T13:36:42.454190+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:36:42.454190+0000","last_undegraded":"2024-03-20T13:36:42.454190+0000","last_fullsized":"2024-03-20T13:36:42.454190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.454069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:47.214837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.145557+0000","last_change":"2024-03-20T13:36:54.145557+0000","last_active":"2024-03-20T13:36:54.145557+0000","last_peered":"2024-03-20T13:36:54.145557+0000","last_clean":"2024-03-20T13:36:54.145557+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:54.145557+0000","last_undegraded":"2024-03-20T13:36:54.145557+0000","last_fullsized":"2024-03-20T13:36:54.145557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.145443+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:45.665997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.225779+0000","last_change":"2024-03-20T13:37:19.225803+0000","last_active":"2024-03-20T13:37:19.225779+0000","last_peered":"2024-03-20T13:37:19.225779+0000","last_clean":"2024-03-20T13:37:19.225779+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:37:19.225779+0000","last_undegraded":"2024-03-20T13:37:19.225779+0000","last_fullsized":"2024-03-20T13:37:19.225779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.225641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.225641+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.225641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:50.649161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:45.251627+0000","last_change":"2024-03-20T13:37:45.251653+0000","last_active":"2024-03-20T13:37:45.251627+0000","last_peered":"2024-03-20T13:37:45.251627+0000","last_clean":"2024-03-20T13:37:45.251627+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:37:45.251627+0000","last_undegraded":"2024-03-20T13:37:45.251627+0000","last_fullsized":"2024-03-20T13:37:45.251627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:45.251522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:45.251522+0000","last_clean_scrub_stamp":"2024-03-20T13:37:45.251522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:06:05.044302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.440517+0000","last_change":"2024-03-20T13:37:12.440569+0000","last_active":"2024-03-20T13:37:12.440517+0000","last_peered":"2024-03-20T13:37:12.440517+0000","last_clean":"2024-03-20T13:37:12.440517+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:37:12.440517+0000","last_undegraded":"2024-03-20T13:37:12.440517+0000","last_fullsized":"2024-03-20T13:37:12.440517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.440412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:23.449890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.083092+0000","last_change":"2024-03-20T13:36:43.083092+0000","last_active":"2024-03-20T13:36:43.083092+0000","last_peered":"2024-03-20T13:36:43.083092+0000","last_clean":"2024-03-20T13:36:43.083092+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:36:43.083092+0000","last_undegraded":"2024-03-20T13:36:43.083092+0000","last_fullsized":"2024-03-20T13:36:43.083092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.082968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:27:06.735401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.848464+0000","last_change":"2024-03-20T13:36:35.848464+0000","last_active":"2024-03-20T13:36:35.848464+0000","last_peered":"2024-03-20T13:36:35.848464+0000","last_clean":"2024-03-20T13:36:35.848464+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:35.848464+0000","last_undegraded":"2024-03-20T13:36:35.848464+0000","last_fullsized":"2024-03-20T13:36:35.848464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.848325+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:59:23.551034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.158892+0000","last_change":"2024-03-20T13:36:54.158892+0000","last_active":"2024-03-20T13:36:54.158892+0000","last_peered":"2024-03-20T13:36:54.158892+0000","last_clean":"2024-03-20T13:36:54.158892+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:36:54.158892+0000","last_undegraded":"2024-03-20T13:36:54.158892+0000","last_fullsized":"2024-03-20T13:36:54.158892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.158747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:05.168226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:34.760041+0000","last_change":"2024-03-20T13:37:34.760069+0000","last_active":"2024-03-20T13:37:34.760041+0000","last_peered":"2024-03-20T13:37:34.760041+0000","last_clean":"2024-03-20T13:37:34.760041+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:37:34.760041+0000","last_undegraded":"2024-03-20T13:37:34.760041+0000","last_fullsized":"2024-03-20T13:37:34.760041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:37:34.759957+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:37:34.759957+0000","last_clean_scrub_stamp":"2024-03-20T13:37:34.759957+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:53.081846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.542586+0000","last_change":"2024-03-20T13:37:03.542621+0000","last_active":"2024-03-20T13:37:03.542586+0000","last_peered":"2024-03-20T13:37:03.542586+0000","last_clean":"2024-03-20T13:37:03.542586+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:37:03.542586+0000","last_undegraded":"2024-03-20T13:37:03.542586+0000","last_fullsized":"2024-03-20T13:37:03.542586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.542501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:05.159751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.239165+0000","last_change":"2024-03-20T13:37:16.239193+0000","last_active":"2024-03-20T13:37:16.239165+0000","last_peered":"2024-03-20T13:37:16.239165+0000","last_clean":"2024-03-20T13:37:16.239165+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:37:16.239165+0000","last_undegraded":"2024-03-20T13:37:16.239165+0000","last_fullsized":"2024-03-20T13:37:16.239165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.239082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.239082+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.239082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:22.371725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.535422+0000","last_change":"2024-03-20T13:37:29.535448+0000","last_active":"2024-03-20T13:37:29.535422+0000","last_peered":"2024-03-20T13:37:29.535422+0000","last_clean":"2024-03-20T13:37:29.535422+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:37:29.535422+0000","last_undegraded":"2024-03-20T13:37:29.535422+0000","last_fullsized":"2024-03-20T13:37:29.535422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:29.535328+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:29.535328+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.535328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:40:00.327953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.148343+0000","last_change":"2024-03-20T13:36:57.148343+0000","last_active":"2024-03-20T13:36:57.148343+0000","last_peered":"2024-03-20T13:36:57.148343+0000","last_clean":"2024-03-20T13:36:57.148343+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:36:57.148343+0000","last_undegraded":"2024-03-20T13:36:57.148343+0000","last_fullsized":"2024-03-20T13:36:57.148343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.148192+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:29.933263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.215018+0000","last_change":"2024-03-20T13:36:47.215018+0000","last_active":"2024-03-20T13:36:47.215018+0000","last_peered":"2024-03-20T13:36:47.215018+0000","last_clean":"2024-03-20T13:36:47.215018+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:47.215018+0000","last_undegraded":"2024-03-20T13:36:47.215018+0000","last_fullsized":"2024-03-20T13:36:47.215018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.214888+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:24.057007+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.483718+0000","last_change":"2024-03-20T13:36:40.483718+0000","last_active":"2024-03-20T13:36:40.483718+0000","last_peered":"2024-03-20T13:36:40.483718+0000","last_clean":"2024-03-20T13:36:40.483718+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:36:40.483718+0000","last_undegraded":"2024-03-20T13:36:40.483718+0000","last_fullsized":"2024-03-20T13:36:40.483718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.483604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:15.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.236869+0000","last_change":"2024-03-20T13:37:16.236869+0000","last_active":"2024-03-20T13:37:16.236869+0000","last_peered":"2024-03-20T13:37:16.236869+0000","last_clean":"2024-03-20T13:37:16.236869+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:37:16.236869+0000","last_undegraded":"2024-03-20T13:37:16.236869+0000","last_fullsized":"2024-03-20T13:37:16.236869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.236742+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:03.762906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.482307+0000","last_change":"2024-03-20T13:37:11.482376+0000","last_active":"2024-03-20T13:37:11.482307+0000","last_peered":"2024-03-20T13:37:11.482307+0000","last_clean":"2024-03-20T13:37:11.482307+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:37:11.482307+0000","last_undegraded":"2024-03-20T13:37:11.482307+0000","last_fullsized":"2024-03-20T13:37:11.482307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.482209+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:05.485475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:43.158744+0000","last_change":"2024-03-20T13:37:43.158770+0000","last_active":"2024-03-20T13:37:43.158744+0000","last_peered":"2024-03-20T13:37:43.158744+0000","last_clean":"2024-03-20T13:37:43.158744+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:37:43.158744+0000","last_undegraded":"2024-03-20T13:37:43.158744+0000","last_fullsized":"2024-03-20T13:37:43.158744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:43.158648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:43.158648+0000","last_clean_scrub_stamp":"2024-03-20T13:37:43.158648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:28:13.174226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.240052+0000","last_change":"2024-03-20T13:37:18.240078+0000","last_active":"2024-03-20T13:37:18.240052+0000","last_peered":"2024-03-20T13:37:18.240052+0000","last_clean":"2024-03-20T13:37:18.240052+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:37:18.240052+0000","last_undegraded":"2024-03-20T13:37:18.240052+0000","last_fullsized":"2024-03-20T13:37:18.240052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:18.239966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:18.239966+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.239966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:41.643848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.507511+0000","last_change":"2024-03-20T13:36:56.507511+0000","last_active":"2024-03-20T13:36:56.507511+0000","last_peered":"2024-03-20T13:36:56.507511+0000","last_clean":"2024-03-20T13:36:56.507511+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:36:56.507511+0000","last_undegraded":"2024-03-20T13:36:56.507511+0000","last_fullsized":"2024-03-20T13:36:56.507511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.507374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:27.390260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.226545+0000","last_change":"2024-03-20T13:36:59.226545+0000","last_active":"2024-03-20T13:36:59.226545+0000","last_peered":"2024-03-20T13:36:59.226545+0000","last_clean":"2024-03-20T13:36:59.226545+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:36:59.226545+0000","last_undegraded":"2024-03-20T13:36:59.226545+0000","last_fullsized":"2024-03-20T13:36:59.226545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.226391+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:17.073932+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.194396+0000","last_change":"2024-03-20T13:36:57.194396+0000","last_active":"2024-03-20T13:36:57.194396+0000","last_peered":"2024-03-20T13:36:57.194396+0000","last_clean":"2024-03-20T13:36:57.194396+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:36:57.194396+0000","last_undegraded":"2024-03-20T13:36:57.194396+0000","last_fullsized":"2024-03-20T13:36:57.194396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.194286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:57.106173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.784884+0000","last_change":"2024-03-20T13:37:32.784934+0000","last_active":"2024-03-20T13:37:32.784884+0000","last_peered":"2024-03-20T13:37:32.784884+0000","last_clean":"2024-03-20T13:37:32.784884+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:37:32.784884+0000","last_undegraded":"2024-03-20T13:37:32.784884+0000","last_fullsized":"2024-03-20T13:37:32.784884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:32.784765+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:32.784765+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.784765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:58.540981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.850116+0000","last_change":"2024-03-20T13:36:56.850116+0000","last_active":"2024-03-20T13:36:56.850116+0000","last_peered":"2024-03-20T13:36:56.850116+0000","last_clean":"2024-03-20T13:36:56.850116+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:56.850116+0000","last_undegraded":"2024-03-20T13:36:56.850116+0000","last_fullsized":"2024-03-20T13:36:56.850116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.849978+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:10.407253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.230500+0000","last_change":"2024-03-20T13:37:17.230526+0000","last_active":"2024-03-20T13:37:17.230500+0000","last_peered":"2024-03-20T13:37:17.230500+0000","last_clean":"2024-03-20T13:37:17.230500+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:37:17.230500+0000","last_undegraded":"2024-03-20T13:37:17.230500+0000","last_fullsized":"2024-03-20T13:37:17.230500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:17.230413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:17.230413+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.230413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:06.528362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.516806+0000","last_change":"2024-03-20T13:37:23.516853+0000","last_active":"2024-03-20T13:37:23.516806+0000","last_peered":"2024-03-20T13:37:23.516806+0000","last_clean":"2024-03-20T13:37:23.516806+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:37:23.516806+0000","last_undegraded":"2024-03-20T13:37:23.516806+0000","last_fullsized":"2024-03-20T13:37:23.516806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.516709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.516709+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.516709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:30.179578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'3","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.474223+0000","last_change":"2024-03-20T13:36:59.474249+0000","last_active":"2024-03-20T13:36:59.474223+0000","last_peered":"2024-03-20T13:36:59.474223+0000","last_clean":"2024-03-20T13:36:59.474223+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:59.474223+0000","last_undegraded":"2024-03-20T13:36:59.474223+0000","last_fullsized":"2024-03-20T13:36:59.474223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.474149+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:43.301196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.439320+0000","last_change":"2024-03-20T13:36:43.439320+0000","last_active":"2024-03-20T13:36:43.439320+0000","last_peered":"2024-03-20T13:36:43.439320+0000","last_clean":"2024-03-20T13:36:43.439320+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:43.439320+0000","last_undegraded":"2024-03-20T13:36:43.439320+0000","last_fullsized":"2024-03-20T13:36:43.439320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.439197+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:55.779728+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.108014+0000","last_change":"2024-03-20T13:36:40.108014+0000","last_active":"2024-03-20T13:36:40.108014+0000","last_peered":"2024-03-20T13:36:40.108014+0000","last_clean":"2024-03-20T13:36:40.108014+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:36:40.108014+0000","last_undegraded":"2024-03-20T13:36:40.108014+0000","last_fullsized":"2024-03-20T13:36:40.108014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.107898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:33.206081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.604388+0000","last_change":"2024-03-20T13:37:32.604430+0000","last_active":"2024-03-20T13:37:32.604388+0000","last_peered":"2024-03-20T13:37:32.604388+0000","last_clean":"2024-03-20T13:37:32.604388+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:37:32.604388+0000","last_undegraded":"2024-03-20T13:37:32.604388+0000","last_fullsized":"2024-03-20T13:37:32.604388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-03-20T13:37:32.604297+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-03-20T13:37:32.604297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.604297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:50.926186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.747290+0000","last_change":"2024-03-20T13:37:05.747316+0000","last_active":"2024-03-20T13:37:05.747290+0000","last_peered":"2024-03-20T13:37:05.747290+0000","last_clean":"2024-03-20T13:37:05.747290+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:37:05.747290+0000","last_undegraded":"2024-03-20T13:37:05.747290+0000","last_fullsized":"2024-03-20T13:37:05.747290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.747166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:55.045115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.428580+0000","last_change":"2024-03-20T13:37:08.428609+0000","last_active":"2024-03-20T13:37:08.428580+0000","last_peered":"2024-03-20T13:37:08.428580+0000","last_clean":"2024-03-20T13:37:08.428580+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:37:08.428580+0000","last_undegraded":"2024-03-20T13:37:08.428580+0000","last_fullsized":"2024-03-20T13:37:08.428580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.428489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:55.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:44.204628+0000","last_change":"2024-03-20T13:37:44.204654+0000","last_active":"2024-03-20T13:37:44.204628+0000","last_peered":"2024-03-20T13:37:44.204628+0000","last_clean":"2024-03-20T13:37:44.204628+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:37:44.204628+0000","last_undegraded":"2024-03-20T13:37:44.204628+0000","last_fullsized":"2024-03-20T13:37:44.204628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:44.204542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:44.204542+0000","last_clean_scrub_stamp":"2024-03-20T13:37:44.204542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:21.138167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.129101+0000","last_change":"2024-03-20T13:36:45.129101+0000","last_active":"2024-03-20T13:36:45.129101+0000","last_peered":"2024-03-20T13:36:45.129101+0000","last_clean":"2024-03-20T13:36:45.129101+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:36:45.129101+0000","last_undegraded":"2024-03-20T13:36:45.129101+0000","last_fullsized":"2024-03-20T13:36:45.129101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.128960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:46.746210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.882086+0000","last_change":"2024-03-20T13:36:34.882086+0000","last_active":"2024-03-20T13:36:34.882086+0000","last_peered":"2024-03-20T13:36:34.882086+0000","last_clean":"2024-03-20T13:36:34.882086+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:36:34.882086+0000","last_undegraded":"2024-03-20T13:36:34.882086+0000","last_fullsized":"2024-03-20T13:36:34.882086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.881955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:01.668025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":291,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.888239+0000","last_change":"2024-03-20T13:36:46.888239+0000","last_active":"2024-03-20T13:36:46.888239+0000","last_peered":"2024-03-20T13:36:46.888239+0000","last_clean":"2024-03-20T13:36:46.888239+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:46.888239+0000","last_undegraded":"2024-03-20T13:36:46.888239+0000","last_fullsized":"2024-03-20T13:36:46.888239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.888110+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.228641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.247268+0000","last_change":"2024-03-20T13:37:12.247268+0000","last_active":"2024-03-20T13:37:12.247268+0000","last_peered":"2024-03-20T13:37:12.247268+0000","last_clean":"2024-03-20T13:37:12.247268+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:37:12.247268+0000","last_undegraded":"2024-03-20T13:37:12.247268+0000","last_fullsized":"2024-03-20T13:37:12.247268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.247124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:39:43.039748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.204303+0000","last_change":"2024-03-20T13:36:51.204303+0000","last_active":"2024-03-20T13:36:51.204303+0000","last_peered":"2024-03-20T13:36:51.204303+0000","last_clean":"2024-03-20T13:36:51.204303+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:36:51.204303+0000","last_undegraded":"2024-03-20T13:36:51.204303+0000","last_fullsized":"2024-03-20T13:36:51.204303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.204192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:38.634547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.084564+0000","last_change":"2024-03-20T13:37:33.084587+0000","last_active":"2024-03-20T13:37:33.084564+0000","last_peered":"2024-03-20T13:37:33.084564+0000","last_clean":"2024-03-20T13:37:33.084564+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:37:33.084564+0000","last_undegraded":"2024-03-20T13:37:33.084564+0000","last_fullsized":"2024-03-20T13:37:33.084564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:33.084477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:33.084477+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.084477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:23:10.286935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.493735+0000","last_change":"2024-03-20T13:37:24.493773+0000","last_active":"2024-03-20T13:37:24.493735+0000","last_peered":"2024-03-20T13:37:24.493735+0000","last_clean":"2024-03-20T13:37:24.493735+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:37:24.493735+0000","last_undegraded":"2024-03-20T13:37:24.493735+0000","last_fullsized":"2024-03-20T13:37:24.493735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:24.493644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:24.493644+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.493644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:52.922127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.593727+0000","last_change":"2024-03-20T13:35:30.990699+0000","last_active":"2024-03-20T13:36:35.593727+0000","last_peered":"2024-03-20T13:36:35.593727+0000","last_clean":"2024-03-20T13:36:35.593727+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:36:35.593727+0000","last_undegraded":"2024-03-20T13:36:35.593727+0000","last_fullsized":"2024-03-20T13:36:35.593727+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:52.925004+0000","last_clean_scrub_stamp":"2024-03-20T13:34:52.925004+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.215859+0000","last_change":"2024-03-20T13:37:05.215894+0000","last_active":"2024-03-20T13:37:05.215859+0000","last_peered":"2024-03-20T13:37:05.215859+0000","last_clean":"2024-03-20T13:37:05.215859+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:37:05.215859+0000","last_undegraded":"2024-03-20T13:37:05.215859+0000","last_fullsized":"2024-03-20T13:37:05.215859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.215760+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:50.554560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.452554+0000","last_change":"2024-03-20T13:36:45.452554+0000","last_active":"2024-03-20T13:36:45.452554+0000","last_peered":"2024-03-20T13:36:45.452554+0000","last_clean":"2024-03-20T13:36:45.452554+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:45.452554+0000","last_undegraded":"2024-03-20T13:36:45.452554+0000","last_fullsized":"2024-03-20T13:36:45.452554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.452437+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:06:35.977614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.722337+0000","last_change":"2024-03-20T13:37:02.722337+0000","last_active":"2024-03-20T13:37:02.722337+0000","last_peered":"2024-03-20T13:37:02.722337+0000","last_clean":"2024-03-20T13:37:02.722337+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:37:02.722337+0000","last_undegraded":"2024-03-20T13:37:02.722337+0000","last_fullsized":"2024-03-20T13:37:02.722337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.722217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:10.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.238524+0000","last_change":"2024-03-20T13:37:14.238550+0000","last_active":"2024-03-20T13:37:14.238524+0000","last_peered":"2024-03-20T13:37:14.238524+0000","last_clean":"2024-03-20T13:37:14.238524+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:37:14.238524+0000","last_undegraded":"2024-03-20T13:37:14.238524+0000","last_fullsized":"2024-03-20T13:37:14.238524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:14.238438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:14.238438+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.238438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:21.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.714031+0000","last_change":"2024-03-20T13:37:15.714057+0000","last_active":"2024-03-20T13:37:15.714031+0000","last_peered":"2024-03-20T13:37:15.714031+0000","last_clean":"2024-03-20T13:37:15.714031+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:37:15.714031+0000","last_undegraded":"2024-03-20T13:37:15.714031+0000","last_fullsized":"2024-03-20T13:37:15.714031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.713941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.713941+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.713941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:56:51.973415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:46.268299+0000","last_change":"2024-03-20T13:37:46.268328+0000","last_active":"2024-03-20T13:37:46.268299+0000","last_peered":"2024-03-20T13:37:46.268299+0000","last_clean":"2024-03-20T13:37:46.268299+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:37:46.268299+0000","last_undegraded":"2024-03-20T13:37:46.268299+0000","last_fullsized":"2024-03-20T13:37:46.268299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:46.268175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:46.268175+0000","last_clean_scrub_stamp":"2024-03-20T13:37:46.268175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:09:40.063831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.105883+0000","last_change":"2024-03-20T13:36:42.105883+0000","last_active":"2024-03-20T13:36:42.105883+0000","last_peered":"2024-03-20T13:36:42.105883+0000","last_clean":"2024-03-20T13:36:42.105883+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:36:42.105883+0000","last_undegraded":"2024-03-20T13:36:42.105883+0000","last_fullsized":"2024-03-20T13:36:42.105883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.105759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:22:49.608123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":184,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.173473+0000","last_change":"2024-03-20T13:36:45.173473+0000","last_active":"2024-03-20T13:36:45.173473+0000","last_peered":"2024-03-20T13:36:45.173473+0000","last_clean":"2024-03-20T13:36:45.173473+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:45.173473+0000","last_undegraded":"2024-03-20T13:36:45.173473+0000","last_fullsized":"2024-03-20T13:36:45.173473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'91","last_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_deep_scrub":"32'91","last_deep_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.173353+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:11.959423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.486441+0000","last_change":"2024-03-20T13:36:36.486441+0000","last_active":"2024-03-20T13:36:36.486441+0000","last_peered":"2024-03-20T13:36:36.486441+0000","last_clean":"2024-03-20T13:36:36.486441+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:36:36.486441+0000","last_undegraded":"2024-03-20T13:36:36.486441+0000","last_fullsized":"2024-03-20T13:36:36.486441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.486298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:56.678415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.195177+0000","last_change":"2024-03-20T13:36:50.195177+0000","last_active":"2024-03-20T13:36:50.195177+0000","last_peered":"2024-03-20T13:36:50.195177+0000","last_clean":"2024-03-20T13:36:50.195177+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:36:50.195177+0000","last_undegraded":"2024-03-20T13:36:50.195177+0000","last_fullsized":"2024-03-20T13:36:50.195177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.195066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:08.652809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.162953+0000","last_change":"2024-03-20T13:36:42.162953+0000","last_active":"2024-03-20T13:36:42.162953+0000","last_peered":"2024-03-20T13:36:42.162953+0000","last_clean":"2024-03-20T13:36:42.162953+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:36:42.162953+0000","last_undegraded":"2024-03-20T13:36:42.162953+0000","last_fullsized":"2024-03-20T13:36:42.162953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.162847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:46:25.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.237627+0000","last_change":"2024-03-20T13:37:12.237627+0000","last_active":"2024-03-20T13:37:12.237627+0000","last_peered":"2024-03-20T13:37:12.237627+0000","last_clean":"2024-03-20T13:37:12.237627+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:37:12.237627+0000","last_undegraded":"2024-03-20T13:37:12.237627+0000","last_fullsized":"2024-03-20T13:37:12.237627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.237514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:54.859398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.094362+0000","last_change":"2024-03-20T13:37:32.094389+0000","last_active":"2024-03-20T13:37:32.094362+0000","last_peered":"2024-03-20T13:37:32.094362+0000","last_clean":"2024-03-20T13:37:32.094362+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:37:32.094362+0000","last_undegraded":"2024-03-20T13:37:32.094362+0000","last_fullsized":"2024-03-20T13:37:32.094362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:32.094255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:32.094255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.094255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:24.944029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.927642+0000","last_change":"2024-03-20T13:36:48.927642+0000","last_active":"2024-03-20T13:36:48.927642+0000","last_peered":"2024-03-20T13:36:48.927642+0000","last_clean":"2024-03-20T13:36:48.927642+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:36:48.927642+0000","last_undegraded":"2024-03-20T13:36:48.927642+0000","last_fullsized":"2024-03-20T13:36:48.927642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.927492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:31.555602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.228501+0000","last_change":"2024-03-20T13:37:02.228501+0000","last_active":"2024-03-20T13:37:02.228501+0000","last_peered":"2024-03-20T13:37:02.228501+0000","last_clean":"2024-03-20T13:37:02.228501+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:37:02.228501+0000","last_undegraded":"2024-03-20T13:37:02.228501+0000","last_fullsized":"2024-03-20T13:37:02.228501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.228382+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:57.609818+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.213463+0000","last_change":"2024-03-20T13:37:00.213463+0000","last_active":"2024-03-20T13:37:00.213463+0000","last_peered":"2024-03-20T13:37:00.213463+0000","last_clean":"2024-03-20T13:37:00.213463+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:37:00.213463+0000","last_undegraded":"2024-03-20T13:37:00.213463+0000","last_fullsized":"2024-03-20T13:37:00.213463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.213347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:55.768317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.470905+0000","last_change":"2024-03-20T13:37:01.470905+0000","last_active":"2024-03-20T13:37:01.470905+0000","last_peered":"2024-03-20T13:37:01.470905+0000","last_clean":"2024-03-20T13:37:01.470905+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:37:01.470905+0000","last_undegraded":"2024-03-20T13:37:01.470905+0000","last_fullsized":"2024-03-20T13:37:01.470905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.470772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:39.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.740422+0000","last_change":"2024-03-20T13:37:08.740422+0000","last_active":"2024-03-20T13:37:08.740422+0000","last_peered":"2024-03-20T13:37:08.740422+0000","last_clean":"2024-03-20T13:37:08.740422+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:37:08.740422+0000","last_undegraded":"2024-03-20T13:37:08.740422+0000","last_fullsized":"2024-03-20T13:37:08.740422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.740297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:41.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.243856+0000","last_change":"2024-03-20T13:37:09.243856+0000","last_active":"2024-03-20T13:37:09.243856+0000","last_peered":"2024-03-20T13:37:09.243856+0000","last_clean":"2024-03-20T13:37:09.243856+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:37:09.243856+0000","last_undegraded":"2024-03-20T13:37:09.243856+0000","last_fullsized":"2024-03-20T13:37:09.243856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.243729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:38.730937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.295167+0000","last_change":"2024-03-20T13:37:27.295167+0000","last_active":"2024-03-20T13:37:27.295167+0000","last_peered":"2024-03-20T13:37:27.295167+0000","last_clean":"2024-03-20T13:37:27.295167+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:37:27.295167+0000","last_undegraded":"2024-03-20T13:37:27.295167+0000","last_fullsized":"2024-03-20T13:37:27.295167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.295064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.295064+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.295064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:01.206762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.478637+0000","last_change":"2024-03-20T13:36:47.478637+0000","last_active":"2024-03-20T13:36:47.478637+0000","last_peered":"2024-03-20T13:36:47.478637+0000","last_clean":"2024-03-20T13:36:47.478637+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:47.478637+0000","last_undegraded":"2024-03-20T13:36:47.478637+0000","last_fullsized":"2024-03-20T13:36:47.478637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.478507+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:17.900912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.100179+0000","last_change":"2024-03-20T13:36:38.100179+0000","last_active":"2024-03-20T13:36:38.100179+0000","last_peered":"2024-03-20T13:36:38.100179+0000","last_clean":"2024-03-20T13:36:38.100179+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:36:38.100179+0000","last_undegraded":"2024-03-20T13:36:38.100179+0000","last_fullsized":"2024-03-20T13:36:38.100179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.100067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:06:11.567457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:36.570094+0000","last_change":"2024-03-20T13:37:36.570116+0000","last_active":"2024-03-20T13:37:36.570094+0000","last_peered":"2024-03-20T13:37:36.570094+0000","last_clean":"2024-03-20T13:37:36.570094+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:37:36.570094+0000","last_undegraded":"2024-03-20T13:37:36.570094+0000","last_fullsized":"2024-03-20T13:37:36.570094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:36.570008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:36.570008+0000","last_clean_scrub_stamp":"2024-03-20T13:37:36.570008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:56:07.993528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.461142+0000","last_change":"2024-03-20T13:37:07.461142+0000","last_active":"2024-03-20T13:37:07.461142+0000","last_peered":"2024-03-20T13:37:07.461142+0000","last_clean":"2024-03-20T13:37:07.461142+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:37:07.461142+0000","last_undegraded":"2024-03-20T13:37:07.461142+0000","last_fullsized":"2024-03-20T13:37:07.461142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.461017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:49.260164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.238017+0000","last_change":"2024-03-20T13:37:22.238044+0000","last_active":"2024-03-20T13:37:22.238017+0000","last_peered":"2024-03-20T13:37:22.238017+0000","last_clean":"2024-03-20T13:37:22.238017+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:37:22.238017+0000","last_undegraded":"2024-03-20T13:37:22.238017+0000","last_fullsized":"2024-03-20T13:37:22.238017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.237932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.237932+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.237932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:09.668288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.112735+0000","last_change":"2024-03-20T13:36:56.112735+0000","last_active":"2024-03-20T13:36:56.112735+0000","last_peered":"2024-03-20T13:36:56.112735+0000","last_clean":"2024-03-20T13:36:56.112735+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:36:56.112735+0000","last_undegraded":"2024-03-20T13:36:56.112735+0000","last_fullsized":"2024-03-20T13:36:56.112735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.112607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:05.346785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.407080+0000","last_change":"2024-03-20T13:36:44.407080+0000","last_active":"2024-03-20T13:36:44.407080+0000","last_peered":"2024-03-20T13:36:44.407080+0000","last_clean":"2024-03-20T13:36:44.407080+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:44.407080+0000","last_undegraded":"2024-03-20T13:36:44.407080+0000","last_fullsized":"2024-03-20T13:36:44.407080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.406901+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:14.825593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.839038+0000","last_change":"2024-03-20T13:36:42.839038+0000","last_active":"2024-03-20T13:36:42.839038+0000","last_peered":"2024-03-20T13:36:42.839038+0000","last_clean":"2024-03-20T13:36:42.839038+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:36:42.839038+0000","last_undegraded":"2024-03-20T13:36:42.839038+0000","last_fullsized":"2024-03-20T13:36:42.839038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.838924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:34.359477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594451+0000","last_change":"2024-03-20T13:34:59.975259+0000","last_active":"2024-03-20T13:36:35.594451+0000","last_peered":"2024-03-20T13:36:35.594451+0000","last_clean":"2024-03-20T13:36:35.594451+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:36:35.594451+0000","last_undegraded":"2024-03-20T13:36:35.594451+0000","last_fullsized":"2024-03-20T13:36:35.594451+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.196840+0000","last_change":"2024-03-20T13:36:49.196840+0000","last_active":"2024-03-20T13:36:49.196840+0000","last_peered":"2024-03-20T13:36:49.196840+0000","last_clean":"2024-03-20T13:36:49.196840+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:36:49.196840+0000","last_undegraded":"2024-03-20T13:36:49.196840+0000","last_fullsized":"2024-03-20T13:36:49.196840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.196667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:30.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.613025+0000","last_change":"2024-03-20T13:37:21.613053+0000","last_active":"2024-03-20T13:37:21.613025+0000","last_peered":"2024-03-20T13:37:21.613025+0000","last_clean":"2024-03-20T13:37:21.613025+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:37:21.613025+0000","last_undegraded":"2024-03-20T13:37:21.613025+0000","last_fullsized":"2024-03-20T13:37:21.613025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:21.612935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:21.612935+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.612935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:55.799847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.120372+0000","last_change":"2024-03-20T13:36:37.120372+0000","last_active":"2024-03-20T13:36:37.120372+0000","last_peered":"2024-03-20T13:36:37.120372+0000","last_clean":"2024-03-20T13:36:37.120372+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:36:37.120372+0000","last_undegraded":"2024-03-20T13:36:37.120372+0000","last_fullsized":"2024-03-20T13:36:37.120372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.120203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.166063+0000","last_change":"2024-03-20T13:36:51.166063+0000","last_active":"2024-03-20T13:36:51.166063+0000","last_peered":"2024-03-20T13:36:51.166063+0000","last_clean":"2024-03-20T13:36:51.166063+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:51.166063+0000","last_undegraded":"2024-03-20T13:36:51.166063+0000","last_fullsized":"2024-03-20T13:36:51.166063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.165931+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:11.358048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.137649+0000","last_change":"2024-03-20T13:36:43.137649+0000","last_active":"2024-03-20T13:36:43.137649+0000","last_peered":"2024-03-20T13:36:43.137649+0000","last_clean":"2024-03-20T13:36:43.137649+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:36:43.137649+0000","last_undegraded":"2024-03-20T13:36:43.137649+0000","last_fullsized":"2024-03-20T13:36:43.137649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.137482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:28.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.205951+0000","last_change":"2024-03-20T13:37:17.205976+0000","last_active":"2024-03-20T13:37:17.205951+0000","last_peered":"2024-03-20T13:37:17.205951+0000","last_clean":"2024-03-20T13:37:17.205951+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:37:17.205951+0000","last_undegraded":"2024-03-20T13:37:17.205951+0000","last_fullsized":"2024-03-20T13:37:17.205951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-03-20T13:37:17.205804+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-03-20T13:37:17.205804+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.205804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:53.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:49.293764+0000","last_change":"2024-03-20T13:37:49.293816+0000","last_active":"2024-03-20T13:37:49.293764+0000","last_peered":"2024-03-20T13:37:49.293764+0000","last_clean":"2024-03-20T13:37:49.293764+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:37:49.293764+0000","last_undegraded":"2024-03-20T13:37:49.293764+0000","last_fullsized":"2024-03-20T13:37:49.293764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:49.293652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:49.293652+0000","last_clean_scrub_stamp":"2024-03-20T13:37:49.293652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:13:08.087084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.515662+0000","last_change":"2024-03-20T13:36:58.515701+0000","last_active":"2024-03-20T13:36:58.515662+0000","last_peered":"2024-03-20T13:36:58.515662+0000","last_clean":"2024-03-20T13:36:58.515662+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:36:58.515662+0000","last_undegraded":"2024-03-20T13:36:58.515662+0000","last_fullsized":"2024-03-20T13:36:58.515662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.515568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:41.137452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.434919+0000","last_change":"2024-03-20T13:36:46.434919+0000","last_active":"2024-03-20T13:36:46.434919+0000","last_peered":"2024-03-20T13:36:46.434919+0000","last_clean":"2024-03-20T13:36:46.434919+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:46.434919+0000","last_undegraded":"2024-03-20T13:36:46.434919+0000","last_fullsized":"2024-03-20T13:36:46.434919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.434789+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:21.531106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.142333+0000","last_change":"2024-03-20T13:36:41.142333+0000","last_active":"2024-03-20T13:36:41.142333+0000","last_peered":"2024-03-20T13:36:41.142333+0000","last_clean":"2024-03-20T13:36:41.142333+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:36:41.142333+0000","last_undegraded":"2024-03-20T13:36:41.142333+0000","last_fullsized":"2024-03-20T13:36:41.142333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.142212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:35.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:34.536062+0000","last_change":"2024-03-20T13:37:34.536090+0000","last_active":"2024-03-20T13:37:34.536062+0000","last_peered":"2024-03-20T13:37:34.536062+0000","last_clean":"2024-03-20T13:37:34.536062+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:37:34.536062+0000","last_undegraded":"2024-03-20T13:37:34.536062+0000","last_fullsized":"2024-03-20T13:37:34.536062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:34.535976+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:34.535976+0000","last_clean_scrub_stamp":"2024-03-20T13:37:34.535976+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:11.116650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.496484+0000","last_change":"2024-03-20T13:37:04.496531+0000","last_active":"2024-03-20T13:37:04.496484+0000","last_peered":"2024-03-20T13:37:04.496484+0000","last_clean":"2024-03-20T13:37:04.496484+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:37:04.496484+0000","last_undegraded":"2024-03-20T13:37:04.496484+0000","last_fullsized":"2024-03-20T13:37:04.496484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.496373+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:27.900255+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.643299+0000","last_change":"2024-03-20T13:37:19.643323+0000","last_active":"2024-03-20T13:37:19.643299+0000","last_peered":"2024-03-20T13:37:19.643299+0000","last_clean":"2024-03-20T13:37:19.643299+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:37:19.643299+0000","last_undegraded":"2024-03-20T13:37:19.643299+0000","last_fullsized":"2024-03-20T13:37:19.643299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.643213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.643213+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.643213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:21:15.198184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.344616+0000","last_change":"2024-03-20T13:37:29.344639+0000","last_active":"2024-03-20T13:37:29.344616+0000","last_peered":"2024-03-20T13:37:29.344616+0000","last_clean":"2024-03-20T13:37:29.344616+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:37:29.344616+0000","last_undegraded":"2024-03-20T13:37:29.344616+0000","last_fullsized":"2024-03-20T13:37:29.344616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:29.344529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:29.344529+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.344529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:45.574840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.193532+0000","last_change":"2024-03-20T13:37:01.193532+0000","last_active":"2024-03-20T13:37:01.193532+0000","last_peered":"2024-03-20T13:37:01.193532+0000","last_clean":"2024-03-20T13:37:01.193532+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:37:01.193532+0000","last_undegraded":"2024-03-20T13:37:01.193532+0000","last_fullsized":"2024-03-20T13:37:01.193532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.193395+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:18.727953+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.825368+0000","last_change":"2024-03-20T13:36:54.825368+0000","last_active":"2024-03-20T13:36:54.825368+0000","last_peered":"2024-03-20T13:36:54.825368+0000","last_clean":"2024-03-20T13:36:54.825368+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:36:54.825368+0000","last_undegraded":"2024-03-20T13:36:54.825368+0000","last_fullsized":"2024-03-20T13:36:54.825368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.825258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:24.356866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:52.237465+0000","last_change":"2024-03-20T13:37:52.237492+0000","last_active":"2024-03-20T13:37:52.237465+0000","last_peered":"2024-03-20T13:37:52.237465+0000","last_clean":"2024-03-20T13:37:52.237465+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:37:52.237465+0000","last_undegraded":"2024-03-20T13:37:52.237465+0000","last_fullsized":"2024-03-20T13:37:52.237465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:52.237377+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:52.237377+0000","last_clean_scrub_stamp":"2024-03-20T13:37:52.237377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:04:38.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.167768+0000","last_change":"2024-03-20T13:36:50.167768+0000","last_active":"2024-03-20T13:36:50.167768+0000","last_peered":"2024-03-20T13:36:50.167768+0000","last_clean":"2024-03-20T13:36:50.167768+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:36:50.167768+0000","last_undegraded":"2024-03-20T13:36:50.167768+0000","last_fullsized":"2024-03-20T13:36:50.167768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.167623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:36.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.755783+0000","last_change":"2024-03-20T13:37:13.755783+0000","last_active":"2024-03-20T13:37:13.755783+0000","last_peered":"2024-03-20T13:37:13.755783+0000","last_clean":"2024-03-20T13:37:13.755783+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:37:13.755783+0000","last_undegraded":"2024-03-20T13:37:13.755783+0000","last_fullsized":"2024-03-20T13:37:13.755783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.755656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:44.151919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.319660+0000","last_change":"2024-03-20T13:37:28.319682+0000","last_active":"2024-03-20T13:37:28.319660+0000","last_peered":"2024-03-20T13:37:28.319660+0000","last_clean":"2024-03-20T13:37:28.319660+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:37:28.319660+0000","last_undegraded":"2024-03-20T13:37:28.319660+0000","last_fullsized":"2024-03-20T13:37:28.319660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.319581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.319581+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.319581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:28.231469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.430174+0000","last_change":"2024-03-20T13:36:48.430174+0000","last_active":"2024-03-20T13:36:48.430174+0000","last_peered":"2024-03-20T13:36:48.430174+0000","last_clean":"2024-03-20T13:36:48.430174+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:48.430174+0000","last_undegraded":"2024-03-20T13:36:48.430174+0000","last_fullsized":"2024-03-20T13:36:48.430174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.430044+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:13:05.290246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.424720+0000","last_change":"2024-03-20T13:36:53.424720+0000","last_active":"2024-03-20T13:36:53.424720+0000","last_peered":"2024-03-20T13:36:53.424720+0000","last_clean":"2024-03-20T13:36:53.424720+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:36:53.424720+0000","last_undegraded":"2024-03-20T13:36:53.424720+0000","last_fullsized":"2024-03-20T13:36:53.424720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.424599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:42.288257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.194266+0000","last_change":"2024-03-20T13:37:20.194266+0000","last_active":"2024-03-20T13:37:20.194266+0000","last_peered":"2024-03-20T13:37:20.194266+0000","last_clean":"2024-03-20T13:37:20.194266+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:37:20.194266+0000","last_undegraded":"2024-03-20T13:37:20.194266+0000","last_fullsized":"2024-03-20T13:37:20.194266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:20.194129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:20.194129+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.194129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:24:20.046133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.549325+0000","last_change":"2024-03-20T13:37:21.549325+0000","last_active":"2024-03-20T13:37:21.549325+0000","last_peered":"2024-03-20T13:37:21.549325+0000","last_clean":"2024-03-20T13:37:21.549325+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:37:21.549325+0000","last_undegraded":"2024-03-20T13:37:21.549325+0000","last_fullsized":"2024-03-20T13:37:21.549325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:21.549211+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:21.549211+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.549211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:37.535250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.182023+0000","last_change":"2024-03-20T13:37:30.182049+0000","last_active":"2024-03-20T13:37:30.182023+0000","last_peered":"2024-03-20T13:37:30.182023+0000","last_clean":"2024-03-20T13:37:30.182023+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:37:30.182023+0000","last_undegraded":"2024-03-20T13:37:30.182023+0000","last_fullsized":"2024-03-20T13:37:30.182023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:30.181902+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:30.181902+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.181902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:12:23.621237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.916154+0000","last_change":"2024-03-20T13:36:51.916154+0000","last_active":"2024-03-20T13:36:51.916154+0000","last_peered":"2024-03-20T13:36:51.916154+0000","last_clean":"2024-03-20T13:36:51.916154+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:36:51.916154+0000","last_undegraded":"2024-03-20T13:36:51.916154+0000","last_fullsized":"2024-03-20T13:36:51.916154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.916042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:20.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.240981+0000","last_change":"2024-03-20T13:36:58.241018+0000","last_active":"2024-03-20T13:36:58.240981+0000","last_peered":"2024-03-20T13:36:58.240981+0000","last_clean":"2024-03-20T13:36:58.240981+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:36:58.240981+0000","last_undegraded":"2024-03-20T13:36:58.240981+0000","last_fullsized":"2024-03-20T13:36:58.240981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.240881+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:38.665383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":306,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.069210+0000","last_change":"2024-03-20T13:36:37.069210+0000","last_active":"2024-03-20T13:36:37.069210+0000","last_peered":"2024-03-20T13:36:37.069210+0000","last_clean":"2024-03-20T13:36:37.069210+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:37.069210+0000","last_undegraded":"2024-03-20T13:36:37.069210+0000","last_fullsized":"2024-03-20T13:36:37.069210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.069055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:28:39.752450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:51.268781+0000","last_change":"2024-03-20T13:37:51.268804+0000","last_active":"2024-03-20T13:37:51.268781+0000","last_peered":"2024-03-20T13:37:51.268781+0000","last_clean":"2024-03-20T13:37:51.268781+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:37:51.268781+0000","last_undegraded":"2024-03-20T13:37:51.268781+0000","last_fullsized":"2024-03-20T13:37:51.268781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:51.268688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:51.268688+0000","last_clean_scrub_stamp":"2024-03-20T13:37:51.268688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:20:33.402878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.292302+0000","last_change":"2024-03-20T13:37:02.292302+0000","last_active":"2024-03-20T13:37:02.292302+0000","last_peered":"2024-03-20T13:37:02.292302+0000","last_clean":"2024-03-20T13:37:02.292302+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:37:02.292302+0000","last_undegraded":"2024-03-20T13:37:02.292302+0000","last_fullsized":"2024-03-20T13:37:02.292302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.292156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:32.714561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.691120+0000","last_change":"2024-03-20T13:37:23.691147+0000","last_active":"2024-03-20T13:37:23.691120+0000","last_peered":"2024-03-20T13:37:23.691120+0000","last_clean":"2024-03-20T13:37:23.691120+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:37:23.691120+0000","last_undegraded":"2024-03-20T13:37:23.691120+0000","last_fullsized":"2024-03-20T13:37:23.691120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.691036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.691036+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.691036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:21.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.882093+0000","last_change":"2024-03-20T13:36:45.882093+0000","last_active":"2024-03-20T13:36:45.882093+0000","last_peered":"2024-03-20T13:36:45.882093+0000","last_clean":"2024-03-20T13:36:45.882093+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:36:45.882093+0000","last_undegraded":"2024-03-20T13:36:45.882093+0000","last_fullsized":"2024-03-20T13:36:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.881976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:18.667047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.780797+0000","last_change":"2024-03-20T13:36:40.780797+0000","last_active":"2024-03-20T13:36:40.780797+0000","last_peered":"2024-03-20T13:36:40.780797+0000","last_clean":"2024-03-20T13:36:40.780797+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:40.780797+0000","last_undegraded":"2024-03-20T13:36:40.780797+0000","last_fullsized":"2024-03-20T13:36:40.780797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.780669+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:55.427462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.483874+0000","last_change":"2024-03-20T13:36:37.483874+0000","last_active":"2024-03-20T13:36:37.483874+0000","last_peered":"2024-03-20T13:36:37.483874+0000","last_clean":"2024-03-20T13:36:37.483874+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:36:37.483874+0000","last_undegraded":"2024-03-20T13:36:37.483874+0000","last_fullsized":"2024-03-20T13:36:37.483874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.483750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:40.729135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.753378+0000","last_change":"2024-03-20T13:37:33.753408+0000","last_active":"2024-03-20T13:37:33.753378+0000","last_peered":"2024-03-20T13:37:33.753378+0000","last_clean":"2024-03-20T13:37:33.753378+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:37:33.753378+0000","last_undegraded":"2024-03-20T13:37:33.753378+0000","last_fullsized":"2024-03-20T13:37:33.753378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:33.753268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:33.753268+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.753268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:17.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.259918+0000","last_change":"2024-03-20T13:37:01.259918+0000","last_active":"2024-03-20T13:37:01.259918+0000","last_peered":"2024-03-20T13:37:01.259918+0000","last_clean":"2024-03-20T13:37:01.259918+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:37:01.259918+0000","last_undegraded":"2024-03-20T13:37:01.259918+0000","last_fullsized":"2024-03-20T13:37:01.259918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.259780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:24.962382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:50.307252+0000","last_change":"2024-03-20T13:37:50.307300+0000","last_active":"2024-03-20T13:37:50.307252+0000","last_peered":"2024-03-20T13:37:50.307252+0000","last_clean":"2024-03-20T13:37:50.307252+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:37:50.307252+0000","last_undegraded":"2024-03-20T13:37:50.307252+0000","last_fullsized":"2024-03-20T13:37:50.307252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:50.307141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:50.307141+0000","last_clean_scrub_stamp":"2024-03-20T13:37:50.307141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:02:41.567931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.111639+0000","last_change":"2024-03-20T13:36:55.111639+0000","last_active":"2024-03-20T13:36:55.111639+0000","last_peered":"2024-03-20T13:36:55.111639+0000","last_clean":"2024-03-20T13:36:55.111639+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:36:55.111639+0000","last_undegraded":"2024-03-20T13:36:55.111639+0000","last_fullsized":"2024-03-20T13:36:55.111639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.111514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:29.756932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.483646+0000","last_change":"2024-03-20T13:36:34.483646+0000","last_active":"2024-03-20T13:36:34.483646+0000","last_peered":"2024-03-20T13:36:34.483646+0000","last_clean":"2024-03-20T13:36:34.483646+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:34.483646+0000","last_undegraded":"2024-03-20T13:36:34.483646+0000","last_fullsized":"2024-03-20T13:36:34.483646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.483533+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:25:29.809601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.258997+0000","last_change":"2024-03-20T13:37:04.258997+0000","last_active":"2024-03-20T13:37:04.258997+0000","last_peered":"2024-03-20T13:37:04.258997+0000","last_clean":"2024-03-20T13:37:04.258997+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:37:04.258997+0000","last_undegraded":"2024-03-20T13:37:04.258997+0000","last_fullsized":"2024-03-20T13:37:04.258997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.258885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:14:48.115373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594468+0000","last_change":"2024-03-20T13:34:59.974914+0000","last_active":"2024-03-20T13:36:35.594468+0000","last_peered":"2024-03-20T13:36:35.594468+0000","last_clean":"2024-03-20T13:36:35.594468+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:36:35.594468+0000","last_undegraded":"2024-03-20T13:36:35.594468+0000","last_fullsized":"2024-03-20T13:36:35.594468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.231760+0000","last_change":"2024-03-20T13:37:15.231760+0000","last_active":"2024-03-20T13:37:15.231760+0000","last_peered":"2024-03-20T13:37:15.231760+0000","last_clean":"2024-03-20T13:37:15.231760+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:37:15.231760+0000","last_undegraded":"2024-03-20T13:37:15.231760+0000","last_fullsized":"2024-03-20T13:37:15.231760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.231613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.231613+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.231613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:33.553502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.482913+0000","last_change":"2024-03-20T13:37:18.482957+0000","last_active":"2024-03-20T13:37:18.482913+0000","last_peered":"2024-03-20T13:37:18.482913+0000","last_clean":"2024-03-20T13:37:18.482913+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:37:18.482913+0000","last_undegraded":"2024-03-20T13:37:18.482913+0000","last_fullsized":"2024-03-20T13:37:18.482913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:18.482773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:18.482773+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.482773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:21:14.037744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.870499+0000","last_change":"2024-03-20T13:36:44.870499+0000","last_active":"2024-03-20T13:36:44.870499+0000","last_peered":"2024-03-20T13:36:44.870499+0000","last_clean":"2024-03-20T13:36:44.870499+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:36:44.870499+0000","last_undegraded":"2024-03-20T13:36:44.870499+0000","last_fullsized":"2024-03-20T13:36:44.870499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:38:54.104546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.096207+0000","last_change":"2024-03-20T13:36:40.096207+0000","last_active":"2024-03-20T13:36:40.096207+0000","last_peered":"2024-03-20T13:36:40.096207+0000","last_clean":"2024-03-20T13:36:40.096207+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:40.096207+0000","last_undegraded":"2024-03-20T13:36:40.096207+0000","last_fullsized":"2024-03-20T13:36:40.096207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.096051+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:22.717936+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.230574+0000","last_change":"2024-03-20T13:36:56.230574+0000","last_active":"2024-03-20T13:36:56.230574+0000","last_peered":"2024-03-20T13:36:56.230574+0000","last_clean":"2024-03-20T13:36:56.230574+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:36:56.230574+0000","last_undegraded":"2024-03-20T13:36:56.230574+0000","last_fullsized":"2024-03-20T13:36:56.230574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.230465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:30.142163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:53.192964+0000","last_change":"2024-03-20T13:37:53.193019+0000","last_active":"2024-03-20T13:37:53.192964+0000","last_peered":"2024-03-20T13:37:53.192964+0000","last_clean":"2024-03-20T13:37:53.192964+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:37:53.192964+0000","last_undegraded":"2024-03-20T13:37:53.192964+0000","last_fullsized":"2024-03-20T13:37:53.192964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:53.192846+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:53.192846+0000","last_clean_scrub_stamp":"2024-03-20T13:37:53.192846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:08:09.288436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.219367+0000","last_change":"2024-03-20T13:37:00.219367+0000","last_active":"2024-03-20T13:37:00.219367+0000","last_peered":"2024-03-20T13:37:00.219367+0000","last_clean":"2024-03-20T13:37:00.219367+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:37:00.219367+0000","last_undegraded":"2024-03-20T13:37:00.219367+0000","last_fullsized":"2024-03-20T13:37:00.219367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.219255+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:42.847366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.655514+0000","last_change":"2024-03-20T13:37:22.655562+0000","last_active":"2024-03-20T13:37:22.655514+0000","last_peered":"2024-03-20T13:37:22.655514+0000","last_clean":"2024-03-20T13:37:22.655514+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:37:22.655514+0000","last_undegraded":"2024-03-20T13:37:22.655514+0000","last_fullsized":"2024-03-20T13:37:22.655514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.655413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.655413+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.655413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:13:19.814687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.792027+0000","last_change":"2024-03-20T13:36:41.792027+0000","last_active":"2024-03-20T13:36:41.792027+0000","last_peered":"2024-03-20T13:36:41.792027+0000","last_clean":"2024-03-20T13:36:41.792027+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:36:41.792027+0000","last_undegraded":"2024-03-20T13:36:41.792027+0000","last_fullsized":"2024-03-20T13:36:41.792027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.791862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:01.217069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.209667+0000","last_change":"2024-03-20T13:36:52.209667+0000","last_active":"2024-03-20T13:36:52.209667+0000","last_peered":"2024-03-20T13:36:52.209667+0000","last_clean":"2024-03-20T13:36:52.209667+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:52.209667+0000","last_undegraded":"2024-03-20T13:36:52.209667+0000","last_fullsized":"2024-03-20T13:36:52.209667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.209539+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:29.303951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.508600+0000","last_change":"2024-03-20T13:36:39.508600+0000","last_active":"2024-03-20T13:36:39.508600+0000","last_peered":"2024-03-20T13:36:39.508600+0000","last_clean":"2024-03-20T13:36:39.508600+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:36:39.508600+0000","last_undegraded":"2024-03-20T13:36:39.508600+0000","last_fullsized":"2024-03-20T13:36:39.508600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.508482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:31.029035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":18,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.594422+0000","last_change":"2024-03-20T13:34:59.974923+0000","last_active":"2024-03-20T13:36:35.594422+0000","last_peered":"2024-03-20T13:36:35.594422+0000","last_clean":"2024-03-20T13:36:35.594422+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:36:35.594422+0000","last_undegraded":"2024-03-20T13:36:35.594422+0000","last_fullsized":"2024-03-20T13:36:35.594422+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:34:58.947551+0000","last_clean_scrub_stamp":"2024-03-20T13:34:58.947551+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.853870+0000","last_change":"2024-03-20T13:36:53.853870+0000","last_active":"2024-03-20T13:36:53.853870+0000","last_peered":"2024-03-20T13:36:53.853870+0000","last_clean":"2024-03-20T13:36:53.853870+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:36:53.853870+0000","last_undegraded":"2024-03-20T13:36:53.853870+0000","last_fullsized":"2024-03-20T13:36:53.853870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.853690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:52.367889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.226235+0000","last_change":"2024-03-20T13:37:15.226284+0000","last_active":"2024-03-20T13:37:15.226235+0000","last_peered":"2024-03-20T13:37:15.226235+0000","last_clean":"2024-03-20T13:37:15.226235+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:37:15.226235+0000","last_undegraded":"2024-03-20T13:37:15.226235+0000","last_fullsized":"2024-03-20T13:37:15.226235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.226132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.226132+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.226132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:53.150881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.508390+0000","last_change":"2024-03-20T13:37:19.508412+0000","last_active":"2024-03-20T13:37:19.508390+0000","last_peered":"2024-03-20T13:37:19.508390+0000","last_clean":"2024-03-20T13:37:19.508390+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:37:19.508390+0000","last_undegraded":"2024-03-20T13:37:19.508390+0000","last_fullsized":"2024-03-20T13:37:19.508390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.508305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.508305+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.508305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:37.042863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.513345+0000","last_change":"2024-03-20T13:37:25.513374+0000","last_active":"2024-03-20T13:37:25.513345+0000","last_peered":"2024-03-20T13:37:25.513345+0000","last_clean":"2024-03-20T13:37:25.513345+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:37:25.513345+0000","last_undegraded":"2024-03-20T13:37:25.513345+0000","last_fullsized":"2024-03-20T13:37:25.513345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:25.513252+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:25.513252+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.513252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:04.951193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.225063+0000","last_change":"2024-03-20T13:37:14.225110+0000","last_active":"2024-03-20T13:37:14.225063+0000","last_peered":"2024-03-20T13:37:14.225063+0000","last_clean":"2024-03-20T13:37:14.225063+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:37:14.225063+0000","last_undegraded":"2024-03-20T13:37:14.225063+0000","last_fullsized":"2024-03-20T13:37:14.225063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:14.224966+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:14.224966+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.224966+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:58.359943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:40.216530+0000","last_change":"2024-03-20T13:37:40.216570+0000","last_active":"2024-03-20T13:37:40.216530+0000","last_peered":"2024-03-20T13:37:40.216530+0000","last_clean":"2024-03-20T13:37:40.216530+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:37:40.216530+0000","last_undegraded":"2024-03-20T13:37:40.216530+0000","last_fullsized":"2024-03-20T13:37:40.216530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:40.216438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:40.216438+0000","last_clean_scrub_stamp":"2024-03-20T13:37:40.216438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:14:50.913168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.453355+0000","last_change":"2024-03-20T13:37:17.453385+0000","last_active":"2024-03-20T13:37:17.453355+0000","last_peered":"2024-03-20T13:37:17.453355+0000","last_clean":"2024-03-20T13:37:17.453355+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:37:17.453355+0000","last_undegraded":"2024-03-20T13:37:17.453355+0000","last_fullsized":"2024-03-20T13:37:17.453355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:17.453269+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:17.453269+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.453269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:35.300810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.549703+0000","last_change":"2024-03-20T13:37:27.549726+0000","last_active":"2024-03-20T13:37:27.549703+0000","last_peered":"2024-03-20T13:37:27.549703+0000","last_clean":"2024-03-20T13:37:27.549703+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:37:27.549703+0000","last_undegraded":"2024-03-20T13:37:27.549703+0000","last_fullsized":"2024-03-20T13:37:27.549703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.549627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.549627+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.549627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:56.355311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.465825+0000","last_change":"2024-03-20T13:37:13.465849+0000","last_active":"2024-03-20T13:37:13.465825+0000","last_peered":"2024-03-20T13:37:13.465825+0000","last_clean":"2024-03-20T13:37:13.465825+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:37:13.465825+0000","last_undegraded":"2024-03-20T13:37:13.465825+0000","last_fullsized":"2024-03-20T13:37:13.465825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.465734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.465734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.465734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:27.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.470748+0000","last_change":"2024-03-20T13:37:10.470774+0000","last_active":"2024-03-20T13:37:10.470748+0000","last_peered":"2024-03-20T13:37:10.470748+0000","last_clean":"2024-03-20T13:37:10.470748+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:37:10.470748+0000","last_undegraded":"2024-03-20T13:37:10.470748+0000","last_fullsized":"2024-03-20T13:37:10.470748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.470658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:47.565070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.807076+0000","last_change":"2024-03-20T13:36:55.807076+0000","last_active":"2024-03-20T13:36:55.807076+0000","last_peered":"2024-03-20T13:36:55.807076+0000","last_clean":"2024-03-20T13:36:55.807076+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:55.807076+0000","last_undegraded":"2024-03-20T13:36:55.807076+0000","last_fullsized":"2024-03-20T13:36:55.807076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.806960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:44.670617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.762037+0000","last_change":"2024-03-20T13:37:27.762086+0000","last_active":"2024-03-20T13:37:27.762037+0000","last_peered":"2024-03-20T13:37:27.762037+0000","last_clean":"2024-03-20T13:37:27.762037+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:37:27.762037+0000","last_undegraded":"2024-03-20T13:37:27.762037+0000","last_fullsized":"2024-03-20T13:37:27.762037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.761939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.761939+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.761939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:07.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.580860+0000","last_change":"2024-03-20T13:37:31.580894+0000","last_active":"2024-03-20T13:37:31.580860+0000","last_peered":"2024-03-20T13:37:31.580860+0000","last_clean":"2024-03-20T13:37:31.580860+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:37:31.580860+0000","last_undegraded":"2024-03-20T13:37:31.580860+0000","last_fullsized":"2024-03-20T13:37:31.580860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:31.580773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:31.580773+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.580773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:15.715751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.232063+0000","last_change":"2024-03-20T13:37:23.232120+0000","last_active":"2024-03-20T13:37:23.232063+0000","last_peered":"2024-03-20T13:37:23.232063+0000","last_clean":"2024-03-20T13:37:23.232063+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:37:23.232063+0000","last_undegraded":"2024-03-20T13:37:23.232063+0000","last_fullsized":"2024-03-20T13:37:23.232063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:23.231964+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:23.231964+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.231964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:34.011833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.770943+0000","last_change":"2024-03-20T13:37:07.770971+0000","last_active":"2024-03-20T13:37:07.770943+0000","last_peered":"2024-03-20T13:37:07.770943+0000","last_clean":"2024-03-20T13:37:07.770943+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:37:07.770943+0000","last_undegraded":"2024-03-20T13:37:07.770943+0000","last_fullsized":"2024-03-20T13:37:07.770943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.770860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:00.706350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.535234+0000","last_change":"2024-03-20T13:37:22.535259+0000","last_active":"2024-03-20T13:37:22.535234+0000","last_peered":"2024-03-20T13:37:22.535234+0000","last_clean":"2024-03-20T13:37:22.535234+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:37:22.535234+0000","last_undegraded":"2024-03-20T13:37:22.535234+0000","last_fullsized":"2024-03-20T13:37:22.535234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.535142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.535142+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.535142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:17:18.418163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.807590+0000","last_change":"2024-03-20T13:37:28.807616+0000","last_active":"2024-03-20T13:37:28.807590+0000","last_peered":"2024-03-20T13:37:28.807590+0000","last_clean":"2024-03-20T13:37:28.807590+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:37:28.807590+0000","last_undegraded":"2024-03-20T13:37:28.807590+0000","last_fullsized":"2024-03-20T13:37:28.807590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.807509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.807509+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.807509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:44.504905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:48.337956+0000","last_change":"2024-03-20T13:37:48.337991+0000","last_active":"2024-03-20T13:37:48.337956+0000","last_peered":"2024-03-20T13:37:48.337956+0000","last_clean":"2024-03-20T13:37:48.337956+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:37:48.337956+0000","last_undegraded":"2024-03-20T13:37:48.337956+0000","last_fullsized":"2024-03-20T13:37:48.337956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:48.337862+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:48.337862+0000","last_clean_scrub_stamp":"2024-03-20T13:37:48.337862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:33.720570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.249034+0000","last_change":"2024-03-20T13:37:10.249034+0000","last_active":"2024-03-20T13:37:10.249034+0000","last_peered":"2024-03-20T13:37:10.249034+0000","last_clean":"2024-03-20T13:37:10.249034+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:37:10.249034+0000","last_undegraded":"2024-03-20T13:37:10.249034+0000","last_fullsized":"2024-03-20T13:37:10.249034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.248909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:39.054592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.543243+0000","last_change":"2024-03-20T13:37:30.543269+0000","last_active":"2024-03-20T13:37:30.543243+0000","last_peered":"2024-03-20T13:37:30.543243+0000","last_clean":"2024-03-20T13:37:30.543243+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:37:30.543243+0000","last_undegraded":"2024-03-20T13:37:30.543243+0000","last_fullsized":"2024-03-20T13:37:30.543243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:30.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:30.543149+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:56.299365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.472298+0000","last_change":"2024-03-20T13:37:09.472360+0000","last_active":"2024-03-20T13:37:09.472298+0000","last_peered":"2024-03-20T13:37:09.472298+0000","last_clean":"2024-03-20T13:37:09.472298+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:37:09.472298+0000","last_undegraded":"2024-03-20T13:37:09.472298+0000","last_fullsized":"2024-03-20T13:37:09.472298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.472199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:56.902554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.779854+0000","last_change":"2024-03-20T13:37:09.779881+0000","last_active":"2024-03-20T13:37:09.779854+0000","last_peered":"2024-03-20T13:37:09.779854+0000","last_clean":"2024-03-20T13:37:09.779854+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:37:09.779854+0000","last_undegraded":"2024-03-20T13:37:09.779854+0000","last_fullsized":"2024-03-20T13:37:09.779854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.779734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:12.306761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.713221+0000","last_change":"2024-03-20T13:37:16.713248+0000","last_active":"2024-03-20T13:37:16.713221+0000","last_peered":"2024-03-20T13:37:16.713221+0000","last_clean":"2024-03-20T13:37:16.713221+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:37:16.713221+0000","last_undegraded":"2024-03-20T13:37:16.713221+0000","last_fullsized":"2024-03-20T13:37:16.713221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:16.713135+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:16.713135+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.713135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:16.625022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.717631+0000","last_change":"2024-03-20T13:37:25.717657+0000","last_active":"2024-03-20T13:37:25.717631+0000","last_peered":"2024-03-20T13:37:25.717631+0000","last_clean":"2024-03-20T13:37:25.717631+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:37:25.717631+0000","last_undegraded":"2024-03-20T13:37:25.717631+0000","last_fullsized":"2024-03-20T13:37:25.717631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:25.717548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:25.717548+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.717548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:32.380417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.698955+0000","last_change":"2024-03-20T13:37:03.698955+0000","last_active":"2024-03-20T13:37:03.698955+0000","last_peered":"2024-03-20T13:37:03.698955+0000","last_clean":"2024-03-20T13:37:03.698955+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:37:03.698955+0000","last_undegraded":"2024-03-20T13:37:03.698955+0000","last_fullsized":"2024-03-20T13:37:03.698955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.698845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:41.623595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:39.180439+0000","last_change":"2024-03-20T13:37:39.180466+0000","last_active":"2024-03-20T13:37:39.180439+0000","last_peered":"2024-03-20T13:37:39.180439+0000","last_clean":"2024-03-20T13:37:39.180439+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:37:39.180439+0000","last_undegraded":"2024-03-20T13:37:39.180439+0000","last_fullsized":"2024-03-20T13:37:39.180439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:39.180348+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:39.180348+0000","last_clean_scrub_stamp":"2024-03-20T13:37:39.180348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:26.782216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.838638+0000","last_change":"2024-03-20T13:36:57.838638+0000","last_active":"2024-03-20T13:36:57.838638+0000","last_peered":"2024-03-20T13:36:57.838638+0000","last_clean":"2024-03-20T13:36:57.838638+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:57.838638+0000","last_undegraded":"2024-03-20T13:36:57.838638+0000","last_fullsized":"2024-03-20T13:36:57.838638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.838471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:27.325680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.213067+0000","last_change":"2024-03-20T13:37:23.213109+0000","last_active":"2024-03-20T13:37:23.213067+0000","last_peered":"2024-03-20T13:37:23.213067+0000","last_clean":"2024-03-20T13:37:23.213067+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:37:23.213067+0000","last_undegraded":"2024-03-20T13:37:23.213067+0000","last_fullsized":"2024-03-20T13:37:23.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.212970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.212970+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.212970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:19:18.200331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.259174+0000","last_change":"2024-03-20T13:37:09.259202+0000","last_active":"2024-03-20T13:37:09.259174+0000","last_peered":"2024-03-20T13:37:09.259174+0000","last_clean":"2024-03-20T13:37:09.259174+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:37:09.259174+0000","last_undegraded":"2024-03-20T13:37:09.259174+0000","last_fullsized":"2024-03-20T13:37:09.259174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.259090+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:24.956485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.241472+0000","last_change":"2024-03-20T13:37:13.241520+0000","last_active":"2024-03-20T13:37:13.241472+0000","last_peered":"2024-03-20T13:37:13.241472+0000","last_clean":"2024-03-20T13:37:13.241472+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:37:13.241472+0000","last_undegraded":"2024-03-20T13:37:13.241472+0000","last_fullsized":"2024-03-20T13:37:13.241472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.241356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:38.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.758880+0000","last_change":"2024-03-20T13:37:12.758905+0000","last_active":"2024-03-20T13:37:12.758880+0000","last_peered":"2024-03-20T13:37:12.758880+0000","last_clean":"2024-03-20T13:37:12.758880+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:37:12.758880+0000","last_undegraded":"2024-03-20T13:37:12.758880+0000","last_fullsized":"2024-03-20T13:37:12.758880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.758780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:41.146374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:36.153244+0000","last_change":"2024-03-20T13:37:36.153275+0000","last_active":"2024-03-20T13:37:36.153244+0000","last_peered":"2024-03-20T13:37:36.153244+0000","last_clean":"2024-03-20T13:37:36.153244+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:37:36.153244+0000","last_undegraded":"2024-03-20T13:37:36.153244+0000","last_fullsized":"2024-03-20T13:37:36.153244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:36.153126+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:36.153126+0000","last_clean_scrub_stamp":"2024-03-20T13:37:36.153126+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:34.772622+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:47.302975+0000","last_change":"2024-03-20T13:37:47.303007+0000","last_active":"2024-03-20T13:37:47.302975+0000","last_peered":"2024-03-20T13:37:47.302975+0000","last_clean":"2024-03-20T13:37:47.302975+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:37:47.302975+0000","last_undegraded":"2024-03-20T13:37:47.302975+0000","last_fullsized":"2024-03-20T13:37:47.302975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:47.302874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:47.302874+0000","last_clean_scrub_stamp":"2024-03-20T13:37:47.302874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:48:59.438649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.431612+0000","last_change":"2024-03-20T13:37:06.431612+0000","last_active":"2024-03-20T13:37:06.431612+0000","last_peered":"2024-03-20T13:37:06.431612+0000","last_clean":"2024-03-20T13:37:06.431612+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:37:06.431612+0000","last_undegraded":"2024-03-20T13:37:06.431612+0000","last_fullsized":"2024-03-20T13:37:06.431612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.431483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:44.278362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.426490+0000","last_change":"2024-03-20T13:37:14.426517+0000","last_active":"2024-03-20T13:37:14.426490+0000","last_peered":"2024-03-20T13:37:14.426490+0000","last_clean":"2024-03-20T13:37:14.426490+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:37:14.426490+0000","last_undegraded":"2024-03-20T13:37:14.426490+0000","last_fullsized":"2024-03-20T13:37:14.426490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:14.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:14.426401+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:48.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.765626+0000","last_change":"2024-03-20T13:37:10.765626+0000","last_active":"2024-03-20T13:37:10.765626+0000","last_peered":"2024-03-20T13:37:10.765626+0000","last_clean":"2024-03-20T13:37:10.765626+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:37:10.765626+0000","last_undegraded":"2024-03-20T13:37:10.765626+0000","last_fullsized":"2024-03-20T13:37:10.765626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.765500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:58.195856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1417,"ondisk_log_size":1417,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673005,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57099999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.441,"15min":0.42499999999999999},"min":{"1min":0.30599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.48399999999999999}]},{"osd":1,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.31900000000000001,"15min":0.32100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.315,"15min":0.32300000000000001},"min":{"1min":0.221,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.41799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.20799999999999999}]},{"osd":3,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.33000000000000002},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.40400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.246},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.439,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.30299999999999999}]}]},{"osd":1,"up_from":10,"seq":42949673004,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.443,"15min":0.42699999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54500000000000004,"5min":1.228,"15min":1.228},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":1.169,"15min":1.169},"last":0.42199999999999999}]},{"osd":2,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.312,"15min":0.31},"min":{"1min":0.218,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42899999999999999,"5min":0.496,"15min":0.496},"last":0.32100000000000001}]},{"osd":3,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46300000000000002,"5min":0.502,"15min":0.502},"last":0.371},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33300000000000002,"15min":0.33400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.30399999999999999}]}]},{"osd":3,"up_from":9,"seq":38654705706,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.52900000000000003}]},{"osd":1,"last update":"Wed Mar 20 13:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.309,"15min":0.31},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.313},{"interface":"front","average":{"1min":0.313,"5min":0.316,"15min":0.32000000000000001},"min":{"1min":0.254,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.44600000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.27600000000000002}]},{"osd":2,"last update":"Wed Mar 20 13:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.28599999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.41199999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.34699999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705708,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69299999999999995,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.80600000000000005}]},{"osd":2,"last update":"Wed Mar 20 13:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64800000000000002,"5min":1.522,"15min":1.522},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63100000000000001,"5min":1.282,"15min":1.282},"last":0.753}]},{"osd":3,"last update":"Wed Mar 20 13:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":1.593,"15min":1.593},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60699999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.70899999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:37:57.462 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-03-20T13:34:52.925004+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=52, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:57.463 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:57.463 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:57.464 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-03-20T13:34:58.947551+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=34, tm_sec=58, tm_wday=2, tm_yday=80, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=20, tm_hour=13, tm_min=36, tm_sec=32, tm_wday=2, tm_yday=80, tm_isdst=0) 2024-03-20T13:37:57.464 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-20T13:38:17.466 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-20T13:38:17.579 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc97238f640 1 Processor -- start 2024-03-20T13:38:17.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc97238f640 1 -- start start 2024-03-20T13:38:17.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc97238f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc96c0956a0 0x7fc96c095a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:17.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc97238f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c095270 con 0x7fc96c127460 2024-03-20T13:38:17.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc97238f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0954a0 con 0x7fc96c0956a0 2024-03-20T13:38:17.580 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc96bfff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc96c0956a0 0x7fc96c095a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:17.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc96b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc96c127460 0x7fc96c127870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55422/0 (socket says 172.21.15.28:55422) 2024-03-20T13:38:17.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc96b7fe640 1 -- 172.21.15.28:0/54122543 learned_addr learned my addr 172.21.15.28:0/54122543 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:38:17.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc96bfff640 1 -- 172.21.15.28:0/54122543 >> v1:172.21.15.28:6789/0 conn(0x7fc96c127460 legacy=0x7fc96c127870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:17.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc96bfff640 1 -- 172.21.15.28:0/54122543 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c093d90 con 0x7fc96c0956a0 2024-03-20T13:38:17.581 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.578+0000 7fc96affd640 1 -- 172.21.15.28:0/54122543 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808862540 0 0) 0x7fc96c095270 con 0x7fc96c127460 2024-03-20T13:38:17.584 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.579+0000 7fc96bfff640 1 --2- 172.21.15.28:0/54122543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c095a80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc954009720 tx=0x7fc95402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790407d68b2ecbe1 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.579+0000 7fc96affd640 1 -- 172.21.15.28:0/54122543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc95402e070 con 0x7fc96c0956a0 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.579+0000 7fc96affd640 1 -- 172.21.15.28:0/54122543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9540316d0 con 0x7fc96c0956a0 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.579+0000 7fc96affd640 1 -- 172.21.15.28:0/54122543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc954031990 con 0x7fc96c0956a0 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 -- 172.21.15.28:0/54122543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 msgr2=0x7fc96c095a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 --2- 172.21.15.28:0/54122543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c095a80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fc954009720 tx=0x7fc95402b840 comp rx=0 tx=0).stop 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 -- 172.21.15.28:0/54122543 shutdown_connections 2024-03-20T13:38:17.585 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 --2- 172.21.15.28:0/54122543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c095a80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 -- 172.21.15.28:0/54122543 >> 172.21.15.28:0/54122543 conn(0x7fc96c09a300 msgr2=0x7fc96c09a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 -- 172.21.15.28:0/54122543 shutdown_connections 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.580+0000 7fc97238f640 1 -- 172.21.15.28:0/54122543 wait complete. 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.581+0000 7fc97238f640 1 Processor -- start 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.581+0000 7fc97238f640 1 -- start start 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.581+0000 7fc97238f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c1af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:17.586 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.581+0000 7fc97238f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c097e40 con 0x7fc96c0956a0 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc96bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c1af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc96bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c1af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52062/0 (socket says 172.21.15.28:52062) 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc96bfff640 1 -- 172.21.15.28:0/1591460706 learned_addr learned my addr 172.21.15.28:0/1591460706 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc96bfff640 1 -- 172.21.15.28:0/1591460706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954009400 con 0x7fc96c0956a0 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc96bfff640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c1af850 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc95402b880 tx=0x7fc9540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc954004160 con 0x7fc96c0956a0 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9540042c0 con 0x7fc96c0956a0 2024-03-20T13:38:17.587 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc954032780 con 0x7fc96c0956a0 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c06d2c0 con 0x7fc96c0956a0 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.582+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c06eb00 con 0x7fc96c0956a0 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.583+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7fc9540328e0 con 0x7fc96c0956a0 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.583+0000 7fc968ff9640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc94c037ef0 0x7fc94c03a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.583+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7fc95406d990 con 0x7fc96c0956a0 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.583+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c123d00 con 0x7fc96c0956a0 2024-03-20T13:38:17.588 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.584+0000 7fc96b7fe640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc94c037ef0 0x7fc94c03a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:17.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.584+0000 7fc96b7fe640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc94c037ef0 0x7fc94c03a3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc95c000c00 tx=0x7fc95c007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:17.589 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.588+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7fc954032b90 con 0x7fc96c0956a0 2024-03-20T13:38:17.768 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.766+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 --> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc96c093ba0 con 0x7fc94c037ef0 2024-03-20T13:38:17.783 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.782+0000 7fc968ff9640 1 -- 172.21.15.28:0/1591460706 <== mgr.4101 v2:172.21.15.177:6824/915573033 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+673682 (secure 0 0 0) 0x7fc96c093ba0 con 0x7fc94c037ef0 2024-03-20T13:38:17.791 INFO:teuthology.orchestra.run.smithi028.stdout: 2024-03-20T13:38:17.797 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2024-03-20T13:38:17.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc94c037ef0 msgr2=0x7fc94c03a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:17.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc94c037ef0 0x7fc94c03a3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc95c000c00 tx=0x7fc95c007910 comp rx=0 tx=0).stop 2024-03-20T13:38:17.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 msgr2=0x7fc96c1af850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:17.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c1af850 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fc95402b880 tx=0x7fc9540046c0 comp rx=0 tx=0).stop 2024-03-20T13:38:17.800 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 shutdown_connections 2024-03-20T13:38:17.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7fc94c037ef0 0x7fc94c03a3b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:17.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 --2- 172.21.15.28:0/1591460706 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc96c0956a0 0x7fc96c1af850 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:17.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 >> 172.21.15.28:0/1591460706 conn(0x7fc96c09a300 msgr2=0x7fc96c094160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:17.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 shutdown_connections 2024-03-20T13:38:17.801 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.786+0000 7fc97238f640 1 -- 172.21.15.28:0/1591460706 wait complete. 2024-03-20T13:38:17.802 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":141,"stamp":"2024-03-20T13:38:17.206595+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":600109,"num_objects":213,"num_object_clones":0,"num_object_copies":427,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":213,"num_whiteouts":0,"num_read":4002,"num_read_kb":3648,"num_write":1517,"num_write_kb":31929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1878,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3966,"ondisk_log_size":3966,"up":594,"acting":594,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":594,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":135828,"kb_used_data":2804,"kb_used_omap":6,"kb_used_meta":132985,"kb_avail":377351532,"statfs":{"total":386547056640,"available":386407968768,"internally_reserved":0,"allocated":2871296,"data_stored":1766110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":136177430},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004396"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.273131+0000","last_change":"2024-03-20T13:37:21.273157+0000","last_active":"2024-03-20T13:37:21.273131+0000","last_peered":"2024-03-20T13:37:21.273131+0000","last_clean":"2024-03-20T13:37:21.273131+0000","last_became_active":"2024-03-20T13:34:49.945029+0000","last_became_peered":"2024-03-20T13:34:49.945029+0000","last_unstale":"2024-03-20T13:37:21.273131+0000","last_undegraded":"2024-03-20T13:37:21.273131+0000","last_fullsized":"2024-03-20T13:37:21.273131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:21.273041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:21.273041+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.273041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:23.800069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.734610+0000","last_change":"2024-03-20T13:37:00.734610+0000","last_active":"2024-03-20T13:37:00.734610+0000","last_peered":"2024-03-20T13:37:00.734610+0000","last_clean":"2024-03-20T13:37:00.734610+0000","last_became_active":"2024-03-20T13:34:51.948374+0000","last_became_peered":"2024-03-20T13:34:51.948374+0000","last_unstale":"2024-03-20T13:37:00.734610+0000","last_undegraded":"2024-03-20T13:37:00.734610+0000","last_fullsized":"2024-03-20T13:37:00.734610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:00.734488+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.734488+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:43.356373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.547724+0000","last_change":"2024-03-20T13:37:26.547753+0000","last_active":"2024-03-20T13:37:26.547724+0000","last_peered":"2024-03-20T13:37:26.547724+0000","last_clean":"2024-03-20T13:37:26.547724+0000","last_became_active":"2024-03-20T13:34:49.932742+0000","last_became_peered":"2024-03-20T13:34:49.932742+0000","last_unstale":"2024-03-20T13:37:26.547724+0000","last_undegraded":"2024-03-20T13:37:26.547724+0000","last_fullsized":"2024-03-20T13:37:26.547724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:26.547630+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:26.547630+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.547630+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:42.245026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"32'6","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:38.533984+0000","last_change":"2024-03-20T13:37:38.533984+0000","last_active":"2024-03-20T13:37:38.533984+0000","last_peered":"2024-03-20T13:37:38.533984+0000","last_clean":"2024-03-20T13:37:38.533984+0000","last_became_active":"2024-03-20T13:35:30.990095+0000","last_became_peered":"2024-03-20T13:35:30.990095+0000","last_unstale":"2024-03-20T13:37:38.533984+0000","last_undegraded":"2024-03-20T13:37:38.533984+0000","last_fullsized":"2024-03-20T13:37:38.533984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:38.533844+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:38.533844+0000","last_clean_scrub_stamp":"2024-03-20T13:37:38.533844+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:50:15.716001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:38.198030+0000","last_change":"2024-03-20T13:37:38.198058+0000","last_active":"2024-03-20T13:37:38.198030+0000","last_peered":"2024-03-20T13:37:38.198030+0000","last_clean":"2024-03-20T13:37:38.198030+0000","last_became_active":"2024-03-20T13:34:49.961092+0000","last_became_peered":"2024-03-20T13:34:49.961092+0000","last_unstale":"2024-03-20T13:37:38.198030+0000","last_undegraded":"2024-03-20T13:37:38.198030+0000","last_fullsized":"2024-03-20T13:37:38.198030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:38.197941+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:38.197941+0000","last_clean_scrub_stamp":"2024-03-20T13:37:38.197941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:55:29.071340+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.198759+0000","last_change":"2024-03-20T13:37:13.198759+0000","last_active":"2024-03-20T13:37:13.198759+0000","last_peered":"2024-03-20T13:37:13.198759+0000","last_clean":"2024-03-20T13:37:13.198759+0000","last_became_active":"2024-03-20T13:34:51.947479+0000","last_became_peered":"2024-03-20T13:34:51.947479+0000","last_unstale":"2024-03-20T13:37:13.198759+0000","last_undegraded":"2024-03-20T13:37:13.198759+0000","last_fullsized":"2024-03-20T13:37:13.198759+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.198622+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.198622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:38.954838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.216682+0000","last_change":"2024-03-20T13:37:07.216726+0000","last_active":"2024-03-20T13:37:07.216682+0000","last_peered":"2024-03-20T13:37:07.216682+0000","last_clean":"2024-03-20T13:37:07.216682+0000","last_became_active":"2024-03-20T13:34:49.952375+0000","last_became_peered":"2024-03-20T13:34:49.952375+0000","last_unstale":"2024-03-20T13:37:07.216682+0000","last_undegraded":"2024-03-20T13:37:07.216682+0000","last_fullsized":"2024-03-20T13:37:07.216682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.216575+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.216575+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:56.080233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"32'6","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.266558+0000","last_change":"2024-03-20T13:37:31.266558+0000","last_active":"2024-03-20T13:37:31.266558+0000","last_peered":"2024-03-20T13:37:31.266558+0000","last_clean":"2024-03-20T13:37:31.266558+0000","last_became_active":"2024-03-20T13:35:30.992035+0000","last_became_peered":"2024-03-20T13:35:30.992035+0000","last_unstale":"2024-03-20T13:37:31.266558+0000","last_undegraded":"2024-03-20T13:37:31.266558+0000","last_fullsized":"2024-03-20T13:37:31.266558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:31.266427+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:31.266427+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.266427+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:33:00.988878+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.149754+0000","last_change":"2024-03-20T13:37:29.149781+0000","last_active":"2024-03-20T13:37:29.149754+0000","last_peered":"2024-03-20T13:37:29.149754+0000","last_clean":"2024-03-20T13:37:29.149754+0000","last_became_active":"2024-03-20T13:34:49.958047+0000","last_became_peered":"2024-03-20T13:34:49.958047+0000","last_unstale":"2024-03-20T13:37:29.149754+0000","last_undegraded":"2024-03-20T13:37:29.149754+0000","last_fullsized":"2024-03-20T13:37:29.149754+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:29.149651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:29.149651+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.149651+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:33:32.566590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.711944+0000","last_change":"2024-03-20T13:37:14.711972+0000","last_active":"2024-03-20T13:37:14.711944+0000","last_peered":"2024-03-20T13:37:14.711944+0000","last_clean":"2024-03-20T13:37:14.711944+0000","last_became_active":"2024-03-20T13:34:51.946642+0000","last_became_peered":"2024-03-20T13:34:51.946642+0000","last_unstale":"2024-03-20T13:37:14.711944+0000","last_undegraded":"2024-03-20T13:37:14.711944+0000","last_fullsized":"2024-03-20T13:37:14.711944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:14.711857+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:14.711857+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.711857+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:41.121171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.176263+0000","last_change":"2024-03-20T13:37:05.176263+0000","last_active":"2024-03-20T13:37:05.176263+0000","last_peered":"2024-03-20T13:37:05.176263+0000","last_clean":"2024-03-20T13:37:05.176263+0000","last_became_active":"2024-03-20T13:34:49.954403+0000","last_became_peered":"2024-03-20T13:34:49.954403+0000","last_unstale":"2024-03-20T13:37:05.176263+0000","last_undegraded":"2024-03-20T13:37:05.176263+0000","last_fullsized":"2024-03-20T13:37:05.176263+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.176117+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.176117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:22:03.690315+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.278090+0000","last_change":"2024-03-20T13:37:07.278147+0000","last_active":"2024-03-20T13:37:07.278090+0000","last_peered":"2024-03-20T13:37:07.278090+0000","last_clean":"2024-03-20T13:37:07.278090+0000","last_became_active":"2024-03-20T13:34:51.952246+0000","last_became_peered":"2024-03-20T13:34:51.952246+0000","last_unstale":"2024-03-20T13:37:07.278090+0000","last_undegraded":"2024-03-20T13:37:07.278090+0000","last_fullsized":"2024-03-20T13:37:07.278090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:07.277994+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.277994+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:07.944110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:41.220861+0000","last_change":"2024-03-20T13:37:41.220893+0000","last_active":"2024-03-20T13:37:41.220861+0000","last_peered":"2024-03-20T13:37:41.220861+0000","last_clean":"2024-03-20T13:37:41.220861+0000","last_became_active":"2024-03-20T13:34:49.954719+0000","last_became_peered":"2024-03-20T13:34:49.954719+0000","last_unstale":"2024-03-20T13:37:41.220861+0000","last_undegraded":"2024-03-20T13:37:41.220861+0000","last_fullsized":"2024-03-20T13:37:41.220861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:41.220727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:41.220727+0000","last_clean_scrub_stamp":"2024-03-20T13:37:41.220727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:37.012526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"32'8","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.168771+0000","last_change":"2024-03-20T13:36:59.168771+0000","last_active":"2024-03-20T13:36:59.168771+0000","last_peered":"2024-03-20T13:36:59.168771+0000","last_clean":"2024-03-20T13:36:59.168771+0000","last_became_active":"2024-03-20T13:34:51.947523+0000","last_became_peered":"2024-03-20T13:34:51.947523+0000","last_unstale":"2024-03-20T13:36:59.168771+0000","last_undegraded":"2024-03-20T13:36:59.168771+0000","last_fullsized":"2024-03-20T13:36:59.168771+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:36:59.168659+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.168659+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:29.587352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":45,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.461791+0000","last_change":"2024-03-20T13:37:16.461791+0000","last_active":"2024-03-20T13:37:16.461791+0000","last_peered":"2024-03-20T13:37:16.461791+0000","last_clean":"2024-03-20T13:37:16.461791+0000","last_became_active":"2024-03-20T13:34:49.940606+0000","last_became_peered":"2024-03-20T13:34:49.940606+0000","last_unstale":"2024-03-20T13:37:16.461791+0000","last_undegraded":"2024-03-20T13:37:16.461791+0000","last_fullsized":"2024-03-20T13:37:16.461791+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.461652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.461652+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.461652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:56.886154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"32'6","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.245850+0000","last_change":"2024-03-20T13:37:24.245894+0000","last_active":"2024-03-20T13:37:24.245850+0000","last_peered":"2024-03-20T13:37:24.245850+0000","last_clean":"2024-03-20T13:37:24.245850+0000","last_became_active":"2024-03-20T13:34:51.944991+0000","last_became_peered":"2024-03-20T13:34:51.944991+0000","last_unstale":"2024-03-20T13:37:24.245850+0000","last_undegraded":"2024-03-20T13:37:24.245850+0000","last_fullsized":"2024-03-20T13:37:24.245850+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:24.245736+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:24.245736+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.245736+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:52.633330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"32'12","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.256576+0000","last_change":"2024-03-20T13:37:11.256576+0000","last_active":"2024-03-20T13:37:11.256576+0000","last_peered":"2024-03-20T13:37:11.256576+0000","last_clean":"2024-03-20T13:37:11.256576+0000","last_became_active":"2024-03-20T13:34:51.949152+0000","last_became_peered":"2024-03-20T13:34:51.949152+0000","last_unstale":"2024-03-20T13:37:11.256576+0000","last_undegraded":"2024-03-20T13:37:11.256576+0000","last_fullsized":"2024-03-20T13:37:11.256576+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'12","last_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_deep_scrub":"32'12","last_deep_scrub_stamp":"2024-03-20T13:37:11.256453+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.256453+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:24.080007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.729110+0000","last_change":"2024-03-20T13:37:26.729154+0000","last_active":"2024-03-20T13:37:26.729110+0000","last_peered":"2024-03-20T13:37:26.729110+0000","last_clean":"2024-03-20T13:37:26.729110+0000","last_became_active":"2024-03-20T13:34:49.944956+0000","last_became_peered":"2024-03-20T13:34:49.944956+0000","last_unstale":"2024-03-20T13:37:26.729110+0000","last_undegraded":"2024-03-20T13:37:26.729110+0000","last_fullsized":"2024-03-20T13:37:26.729110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:26.729021+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:26.729021+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.729021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:35:27.395137+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.780265+0000","last_change":"2024-03-20T13:36:59.780265+0000","last_active":"2024-03-20T13:36:59.780265+0000","last_peered":"2024-03-20T13:36:59.780265+0000","last_clean":"2024-03-20T13:36:59.780265+0000","last_became_active":"2024-03-20T13:34:51.947738+0000","last_became_peered":"2024-03-20T13:34:51.947738+0000","last_unstale":"2024-03-20T13:36:59.780265+0000","last_undegraded":"2024-03-20T13:36:59.780265+0000","last_fullsized":"2024-03-20T13:36:59.780265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:59.780140+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.780140+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:43.003558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.218269+0000","last_change":"2024-03-20T13:37:11.218269+0000","last_active":"2024-03-20T13:37:11.218269+0000","last_peered":"2024-03-20T13:37:11.218269+0000","last_clean":"2024-03-20T13:37:11.218269+0000","last_became_active":"2024-03-20T13:34:49.950258+0000","last_became_peered":"2024-03-20T13:34:49.950258+0000","last_unstale":"2024-03-20T13:37:11.218269+0000","last_undegraded":"2024-03-20T13:37:11.218269+0000","last_fullsized":"2024-03-20T13:37:11.218269+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:11.218156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.218156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:54.441574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.671523+0000","last_change":"2024-03-20T13:37:18.671551+0000","last_active":"2024-03-20T13:37:18.671523+0000","last_peered":"2024-03-20T13:37:18.671523+0000","last_clean":"2024-03-20T13:37:18.671523+0000","last_became_active":"2024-03-20T13:34:51.947124+0000","last_became_peered":"2024-03-20T13:34:51.947124+0000","last_unstale":"2024-03-20T13:37:18.671523+0000","last_undegraded":"2024-03-20T13:37:18.671523+0000","last_fullsized":"2024-03-20T13:37:18.671523+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:18.671437+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:18.671437+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.671437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:36.640507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.684833+0000","last_change":"2024-03-20T13:37:17.684875+0000","last_active":"2024-03-20T13:37:17.684833+0000","last_peered":"2024-03-20T13:37:17.684833+0000","last_clean":"2024-03-20T13:37:17.684833+0000","last_became_active":"2024-03-20T13:34:49.945954+0000","last_became_peered":"2024-03-20T13:34:49.945954+0000","last_unstale":"2024-03-20T13:37:17.684833+0000","last_undegraded":"2024-03-20T13:37:17.684833+0000","last_fullsized":"2024-03-20T13:37:17.684833+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:17.684738+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:17.684738+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.684738+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:33.915049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"32'4","reported_seq":66,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.437229+0000","last_change":"2024-03-20T13:37:15.437229+0000","last_active":"2024-03-20T13:37:15.437229+0000","last_peered":"2024-03-20T13:37:15.437229+0000","last_clean":"2024-03-20T13:37:15.437229+0000","last_became_active":"2024-03-20T13:34:51.937080+0000","last_became_peered":"2024-03-20T13:34:51.937080+0000","last_unstale":"2024-03-20T13:37:15.437229+0000","last_undegraded":"2024-03-20T13:37:15.437229+0000","last_fullsized":"2024-03-20T13:37:15.437229+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:15.437078+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:15.437078+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.437078+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:15.348966+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.725707+0000","last_change":"2024-03-20T13:37:11.725707+0000","last_active":"2024-03-20T13:37:11.725707+0000","last_peered":"2024-03-20T13:37:11.725707+0000","last_clean":"2024-03-20T13:37:11.725707+0000","last_became_active":"2024-03-20T13:34:49.949564+0000","last_became_peered":"2024-03-20T13:34:49.949564+0000","last_unstale":"2024-03-20T13:37:11.725707+0000","last_undegraded":"2024-03-20T13:37:11.725707+0000","last_fullsized":"2024-03-20T13:37:11.725707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:11.725594+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.725594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:22.505463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.174785+0000","last_change":"2024-03-20T13:37:06.174785+0000","last_active":"2024-03-20T13:37:06.174785+0000","last_peered":"2024-03-20T13:37:06.174785+0000","last_clean":"2024-03-20T13:37:06.174785+0000","last_became_active":"2024-03-20T13:34:51.941520+0000","last_became_peered":"2024-03-20T13:34:51.941520+0000","last_unstale":"2024-03-20T13:37:06.174785+0000","last_undegraded":"2024-03-20T13:37:06.174785+0000","last_fullsized":"2024-03-20T13:37:06.174785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:06.174669+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.174669+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:35.706277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.509348+0000","last_change":"2024-03-20T13:37:20.509376+0000","last_active":"2024-03-20T13:37:20.509348+0000","last_peered":"2024-03-20T13:37:20.509348+0000","last_clean":"2024-03-20T13:37:20.509348+0000","last_became_active":"2024-03-20T13:34:49.934403+0000","last_became_peered":"2024-03-20T13:34:49.934403+0000","last_unstale":"2024-03-20T13:37:20.509348+0000","last_undegraded":"2024-03-20T13:37:20.509348+0000","last_fullsized":"2024-03-20T13:37:20.509348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:20.509258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:20.509258+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.509258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:54.696170+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.750652+0000","last_change":"2024-03-20T13:37:01.750652+0000","last_active":"2024-03-20T13:37:01.750652+0000","last_peered":"2024-03-20T13:37:01.750652+0000","last_clean":"2024-03-20T13:37:01.750652+0000","last_became_active":"2024-03-20T13:34:51.946614+0000","last_became_peered":"2024-03-20T13:34:51.946614+0000","last_unstale":"2024-03-20T13:37:01.750652+0000","last_undegraded":"2024-03-20T13:37:01.750652+0000","last_fullsized":"2024-03-20T13:37:01.750652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:01.750537+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.750537+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:27.000513+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.227968+0000","last_change":"2024-03-20T13:37:26.227994+0000","last_active":"2024-03-20T13:37:26.227968+0000","last_peered":"2024-03-20T13:37:26.227968+0000","last_clean":"2024-03-20T13:37:26.227968+0000","last_became_active":"2024-03-20T13:34:49.957891+0000","last_became_peered":"2024-03-20T13:34:49.957891+0000","last_unstale":"2024-03-20T13:37:26.227968+0000","last_undegraded":"2024-03-20T13:37:26.227968+0000","last_fullsized":"2024-03-20T13:37:26.227968+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:26.227867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:26.227867+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.227867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:08:15.426533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"32'18","reported_seq":86,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:35.783932+0000","last_change":"2024-03-20T13:37:35.783959+0000","last_active":"2024-03-20T13:37:35.783932+0000","last_peered":"2024-03-20T13:37:35.783932+0000","last_clean":"2024-03-20T13:37:35.783932+0000","last_became_active":"2024-03-20T13:34:59.976202+0000","last_became_peered":"2024-03-20T13:34:59.976202+0000","last_unstale":"2024-03-20T13:37:35.783932+0000","last_undegraded":"2024-03-20T13:37:35.783932+0000","last_fullsized":"2024-03-20T13:37:35.783932+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-20T13:37:35.783852+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-20T13:37:35.783852+0000","last_clean_scrub_stamp":"2024-03-20T13:37:35.783852+0000","objects_scrubbed":1,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:23.310016+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":166,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":139,"num_read_kb":138,"num_write":48,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"30'2","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.312980+0000","last_change":"2024-03-20T13:37:30.312980+0000","last_active":"2024-03-20T13:37:30.312980+0000","last_peered":"2024-03-20T13:37:30.312980+0000","last_clean":"2024-03-20T13:37:30.312980+0000","last_became_active":"2024-03-20T13:35:30.990122+0000","last_became_peered":"2024-03-20T13:35:30.990122+0000","last_unstale":"2024-03-20T13:37:30.312980+0000","last_undegraded":"2024-03-20T13:37:30.312980+0000","last_fullsized":"2024-03-20T13:37:30.312980+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:30.312873+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:30.312873+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.312873+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:37:48.281943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.194714+0000","last_change":"2024-03-20T13:37:27.194741+0000","last_active":"2024-03-20T13:37:27.194714+0000","last_peered":"2024-03-20T13:37:27.194714+0000","last_clean":"2024-03-20T13:37:27.194714+0000","last_became_active":"2024-03-20T13:34:49.958847+0000","last_became_peered":"2024-03-20T13:34:49.958847+0000","last_unstale":"2024-03-20T13:37:27.194714+0000","last_undegraded":"2024-03-20T13:37:27.194714+0000","last_fullsized":"2024-03-20T13:37:27.194714+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.194628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.194628+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.194628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:19:59.581273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.127878+0000","last_change":"2024-03-20T13:36:41.127878+0000","last_active":"2024-03-20T13:36:41.127878+0000","last_peered":"2024-03-20T13:36:41.127878+0000","last_clean":"2024-03-20T13:36:41.127878+0000","last_became_active":"2024-03-20T13:34:53.942069+0000","last_became_peered":"2024-03-20T13:34:53.942069+0000","last_unstale":"2024-03-20T13:36:41.127878+0000","last_undegraded":"2024-03-20T13:36:41.127878+0000","last_fullsized":"2024-03-20T13:36:41.127878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.127679+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.127679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:24.954726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.230716+0000","last_change":"2024-03-20T13:37:03.230716+0000","last_active":"2024-03-20T13:37:03.230716+0000","last_peered":"2024-03-20T13:37:03.230716+0000","last_clean":"2024-03-20T13:37:03.230716+0000","last_became_active":"2024-03-20T13:34:55.954802+0000","last_became_peered":"2024-03-20T13:34:55.954802+0000","last_unstale":"2024-03-20T13:37:03.230716+0000","last_undegraded":"2024-03-20T13:37:03.230716+0000","last_fullsized":"2024-03-20T13:37:03.230716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:37:03.230582+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.230582+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:19.216621+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.930574+0000","last_change":"2024-03-20T13:36:50.930574+0000","last_active":"2024-03-20T13:36:50.930574+0000","last_peered":"2024-03-20T13:36:50.930574+0000","last_clean":"2024-03-20T13:36:50.930574+0000","last_became_active":"2024-03-20T13:34:57.963962+0000","last_became_peered":"2024-03-20T13:34:57.963962+0000","last_unstale":"2024-03-20T13:36:50.930574+0000","last_undegraded":"2024-03-20T13:36:50.930574+0000","last_fullsized":"2024-03-20T13:36:50.930574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.930463+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.930463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:21.352868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"32'4","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.746110+0000","last_change":"2024-03-20T13:37:30.746158+0000","last_active":"2024-03-20T13:37:30.746110+0000","last_peered":"2024-03-20T13:37:30.746110+0000","last_clean":"2024-03-20T13:37:30.746110+0000","last_became_active":"2024-03-20T13:34:59.969199+0000","last_became_peered":"2024-03-20T13:34:59.969199+0000","last_unstale":"2024-03-20T13:37:30.746110+0000","last_undegraded":"2024-03-20T13:37:30.746110+0000","last_fullsized":"2024-03-20T13:37:30.746110+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:30.746014+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:30.746014+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.746014+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:43.569568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.243276+0000","last_change":"2024-03-20T13:37:18.243303+0000","last_active":"2024-03-20T13:37:18.243276+0000","last_peered":"2024-03-20T13:37:18.243276+0000","last_clean":"2024-03-20T13:37:18.243276+0000","last_became_active":"2024-03-20T13:34:51.943164+0000","last_became_peered":"2024-03-20T13:34:51.943164+0000","last_unstale":"2024-03-20T13:37:18.243276+0000","last_undegraded":"2024-03-20T13:37:18.243276+0000","last_fullsized":"2024-03-20T13:37:18.243276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:18.243199+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:18.243199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.243199+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:58:48.434148+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.247358+0000","last_change":"2024-03-20T13:37:03.247358+0000","last_active":"2024-03-20T13:37:03.247358+0000","last_peered":"2024-03-20T13:37:03.247358+0000","last_clean":"2024-03-20T13:37:03.247358+0000","last_became_active":"2024-03-20T13:34:49.954786+0000","last_became_peered":"2024-03-20T13:34:49.954786+0000","last_unstale":"2024-03-20T13:37:03.247358+0000","last_undegraded":"2024-03-20T13:37:03.247358+0000","last_fullsized":"2024-03-20T13:37:03.247358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:03.247246+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.247246+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:31.455119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.442856+0000","last_change":"2024-03-20T13:36:50.442856+0000","last_active":"2024-03-20T13:36:50.442856+0000","last_peered":"2024-03-20T13:36:50.442856+0000","last_clean":"2024-03-20T13:36:50.442856+0000","last_became_active":"2024-03-20T13:34:53.944296+0000","last_became_peered":"2024-03-20T13:34:53.944296+0000","last_unstale":"2024-03-20T13:36:50.442856+0000","last_undegraded":"2024-03-20T13:36:50.442856+0000","last_fullsized":"2024-03-20T13:36:50.442856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.442744+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.442744+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:21.896022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"32'9","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.832911+0000","last_change":"2024-03-20T13:36:36.832911+0000","last_active":"2024-03-20T13:36:36.832911+0000","last_peered":"2024-03-20T13:36:36.832911+0000","last_clean":"2024-03-20T13:36:36.832911+0000","last_became_active":"2024-03-20T13:34:55.953632+0000","last_became_peered":"2024-03-20T13:34:55.953632+0000","last_unstale":"2024-03-20T13:36:36.832911+0000","last_undegraded":"2024-03-20T13:36:36.832911+0000","last_fullsized":"2024-03-20T13:36:36.832911+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'9","last_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_deep_scrub":"32'9","last_deep_scrub_stamp":"2024-03-20T13:36:36.832759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.832759+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:05:49.042157+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.814020+0000","last_change":"2024-03-20T13:36:58.814020+0000","last_active":"2024-03-20T13:36:58.814020+0000","last_peered":"2024-03-20T13:36:58.814020+0000","last_clean":"2024-03-20T13:36:58.814020+0000","last_became_active":"2024-03-20T13:34:57.965999+0000","last_became_peered":"2024-03-20T13:34:57.965999+0000","last_unstale":"2024-03-20T13:36:58.814020+0000","last_undegraded":"2024-03-20T13:36:58.814020+0000","last_fullsized":"2024-03-20T13:36:58.814020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.813903+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.813903+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:48.477979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:35.556856+0000","last_change":"2024-03-20T13:37:35.556909+0000","last_active":"2024-03-20T13:37:35.556856+0000","last_peered":"2024-03-20T13:37:35.556856+0000","last_clean":"2024-03-20T13:37:35.556856+0000","last_became_active":"2024-03-20T13:34:59.974321+0000","last_became_peered":"2024-03-20T13:34:59.974321+0000","last_unstale":"2024-03-20T13:37:35.556856+0000","last_undegraded":"2024-03-20T13:37:35.556856+0000","last_fullsized":"2024-03-20T13:37:35.556856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:35.556772+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:35.556772+0000","last_clean_scrub_stamp":"2024-03-20T13:37:35.556772+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:59:05.747721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"32'6","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.154069+0000","last_change":"2024-03-20T13:37:21.154094+0000","last_active":"2024-03-20T13:37:21.154069+0000","last_peered":"2024-03-20T13:37:21.154069+0000","last_clean":"2024-03-20T13:37:21.154069+0000","last_became_active":"2024-03-20T13:34:51.940369+0000","last_became_peered":"2024-03-20T13:34:51.940369+0000","last_unstale":"2024-03-20T13:37:21.154069+0000","last_undegraded":"2024-03-20T13:37:21.154069+0000","last_fullsized":"2024-03-20T13:37:21.154069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:21.153982+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:21.153982+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.153982+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:49:58.336139+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.171553+0000","last_change":"2024-03-20T13:37:28.171579+0000","last_active":"2024-03-20T13:37:28.171553+0000","last_peered":"2024-03-20T13:37:28.171553+0000","last_clean":"2024-03-20T13:37:28.171553+0000","last_became_active":"2024-03-20T13:34:49.959537+0000","last_became_peered":"2024-03-20T13:34:49.959537+0000","last_unstale":"2024-03-20T13:37:28.171553+0000","last_undegraded":"2024-03-20T13:37:28.171553+0000","last_fullsized":"2024-03-20T13:37:28.171553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.171464+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.171464+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.171464+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:08:43.848903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.419261+0000","last_change":"2024-03-20T13:36:51.419261+0000","last_active":"2024-03-20T13:36:51.419261+0000","last_peered":"2024-03-20T13:36:51.419261+0000","last_clean":"2024-03-20T13:36:51.419261+0000","last_became_active":"2024-03-20T13:34:53.943800+0000","last_became_peered":"2024-03-20T13:34:53.943800+0000","last_unstale":"2024-03-20T13:36:51.419261+0000","last_undegraded":"2024-03-20T13:36:51.419261+0000","last_fullsized":"2024-03-20T13:36:51.419261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.419143+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.419143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:49.933341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.14","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.226186+0000","last_change":"2024-03-20T13:36:49.226186+0000","last_active":"2024-03-20T13:36:49.226186+0000","last_peered":"2024-03-20T13:36:49.226186+0000","last_clean":"2024-03-20T13:36:49.226186+0000","last_became_active":"2024-03-20T13:34:55.950905+0000","last_became_peered":"2024-03-20T13:34:55.950905+0000","last_unstale":"2024-03-20T13:36:49.226186+0000","last_undegraded":"2024-03-20T13:36:49.226186+0000","last_fullsized":"2024-03-20T13:36:49.226186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:49.226058+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.226058+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:31:05.000426+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"32'244","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.289581+0000","last_change":"2024-03-20T13:37:08.289581+0000","last_active":"2024-03-20T13:37:08.289581+0000","last_peered":"2024-03-20T13:37:08.289581+0000","last_clean":"2024-03-20T13:37:08.289581+0000","last_became_active":"2024-03-20T13:34:57.969669+0000","last_became_peered":"2024-03-20T13:34:57.969669+0000","last_unstale":"2024-03-20T13:37:08.289581+0000","last_undegraded":"2024-03-20T13:37:08.289581+0000","last_fullsized":"2024-03-20T13:37:08.289581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'244","last_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_deep_scrub":"32'244","last_deep_scrub_stamp":"2024-03-20T13:37:08.289461+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.289461+0000","objects_scrubbed":1,"log_size":244,"log_dups_size":0,"ondisk_log_size":244,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:24:47.727403+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.208783+0000","last_change":"2024-03-20T13:36:46.208783+0000","last_active":"2024-03-20T13:36:46.208783+0000","last_peered":"2024-03-20T13:36:46.208783+0000","last_clean":"2024-03-20T13:36:46.208783+0000","last_became_active":"2024-03-20T13:34:59.971103+0000","last_became_peered":"2024-03-20T13:34:59.971103+0000","last_unstale":"2024-03-20T13:36:46.208783+0000","last_undegraded":"2024-03-20T13:36:46.208783+0000","last_fullsized":"2024-03-20T13:36:46.208783+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:46.208641+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.208641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:07:45.085668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.498473+0000","last_change":"2024-03-20T13:37:02.498473+0000","last_active":"2024-03-20T13:37:02.498473+0000","last_peered":"2024-03-20T13:37:02.498473+0000","last_clean":"2024-03-20T13:37:02.498473+0000","last_became_active":"2024-03-20T13:34:51.947183+0000","last_became_peered":"2024-03-20T13:34:51.947183+0000","last_unstale":"2024-03-20T13:37:02.498473+0000","last_undegraded":"2024-03-20T13:37:02.498473+0000","last_fullsized":"2024-03-20T13:37:02.498473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:02.498327+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.498327+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:03:43.010962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.714650+0000","last_change":"2024-03-20T13:37:24.714673+0000","last_active":"2024-03-20T13:37:24.714650+0000","last_peered":"2024-03-20T13:37:24.714650+0000","last_clean":"2024-03-20T13:37:24.714650+0000","last_became_active":"2024-03-20T13:34:49.943021+0000","last_became_peered":"2024-03-20T13:34:49.943021+0000","last_unstale":"2024-03-20T13:37:24.714650+0000","last_undegraded":"2024-03-20T13:37:24.714650+0000","last_fullsized":"2024-03-20T13:37:24.714650+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:24.714562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:24.714562+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.714562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:45:10.053361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.164527+0000","last_change":"2024-03-20T13:36:47.164527+0000","last_active":"2024-03-20T13:36:47.164527+0000","last_peered":"2024-03-20T13:36:47.164527+0000","last_clean":"2024-03-20T13:36:47.164527+0000","last_became_active":"2024-03-20T13:34:53.939571+0000","last_became_peered":"2024-03-20T13:34:53.939571+0000","last_unstale":"2024-03-20T13:36:47.164527+0000","last_undegraded":"2024-03-20T13:36:47.164527+0000","last_fullsized":"2024-03-20T13:36:47.164527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:47.164416+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.164416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:15.628781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.124403+0000","last_change":"2024-03-20T13:36:44.124403+0000","last_active":"2024-03-20T13:36:44.124403+0000","last_peered":"2024-03-20T13:36:44.124403+0000","last_clean":"2024-03-20T13:36:44.124403+0000","last_became_active":"2024-03-20T13:34:55.957525+0000","last_became_peered":"2024-03-20T13:34:55.957525+0000","last_unstale":"2024-03-20T13:36:44.124403+0000","last_undegraded":"2024-03-20T13:36:44.124403+0000","last_fullsized":"2024-03-20T13:36:44.124403+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:44.124221+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.124221+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:21:07.675114+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"32'243","reported_seq":349,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.427157+0000","last_change":"2024-03-20T13:36:49.427157+0000","last_active":"2024-03-20T13:36:49.427157+0000","last_peered":"2024-03-20T13:36:49.427157+0000","last_clean":"2024-03-20T13:36:49.427157+0000","last_became_active":"2024-03-20T13:34:57.967816+0000","last_became_peered":"2024-03-20T13:34:57.967816+0000","last_unstale":"2024-03-20T13:36:49.427157+0000","last_undegraded":"2024-03-20T13:36:49.427157+0000","last_fullsized":"2024-03-20T13:36:49.427157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:49.427037+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.427037+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:05:56.566896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.240751+0000","last_change":"2024-03-20T13:37:06.240821+0000","last_active":"2024-03-20T13:37:06.240751+0000","last_peered":"2024-03-20T13:37:06.240751+0000","last_clean":"2024-03-20T13:37:06.240751+0000","last_became_active":"2024-03-20T13:34:51.953337+0000","last_became_peered":"2024-03-20T13:34:51.953337+0000","last_unstale":"2024-03-20T13:37:06.240751+0000","last_undegraded":"2024-03-20T13:37:06.240751+0000","last_fullsized":"2024-03-20T13:37:06.240751+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:06.240654+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.240654+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:12.903523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.251632+0000","last_change":"2024-03-20T13:37:20.251666+0000","last_active":"2024-03-20T13:37:20.251632+0000","last_peered":"2024-03-20T13:37:20.251632+0000","last_clean":"2024-03-20T13:37:20.251632+0000","last_became_active":"2024-03-20T13:34:49.944192+0000","last_became_peered":"2024-03-20T13:34:49.944192+0000","last_unstale":"2024-03-20T13:37:20.251632+0000","last_undegraded":"2024-03-20T13:37:20.251632+0000","last_fullsized":"2024-03-20T13:37:20.251632+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:20.251541+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:20.251541+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.251541+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:53.391499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.819999+0000","last_change":"2024-03-20T13:36:43.819999+0000","last_active":"2024-03-20T13:36:43.819999+0000","last_peered":"2024-03-20T13:36:43.819999+0000","last_clean":"2024-03-20T13:36:43.819999+0000","last_became_active":"2024-03-20T13:34:53.944999+0000","last_became_peered":"2024-03-20T13:34:53.944999+0000","last_unstale":"2024-03-20T13:36:43.819999+0000","last_undegraded":"2024-03-20T13:36:43.819999+0000","last_fullsized":"2024-03-20T13:36:43.819999+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.819876+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.819876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:18.465294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"32'49","reported_seq":109,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.190487+0000","last_change":"2024-03-20T13:36:48.190487+0000","last_active":"2024-03-20T13:36:48.190487+0000","last_peered":"2024-03-20T13:36:48.190487+0000","last_clean":"2024-03-20T13:36:48.190487+0000","last_became_active":"2024-03-20T13:34:55.951799+0000","last_became_peered":"2024-03-20T13:34:55.951799+0000","last_unstale":"2024-03-20T13:36:48.190487+0000","last_undegraded":"2024-03-20T13:36:48.190487+0000","last_fullsized":"2024-03-20T13:36:48.190487+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:48.190343+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.190343+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:33:34.104031+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.451320+0000","last_change":"2024-03-20T13:36:41.451320+0000","last_active":"2024-03-20T13:36:41.451320+0000","last_peered":"2024-03-20T13:36:41.451320+0000","last_clean":"2024-03-20T13:36:41.451320+0000","last_became_active":"2024-03-20T13:34:57.967652+0000","last_became_peered":"2024-03-20T13:34:57.967652+0000","last_unstale":"2024-03-20T13:36:41.451320+0000","last_undegraded":"2024-03-20T13:36:41.451320+0000","last_fullsized":"2024-03-20T13:36:41.451320+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.451207+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.451207+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:21:01.674365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"32'5","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.271317+0000","last_change":"2024-03-20T13:37:25.271359+0000","last_active":"2024-03-20T13:37:25.271317+0000","last_peered":"2024-03-20T13:37:25.271317+0000","last_clean":"2024-03-20T13:37:25.271317+0000","last_became_active":"2024-03-20T13:34:59.973611+0000","last_became_peered":"2024-03-20T13:34:59.973611+0000","last_unstale":"2024-03-20T13:37:25.271317+0000","last_undegraded":"2024-03-20T13:37:25.271317+0000","last_fullsized":"2024-03-20T13:37:25.271317+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:37:25.271197+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:37:25.271197+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.271197+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:55.667460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.706447+0000","last_change":"2024-03-20T13:37:04.706474+0000","last_active":"2024-03-20T13:37:04.706447+0000","last_peered":"2024-03-20T13:37:04.706447+0000","last_clean":"2024-03-20T13:37:04.706447+0000","last_became_active":"2024-03-20T13:34:51.941646+0000","last_became_peered":"2024-03-20T13:34:51.941646+0000","last_unstale":"2024-03-20T13:37:04.706447+0000","last_undegraded":"2024-03-20T13:37:04.706447+0000","last_fullsized":"2024-03-20T13:37:04.706447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.706331+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.706331+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:10.838974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"32'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.258412+0000","last_change":"2024-03-20T13:37:19.258440+0000","last_active":"2024-03-20T13:37:19.258412+0000","last_peered":"2024-03-20T13:37:19.258412+0000","last_clean":"2024-03-20T13:37:19.258412+0000","last_became_active":"2024-03-20T13:34:49.938757+0000","last_became_peered":"2024-03-20T13:34:49.938757+0000","last_unstale":"2024-03-20T13:37:19.258412+0000","last_undegraded":"2024-03-20T13:37:19.258412+0000","last_fullsized":"2024-03-20T13:37:19.258412+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:19.258326+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:19.258326+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.258326+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:12.193816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.409281+0000","last_change":"2024-03-20T13:36:52.409281+0000","last_active":"2024-03-20T13:36:52.409281+0000","last_peered":"2024-03-20T13:36:52.409281+0000","last_clean":"2024-03-20T13:36:52.409281+0000","last_became_active":"2024-03-20T13:34:53.943223+0000","last_became_peered":"2024-03-20T13:34:53.943223+0000","last_unstale":"2024-03-20T13:36:52.409281+0000","last_undegraded":"2024-03-20T13:36:52.409281+0000","last_fullsized":"2024-03-20T13:36:52.409281+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:52.409171+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.409171+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:56:42.443923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.099051+0000","last_change":"2024-03-20T13:36:44.099051+0000","last_active":"2024-03-20T13:36:44.099051+0000","last_peered":"2024-03-20T13:36:44.099051+0000","last_clean":"2024-03-20T13:36:44.099051+0000","last_became_active":"2024-03-20T13:34:55.953932+0000","last_became_peered":"2024-03-20T13:34:55.953932+0000","last_unstale":"2024-03-20T13:36:44.099051+0000","last_undegraded":"2024-03-20T13:36:44.099051+0000","last_fullsized":"2024-03-20T13:36:44.099051+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:44.098880+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.098880+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:05:38.576272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.461685+0000","last_change":"2024-03-20T13:36:35.461685+0000","last_active":"2024-03-20T13:36:35.461685+0000","last_peered":"2024-03-20T13:36:35.461685+0000","last_clean":"2024-03-20T13:36:35.461685+0000","last_became_active":"2024-03-20T13:34:57.962682+0000","last_became_peered":"2024-03-20T13:34:57.962682+0000","last_unstale":"2024-03-20T13:36:35.461685+0000","last_undegraded":"2024-03-20T13:36:35.461685+0000","last_fullsized":"2024-03-20T13:36:35.461685+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:35.461582+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.461582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:53.919325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.780610+0000","last_change":"2024-03-20T13:37:31.780639+0000","last_active":"2024-03-20T13:37:31.780610+0000","last_peered":"2024-03-20T13:37:31.780610+0000","last_clean":"2024-03-20T13:37:31.780610+0000","last_became_active":"2024-03-20T13:34:59.972169+0000","last_became_peered":"2024-03-20T13:34:59.972169+0000","last_unstale":"2024-03-20T13:37:31.780610+0000","last_undegraded":"2024-03-20T13:37:31.780610+0000","last_fullsized":"2024-03-20T13:37:31.780610+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:31.780528+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:31.780528+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.780528+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:40:02.573152+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.238190+0000","last_change":"2024-03-20T13:37:08.238221+0000","last_active":"2024-03-20T13:37:08.238190+0000","last_peered":"2024-03-20T13:37:08.238190+0000","last_clean":"2024-03-20T13:37:08.238190+0000","last_became_active":"2024-03-20T13:34:51.941563+0000","last_became_peered":"2024-03-20T13:34:51.941563+0000","last_unstale":"2024-03-20T13:37:08.238190+0000","last_undegraded":"2024-03-20T13:37:08.238190+0000","last_fullsized":"2024-03-20T13:37:08.238190+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:08.238084+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.238084+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:21.795359+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:35.141162+0000","last_change":"2024-03-20T13:37:35.141186+0000","last_active":"2024-03-20T13:37:35.141162+0000","last_peered":"2024-03-20T13:37:35.141162+0000","last_clean":"2024-03-20T13:37:35.141162+0000","last_became_active":"2024-03-20T13:34:49.956666+0000","last_became_peered":"2024-03-20T13:34:49.956666+0000","last_unstale":"2024-03-20T13:37:35.141162+0000","last_undegraded":"2024-03-20T13:37:35.141162+0000","last_fullsized":"2024-03-20T13:37:35.141162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:35.141073+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:35.141073+0000","last_clean_scrub_stamp":"2024-03-20T13:37:35.141073+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:57:10.528527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.423979+0000","last_change":"2024-03-20T13:37:00.423979+0000","last_active":"2024-03-20T13:37:00.423979+0000","last_peered":"2024-03-20T13:37:00.423979+0000","last_clean":"2024-03-20T13:37:00.423979+0000","last_became_active":"2024-03-20T13:34:53.941478+0000","last_became_peered":"2024-03-20T13:34:53.941478+0000","last_unstale":"2024-03-20T13:37:00.423979+0000","last_undegraded":"2024-03-20T13:37:00.423979+0000","last_fullsized":"2024-03-20T13:37:00.423979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.423821+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.423821+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:07.953451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.195079+0000","last_change":"2024-03-20T13:36:48.195079+0000","last_active":"2024-03-20T13:36:48.195079+0000","last_peered":"2024-03-20T13:36:48.195079+0000","last_clean":"2024-03-20T13:36:48.195079+0000","last_became_active":"2024-03-20T13:34:55.954499+0000","last_became_peered":"2024-03-20T13:34:55.954499+0000","last_unstale":"2024-03-20T13:36:48.195079+0000","last_undegraded":"2024-03-20T13:36:48.195079+0000","last_fullsized":"2024-03-20T13:36:48.195079+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:48.194921+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.194921+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:26.041799+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"32'243","reported_seq":297,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.482065+0000","last_change":"2024-03-20T13:36:57.482065+0000","last_active":"2024-03-20T13:36:57.482065+0000","last_peered":"2024-03-20T13:36:57.482065+0000","last_clean":"2024-03-20T13:36:57.482065+0000","last_became_active":"2024-03-20T13:34:57.969219+0000","last_became_peered":"2024-03-20T13:34:57.969219+0000","last_unstale":"2024-03-20T13:36:57.482065+0000","last_undegraded":"2024-03-20T13:36:57.482065+0000","last_fullsized":"2024-03-20T13:36:57.482065+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:57.481947+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.481947+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:40.705365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:37.553362+0000","last_change":"2024-03-20T13:37:37.553392+0000","last_active":"2024-03-20T13:37:37.553362+0000","last_peered":"2024-03-20T13:37:37.553362+0000","last_clean":"2024-03-20T13:37:37.553362+0000","last_became_active":"2024-03-20T13:34:59.975849+0000","last_became_peered":"2024-03-20T13:34:59.975849+0000","last_unstale":"2024-03-20T13:37:37.553362+0000","last_undegraded":"2024-03-20T13:37:37.553362+0000","last_fullsized":"2024-03-20T13:37:37.553362+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:37.553270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:37.553270+0000","last_clean_scrub_stamp":"2024-03-20T13:37:37.553270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:24:37.405274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.208881+0000","last_change":"2024-03-20T13:37:04.208881+0000","last_active":"2024-03-20T13:37:04.208881+0000","last_peered":"2024-03-20T13:37:04.208881+0000","last_clean":"2024-03-20T13:37:04.208881+0000","last_became_active":"2024-03-20T13:34:51.934825+0000","last_became_peered":"2024-03-20T13:34:51.934825+0000","last_unstale":"2024-03-20T13:37:04.208881+0000","last_undegraded":"2024-03-20T13:37:04.208881+0000","last_fullsized":"2024-03-20T13:37:04.208881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:04.208708+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.208708+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:35.661985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.180303+0000","last_change":"2024-03-20T13:37:25.180355+0000","last_active":"2024-03-20T13:37:25.180303+0000","last_peered":"2024-03-20T13:37:25.180303+0000","last_clean":"2024-03-20T13:37:25.180303+0000","last_became_active":"2024-03-20T13:34:49.962066+0000","last_became_peered":"2024-03-20T13:34:49.962066+0000","last_unstale":"2024-03-20T13:37:25.180303+0000","last_undegraded":"2024-03-20T13:37:25.180303+0000","last_fullsized":"2024-03-20T13:37:25.180303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:25.180191+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:25.180191+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.180191+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:05:43.586233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.462228+0000","last_change":"2024-03-20T13:36:54.462228+0000","last_active":"2024-03-20T13:36:54.462228+0000","last_peered":"2024-03-20T13:36:54.462228+0000","last_clean":"2024-03-20T13:36:54.462228+0000","last_became_active":"2024-03-20T13:34:53.943358+0000","last_became_peered":"2024-03-20T13:34:53.943358+0000","last_unstale":"2024-03-20T13:36:54.462228+0000","last_undegraded":"2024-03-20T13:36:54.462228+0000","last_fullsized":"2024-03-20T13:36:54.462228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.462112+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.462112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:08.019387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"32'59","reported_seq":132,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.148045+0000","last_change":"2024-03-20T13:36:36.148045+0000","last_active":"2024-03-20T13:36:36.148045+0000","last_peered":"2024-03-20T13:36:36.148045+0000","last_clean":"2024-03-20T13:36:36.148045+0000","last_became_active":"2024-03-20T13:34:55.950692+0000","last_became_peered":"2024-03-20T13:34:55.950692+0000","last_unstale":"2024-03-20T13:36:36.148045+0000","last_undegraded":"2024-03-20T13:36:36.148045+0000","last_fullsized":"2024-03-20T13:36:36.148045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'59","last_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_deep_scrub":"32'59","last_deep_scrub_stamp":"2024-03-20T13:36:36.147906+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.147906+0000","objects_scrubbed":5,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:41:00.828075+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.497904+0000","last_change":"2024-03-20T13:36:38.497904+0000","last_active":"2024-03-20T13:36:38.497904+0000","last_peered":"2024-03-20T13:36:38.497904+0000","last_clean":"2024-03-20T13:36:38.497904+0000","last_became_active":"2024-03-20T13:34:57.961817+0000","last_became_peered":"2024-03-20T13:34:57.961817+0000","last_unstale":"2024-03-20T13:36:38.497904+0000","last_undegraded":"2024-03-20T13:36:38.497904+0000","last_fullsized":"2024-03-20T13:36:38.497904+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.497774+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.497774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:38:57.922980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"32'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.478488+0000","last_change":"2024-03-20T13:37:05.478488+0000","last_active":"2024-03-20T13:37:05.478488+0000","last_peered":"2024-03-20T13:37:05.478488+0000","last_clean":"2024-03-20T13:37:05.478488+0000","last_became_active":"2024-03-20T13:34:59.966421+0000","last_became_peered":"2024-03-20T13:34:59.966421+0000","last_unstale":"2024-03-20T13:37:05.478488+0000","last_undegraded":"2024-03-20T13:37:05.478488+0000","last_fullsized":"2024-03-20T13:37:05.478488+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.478357+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.478357+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:57:33.942722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"32'2","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.735341+0000","last_change":"2024-03-20T13:37:06.735341+0000","last_active":"2024-03-20T13:37:06.735341+0000","last_peered":"2024-03-20T13:37:06.735341+0000","last_clean":"2024-03-20T13:37:06.735341+0000","last_became_active":"2024-03-20T13:34:51.943295+0000","last_became_peered":"2024-03-20T13:34:51.943295+0000","last_unstale":"2024-03-20T13:37:06.735341+0000","last_undegraded":"2024-03-20T13:37:06.735341+0000","last_fullsized":"2024-03-20T13:37:06.735341+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:06.735167+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.735167+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:30.139049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.574580+0000","last_change":"2024-03-20T13:37:28.574608+0000","last_active":"2024-03-20T13:37:28.574580+0000","last_peered":"2024-03-20T13:37:28.574580+0000","last_clean":"2024-03-20T13:37:28.574580+0000","last_became_active":"2024-03-20T13:34:49.932378+0000","last_became_peered":"2024-03-20T13:34:49.932378+0000","last_unstale":"2024-03-20T13:37:28.574580+0000","last_undegraded":"2024-03-20T13:37:28.574580+0000","last_fullsized":"2024-03-20T13:37:28.574580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:28.574489+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:28.574489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.574489+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:39:41.398042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":625,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"32'5","reported_seq":211,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.170733+0000","last_change":"2024-03-20T13:36:53.170733+0000","last_active":"2024-03-20T13:36:53.170733+0000","last_peered":"2024-03-20T13:36:53.170733+0000","last_clean":"2024-03-20T13:36:53.170733+0000","last_became_active":"2024-03-20T13:34:53.944403+0000","last_became_peered":"2024-03-20T13:34:53.944403+0000","last_unstale":"2024-03-20T13:36:53.170733+0000","last_undegraded":"2024-03-20T13:36:53.170733+0000","last_fullsized":"2024-03-20T13:36:53.170733+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:36:53.170592+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.170592+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:12.595798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":921,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":264,"num_read_kb":263,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.786164+0000","last_change":"2024-03-20T13:36:39.786164+0000","last_active":"2024-03-20T13:36:39.786164+0000","last_peered":"2024-03-20T13:36:39.786164+0000","last_clean":"2024-03-20T13:36:39.786164+0000","last_became_active":"2024-03-20T13:34:55.951971+0000","last_became_peered":"2024-03-20T13:34:55.951971+0000","last_unstale":"2024-03-20T13:36:39.786164+0000","last_undegraded":"2024-03-20T13:36:39.786164+0000","last_fullsized":"2024-03-20T13:36:39.786164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:39.786041+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.786041+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:59.978158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.192708+0000","last_change":"2024-03-20T13:36:55.192708+0000","last_active":"2024-03-20T13:36:55.192708+0000","last_peered":"2024-03-20T13:36:55.192708+0000","last_clean":"2024-03-20T13:36:55.192708+0000","last_became_active":"2024-03-20T13:34:57.962438+0000","last_became_peered":"2024-03-20T13:34:57.962438+0000","last_unstale":"2024-03-20T13:36:55.192708+0000","last_undegraded":"2024-03-20T13:36:55.192708+0000","last_fullsized":"2024-03-20T13:36:55.192708+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.192599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.192599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:09.415889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"32'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.217757+0000","last_change":"2024-03-20T13:37:24.217819+0000","last_active":"2024-03-20T13:37:24.217757+0000","last_peered":"2024-03-20T13:37:24.217757+0000","last_clean":"2024-03-20T13:37:24.217757+0000","last_became_active":"2024-03-20T13:34:59.971074+0000","last_became_peered":"2024-03-20T13:34:59.971074+0000","last_unstale":"2024-03-20T13:37:24.217757+0000","last_undegraded":"2024-03-20T13:37:24.217757+0000","last_fullsized":"2024-03-20T13:37:24.217757+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:37:24.217670+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:37:24.217670+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.217670+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:01:37.258253+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":353,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"32'2","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:26.267495+0000","last_change":"2024-03-20T13:37:26.267495+0000","last_active":"2024-03-20T13:37:26.267495+0000","last_peered":"2024-03-20T13:37:26.267495+0000","last_clean":"2024-03-20T13:37:26.267495+0000","last_became_active":"2024-03-20T13:35:30.987960+0000","last_became_peered":"2024-03-20T13:35:30.987960+0000","last_unstale":"2024-03-20T13:37:26.267495+0000","last_undegraded":"2024-03-20T13:37:26.267495+0000","last_fullsized":"2024-03-20T13:37:26.267495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:26.267387+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:26.267387+0000","last_clean_scrub_stamp":"2024-03-20T13:37:26.267387+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:20:52.676700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.134100+0000","last_change":"2024-03-20T13:37:31.134127+0000","last_active":"2024-03-20T13:37:31.134100+0000","last_peered":"2024-03-20T13:37:31.134100+0000","last_clean":"2024-03-20T13:37:31.134100+0000","last_became_active":"2024-03-20T13:34:49.956776+0000","last_became_peered":"2024-03-20T13:34:49.956776+0000","last_unstale":"2024-03-20T13:37:31.134100+0000","last_undegraded":"2024-03-20T13:37:31.134100+0000","last_fullsized":"2024-03-20T13:37:31.134100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:31.134014+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:31.134014+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.134014+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:16:55.956000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.492572+0000","last_change":"2024-03-20T13:36:55.492572+0000","last_active":"2024-03-20T13:36:55.492572+0000","last_peered":"2024-03-20T13:36:55.492572+0000","last_clean":"2024-03-20T13:36:55.492572+0000","last_became_active":"2024-03-20T13:34:53.943155+0000","last_became_peered":"2024-03-20T13:34:53.943155+0000","last_unstale":"2024-03-20T13:36:55.492572+0000","last_undegraded":"2024-03-20T13:36:55.492572+0000","last_fullsized":"2024-03-20T13:36:55.492572+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.492425+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.492425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:40.395733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.189274+0000","last_change":"2024-03-20T13:36:52.189274+0000","last_active":"2024-03-20T13:36:52.189274+0000","last_peered":"2024-03-20T13:36:52.189274+0000","last_clean":"2024-03-20T13:36:52.189274+0000","last_became_active":"2024-03-20T13:34:55.948664+0000","last_became_peered":"2024-03-20T13:34:55.948664+0000","last_unstale":"2024-03-20T13:36:52.189274+0000","last_undegraded":"2024-03-20T13:36:52.189274+0000","last_fullsized":"2024-03-20T13:36:52.189274+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:52.189115+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.189115+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:34:06.835908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"32'243","reported_seq":373,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.043936+0000","last_change":"2024-03-20T13:36:36.043936+0000","last_active":"2024-03-20T13:36:36.043936+0000","last_peered":"2024-03-20T13:36:36.043936+0000","last_clean":"2024-03-20T13:36:36.043936+0000","last_became_active":"2024-03-20T13:34:57.966908+0000","last_became_peered":"2024-03-20T13:34:57.966908+0000","last_unstale":"2024-03-20T13:36:36.043936+0000","last_undegraded":"2024-03-20T13:36:36.043936+0000","last_fullsized":"2024-03-20T13:36:36.043936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:36.043753+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.043753+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:45.456154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"32'8","reported_seq":37,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.581097+0000","last_change":"2024-03-20T13:37:33.581149+0000","last_active":"2024-03-20T13:37:33.581097+0000","last_peered":"2024-03-20T13:37:33.581097+0000","last_clean":"2024-03-20T13:37:33.581097+0000","last_became_active":"2024-03-20T13:34:59.974118+0000","last_became_peered":"2024-03-20T13:34:59.974118+0000","last_unstale":"2024-03-20T13:37:33.581097+0000","last_undegraded":"2024-03-20T13:37:33.581097+0000","last_fullsized":"2024-03-20T13:37:33.581097+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:33.580998+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:33.580998+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.580998+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:21.107161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.215988+0000","last_change":"2024-03-20T13:37:10.216028+0000","last_active":"2024-03-20T13:37:10.215988+0000","last_peered":"2024-03-20T13:37:10.215988+0000","last_clean":"2024-03-20T13:37:10.215988+0000","last_became_active":"2024-03-20T13:34:51.941739+0000","last_became_peered":"2024-03-20T13:34:51.941739+0000","last_unstale":"2024-03-20T13:37:10.215988+0000","last_undegraded":"2024-03-20T13:37:10.215988+0000","last_fullsized":"2024-03-20T13:37:10.215988+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.215883+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.215883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:51:59.879959+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:34.097525+0000","last_change":"2024-03-20T13:37:34.097560+0000","last_active":"2024-03-20T13:37:34.097525+0000","last_peered":"2024-03-20T13:37:34.097525+0000","last_clean":"2024-03-20T13:37:34.097525+0000","last_became_active":"2024-03-20T13:34:49.960994+0000","last_became_peered":"2024-03-20T13:34:49.960994+0000","last_unstale":"2024-03-20T13:37:34.097525+0000","last_undegraded":"2024-03-20T13:37:34.097525+0000","last_fullsized":"2024-03-20T13:37:34.097525+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:34.097435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:34.097435+0000","last_clean_scrub_stamp":"2024-03-20T13:37:34.097435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:45:56.386962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"32'4","reported_seq":374,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.891230+0000","last_change":"2024-03-20T13:36:47.891230+0000","last_active":"2024-03-20T13:36:47.891230+0000","last_peered":"2024-03-20T13:36:47.891230+0000","last_clean":"2024-03-20T13:36:47.891230+0000","last_became_active":"2024-03-20T13:34:53.942175+0000","last_became_peered":"2024-03-20T13:34:53.942175+0000","last_unstale":"2024-03-20T13:36:47.891230+0000","last_undegraded":"2024-03-20T13:36:47.891230+0000","last_fullsized":"2024-03-20T13:36:47.891230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:47.891061+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.891061+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:18.309754+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":332,"num_read_kb":332,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.146186+0000","last_change":"2024-03-20T13:36:38.146186+0000","last_active":"2024-03-20T13:36:38.146186+0000","last_peered":"2024-03-20T13:36:38.146186+0000","last_clean":"2024-03-20T13:36:38.146186+0000","last_became_active":"2024-03-20T13:34:55.953296+0000","last_became_peered":"2024-03-20T13:34:55.953296+0000","last_unstale":"2024-03-20T13:36:38.146186+0000","last_undegraded":"2024-03-20T13:36:38.146186+0000","last_fullsized":"2024-03-20T13:36:38.146186+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:38.146066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.146066+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:09.028952+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"32'243","reported_seq":348,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.789972+0000","last_change":"2024-03-20T13:36:38.789972+0000","last_active":"2024-03-20T13:36:38.789972+0000","last_peered":"2024-03-20T13:36:38.789972+0000","last_clean":"2024-03-20T13:36:38.789972+0000","last_became_active":"2024-03-20T13:34:57.960793+0000","last_became_peered":"2024-03-20T13:34:57.960793+0000","last_unstale":"2024-03-20T13:36:38.789972+0000","last_undegraded":"2024-03-20T13:36:38.789972+0000","last_fullsized":"2024-03-20T13:36:38.789972+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:38.789823+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.789823+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:22:57.247566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.194544+0000","last_change":"2024-03-20T13:36:58.194544+0000","last_active":"2024-03-20T13:36:58.194544+0000","last_peered":"2024-03-20T13:36:58.194544+0000","last_clean":"2024-03-20T13:36:58.194544+0000","last_became_active":"2024-03-20T13:34:59.973106+0000","last_became_peered":"2024-03-20T13:34:59.973106+0000","last_unstale":"2024-03-20T13:36:58.194544+0000","last_undegraded":"2024-03-20T13:36:58.194544+0000","last_fullsized":"2024-03-20T13:36:58.194544+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:36:58.194424+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.194424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:48:10.534956+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.880699+0000","last_change":"2024-03-20T13:36:52.880699+0000","last_active":"2024-03-20T13:36:52.880699+0000","last_peered":"2024-03-20T13:36:52.880699+0000","last_clean":"2024-03-20T13:36:52.880699+0000","last_became_active":"2024-03-20T13:34:51.956910+0000","last_became_peered":"2024-03-20T13:34:51.956910+0000","last_unstale":"2024-03-20T13:36:52.880699+0000","last_undegraded":"2024-03-20T13:36:52.880699+0000","last_fullsized":"2024-03-20T13:36:52.880699+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:52.880575+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.880575+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:11:24.333852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:37.159346+0000","last_change":"2024-03-20T13:37:37.159375+0000","last_active":"2024-03-20T13:37:37.159346+0000","last_peered":"2024-03-20T13:37:37.159346+0000","last_clean":"2024-03-20T13:37:37.159346+0000","last_became_active":"2024-03-20T13:34:49.955641+0000","last_became_peered":"2024-03-20T13:34:49.955641+0000","last_unstale":"2024-03-20T13:37:37.159346+0000","last_undegraded":"2024-03-20T13:37:37.159346+0000","last_fullsized":"2024-03-20T13:37:37.159346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:37.159252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:37.159252+0000","last_clean_scrub_stamp":"2024-03-20T13:37:37.159252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:00:48.819331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.116987+0000","last_change":"2024-03-20T13:36:39.116987+0000","last_active":"2024-03-20T13:36:39.116987+0000","last_peered":"2024-03-20T13:36:39.116987+0000","last_clean":"2024-03-20T13:36:39.116987+0000","last_became_active":"2024-03-20T13:34:53.944528+0000","last_became_peered":"2024-03-20T13:34:53.944528+0000","last_unstale":"2024-03-20T13:36:39.116987+0000","last_undegraded":"2024-03-20T13:36:39.116987+0000","last_fullsized":"2024-03-20T13:36:39.116987+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.116826+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.116826+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:14:51.320018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"32'46","reported_seq":105,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.797716+0000","last_change":"2024-03-20T13:36:37.797716+0000","last_active":"2024-03-20T13:36:37.797716+0000","last_peered":"2024-03-20T13:36:37.797716+0000","last_clean":"2024-03-20T13:36:37.797716+0000","last_became_active":"2024-03-20T13:34:55.952901+0000","last_became_peered":"2024-03-20T13:34:55.952901+0000","last_unstale":"2024-03-20T13:36:37.797716+0000","last_undegraded":"2024-03-20T13:36:37.797716+0000","last_fullsized":"2024-03-20T13:36:37.797716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'46","last_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_deep_scrub":"32'46","last_deep_scrub_stamp":"2024-03-20T13:36:37.797588+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.797588+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:30:53.571956+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.074189+0000","last_change":"2024-03-20T13:36:39.074189+0000","last_active":"2024-03-20T13:36:39.074189+0000","last_peered":"2024-03-20T13:36:39.074189+0000","last_clean":"2024-03-20T13:36:39.074189+0000","last_became_active":"2024-03-20T13:34:57.965834+0000","last_became_peered":"2024-03-20T13:34:57.965834+0000","last_unstale":"2024-03-20T13:36:39.074189+0000","last_undegraded":"2024-03-20T13:36:39.074189+0000","last_fullsized":"2024-03-20T13:36:39.074189+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.074084+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.074084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:13:36.877815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.759650+0000","last_change":"2024-03-20T13:37:29.759699+0000","last_active":"2024-03-20T13:37:29.759650+0000","last_peered":"2024-03-20T13:37:29.759650+0000","last_clean":"2024-03-20T13:37:29.759650+0000","last_became_active":"2024-03-20T13:34:59.968476+0000","last_became_peered":"2024-03-20T13:34:59.968476+0000","last_unstale":"2024-03-20T13:37:29.759650+0000","last_undegraded":"2024-03-20T13:37:29.759650+0000","last_fullsized":"2024-03-20T13:37:29.759650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:29.759542+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:29.759542+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.759542+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:58.565225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.201510+0000","last_change":"2024-03-20T13:36:53.201510+0000","last_active":"2024-03-20T13:36:53.201510+0000","last_peered":"2024-03-20T13:36:53.201510+0000","last_clean":"2024-03-20T13:36:53.201510+0000","last_became_active":"2024-03-20T13:34:51.953514+0000","last_became_peered":"2024-03-20T13:34:51.953514+0000","last_unstale":"2024-03-20T13:36:53.201510+0000","last_undegraded":"2024-03-20T13:36:53.201510+0000","last_fullsized":"2024-03-20T13:36:53.201510+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.201374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.201374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:20:47.204640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"32'119","reported_seq":214,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.638719+0000","last_change":"2024-03-20T13:37:20.638758+0000","last_active":"2024-03-20T13:37:20.638719+0000","last_peered":"2024-03-20T13:37:20.638719+0000","last_clean":"2024-03-20T13:37:20.638719+0000","last_became_active":"2024-03-20T13:34:35.122402+0000","last_became_peered":"2024-03-20T13:34:35.122402+0000","last_unstale":"2024-03-20T13:37:20.638719+0000","last_undegraded":"2024-03-20T13:37:20.638719+0000","last_fullsized":"2024-03-20T13:37:20.638719+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'119","last_scrub_stamp":"2024-03-20T13:37:20.638623+0000","last_deep_scrub":"32'119","last_deep_scrub_stamp":"2024-03-20T13:37:20.638623+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.638623+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:38.173181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:42.172548+0000","last_change":"2024-03-20T13:37:42.172573+0000","last_active":"2024-03-20T13:37:42.172548+0000","last_peered":"2024-03-20T13:37:42.172548+0000","last_clean":"2024-03-20T13:37:42.172548+0000","last_became_active":"2024-03-20T13:34:41.902761+0000","last_became_peered":"2024-03-20T13:34:41.902761+0000","last_unstale":"2024-03-20T13:37:42.172548+0000","last_undegraded":"2024-03-20T13:37:42.172548+0000","last_fullsized":"2024-03-20T13:37:42.172548+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:42.172457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:42.172457+0000","last_clean_scrub_stamp":"2024-03-20T13:37:42.172457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:51:43.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.185264+0000","last_change":"2024-03-20T13:37:22.185291+0000","last_active":"2024-03-20T13:37:22.185264+0000","last_peered":"2024-03-20T13:37:22.185264+0000","last_clean":"2024-03-20T13:37:22.185264+0000","last_became_active":"2024-03-20T13:34:49.962382+0000","last_became_peered":"2024-03-20T13:34:49.962382+0000","last_unstale":"2024-03-20T13:37:22.185264+0000","last_undegraded":"2024-03-20T13:37:22.185264+0000","last_fullsized":"2024-03-20T13:37:22.185264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.185170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.185170+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.185170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:52:26.780533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.953552+0000","last_change":"2024-03-20T13:36:49.953552+0000","last_active":"2024-03-20T13:36:49.953552+0000","last_peered":"2024-03-20T13:36:49.953552+0000","last_clean":"2024-03-20T13:36:49.953552+0000","last_became_active":"2024-03-20T13:34:53.940606+0000","last_became_peered":"2024-03-20T13:34:53.940606+0000","last_unstale":"2024-03-20T13:36:49.953552+0000","last_undegraded":"2024-03-20T13:36:49.953552+0000","last_fullsized":"2024-03-20T13:36:49.953552+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:49.953431+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.953431+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:13.656033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"32'82","reported_seq":172,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.123405+0000","last_change":"2024-03-20T13:36:46.123405+0000","last_active":"2024-03-20T13:36:46.123405+0000","last_peered":"2024-03-20T13:36:46.123405+0000","last_clean":"2024-03-20T13:36:46.123405+0000","last_became_active":"2024-03-20T13:34:55.954424+0000","last_became_peered":"2024-03-20T13:34:55.954424+0000","last_unstale":"2024-03-20T13:36:46.123405+0000","last_undegraded":"2024-03-20T13:36:46.123405+0000","last_fullsized":"2024-03-20T13:36:46.123405+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'82","last_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_deep_scrub":"32'82","last_deep_scrub_stamp":"2024-03-20T13:36:46.123283+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.123283+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:09.527164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.454190+0000","last_change":"2024-03-20T13:36:42.454190+0000","last_active":"2024-03-20T13:36:42.454190+0000","last_peered":"2024-03-20T13:36:42.454190+0000","last_clean":"2024-03-20T13:36:42.454190+0000","last_became_active":"2024-03-20T13:34:57.960780+0000","last_became_peered":"2024-03-20T13:34:57.960780+0000","last_unstale":"2024-03-20T13:36:42.454190+0000","last_undegraded":"2024-03-20T13:36:42.454190+0000","last_fullsized":"2024-03-20T13:36:42.454190+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.454069+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.454069+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:02:47.214837+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"32'49","reported_seq":121,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.145557+0000","last_change":"2024-03-20T13:36:54.145557+0000","last_active":"2024-03-20T13:36:54.145557+0000","last_peered":"2024-03-20T13:36:54.145557+0000","last_clean":"2024-03-20T13:36:54.145557+0000","last_became_active":"2024-03-20T13:34:59.973041+0000","last_became_peered":"2024-03-20T13:34:59.973041+0000","last_unstale":"2024-03-20T13:36:54.145557+0000","last_undegraded":"2024-03-20T13:36:54.145557+0000","last_fullsized":"2024-03-20T13:36:54.145557+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'49","last_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_deep_scrub":"32'49","last_deep_scrub_stamp":"2024-03-20T13:36:54.145443+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.145443+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:45.665997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":144,"num_write":95,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.225779+0000","last_change":"2024-03-20T13:37:19.225803+0000","last_active":"2024-03-20T13:37:19.225779+0000","last_peered":"2024-03-20T13:37:19.225779+0000","last_clean":"2024-03-20T13:37:19.225779+0000","last_became_active":"2024-03-20T13:34:51.940859+0000","last_became_peered":"2024-03-20T13:34:51.940859+0000","last_unstale":"2024-03-20T13:37:19.225779+0000","last_undegraded":"2024-03-20T13:37:19.225779+0000","last_fullsized":"2024-03-20T13:37:19.225779+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.225641+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.225641+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.225641+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:55:50.649161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:45.251627+0000","last_change":"2024-03-20T13:37:45.251653+0000","last_active":"2024-03-20T13:37:45.251627+0000","last_peered":"2024-03-20T13:37:45.251627+0000","last_clean":"2024-03-20T13:37:45.251627+0000","last_became_active":"2024-03-20T13:34:41.903610+0000","last_became_peered":"2024-03-20T13:34:41.903610+0000","last_unstale":"2024-03-20T13:37:45.251627+0000","last_undegraded":"2024-03-20T13:37:45.251627+0000","last_fullsized":"2024-03-20T13:37:45.251627+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:45.251522+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:45.251522+0000","last_clean_scrub_stamp":"2024-03-20T13:37:45.251522+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:06:05.044302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.440517+0000","last_change":"2024-03-20T13:37:12.440569+0000","last_active":"2024-03-20T13:37:12.440517+0000","last_peered":"2024-03-20T13:37:12.440517+0000","last_clean":"2024-03-20T13:37:12.440517+0000","last_became_active":"2024-03-20T13:34:49.941420+0000","last_became_peered":"2024-03-20T13:34:49.941420+0000","last_unstale":"2024-03-20T13:37:12.440517+0000","last_undegraded":"2024-03-20T13:37:12.440517+0000","last_fullsized":"2024-03-20T13:37:12.440517+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.440412+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.440412+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:23.449890+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.083092+0000","last_change":"2024-03-20T13:36:43.083092+0000","last_active":"2024-03-20T13:36:43.083092+0000","last_peered":"2024-03-20T13:36:43.083092+0000","last_clean":"2024-03-20T13:36:43.083092+0000","last_became_active":"2024-03-20T13:34:53.939653+0000","last_became_peered":"2024-03-20T13:34:53.939653+0000","last_unstale":"2024-03-20T13:36:43.083092+0000","last_undegraded":"2024-03-20T13:36:43.083092+0000","last_fullsized":"2024-03-20T13:36:43.083092+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.082968+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.082968+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:27:06.735401+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"32'256","reported_seq":448,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:35.848464+0000","last_change":"2024-03-20T13:36:35.848464+0000","last_active":"2024-03-20T13:36:35.848464+0000","last_peered":"2024-03-20T13:36:35.848464+0000","last_clean":"2024-03-20T13:36:35.848464+0000","last_became_active":"2024-03-20T13:34:55.956032+0000","last_became_peered":"2024-03-20T13:34:55.956032+0000","last_unstale":"2024-03-20T13:36:35.848464+0000","last_undegraded":"2024-03-20T13:36:35.848464+0000","last_fullsized":"2024-03-20T13:36:35.848464+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'256","last_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_deep_scrub":"32'256","last_deep_scrub_stamp":"2024-03-20T13:36:35.848325+0000","last_clean_scrub_stamp":"2024-03-20T13:36:35.848325+0000","objects_scrubbed":10,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:59:23.551034+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":336,"num_read_kb":321,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.158892+0000","last_change":"2024-03-20T13:36:54.158892+0000","last_active":"2024-03-20T13:36:54.158892+0000","last_peered":"2024-03-20T13:36:54.158892+0000","last_clean":"2024-03-20T13:36:54.158892+0000","last_became_active":"2024-03-20T13:34:57.964268+0000","last_became_peered":"2024-03-20T13:34:57.964268+0000","last_unstale":"2024-03-20T13:36:54.158892+0000","last_undegraded":"2024-03-20T13:36:54.158892+0000","last_fullsized":"2024-03-20T13:36:54.158892+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.158747+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.158747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:05.168226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"32'5","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:34.760041+0000","last_change":"2024-03-20T13:37:34.760069+0000","last_active":"2024-03-20T13:37:34.760041+0000","last_peered":"2024-03-20T13:37:34.760041+0000","last_clean":"2024-03-20T13:37:34.760041+0000","last_became_active":"2024-03-20T13:34:59.974334+0000","last_became_peered":"2024-03-20T13:34:59.974334+0000","last_unstale":"2024-03-20T13:37:34.760041+0000","last_undegraded":"2024-03-20T13:37:34.760041+0000","last_fullsized":"2024-03-20T13:37:34.760041+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'5","last_scrub_stamp":"2024-03-20T13:37:34.759957+0000","last_deep_scrub":"32'5","last_deep_scrub_stamp":"2024-03-20T13:37:34.759957+0000","last_clean_scrub_stamp":"2024-03-20T13:37:34.759957+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:53.081846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"32'4","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.542586+0000","last_change":"2024-03-20T13:37:03.542621+0000","last_active":"2024-03-20T13:37:03.542586+0000","last_peered":"2024-03-20T13:37:03.542586+0000","last_clean":"2024-03-20T13:37:03.542586+0000","last_became_active":"2024-03-20T13:34:51.947482+0000","last_became_peered":"2024-03-20T13:34:51.947482+0000","last_unstale":"2024-03-20T13:37:03.542586+0000","last_undegraded":"2024-03-20T13:37:03.542586+0000","last_fullsized":"2024-03-20T13:37:03.542586+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.542501+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.542501+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:35:05.159751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":16,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.239165+0000","last_change":"2024-03-20T13:37:16.239193+0000","last_active":"2024-03-20T13:37:16.239165+0000","last_peered":"2024-03-20T13:37:16.239165+0000","last_clean":"2024-03-20T13:37:16.239165+0000","last_became_active":"2024-03-20T13:34:41.903658+0000","last_became_peered":"2024-03-20T13:34:41.903658+0000","last_unstale":"2024-03-20T13:37:16.239165+0000","last_undegraded":"2024-03-20T13:37:16.239165+0000","last_fullsized":"2024-03-20T13:37:16.239165+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.239082+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.239082+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.239082+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:46:22.371725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.535422+0000","last_change":"2024-03-20T13:37:29.535448+0000","last_active":"2024-03-20T13:37:29.535422+0000","last_peered":"2024-03-20T13:37:29.535422+0000","last_clean":"2024-03-20T13:37:29.535422+0000","last_became_active":"2024-03-20T13:34:49.933872+0000","last_became_peered":"2024-03-20T13:34:49.933872+0000","last_unstale":"2024-03-20T13:37:29.535422+0000","last_undegraded":"2024-03-20T13:37:29.535422+0000","last_fullsized":"2024-03-20T13:37:29.535422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:29.535328+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:29.535328+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.535328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:40:00.327953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"32'2","reported_seq":40,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.148343+0000","last_change":"2024-03-20T13:36:57.148343+0000","last_active":"2024-03-20T13:36:57.148343+0000","last_peered":"2024-03-20T13:36:57.148343+0000","last_clean":"2024-03-20T13:36:57.148343+0000","last_became_active":"2024-03-20T13:34:53.942864+0000","last_became_peered":"2024-03-20T13:34:53.942864+0000","last_unstale":"2024-03-20T13:36:57.148343+0000","last_undegraded":"2024-03-20T13:36:57.148343+0000","last_fullsized":"2024-03-20T13:36:57.148343+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.148192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.148192+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:29.933263+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'23","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.215018+0000","last_change":"2024-03-20T13:36:47.215018+0000","last_active":"2024-03-20T13:36:47.215018+0000","last_peered":"2024-03-20T13:36:47.215018+0000","last_clean":"2024-03-20T13:36:47.215018+0000","last_became_active":"2024-03-20T13:34:55.953858+0000","last_became_peered":"2024-03-20T13:34:55.953858+0000","last_unstale":"2024-03-20T13:36:47.215018+0000","last_undegraded":"2024-03-20T13:36:47.215018+0000","last_fullsized":"2024-03-20T13:36:47.215018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'23","last_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_deep_scrub":"32'23","last_deep_scrub_stamp":"2024-03-20T13:36:47.214888+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.214888+0000","objects_scrubbed":8,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:24.057007+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.483718+0000","last_change":"2024-03-20T13:36:40.483718+0000","last_active":"2024-03-20T13:36:40.483718+0000","last_peered":"2024-03-20T13:36:40.483718+0000","last_clean":"2024-03-20T13:36:40.483718+0000","last_became_active":"2024-03-20T13:34:57.960779+0000","last_became_peered":"2024-03-20T13:34:57.960779+0000","last_unstale":"2024-03-20T13:36:40.483718+0000","last_undegraded":"2024-03-20T13:36:40.483718+0000","last_fullsized":"2024-03-20T13:36:40.483718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.483604+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.483604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:15.129022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.236869+0000","last_change":"2024-03-20T13:37:16.236869+0000","last_active":"2024-03-20T13:37:16.236869+0000","last_peered":"2024-03-20T13:37:16.236869+0000","last_clean":"2024-03-20T13:37:16.236869+0000","last_became_active":"2024-03-20T13:34:59.969745+0000","last_became_peered":"2024-03-20T13:34:59.969745+0000","last_unstale":"2024-03-20T13:37:16.236869+0000","last_undegraded":"2024-03-20T13:37:16.236869+0000","last_fullsized":"2024-03-20T13:37:16.236869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:16.236742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:16.236742+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.236742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:04:03.762906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"32'18","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:11.482307+0000","last_change":"2024-03-20T13:37:11.482376+0000","last_active":"2024-03-20T13:37:11.482307+0000","last_peered":"2024-03-20T13:37:11.482307+0000","last_clean":"2024-03-20T13:37:11.482307+0000","last_became_active":"2024-03-20T13:34:51.936611+0000","last_became_peered":"2024-03-20T13:34:51.936611+0000","last_unstale":"2024-03-20T13:37:11.482307+0000","last_undegraded":"2024-03-20T13:37:11.482307+0000","last_fullsized":"2024-03-20T13:37:11.482307+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'18","last_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_deep_scrub":"32'18","last_deep_scrub_stamp":"2024-03-20T13:37:11.482209+0000","last_clean_scrub_stamp":"2024-03-20T13:37:11.482209+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:21:05.485475+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":46,"num_write":24,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:43.158744+0000","last_change":"2024-03-20T13:37:43.158770+0000","last_active":"2024-03-20T13:37:43.158744+0000","last_peered":"2024-03-20T13:37:43.158744+0000","last_clean":"2024-03-20T13:37:43.158744+0000","last_became_active":"2024-03-20T13:34:41.903461+0000","last_became_peered":"2024-03-20T13:34:41.903461+0000","last_unstale":"2024-03-20T13:37:43.158744+0000","last_undegraded":"2024-03-20T13:37:43.158744+0000","last_fullsized":"2024-03-20T13:37:43.158744+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:43.158648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:43.158648+0000","last_clean_scrub_stamp":"2024-03-20T13:37:43.158648+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:28:13.174226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.240052+0000","last_change":"2024-03-20T13:37:18.240078+0000","last_active":"2024-03-20T13:37:18.240052+0000","last_peered":"2024-03-20T13:37:18.240052+0000","last_clean":"2024-03-20T13:37:18.240052+0000","last_became_active":"2024-03-20T13:34:49.937168+0000","last_became_peered":"2024-03-20T13:34:49.937168+0000","last_unstale":"2024-03-20T13:37:18.240052+0000","last_undegraded":"2024-03-20T13:37:18.240052+0000","last_fullsized":"2024-03-20T13:37:18.240052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:18.239966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:18.239966+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.239966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:41.643848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.507511+0000","last_change":"2024-03-20T13:36:56.507511+0000","last_active":"2024-03-20T13:36:56.507511+0000","last_peered":"2024-03-20T13:36:56.507511+0000","last_clean":"2024-03-20T13:36:56.507511+0000","last_became_active":"2024-03-20T13:34:53.942509+0000","last_became_peered":"2024-03-20T13:34:53.942509+0000","last_unstale":"2024-03-20T13:36:56.507511+0000","last_undegraded":"2024-03-20T13:36:56.507511+0000","last_fullsized":"2024-03-20T13:36:56.507511+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.507374+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.507374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:35:27.390260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'20","reported_seq":60,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.226545+0000","last_change":"2024-03-20T13:36:59.226545+0000","last_active":"2024-03-20T13:36:59.226545+0000","last_peered":"2024-03-20T13:36:59.226545+0000","last_clean":"2024-03-20T13:36:59.226545+0000","last_became_active":"2024-03-20T13:34:55.955475+0000","last_became_peered":"2024-03-20T13:34:55.955475+0000","last_unstale":"2024-03-20T13:36:59.226545+0000","last_undegraded":"2024-03-20T13:36:59.226545+0000","last_fullsized":"2024-03-20T13:36:59.226545+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'20","last_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_deep_scrub":"32'20","last_deep_scrub_stamp":"2024-03-20T13:36:59.226391+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.226391+0000","objects_scrubbed":7,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:17.073932+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":19,"num_read_kb":13,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":350,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.194396+0000","last_change":"2024-03-20T13:36:57.194396+0000","last_active":"2024-03-20T13:36:57.194396+0000","last_peered":"2024-03-20T13:36:57.194396+0000","last_clean":"2024-03-20T13:36:57.194396+0000","last_became_active":"2024-03-20T13:34:57.962208+0000","last_became_peered":"2024-03-20T13:34:57.962208+0000","last_unstale":"2024-03-20T13:36:57.194396+0000","last_undegraded":"2024-03-20T13:36:57.194396+0000","last_fullsized":"2024-03-20T13:36:57.194396+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:57.194286+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.194286+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:46:57.106173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"32'10","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.784884+0000","last_change":"2024-03-20T13:37:32.784934+0000","last_active":"2024-03-20T13:37:32.784884+0000","last_peered":"2024-03-20T13:37:32.784884+0000","last_clean":"2024-03-20T13:37:32.784884+0000","last_became_active":"2024-03-20T13:34:59.972127+0000","last_became_peered":"2024-03-20T13:34:59.972127+0000","last_unstale":"2024-03-20T13:37:32.784884+0000","last_undegraded":"2024-03-20T13:37:32.784884+0000","last_fullsized":"2024-03-20T13:37:32.784884+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:32.784765+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:32.784765+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.784765+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:58.540981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":58,"num_write":29,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.850116+0000","last_change":"2024-03-20T13:36:56.850116+0000","last_active":"2024-03-20T13:36:56.850116+0000","last_peered":"2024-03-20T13:36:56.850116+0000","last_clean":"2024-03-20T13:36:56.850116+0000","last_became_active":"2024-03-20T13:34:51.950506+0000","last_became_peered":"2024-03-20T13:34:51.950506+0000","last_unstale":"2024-03-20T13:36:56.850116+0000","last_undegraded":"2024-03-20T13:36:56.850116+0000","last_fullsized":"2024-03-20T13:36:56.850116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:56.849978+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.849978+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:07:10.407253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":32,"num_read_kb":28,"num_write":10,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.230500+0000","last_change":"2024-03-20T13:37:17.230526+0000","last_active":"2024-03-20T13:37:17.230500+0000","last_peered":"2024-03-20T13:37:17.230500+0000","last_clean":"2024-03-20T13:37:17.230500+0000","last_became_active":"2024-03-20T13:34:49.936287+0000","last_became_peered":"2024-03-20T13:34:49.936287+0000","last_unstale":"2024-03-20T13:37:17.230500+0000","last_undegraded":"2024-03-20T13:37:17.230500+0000","last_fullsized":"2024-03-20T13:37:17.230500+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:17.230413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:17.230413+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.230413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:56:06.528362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.516806+0000","last_change":"2024-03-20T13:37:23.516853+0000","last_active":"2024-03-20T13:37:23.516806+0000","last_peered":"2024-03-20T13:37:23.516806+0000","last_clean":"2024-03-20T13:37:23.516806+0000","last_became_active":"2024-03-20T13:34:41.904452+0000","last_became_peered":"2024-03-20T13:34:41.904452+0000","last_unstale":"2024-03-20T13:37:23.516806+0000","last_undegraded":"2024-03-20T13:37:23.516806+0000","last_fullsized":"2024-03-20T13:37:23.516806+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.516709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.516709+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.516709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:30.179578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"32'3","reported_seq":205,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:59.474223+0000","last_change":"2024-03-20T13:36:59.474249+0000","last_active":"2024-03-20T13:36:59.474223+0000","last_peered":"2024-03-20T13:36:59.474223+0000","last_clean":"2024-03-20T13:36:59.474223+0000","last_became_active":"2024-03-20T13:34:53.941912+0000","last_became_peered":"2024-03-20T13:34:53.941912+0000","last_unstale":"2024-03-20T13:36:59.474223+0000","last_undegraded":"2024-03-20T13:36:59.474223+0000","last_fullsized":"2024-03-20T13:36:59.474223+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:59.474149+0000","last_clean_scrub_stamp":"2024-03-20T13:36:59.474149+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:18:43.301196+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":250,"num_read_kb":249,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'68","reported_seq":144,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.439320+0000","last_change":"2024-03-20T13:36:43.439320+0000","last_active":"2024-03-20T13:36:43.439320+0000","last_peered":"2024-03-20T13:36:43.439320+0000","last_clean":"2024-03-20T13:36:43.439320+0000","last_became_active":"2024-03-20T13:34:55.955214+0000","last_became_peered":"2024-03-20T13:34:55.955214+0000","last_unstale":"2024-03-20T13:36:43.439320+0000","last_undegraded":"2024-03-20T13:36:43.439320+0000","last_fullsized":"2024-03-20T13:36:43.439320+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'68","last_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_deep_scrub":"32'68","last_deep_scrub_stamp":"2024-03-20T13:36:43.439197+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.439197+0000","objects_scrubbed":8,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:55.779728+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":58,"num_write":28,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.108014+0000","last_change":"2024-03-20T13:36:40.108014+0000","last_active":"2024-03-20T13:36:40.108014+0000","last_peered":"2024-03-20T13:36:40.108014+0000","last_clean":"2024-03-20T13:36:40.108014+0000","last_became_active":"2024-03-20T13:34:57.965816+0000","last_became_peered":"2024-03-20T13:34:57.965816+0000","last_unstale":"2024-03-20T13:36:40.108014+0000","last_undegraded":"2024-03-20T13:36:40.108014+0000","last_fullsized":"2024-03-20T13:36:40.108014+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:40.107898+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.107898+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:02:33.206081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"32'7","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.604388+0000","last_change":"2024-03-20T13:37:32.604430+0000","last_active":"2024-03-20T13:37:32.604388+0000","last_peered":"2024-03-20T13:37:32.604388+0000","last_clean":"2024-03-20T13:37:32.604388+0000","last_became_active":"2024-03-20T13:34:59.968662+0000","last_became_peered":"2024-03-20T13:34:59.968662+0000","last_unstale":"2024-03-20T13:37:32.604388+0000","last_undegraded":"2024-03-20T13:37:32.604388+0000","last_fullsized":"2024-03-20T13:37:32.604388+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'7","last_scrub_stamp":"2024-03-20T13:37:32.604297+0000","last_deep_scrub":"32'7","last_deep_scrub_stamp":"2024-03-20T13:37:32.604297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.604297+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:50.926186+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.747290+0000","last_change":"2024-03-20T13:37:05.747316+0000","last_active":"2024-03-20T13:37:05.747290+0000","last_peered":"2024-03-20T13:37:05.747290+0000","last_clean":"2024-03-20T13:37:05.747290+0000","last_became_active":"2024-03-20T13:34:51.941449+0000","last_became_peered":"2024-03-20T13:34:51.941449+0000","last_unstale":"2024-03-20T13:37:05.747290+0000","last_undegraded":"2024-03-20T13:37:05.747290+0000","last_fullsized":"2024-03-20T13:37:05.747290+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:05.747166+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.747166+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:55:55.045115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.428580+0000","last_change":"2024-03-20T13:37:08.428609+0000","last_active":"2024-03-20T13:37:08.428580+0000","last_peered":"2024-03-20T13:37:08.428580+0000","last_clean":"2024-03-20T13:37:08.428580+0000","last_became_active":"2024-03-20T13:34:49.946322+0000","last_became_peered":"2024-03-20T13:34:49.946322+0000","last_unstale":"2024-03-20T13:37:08.428580+0000","last_undegraded":"2024-03-20T13:37:08.428580+0000","last_fullsized":"2024-03-20T13:37:08.428580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:08.428489+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.428489+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:55.125702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:44.204628+0000","last_change":"2024-03-20T13:37:44.204654+0000","last_active":"2024-03-20T13:37:44.204628+0000","last_peered":"2024-03-20T13:37:44.204628+0000","last_clean":"2024-03-20T13:37:44.204628+0000","last_became_active":"2024-03-20T13:34:41.903572+0000","last_became_peered":"2024-03-20T13:34:41.903572+0000","last_unstale":"2024-03-20T13:37:44.204628+0000","last_undegraded":"2024-03-20T13:37:44.204628+0000","last_fullsized":"2024-03-20T13:37:44.204628+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:44.204542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:44.204542+0000","last_clean_scrub_stamp":"2024-03-20T13:37:44.204542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:07:21.138167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.129101+0000","last_change":"2024-03-20T13:36:45.129101+0000","last_active":"2024-03-20T13:36:45.129101+0000","last_peered":"2024-03-20T13:36:45.129101+0000","last_clean":"2024-03-20T13:36:45.129101+0000","last_became_active":"2024-03-20T13:34:53.939867+0000","last_became_peered":"2024-03-20T13:34:53.939867+0000","last_unstale":"2024-03-20T13:36:45.129101+0000","last_undegraded":"2024-03-20T13:36:45.129101+0000","last_fullsized":"2024-03-20T13:36:45.129101+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.128960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.128960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:34:46.746210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"32'21","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.882086+0000","last_change":"2024-03-20T13:36:34.882086+0000","last_active":"2024-03-20T13:36:34.882086+0000","last_peered":"2024-03-20T13:36:34.882086+0000","last_clean":"2024-03-20T13:36:34.882086+0000","last_became_active":"2024-03-20T13:34:55.956248+0000","last_became_peered":"2024-03-20T13:34:55.956248+0000","last_unstale":"2024-03-20T13:36:34.882086+0000","last_undegraded":"2024-03-20T13:36:34.882086+0000","last_fullsized":"2024-03-20T13:36:34.882086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'21","last_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_deep_scrub":"32'21","last_deep_scrub_stamp":"2024-03-20T13:36:34.881955+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.881955+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:01.668025+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"32'243","reported_seq":291,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.888239+0000","last_change":"2024-03-20T13:36:46.888239+0000","last_active":"2024-03-20T13:36:46.888239+0000","last_peered":"2024-03-20T13:36:46.888239+0000","last_clean":"2024-03-20T13:36:46.888239+0000","last_became_active":"2024-03-20T13:34:57.962172+0000","last_became_peered":"2024-03-20T13:34:57.962172+0000","last_unstale":"2024-03-20T13:36:46.888239+0000","last_undegraded":"2024-03-20T13:36:46.888239+0000","last_fullsized":"2024-03-20T13:36:46.888239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:46.888110+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.888110+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:47:59.228641+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"32'4","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.247268+0000","last_change":"2024-03-20T13:37:12.247268+0000","last_active":"2024-03-20T13:37:12.247268+0000","last_peered":"2024-03-20T13:37:12.247268+0000","last_clean":"2024-03-20T13:37:12.247268+0000","last_became_active":"2024-03-20T13:34:59.965560+0000","last_became_peered":"2024-03-20T13:34:59.965560+0000","last_unstale":"2024-03-20T13:37:12.247268+0000","last_undegraded":"2024-03-20T13:37:12.247268+0000","last_fullsized":"2024-03-20T13:37:12.247268+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.247124+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.247124+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:39:43.039748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6,"num_write":11,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"30'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.204303+0000","last_change":"2024-03-20T13:36:51.204303+0000","last_active":"2024-03-20T13:36:51.204303+0000","last_peered":"2024-03-20T13:36:51.204303+0000","last_clean":"2024-03-20T13:36:51.204303+0000","last_became_active":"2024-03-20T13:34:51.955349+0000","last_became_peered":"2024-03-20T13:34:51.955349+0000","last_unstale":"2024-03-20T13:36:51.204303+0000","last_undegraded":"2024-03-20T13:36:51.204303+0000","last_fullsized":"2024-03-20T13:36:51.204303+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'4","last_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_deep_scrub":"30'4","last_deep_scrub_stamp":"2024-03-20T13:36:51.204192+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.204192+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:38.634547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.084564+0000","last_change":"2024-03-20T13:37:33.084587+0000","last_active":"2024-03-20T13:37:33.084564+0000","last_peered":"2024-03-20T13:37:33.084564+0000","last_clean":"2024-03-20T13:37:33.084564+0000","last_became_active":"2024-03-20T13:34:49.955438+0000","last_became_peered":"2024-03-20T13:34:49.955438+0000","last_unstale":"2024-03-20T13:37:33.084564+0000","last_undegraded":"2024-03-20T13:37:33.084564+0000","last_fullsized":"2024-03-20T13:37:33.084564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:33.084477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:33.084477+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.084477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:23:10.286935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:24.493735+0000","last_change":"2024-03-20T13:37:24.493773+0000","last_active":"2024-03-20T13:37:24.493735+0000","last_peered":"2024-03-20T13:37:24.493735+0000","last_clean":"2024-03-20T13:37:24.493735+0000","last_became_active":"2024-03-20T13:34:41.904499+0000","last_became_peered":"2024-03-20T13:34:41.904499+0000","last_unstale":"2024-03-20T13:37:24.493735+0000","last_undegraded":"2024-03-20T13:37:24.493735+0000","last_fullsized":"2024-03-20T13:37:24.493735+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:24.493644+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:24.493644+0000","last_clean_scrub_stamp":"2024-03-20T13:37:24.493644+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:05:52.922127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:57.069763+0000","last_change":"2024-03-20T13:37:57.069785+0000","last_active":"2024-03-20T13:37:57.069763+0000","last_peered":"2024-03-20T13:37:57.069763+0000","last_clean":"2024-03-20T13:37:57.069763+0000","last_became_active":"2024-03-20T13:35:30.990293+0000","last_became_peered":"2024-03-20T13:35:30.990293+0000","last_unstale":"2024-03-20T13:37:57.069763+0000","last_undegraded":"2024-03-20T13:37:57.069763+0000","last_fullsized":"2024-03-20T13:37:57.069763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:57.069681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:57.069681+0000","last_clean_scrub_stamp":"2024-03-20T13:37:57.069681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:25:45.099414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:05.215859+0000","last_change":"2024-03-20T13:37:05.215894+0000","last_active":"2024-03-20T13:37:05.215859+0000","last_peered":"2024-03-20T13:37:05.215859+0000","last_clean":"2024-03-20T13:37:05.215859+0000","last_became_active":"2024-03-20T13:34:55.954634+0000","last_became_peered":"2024-03-20T13:34:55.954634+0000","last_unstale":"2024-03-20T13:37:05.215859+0000","last_undegraded":"2024-03-20T13:37:05.215859+0000","last_fullsized":"2024-03-20T13:37:05.215859+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:37:05.215760+0000","last_clean_scrub_stamp":"2024-03-20T13:37:05.215760+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:44:50.554560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"32'243","reported_seq":330,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.452554+0000","last_change":"2024-03-20T13:36:45.452554+0000","last_active":"2024-03-20T13:36:45.452554+0000","last_peered":"2024-03-20T13:36:45.452554+0000","last_clean":"2024-03-20T13:36:45.452554+0000","last_became_active":"2024-03-20T13:34:57.967698+0000","last_became_peered":"2024-03-20T13:34:57.967698+0000","last_unstale":"2024-03-20T13:36:45.452554+0000","last_undegraded":"2024-03-20T13:36:45.452554+0000","last_fullsized":"2024-03-20T13:36:45.452554+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:45.452437+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.452437+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:06:35.977614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"30'3","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.722337+0000","last_change":"2024-03-20T13:37:02.722337+0000","last_active":"2024-03-20T13:37:02.722337+0000","last_peered":"2024-03-20T13:37:02.722337+0000","last_clean":"2024-03-20T13:37:02.722337+0000","last_became_active":"2024-03-20T13:34:59.968045+0000","last_became_peered":"2024-03-20T13:34:59.968045+0000","last_unstale":"2024-03-20T13:37:02.722337+0000","last_undegraded":"2024-03-20T13:37:02.722337+0000","last_fullsized":"2024-03-20T13:37:02.722337+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'3","last_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_deep_scrub":"30'3","last_deep_scrub_stamp":"2024-03-20T13:37:02.722217+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.722217+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:10.251847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.238524+0000","last_change":"2024-03-20T13:37:14.238550+0000","last_active":"2024-03-20T13:37:14.238524+0000","last_peered":"2024-03-20T13:37:14.238524+0000","last_clean":"2024-03-20T13:37:14.238524+0000","last_became_active":"2024-03-20T13:34:51.943882+0000","last_became_peered":"2024-03-20T13:34:51.943882+0000","last_unstale":"2024-03-20T13:37:14.238524+0000","last_undegraded":"2024-03-20T13:37:14.238524+0000","last_fullsized":"2024-03-20T13:37:14.238524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:14.238438+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:14.238438+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.238438+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:21.768068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.714031+0000","last_change":"2024-03-20T13:37:15.714057+0000","last_active":"2024-03-20T13:37:15.714031+0000","last_peered":"2024-03-20T13:37:15.714031+0000","last_clean":"2024-03-20T13:37:15.714031+0000","last_became_active":"2024-03-20T13:34:49.947233+0000","last_became_peered":"2024-03-20T13:34:49.947233+0000","last_unstale":"2024-03-20T13:37:15.714031+0000","last_undegraded":"2024-03-20T13:37:15.714031+0000","last_fullsized":"2024-03-20T13:37:15.714031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.713941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.713941+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.713941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:56:51.973415+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:46.268299+0000","last_change":"2024-03-20T13:37:46.268328+0000","last_active":"2024-03-20T13:37:46.268299+0000","last_peered":"2024-03-20T13:37:46.268299+0000","last_clean":"2024-03-20T13:37:46.268299+0000","last_became_active":"2024-03-20T13:34:41.947950+0000","last_became_peered":"2024-03-20T13:34:41.947950+0000","last_unstale":"2024-03-20T13:37:46.268299+0000","last_undegraded":"2024-03-20T13:37:46.268299+0000","last_fullsized":"2024-03-20T13:37:46.268299+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:46.268175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:46.268175+0000","last_clean_scrub_stamp":"2024-03-20T13:37:46.268175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:09:40.063831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.105883+0000","last_change":"2024-03-20T13:36:42.105883+0000","last_active":"2024-03-20T13:36:42.105883+0000","last_peered":"2024-03-20T13:36:42.105883+0000","last_clean":"2024-03-20T13:36:42.105883+0000","last_became_active":"2024-03-20T13:34:53.941154+0000","last_became_peered":"2024-03-20T13:34:53.941154+0000","last_unstale":"2024-03-20T13:36:42.105883+0000","last_undegraded":"2024-03-20T13:36:42.105883+0000","last_fullsized":"2024-03-20T13:36:42.105883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.105759+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.105759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:22:49.608123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'91","reported_seq":184,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.173473+0000","last_change":"2024-03-20T13:36:45.173473+0000","last_active":"2024-03-20T13:36:45.173473+0000","last_peered":"2024-03-20T13:36:45.173473+0000","last_clean":"2024-03-20T13:36:45.173473+0000","last_became_active":"2024-03-20T13:34:55.956069+0000","last_became_peered":"2024-03-20T13:34:55.956069+0000","last_unstale":"2024-03-20T13:36:45.173473+0000","last_undegraded":"2024-03-20T13:36:45.173473+0000","last_fullsized":"2024-03-20T13:36:45.173473+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'91","last_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_deep_scrub":"32'91","last_deep_scrub_stamp":"2024-03-20T13:36:45.173353+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.173353+0000","objects_scrubbed":8,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:11.959423+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:36.486441+0000","last_change":"2024-03-20T13:36:36.486441+0000","last_active":"2024-03-20T13:36:36.486441+0000","last_peered":"2024-03-20T13:36:36.486441+0000","last_clean":"2024-03-20T13:36:36.486441+0000","last_became_active":"2024-03-20T13:34:57.961974+0000","last_became_peered":"2024-03-20T13:34:57.961974+0000","last_unstale":"2024-03-20T13:36:36.486441+0000","last_undegraded":"2024-03-20T13:36:36.486441+0000","last_fullsized":"2024-03-20T13:36:36.486441+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:36.486298+0000","last_clean_scrub_stamp":"2024-03-20T13:36:36.486298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:46:56.678415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.195177+0000","last_change":"2024-03-20T13:36:50.195177+0000","last_active":"2024-03-20T13:36:50.195177+0000","last_peered":"2024-03-20T13:36:50.195177+0000","last_clean":"2024-03-20T13:36:50.195177+0000","last_became_active":"2024-03-20T13:34:59.972408+0000","last_became_peered":"2024-03-20T13:34:59.972408+0000","last_unstale":"2024-03-20T13:36:50.195177+0000","last_undegraded":"2024-03-20T13:36:50.195177+0000","last_fullsized":"2024-03-20T13:36:50.195177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:50.195066+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.195066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:08.652809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.162953+0000","last_change":"2024-03-20T13:36:42.162953+0000","last_active":"2024-03-20T13:36:42.162953+0000","last_peered":"2024-03-20T13:36:42.162953+0000","last_clean":"2024-03-20T13:36:42.162953+0000","last_became_active":"2024-03-20T13:34:59.969811+0000","last_became_peered":"2024-03-20T13:34:59.969811+0000","last_unstale":"2024-03-20T13:36:42.162953+0000","last_undegraded":"2024-03-20T13:36:42.162953+0000","last_fullsized":"2024-03-20T13:36:42.162953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.162847+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.162847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:46:25.287712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.237627+0000","last_change":"2024-03-20T13:37:12.237627+0000","last_active":"2024-03-20T13:37:12.237627+0000","last_peered":"2024-03-20T13:37:12.237627+0000","last_clean":"2024-03-20T13:37:12.237627+0000","last_became_active":"2024-03-20T13:34:51.942980+0000","last_became_peered":"2024-03-20T13:34:51.942980+0000","last_unstale":"2024-03-20T13:37:12.237627+0000","last_undegraded":"2024-03-20T13:37:12.237627+0000","last_fullsized":"2024-03-20T13:37:12.237627+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:12.237514+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.237514+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:54.859398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:32.094362+0000","last_change":"2024-03-20T13:37:32.094389+0000","last_active":"2024-03-20T13:37:32.094362+0000","last_peered":"2024-03-20T13:37:32.094362+0000","last_clean":"2024-03-20T13:37:32.094362+0000","last_became_active":"2024-03-20T13:34:49.960346+0000","last_became_peered":"2024-03-20T13:34:49.960346+0000","last_unstale":"2024-03-20T13:37:32.094362+0000","last_undegraded":"2024-03-20T13:37:32.094362+0000","last_fullsized":"2024-03-20T13:37:32.094362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:32.094255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:32.094255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:32.094255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:33:24.944029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.927642+0000","last_change":"2024-03-20T13:36:48.927642+0000","last_active":"2024-03-20T13:36:48.927642+0000","last_peered":"2024-03-20T13:36:48.927642+0000","last_clean":"2024-03-20T13:36:48.927642+0000","last_became_active":"2024-03-20T13:34:53.941343+0000","last_became_peered":"2024-03-20T13:34:53.941343+0000","last_unstale":"2024-03-20T13:36:48.927642+0000","last_undegraded":"2024-03-20T13:36:48.927642+0000","last_fullsized":"2024-03-20T13:36:48.927642+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:48.927492+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.927492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:31.555602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'38","reported_seq":94,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.228501+0000","last_change":"2024-03-20T13:37:02.228501+0000","last_active":"2024-03-20T13:37:02.228501+0000","last_peered":"2024-03-20T13:37:02.228501+0000","last_clean":"2024-03-20T13:37:02.228501+0000","last_became_active":"2024-03-20T13:34:55.954927+0000","last_became_peered":"2024-03-20T13:34:55.954927+0000","last_unstale":"2024-03-20T13:37:02.228501+0000","last_undegraded":"2024-03-20T13:37:02.228501+0000","last_fullsized":"2024-03-20T13:37:02.228501+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'38","last_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_deep_scrub":"32'38","last_deep_scrub_stamp":"2024-03-20T13:37:02.228382+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.228382+0000","objects_scrubbed":5,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:59:57.609818+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.213463+0000","last_change":"2024-03-20T13:37:00.213463+0000","last_active":"2024-03-20T13:37:00.213463+0000","last_peered":"2024-03-20T13:37:00.213463+0000","last_clean":"2024-03-20T13:37:00.213463+0000","last_became_active":"2024-03-20T13:34:57.968581+0000","last_became_peered":"2024-03-20T13:34:57.968581+0000","last_unstale":"2024-03-20T13:37:00.213463+0000","last_undegraded":"2024-03-20T13:37:00.213463+0000","last_fullsized":"2024-03-20T13:37:00.213463+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:00.213347+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.213347+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:20:55.768317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.470905+0000","last_change":"2024-03-20T13:37:01.470905+0000","last_active":"2024-03-20T13:37:01.470905+0000","last_peered":"2024-03-20T13:37:01.470905+0000","last_clean":"2024-03-20T13:37:01.470905+0000","last_became_active":"2024-03-20T13:34:59.966162+0000","last_became_peered":"2024-03-20T13:34:59.966162+0000","last_unstale":"2024-03-20T13:37:01.470905+0000","last_undegraded":"2024-03-20T13:37:01.470905+0000","last_fullsized":"2024-03-20T13:37:01.470905+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:01.470772+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.470772+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:39.395522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:08.740422+0000","last_change":"2024-03-20T13:37:08.740422+0000","last_active":"2024-03-20T13:37:08.740422+0000","last_peered":"2024-03-20T13:37:08.740422+0000","last_clean":"2024-03-20T13:37:08.740422+0000","last_became_active":"2024-03-20T13:34:51.943791+0000","last_became_peered":"2024-03-20T13:34:51.943791+0000","last_unstale":"2024-03-20T13:37:08.740422+0000","last_undegraded":"2024-03-20T13:37:08.740422+0000","last_fullsized":"2024-03-20T13:37:08.740422+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:08.740297+0000","last_clean_scrub_stamp":"2024-03-20T13:37:08.740297+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:08:41.880256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.243856+0000","last_change":"2024-03-20T13:37:09.243856+0000","last_active":"2024-03-20T13:37:09.243856+0000","last_peered":"2024-03-20T13:37:09.243856+0000","last_clean":"2024-03-20T13:37:09.243856+0000","last_became_active":"2024-03-20T13:34:49.950542+0000","last_became_peered":"2024-03-20T13:34:49.950542+0000","last_unstale":"2024-03-20T13:37:09.243856+0000","last_undegraded":"2024-03-20T13:37:09.243856+0000","last_fullsized":"2024-03-20T13:37:09.243856+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:09.243729+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.243729+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:38.730937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":12,"num_write_kb":4097,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.295167+0000","last_change":"2024-03-20T13:37:27.295167+0000","last_active":"2024-03-20T13:37:27.295167+0000","last_peered":"2024-03-20T13:37:27.295167+0000","last_clean":"2024-03-20T13:37:27.295167+0000","last_became_active":"2024-03-20T13:35:30.990334+0000","last_became_peered":"2024-03-20T13:35:30.990334+0000","last_unstale":"2024-03-20T13:37:27.295167+0000","last_undegraded":"2024-03-20T13:37:27.295167+0000","last_fullsized":"2024-03-20T13:37:27.295167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.295064+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.295064+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.295064+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:07:01.206762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.10","version":"32'10","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:47.478637+0000","last_change":"2024-03-20T13:36:47.478637+0000","last_active":"2024-03-20T13:36:47.478637+0000","last_peered":"2024-03-20T13:36:47.478637+0000","last_clean":"2024-03-20T13:36:47.478637+0000","last_became_active":"2024-03-20T13:34:55.948697+0000","last_became_peered":"2024-03-20T13:34:55.948697+0000","last_unstale":"2024-03-20T13:36:47.478637+0000","last_undegraded":"2024-03-20T13:36:47.478637+0000","last_fullsized":"2024-03-20T13:36:47.478637+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:47.478507+0000","last_clean_scrub_stamp":"2024-03-20T13:36:47.478507+0000","objects_scrubbed":3,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:17.900912+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":7,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":250,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:38.100179+0000","last_change":"2024-03-20T13:36:38.100179+0000","last_active":"2024-03-20T13:36:38.100179+0000","last_peered":"2024-03-20T13:36:38.100179+0000","last_clean":"2024-03-20T13:36:38.100179+0000","last_became_active":"2024-03-20T13:34:57.970246+0000","last_became_peered":"2024-03-20T13:34:57.970246+0000","last_unstale":"2024-03-20T13:36:38.100179+0000","last_undegraded":"2024-03-20T13:36:38.100179+0000","last_fullsized":"2024-03-20T13:36:38.100179+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:38.100067+0000","last_clean_scrub_stamp":"2024-03-20T13:36:38.100067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:06:11.567457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:36.570094+0000","last_change":"2024-03-20T13:37:36.570116+0000","last_active":"2024-03-20T13:37:36.570094+0000","last_peered":"2024-03-20T13:37:36.570094+0000","last_clean":"2024-03-20T13:37:36.570094+0000","last_became_active":"2024-03-20T13:34:59.974364+0000","last_became_peered":"2024-03-20T13:34:59.974364+0000","last_unstale":"2024-03-20T13:37:36.570094+0000","last_undegraded":"2024-03-20T13:37:36.570094+0000","last_fullsized":"2024-03-20T13:37:36.570094+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:36.570008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:36.570008+0000","last_clean_scrub_stamp":"2024-03-20T13:37:36.570008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:56:07.993528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.461142+0000","last_change":"2024-03-20T13:37:07.461142+0000","last_active":"2024-03-20T13:37:07.461142+0000","last_peered":"2024-03-20T13:37:07.461142+0000","last_clean":"2024-03-20T13:37:07.461142+0000","last_became_active":"2024-03-20T13:34:51.934830+0000","last_became_peered":"2024-03-20T13:34:51.934830+0000","last_unstale":"2024-03-20T13:37:07.461142+0000","last_undegraded":"2024-03-20T13:37:07.461142+0000","last_fullsized":"2024-03-20T13:37:07.461142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:07.461017+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.461017+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:49.260164+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.238017+0000","last_change":"2024-03-20T13:37:22.238044+0000","last_active":"2024-03-20T13:37:22.238017+0000","last_peered":"2024-03-20T13:37:22.238017+0000","last_clean":"2024-03-20T13:37:22.238017+0000","last_became_active":"2024-03-20T13:34:49.945821+0000","last_became_peered":"2024-03-20T13:34:49.945821+0000","last_unstale":"2024-03-20T13:37:22.238017+0000","last_undegraded":"2024-03-20T13:37:22.238017+0000","last_fullsized":"2024-03-20T13:37:22.238017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.237932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.237932+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.237932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:54:09.668288+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.112735+0000","last_change":"2024-03-20T13:36:56.112735+0000","last_active":"2024-03-20T13:36:56.112735+0000","last_peered":"2024-03-20T13:36:56.112735+0000","last_clean":"2024-03-20T13:36:56.112735+0000","last_became_active":"2024-03-20T13:34:53.943819+0000","last_became_peered":"2024-03-20T13:34:53.943819+0000","last_unstale":"2024-03-20T13:36:56.112735+0000","last_undegraded":"2024-03-20T13:36:56.112735+0000","last_fullsized":"2024-03-20T13:36:56.112735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.112607+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.112607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:39:05.346785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"32'42","reported_seq":106,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.407080+0000","last_change":"2024-03-20T13:36:44.407080+0000","last_active":"2024-03-20T13:36:44.407080+0000","last_peered":"2024-03-20T13:36:44.407080+0000","last_clean":"2024-03-20T13:36:44.407080+0000","last_became_active":"2024-03-20T13:34:55.953127+0000","last_became_peered":"2024-03-20T13:34:55.953127+0000","last_unstale":"2024-03-20T13:36:44.407080+0000","last_undegraded":"2024-03-20T13:36:44.407080+0000","last_fullsized":"2024-03-20T13:36:44.407080+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'42","last_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_deep_scrub":"32'42","last_deep_scrub_stamp":"2024-03-20T13:36:44.406901+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.406901+0000","objects_scrubbed":6,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:03:14.825593+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":54,"num_read_kb":56,"num_write":38,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:42.839038+0000","last_change":"2024-03-20T13:36:42.839038+0000","last_active":"2024-03-20T13:36:42.839038+0000","last_peered":"2024-03-20T13:36:42.839038+0000","last_clean":"2024-03-20T13:36:42.839038+0000","last_became_active":"2024-03-20T13:34:57.961811+0000","last_became_peered":"2024-03-20T13:34:57.961811+0000","last_unstale":"2024-03-20T13:36:42.839038+0000","last_undegraded":"2024-03-20T13:36:42.839038+0000","last_fullsized":"2024-03-20T13:36:42.839038+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:42.838924+0000","last_clean_scrub_stamp":"2024-03-20T13:36:42.838924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:34.359477+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:56.113334+0000","last_change":"2024-03-20T13:37:56.113357+0000","last_active":"2024-03-20T13:37:56.113334+0000","last_peered":"2024-03-20T13:37:56.113334+0000","last_clean":"2024-03-20T13:37:56.113334+0000","last_became_active":"2024-03-20T13:34:59.974985+0000","last_became_peered":"2024-03-20T13:34:59.974985+0000","last_unstale":"2024-03-20T13:37:56.113334+0000","last_undegraded":"2024-03-20T13:37:56.113334+0000","last_fullsized":"2024-03-20T13:37:56.113334+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:56.113242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:56.113242+0000","last_clean_scrub_stamp":"2024-03-20T13:37:56.113242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:39:08.254552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"32'2","reported_seq":44,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:49.196840+0000","last_change":"2024-03-20T13:36:49.196840+0000","last_active":"2024-03-20T13:36:49.196840+0000","last_peered":"2024-03-20T13:36:49.196840+0000","last_clean":"2024-03-20T13:36:49.196840+0000","last_became_active":"2024-03-20T13:34:51.955404+0000","last_became_peered":"2024-03-20T13:34:51.955404+0000","last_unstale":"2024-03-20T13:36:49.196840+0000","last_undegraded":"2024-03-20T13:36:49.196840+0000","last_fullsized":"2024-03-20T13:36:49.196840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:49.196667+0000","last_clean_scrub_stamp":"2024-03-20T13:36:49.196667+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:00:30.995814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.613025+0000","last_change":"2024-03-20T13:37:21.613053+0000","last_active":"2024-03-20T13:37:21.613025+0000","last_peered":"2024-03-20T13:37:21.613025+0000","last_clean":"2024-03-20T13:37:21.613025+0000","last_became_active":"2024-03-20T13:34:49.937516+0000","last_became_peered":"2024-03-20T13:34:49.937516+0000","last_unstale":"2024-03-20T13:37:21.613025+0000","last_undegraded":"2024-03-20T13:37:21.613025+0000","last_fullsized":"2024-03-20T13:37:21.613025+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:21.612935+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:21.612935+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.612935+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:17:55.799847+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.120372+0000","last_change":"2024-03-20T13:36:37.120372+0000","last_active":"2024-03-20T13:36:37.120372+0000","last_peered":"2024-03-20T13:36:37.120372+0000","last_clean":"2024-03-20T13:36:37.120372+0000","last_became_active":"2024-03-20T13:34:53.943907+0000","last_became_peered":"2024-03-20T13:34:53.943907+0000","last_unstale":"2024-03-20T13:36:37.120372+0000","last_undegraded":"2024-03-20T13:36:37.120372+0000","last_fullsized":"2024-03-20T13:36:37.120372+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.120203+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.120203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:22.023511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"32'34","reported_seq":89,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.166063+0000","last_change":"2024-03-20T13:36:51.166063+0000","last_active":"2024-03-20T13:36:51.166063+0000","last_peered":"2024-03-20T13:36:51.166063+0000","last_clean":"2024-03-20T13:36:51.166063+0000","last_became_active":"2024-03-20T13:34:55.949631+0000","last_became_peered":"2024-03-20T13:34:55.949631+0000","last_unstale":"2024-03-20T13:36:51.166063+0000","last_undegraded":"2024-03-20T13:36:51.166063+0000","last_fullsized":"2024-03-20T13:36:51.166063+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'34","last_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_deep_scrub":"32'34","last_deep_scrub_stamp":"2024-03-20T13:36:51.165931+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.165931+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:47:11.358048+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:43.137649+0000","last_change":"2024-03-20T13:36:43.137649+0000","last_active":"2024-03-20T13:36:43.137649+0000","last_peered":"2024-03-20T13:36:43.137649+0000","last_clean":"2024-03-20T13:36:43.137649+0000","last_became_active":"2024-03-20T13:34:57.960203+0000","last_became_peered":"2024-03-20T13:34:57.960203+0000","last_unstale":"2024-03-20T13:36:43.137649+0000","last_undegraded":"2024-03-20T13:36:43.137649+0000","last_fullsized":"2024-03-20T13:36:43.137649+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:43.137482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:43.137482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:28.715242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"32'14","reported_seq":79,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.205951+0000","last_change":"2024-03-20T13:37:17.205976+0000","last_active":"2024-03-20T13:37:17.205951+0000","last_peered":"2024-03-20T13:37:17.205951+0000","last_clean":"2024-03-20T13:37:17.205951+0000","last_became_active":"2024-03-20T13:34:51.943827+0000","last_became_peered":"2024-03-20T13:34:51.943827+0000","last_unstale":"2024-03-20T13:37:17.205951+0000","last_undegraded":"2024-03-20T13:37:17.205951+0000","last_fullsized":"2024-03-20T13:37:17.205951+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'14","last_scrub_stamp":"2024-03-20T13:37:17.205804+0000","last_deep_scrub":"32'14","last_deep_scrub_stamp":"2024-03-20T13:37:17.205804+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.205804+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:39:53.786478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:49.293764+0000","last_change":"2024-03-20T13:37:49.293816+0000","last_active":"2024-03-20T13:37:49.293764+0000","last_peered":"2024-03-20T13:37:49.293764+0000","last_clean":"2024-03-20T13:37:49.293764+0000","last_became_active":"2024-03-20T13:34:49.953800+0000","last_became_peered":"2024-03-20T13:34:49.953800+0000","last_unstale":"2024-03-20T13:37:49.293764+0000","last_undegraded":"2024-03-20T13:37:49.293764+0000","last_fullsized":"2024-03-20T13:37:49.293764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:49.293652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:49.293652+0000","last_clean_scrub_stamp":"2024-03-20T13:37:49.293652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:13:08.087084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.515662+0000","last_change":"2024-03-20T13:36:58.515701+0000","last_active":"2024-03-20T13:36:58.515662+0000","last_peered":"2024-03-20T13:36:58.515662+0000","last_clean":"2024-03-20T13:36:58.515662+0000","last_became_active":"2024-03-20T13:34:53.942107+0000","last_became_peered":"2024-03-20T13:34:53.942107+0000","last_unstale":"2024-03-20T13:36:58.515662+0000","last_undegraded":"2024-03-20T13:36:58.515662+0000","last_fullsized":"2024-03-20T13:36:58.515662+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:58.515568+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.515568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:41.137452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'61","reported_seq":134,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:46.434919+0000","last_change":"2024-03-20T13:36:46.434919+0000","last_active":"2024-03-20T13:36:46.434919+0000","last_peered":"2024-03-20T13:36:46.434919+0000","last_clean":"2024-03-20T13:36:46.434919+0000","last_became_active":"2024-03-20T13:34:55.951130+0000","last_became_peered":"2024-03-20T13:34:55.951130+0000","last_unstale":"2024-03-20T13:36:46.434919+0000","last_undegraded":"2024-03-20T13:36:46.434919+0000","last_fullsized":"2024-03-20T13:36:46.434919+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'61","last_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_deep_scrub":"32'61","last_deep_scrub_stamp":"2024-03-20T13:36:46.434789+0000","last_clean_scrub_stamp":"2024-03-20T13:36:46.434789+0000","objects_scrubbed":5,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:23:21.531106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.142333+0000","last_change":"2024-03-20T13:36:41.142333+0000","last_active":"2024-03-20T13:36:41.142333+0000","last_peered":"2024-03-20T13:36:41.142333+0000","last_clean":"2024-03-20T13:36:41.142333+0000","last_became_active":"2024-03-20T13:34:57.964991+0000","last_became_peered":"2024-03-20T13:34:57.964991+0000","last_unstale":"2024-03-20T13:36:41.142333+0000","last_undegraded":"2024-03-20T13:36:41.142333+0000","last_fullsized":"2024-03-20T13:36:41.142333+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:41.142212+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.142212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:08:35.514136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"32'10","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:34.536062+0000","last_change":"2024-03-20T13:37:34.536090+0000","last_active":"2024-03-20T13:37:34.536062+0000","last_peered":"2024-03-20T13:37:34.536062+0000","last_clean":"2024-03-20T13:37:34.536062+0000","last_became_active":"2024-03-20T13:34:59.974378+0000","last_became_peered":"2024-03-20T13:34:59.974378+0000","last_unstale":"2024-03-20T13:37:34.536062+0000","last_undegraded":"2024-03-20T13:37:34.536062+0000","last_fullsized":"2024-03-20T13:37:34.536062+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:34.535976+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:34.535976+0000","last_clean_scrub_stamp":"2024-03-20T13:37:34.535976+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:40:11.116650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":12,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.496484+0000","last_change":"2024-03-20T13:37:04.496531+0000","last_active":"2024-03-20T13:37:04.496484+0000","last_peered":"2024-03-20T13:37:04.496484+0000","last_clean":"2024-03-20T13:37:04.496484+0000","last_became_active":"2024-03-20T13:34:51.946940+0000","last_became_peered":"2024-03-20T13:34:51.946940+0000","last_unstale":"2024-03-20T13:37:04.496484+0000","last_undegraded":"2024-03-20T13:37:04.496484+0000","last_fullsized":"2024-03-20T13:37:04.496484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:04.496373+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.496373+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:01:27.900255+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.643299+0000","last_change":"2024-03-20T13:37:19.643323+0000","last_active":"2024-03-20T13:37:19.643299+0000","last_peered":"2024-03-20T13:37:19.643299+0000","last_clean":"2024-03-20T13:37:19.643299+0000","last_became_active":"2024-03-20T13:34:49.945977+0000","last_became_peered":"2024-03-20T13:34:49.945977+0000","last_unstale":"2024-03-20T13:37:19.643299+0000","last_undegraded":"2024-03-20T13:37:19.643299+0000","last_fullsized":"2024-03-20T13:37:19.643299+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.643213+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.643213+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.643213+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:21:15.198184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:29.344616+0000","last_change":"2024-03-20T13:37:29.344639+0000","last_active":"2024-03-20T13:37:29.344616+0000","last_peered":"2024-03-20T13:37:29.344616+0000","last_clean":"2024-03-20T13:37:29.344616+0000","last_became_active":"2024-03-20T13:35:30.992547+0000","last_became_peered":"2024-03-20T13:35:30.992547+0000","last_unstale":"2024-03-20T13:37:29.344616+0000","last_undegraded":"2024-03-20T13:37:29.344616+0000","last_fullsized":"2024-03-20T13:37:29.344616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:29.344529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:29.344529+0000","last_clean_scrub_stamp":"2024-03-20T13:37:29.344529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:41:45.574840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.193532+0000","last_change":"2024-03-20T13:37:01.193532+0000","last_active":"2024-03-20T13:37:01.193532+0000","last_peered":"2024-03-20T13:37:01.193532+0000","last_clean":"2024-03-20T13:37:01.193532+0000","last_became_active":"2024-03-20T13:34:55.955008+0000","last_became_peered":"2024-03-20T13:34:55.955008+0000","last_unstale":"2024-03-20T13:37:01.193532+0000","last_undegraded":"2024-03-20T13:37:01.193532+0000","last_fullsized":"2024-03-20T13:37:01.193532+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:37:01.193395+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.193395+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:18.727953+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:54.825368+0000","last_change":"2024-03-20T13:36:54.825368+0000","last_active":"2024-03-20T13:36:54.825368+0000","last_peered":"2024-03-20T13:36:54.825368+0000","last_clean":"2024-03-20T13:36:54.825368+0000","last_became_active":"2024-03-20T13:34:57.964645+0000","last_became_peered":"2024-03-20T13:34:57.964645+0000","last_unstale":"2024-03-20T13:36:54.825368+0000","last_undegraded":"2024-03-20T13:36:54.825368+0000","last_fullsized":"2024-03-20T13:36:54.825368+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:54.825258+0000","last_clean_scrub_stamp":"2024-03-20T13:36:54.825258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:26:24.356866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:52.237465+0000","last_change":"2024-03-20T13:37:52.237492+0000","last_active":"2024-03-20T13:37:52.237465+0000","last_peered":"2024-03-20T13:37:52.237465+0000","last_clean":"2024-03-20T13:37:52.237465+0000","last_became_active":"2024-03-20T13:34:59.970589+0000","last_became_peered":"2024-03-20T13:34:59.970589+0000","last_unstale":"2024-03-20T13:37:52.237465+0000","last_undegraded":"2024-03-20T13:37:52.237465+0000","last_fullsized":"2024-03-20T13:37:52.237465+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:52.237377+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:52.237377+0000","last_clean_scrub_stamp":"2024-03-20T13:37:52.237377+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:04:38.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"32'6","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:50.167768+0000","last_change":"2024-03-20T13:36:50.167768+0000","last_active":"2024-03-20T13:36:50.167768+0000","last_peered":"2024-03-20T13:36:50.167768+0000","last_clean":"2024-03-20T13:36:50.167768+0000","last_became_active":"2024-03-20T13:34:51.955337+0000","last_became_peered":"2024-03-20T13:34:51.955337+0000","last_unstale":"2024-03-20T13:36:50.167768+0000","last_undegraded":"2024-03-20T13:36:50.167768+0000","last_fullsized":"2024-03-20T13:36:50.167768+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:36:50.167623+0000","last_clean_scrub_stamp":"2024-03-20T13:36:50.167623+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:38:36.864837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.755783+0000","last_change":"2024-03-20T13:37:13.755783+0000","last_active":"2024-03-20T13:37:13.755783+0000","last_peered":"2024-03-20T13:37:13.755783+0000","last_clean":"2024-03-20T13:37:13.755783+0000","last_became_active":"2024-03-20T13:34:49.947970+0000","last_became_peered":"2024-03-20T13:34:49.947970+0000","last_unstale":"2024-03-20T13:37:13.755783+0000","last_undegraded":"2024-03-20T13:37:13.755783+0000","last_fullsized":"2024-03-20T13:37:13.755783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.755656+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.755656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:20:44.151919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.319660+0000","last_change":"2024-03-20T13:37:28.319682+0000","last_active":"2024-03-20T13:37:28.319660+0000","last_peered":"2024-03-20T13:37:28.319660+0000","last_clean":"2024-03-20T13:37:28.319660+0000","last_became_active":"2024-03-20T13:35:30.991546+0000","last_became_peered":"2024-03-20T13:35:30.991546+0000","last_unstale":"2024-03-20T13:37:28.319660+0000","last_undegraded":"2024-03-20T13:37:28.319660+0000","last_fullsized":"2024-03-20T13:37:28.319660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.319581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.319581+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.319581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:28.231469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"32'37","reported_seq":93,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:48.430174+0000","last_change":"2024-03-20T13:36:48.430174+0000","last_active":"2024-03-20T13:36:48.430174+0000","last_peered":"2024-03-20T13:36:48.430174+0000","last_clean":"2024-03-20T13:36:48.430174+0000","last_became_active":"2024-03-20T13:34:55.945960+0000","last_became_peered":"2024-03-20T13:34:55.945960+0000","last_unstale":"2024-03-20T13:36:48.430174+0000","last_undegraded":"2024-03-20T13:36:48.430174+0000","last_fullsized":"2024-03-20T13:36:48.430174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'37","last_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_deep_scrub":"32'37","last_deep_scrub_stamp":"2024-03-20T13:36:48.430044+0000","last_clean_scrub_stamp":"2024-03-20T13:36:48.430044+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:13:05.290246+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.424720+0000","last_change":"2024-03-20T13:36:53.424720+0000","last_active":"2024-03-20T13:36:53.424720+0000","last_peered":"2024-03-20T13:36:53.424720+0000","last_clean":"2024-03-20T13:36:53.424720+0000","last_became_active":"2024-03-20T13:34:57.967873+0000","last_became_peered":"2024-03-20T13:34:57.967873+0000","last_unstale":"2024-03-20T13:36:53.424720+0000","last_undegraded":"2024-03-20T13:36:53.424720+0000","last_fullsized":"2024-03-20T13:36:53.424720+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:53.424599+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.424599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:42.288257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"32'2","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:20.194266+0000","last_change":"2024-03-20T13:37:20.194266+0000","last_active":"2024-03-20T13:37:20.194266+0000","last_peered":"2024-03-20T13:37:20.194266+0000","last_clean":"2024-03-20T13:37:20.194266+0000","last_became_active":"2024-03-20T13:34:59.970393+0000","last_became_peered":"2024-03-20T13:34:59.970393+0000","last_unstale":"2024-03-20T13:37:20.194266+0000","last_undegraded":"2024-03-20T13:37:20.194266+0000","last_fullsized":"2024-03-20T13:37:20.194266+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:20.194129+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:20.194129+0000","last_clean_scrub_stamp":"2024-03-20T13:37:20.194129+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:24:20.046133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:21.549325+0000","last_change":"2024-03-20T13:37:21.549325+0000","last_active":"2024-03-20T13:37:21.549325+0000","last_peered":"2024-03-20T13:37:21.549325+0000","last_clean":"2024-03-20T13:37:21.549325+0000","last_became_active":"2024-03-20T13:34:51.942701+0000","last_became_peered":"2024-03-20T13:34:51.942701+0000","last_unstale":"2024-03-20T13:37:21.549325+0000","last_undegraded":"2024-03-20T13:37:21.549325+0000","last_fullsized":"2024-03-20T13:37:21.549325+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:21.549211+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:21.549211+0000","last_clean_scrub_stamp":"2024-03-20T13:37:21.549211+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:41:37.535250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"30'2","reported_seq":50,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.182023+0000","last_change":"2024-03-20T13:37:30.182049+0000","last_active":"2024-03-20T13:37:30.182023+0000","last_peered":"2024-03-20T13:37:30.182023+0000","last_clean":"2024-03-20T13:37:30.182023+0000","last_became_active":"2024-03-20T13:34:49.959987+0000","last_became_peered":"2024-03-20T13:34:49.959987+0000","last_unstale":"2024-03-20T13:37:30.182023+0000","last_undegraded":"2024-03-20T13:37:30.182023+0000","last_fullsized":"2024-03-20T13:37:30.182023+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:30.181902+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:30.181902+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.181902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:12:23.621237+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:51.916154+0000","last_change":"2024-03-20T13:36:51.916154+0000","last_active":"2024-03-20T13:36:51.916154+0000","last_peered":"2024-03-20T13:36:51.916154+0000","last_clean":"2024-03-20T13:36:51.916154+0000","last_became_active":"2024-03-20T13:34:53.940469+0000","last_became_peered":"2024-03-20T13:34:53.940469+0000","last_unstale":"2024-03-20T13:36:51.916154+0000","last_undegraded":"2024-03-20T13:36:51.916154+0000","last_fullsized":"2024-03-20T13:36:51.916154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:51.916042+0000","last_clean_scrub_stamp":"2024-03-20T13:36:51.916042+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:24:20.123915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'15","reported_seq":54,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:58.240981+0000","last_change":"2024-03-20T13:36:58.241018+0000","last_active":"2024-03-20T13:36:58.240981+0000","last_peered":"2024-03-20T13:36:58.240981+0000","last_clean":"2024-03-20T13:36:58.240981+0000","last_became_active":"2024-03-20T13:34:55.961789+0000","last_became_peered":"2024-03-20T13:34:55.961789+0000","last_unstale":"2024-03-20T13:36:58.240981+0000","last_undegraded":"2024-03-20T13:36:58.240981+0000","last_fullsized":"2024-03-20T13:36:58.240981+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'15","last_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_deep_scrub":"32'15","last_deep_scrub_stamp":"2024-03-20T13:36:58.240881+0000","last_clean_scrub_stamp":"2024-03-20T13:36:58.240881+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:13:38.665383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"32'243","reported_seq":306,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.069210+0000","last_change":"2024-03-20T13:36:37.069210+0000","last_active":"2024-03-20T13:36:37.069210+0000","last_peered":"2024-03-20T13:36:37.069210+0000","last_clean":"2024-03-20T13:36:37.069210+0000","last_became_active":"2024-03-20T13:34:57.965483+0000","last_became_peered":"2024-03-20T13:34:57.965483+0000","last_unstale":"2024-03-20T13:36:37.069210+0000","last_undegraded":"2024-03-20T13:36:37.069210+0000","last_fullsized":"2024-03-20T13:36:37.069210+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'243","last_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_deep_scrub":"32'243","last_deep_scrub_stamp":"2024-03-20T13:36:37.069055+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.069055+0000","objects_scrubbed":1,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:28:39.752450+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:51.268781+0000","last_change":"2024-03-20T13:37:51.268804+0000","last_active":"2024-03-20T13:37:51.268781+0000","last_peered":"2024-03-20T13:37:51.268781+0000","last_clean":"2024-03-20T13:37:51.268781+0000","last_became_active":"2024-03-20T13:34:59.971436+0000","last_became_peered":"2024-03-20T13:34:59.971436+0000","last_unstale":"2024-03-20T13:37:51.268781+0000","last_undegraded":"2024-03-20T13:37:51.268781+0000","last_fullsized":"2024-03-20T13:37:51.268781+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:51.268688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:51.268688+0000","last_clean_scrub_stamp":"2024-03-20T13:37:51.268688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:20:33.402878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"32'6","reported_seq":62,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:02.292302+0000","last_change":"2024-03-20T13:37:02.292302+0000","last_active":"2024-03-20T13:37:02.292302+0000","last_peered":"2024-03-20T13:37:02.292302+0000","last_clean":"2024-03-20T13:37:02.292302+0000","last_became_active":"2024-03-20T13:34:51.934791+0000","last_became_peered":"2024-03-20T13:34:51.934791+0000","last_unstale":"2024-03-20T13:37:02.292302+0000","last_undegraded":"2024-03-20T13:37:02.292302+0000","last_fullsized":"2024-03-20T13:37:02.292302+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'6","last_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_deep_scrub":"32'6","last_deep_scrub_stamp":"2024-03-20T13:37:02.292156+0000","last_clean_scrub_stamp":"2024-03-20T13:37:02.292156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:12:32.714561+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.691120+0000","last_change":"2024-03-20T13:37:23.691147+0000","last_active":"2024-03-20T13:37:23.691120+0000","last_peered":"2024-03-20T13:37:23.691120+0000","last_clean":"2024-03-20T13:37:23.691120+0000","last_became_active":"2024-03-20T13:34:49.939509+0000","last_became_peered":"2024-03-20T13:34:49.939509+0000","last_unstale":"2024-03-20T13:37:23.691120+0000","last_undegraded":"2024-03-20T13:37:23.691120+0000","last_fullsized":"2024-03-20T13:37:23.691120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.691036+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.691036+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.691036+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:28:21.599500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0],"acting":[1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:45.882093+0000","last_change":"2024-03-20T13:36:45.882093+0000","last_active":"2024-03-20T13:36:45.882093+0000","last_peered":"2024-03-20T13:36:45.882093+0000","last_clean":"2024-03-20T13:36:45.882093+0000","last_became_active":"2024-03-20T13:34:53.941878+0000","last_became_peered":"2024-03-20T13:34:53.941878+0000","last_unstale":"2024-03-20T13:36:45.882093+0000","last_undegraded":"2024-03-20T13:36:45.882093+0000","last_fullsized":"2024-03-20T13:36:45.882093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:45.881976+0000","last_clean_scrub_stamp":"2024-03-20T13:36:45.881976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:23:18.667047+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"32'43","reported_seq":101,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.780797+0000","last_change":"2024-03-20T13:36:40.780797+0000","last_active":"2024-03-20T13:36:40.780797+0000","last_peered":"2024-03-20T13:36:40.780797+0000","last_clean":"2024-03-20T13:36:40.780797+0000","last_became_active":"2024-03-20T13:34:55.949967+0000","last_became_peered":"2024-03-20T13:34:55.949967+0000","last_unstale":"2024-03-20T13:36:40.780797+0000","last_undegraded":"2024-03-20T13:36:40.780797+0000","last_fullsized":"2024-03-20T13:36:40.780797+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'43","last_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_deep_scrub":"32'43","last_deep_scrub_stamp":"2024-03-20T13:36:40.780669+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.780669+0000","objects_scrubbed":7,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:33:55.427462+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:37.483874+0000","last_change":"2024-03-20T13:36:37.483874+0000","last_active":"2024-03-20T13:36:37.483874+0000","last_peered":"2024-03-20T13:36:37.483874+0000","last_clean":"2024-03-20T13:36:37.483874+0000","last_became_active":"2024-03-20T13:34:57.966227+0000","last_became_peered":"2024-03-20T13:34:57.966227+0000","last_unstale":"2024-03-20T13:36:37.483874+0000","last_undegraded":"2024-03-20T13:36:37.483874+0000","last_fullsized":"2024-03-20T13:36:37.483874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:37.483750+0000","last_clean_scrub_stamp":"2024-03-20T13:36:37.483750+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:23:40.729135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:33.753378+0000","last_change":"2024-03-20T13:37:33.753408+0000","last_active":"2024-03-20T13:37:33.753378+0000","last_peered":"2024-03-20T13:37:33.753378+0000","last_clean":"2024-03-20T13:37:33.753378+0000","last_became_active":"2024-03-20T13:34:59.974062+0000","last_became_peered":"2024-03-20T13:34:59.974062+0000","last_unstale":"2024-03-20T13:37:33.753378+0000","last_undegraded":"2024-03-20T13:37:33.753378+0000","last_fullsized":"2024-03-20T13:37:33.753378+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:33.753268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:33.753268+0000","last_clean_scrub_stamp":"2024-03-20T13:37:33.753268+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:17.888246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"32'8","reported_seq":70,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:01.259918+0000","last_change":"2024-03-20T13:37:01.259918+0000","last_active":"2024-03-20T13:37:01.259918+0000","last_peered":"2024-03-20T13:37:01.259918+0000","last_clean":"2024-03-20T13:37:01.259918+0000","last_became_active":"2024-03-20T13:34:51.933252+0000","last_became_peered":"2024-03-20T13:34:51.933252+0000","last_unstale":"2024-03-20T13:37:01.259918+0000","last_undegraded":"2024-03-20T13:37:01.259918+0000","last_fullsized":"2024-03-20T13:37:01.259918+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:01.259780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:01.259780+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:05:24.962382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:50.307252+0000","last_change":"2024-03-20T13:37:50.307300+0000","last_active":"2024-03-20T13:37:50.307252+0000","last_peered":"2024-03-20T13:37:50.307252+0000","last_clean":"2024-03-20T13:37:50.307252+0000","last_became_active":"2024-03-20T13:34:49.961523+0000","last_became_peered":"2024-03-20T13:34:49.961523+0000","last_unstale":"2024-03-20T13:37:50.307252+0000","last_undegraded":"2024-03-20T13:37:50.307252+0000","last_fullsized":"2024-03-20T13:37:50.307252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:50.307141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:50.307141+0000","last_clean_scrub_stamp":"2024-03-20T13:37:50.307141+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:02:41.567931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.111639+0000","last_change":"2024-03-20T13:36:55.111639+0000","last_active":"2024-03-20T13:36:55.111639+0000","last_peered":"2024-03-20T13:36:55.111639+0000","last_clean":"2024-03-20T13:36:55.111639+0000","last_became_active":"2024-03-20T13:34:53.944291+0000","last_became_peered":"2024-03-20T13:34:53.944291+0000","last_unstale":"2024-03-20T13:36:55.111639+0000","last_undegraded":"2024-03-20T13:36:55.111639+0000","last_fullsized":"2024-03-20T13:36:55.111639+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:55.111514+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.111514+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:21:29.756932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:34.483646+0000","last_change":"2024-03-20T13:36:34.483646+0000","last_active":"2024-03-20T13:36:34.483646+0000","last_peered":"2024-03-20T13:36:34.483646+0000","last_clean":"2024-03-20T13:36:34.483646+0000","last_became_active":"2024-03-20T13:34:55.949322+0000","last_became_peered":"2024-03-20T13:34:55.949322+0000","last_unstale":"2024-03-20T13:36:34.483646+0000","last_undegraded":"2024-03-20T13:36:34.483646+0000","last_fullsized":"2024-03-20T13:36:34.483646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:34.483533+0000","last_clean_scrub_stamp":"2024-03-20T13:36:34.483533+0000","objects_scrubbed":4,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:25:29.809601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:04.258997+0000","last_change":"2024-03-20T13:37:04.258997+0000","last_active":"2024-03-20T13:37:04.258997+0000","last_peered":"2024-03-20T13:37:04.258997+0000","last_clean":"2024-03-20T13:37:04.258997+0000","last_became_active":"2024-03-20T13:34:57.967686+0000","last_became_peered":"2024-03-20T13:34:57.967686+0000","last_unstale":"2024-03-20T13:37:04.258997+0000","last_undegraded":"2024-03-20T13:37:04.258997+0000","last_fullsized":"2024-03-20T13:37:04.258997+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:04.258885+0000","last_clean_scrub_stamp":"2024-03-20T13:37:04.258885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:14:48.115373+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"32'4","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:54.149869+0000","last_change":"2024-03-20T13:37:54.149897+0000","last_active":"2024-03-20T13:37:54.149869+0000","last_peered":"2024-03-20T13:37:54.149869+0000","last_clean":"2024-03-20T13:37:54.149869+0000","last_became_active":"2024-03-20T13:34:59.974601+0000","last_became_peered":"2024-03-20T13:34:59.974601+0000","last_unstale":"2024-03-20T13:37:54.149869+0000","last_undegraded":"2024-03-20T13:37:54.149869+0000","last_fullsized":"2024-03-20T13:37:54.149869+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:54.149763+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:54.149763+0000","last_clean_scrub_stamp":"2024-03-20T13:37:54.149763+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:15:11.974326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":13,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.231760+0000","last_change":"2024-03-20T13:37:15.231760+0000","last_active":"2024-03-20T13:37:15.231760+0000","last_peered":"2024-03-20T13:37:15.231760+0000","last_clean":"2024-03-20T13:37:15.231760+0000","last_became_active":"2024-03-20T13:34:51.944936+0000","last_became_peered":"2024-03-20T13:34:51.944936+0000","last_unstale":"2024-03-20T13:37:15.231760+0000","last_undegraded":"2024-03-20T13:37:15.231760+0000","last_fullsized":"2024-03-20T13:37:15.231760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.231613+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.231613+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.231613+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:14:33.553502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:18.482913+0000","last_change":"2024-03-20T13:37:18.482957+0000","last_active":"2024-03-20T13:37:18.482913+0000","last_peered":"2024-03-20T13:37:18.482913+0000","last_clean":"2024-03-20T13:37:18.482913+0000","last_became_active":"2024-03-20T13:34:49.938901+0000","last_became_peered":"2024-03-20T13:34:49.938901+0000","last_unstale":"2024-03-20T13:37:18.482913+0000","last_undegraded":"2024-03-20T13:37:18.482913+0000","last_fullsized":"2024-03-20T13:37:18.482913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:18.482773+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:18.482773+0000","last_clean_scrub_stamp":"2024-03-20T13:37:18.482773+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:21:14.037744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:44.870499+0000","last_change":"2024-03-20T13:36:44.870499+0000","last_active":"2024-03-20T13:36:44.870499+0000","last_peered":"2024-03-20T13:36:44.870499+0000","last_clean":"2024-03-20T13:36:44.870499+0000","last_became_active":"2024-03-20T13:34:53.944518+0000","last_became_peered":"2024-03-20T13:34:53.944518+0000","last_unstale":"2024-03-20T13:36:44.870499+0000","last_undegraded":"2024-03-20T13:36:44.870499+0000","last_fullsized":"2024-03-20T13:36:44.870499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:44.870368+0000","last_clean_scrub_stamp":"2024-03-20T13:36:44.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:38:54.104546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"32'28","reported_seq":81,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:40.096207+0000","last_change":"2024-03-20T13:36:40.096207+0000","last_active":"2024-03-20T13:36:40.096207+0000","last_peered":"2024-03-20T13:36:40.096207+0000","last_clean":"2024-03-20T13:36:40.096207+0000","last_became_active":"2024-03-20T13:34:55.953735+0000","last_became_peered":"2024-03-20T13:34:55.953735+0000","last_unstale":"2024-03-20T13:36:40.096207+0000","last_undegraded":"2024-03-20T13:36:40.096207+0000","last_fullsized":"2024-03-20T13:36:40.096207+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'28","last_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_deep_scrub":"32'28","last_deep_scrub_stamp":"2024-03-20T13:36:40.096051+0000","last_clean_scrub_stamp":"2024-03-20T13:36:40.096051+0000","objects_scrubbed":2,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:41:22.717936+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:56.230574+0000","last_change":"2024-03-20T13:36:56.230574+0000","last_active":"2024-03-20T13:36:56.230574+0000","last_peered":"2024-03-20T13:36:56.230574+0000","last_clean":"2024-03-20T13:36:56.230574+0000","last_became_active":"2024-03-20T13:34:57.967212+0000","last_became_peered":"2024-03-20T13:34:57.967212+0000","last_unstale":"2024-03-20T13:36:56.230574+0000","last_undegraded":"2024-03-20T13:36:56.230574+0000","last_fullsized":"2024-03-20T13:36:56.230574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:56.230465+0000","last_clean_scrub_stamp":"2024-03-20T13:36:56.230465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:30.142163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"30'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:53.192964+0000","last_change":"2024-03-20T13:37:53.193019+0000","last_active":"2024-03-20T13:37:53.192964+0000","last_peered":"2024-03-20T13:37:53.192964+0000","last_clean":"2024-03-20T13:37:53.192964+0000","last_became_active":"2024-03-20T13:34:59.974543+0000","last_became_peered":"2024-03-20T13:34:59.974543+0000","last_unstale":"2024-03-20T13:37:53.192964+0000","last_undegraded":"2024-03-20T13:37:53.192964+0000","last_fullsized":"2024-03-20T13:37:53.192964+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"30'2","last_scrub_stamp":"2024-03-20T13:37:53.192846+0000","last_deep_scrub":"30'2","last_deep_scrub_stamp":"2024-03-20T13:37:53.192846+0000","last_clean_scrub_stamp":"2024-03-20T13:37:53.192846+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T15:08:09.288436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"32'10","reported_seq":72,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:00.219367+0000","last_change":"2024-03-20T13:37:00.219367+0000","last_active":"2024-03-20T13:37:00.219367+0000","last_peered":"2024-03-20T13:37:00.219367+0000","last_clean":"2024-03-20T13:37:00.219367+0000","last_became_active":"2024-03-20T13:34:51.933293+0000","last_became_peered":"2024-03-20T13:34:51.933293+0000","last_unstale":"2024-03-20T13:37:00.219367+0000","last_undegraded":"2024-03-20T13:37:00.219367+0000","last_fullsized":"2024-03-20T13:37:00.219367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:00.219255+0000","last_clean_scrub_stamp":"2024-03-20T13:37:00.219255+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:32:42.847366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":40,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.655514+0000","last_change":"2024-03-20T13:37:22.655562+0000","last_active":"2024-03-20T13:37:22.655514+0000","last_peered":"2024-03-20T13:37:22.655514+0000","last_clean":"2024-03-20T13:37:22.655514+0000","last_became_active":"2024-03-20T13:34:49.937564+0000","last_became_peered":"2024-03-20T13:34:49.937564+0000","last_unstale":"2024-03-20T13:37:22.655514+0000","last_undegraded":"2024-03-20T13:37:22.655514+0000","last_fullsized":"2024-03-20T13:37:22.655514+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.655413+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.655413+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.655413+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:13:19.814687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3],"acting":[1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"32'3","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:41.792027+0000","last_change":"2024-03-20T13:36:41.792027+0000","last_active":"2024-03-20T13:36:41.792027+0000","last_peered":"2024-03-20T13:36:41.792027+0000","last_clean":"2024-03-20T13:36:41.792027+0000","last_became_active":"2024-03-20T13:34:53.945359+0000","last_became_peered":"2024-03-20T13:34:53.945359+0000","last_unstale":"2024-03-20T13:36:41.792027+0000","last_undegraded":"2024-03-20T13:36:41.792027+0000","last_fullsized":"2024-03-20T13:36:41.792027+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'3","last_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_deep_scrub":"32'3","last_deep_scrub_stamp":"2024-03-20T13:36:41.791862+0000","last_clean_scrub_stamp":"2024-03-20T13:36:41.791862+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:39:01.217069+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'35","reported_seq":90,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:52.209667+0000","last_change":"2024-03-20T13:36:52.209667+0000","last_active":"2024-03-20T13:36:52.209667+0000","last_peered":"2024-03-20T13:36:52.209667+0000","last_clean":"2024-03-20T13:36:52.209667+0000","last_became_active":"2024-03-20T13:34:55.954626+0000","last_became_peered":"2024-03-20T13:34:55.954626+0000","last_unstale":"2024-03-20T13:36:52.209667+0000","last_undegraded":"2024-03-20T13:36:52.209667+0000","last_fullsized":"2024-03-20T13:36:52.209667+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'35","last_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_deep_scrub":"32'35","last_deep_scrub_stamp":"2024-03-20T13:36:52.209539+0000","last_clean_scrub_stamp":"2024-03-20T13:36:52.209539+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:29.303951+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":31,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":900,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:39.508600+0000","last_change":"2024-03-20T13:36:39.508600+0000","last_active":"2024-03-20T13:36:39.508600+0000","last_peered":"2024-03-20T13:36:39.508600+0000","last_clean":"2024-03-20T13:36:39.508600+0000","last_became_active":"2024-03-20T13:34:57.960840+0000","last_became_peered":"2024-03-20T13:34:57.960840+0000","last_unstale":"2024-03-20T13:36:39.508600+0000","last_undegraded":"2024-03-20T13:36:39.508600+0000","last_fullsized":"2024-03-20T13:36:39.508600+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:36:39.508482+0000","last_clean_scrub_stamp":"2024-03-20T13:36:39.508482+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:11:31.029035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:55.156825+0000","last_change":"2024-03-20T13:37:55.156849+0000","last_active":"2024-03-20T13:37:55.156825+0000","last_peered":"2024-03-20T13:37:55.156825+0000","last_clean":"2024-03-20T13:37:55.156825+0000","last_became_active":"2024-03-20T13:34:59.974487+0000","last_became_peered":"2024-03-20T13:34:59.974487+0000","last_unstale":"2024-03-20T13:37:55.156825+0000","last_undegraded":"2024-03-20T13:37:55.156825+0000","last_fullsized":"2024-03-20T13:37:55.156825+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:55.156727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:55.156727+0000","last_clean_scrub_stamp":"2024-03-20T13:37:55.156727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:48:37.282479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:53.853870+0000","last_change":"2024-03-20T13:36:53.853870+0000","last_active":"2024-03-20T13:36:53.853870+0000","last_peered":"2024-03-20T13:36:53.853870+0000","last_clean":"2024-03-20T13:36:53.853870+0000","last_became_active":"2024-03-20T13:34:51.956893+0000","last_became_peered":"2024-03-20T13:34:51.956893+0000","last_unstale":"2024-03-20T13:36:53.853870+0000","last_undegraded":"2024-03-20T13:36:53.853870+0000","last_fullsized":"2024-03-20T13:36:53.853870+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:36:53.853690+0000","last_clean_scrub_stamp":"2024-03-20T13:36:53.853690+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:21:52.367889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:15.226235+0000","last_change":"2024-03-20T13:37:15.226284+0000","last_active":"2024-03-20T13:37:15.226235+0000","last_peered":"2024-03-20T13:37:15.226235+0000","last_clean":"2024-03-20T13:37:15.226235+0000","last_became_active":"2024-03-20T13:34:49.948775+0000","last_became_peered":"2024-03-20T13:34:49.948775+0000","last_unstale":"2024-03-20T13:37:15.226235+0000","last_undegraded":"2024-03-20T13:37:15.226235+0000","last_fullsized":"2024-03-20T13:37:15.226235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:15.226132+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:15.226132+0000","last_clean_scrub_stamp":"2024-03-20T13:37:15.226132+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:53.150881+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:19.508390+0000","last_change":"2024-03-20T13:37:19.508412+0000","last_active":"2024-03-20T13:37:19.508390+0000","last_peered":"2024-03-20T13:37:19.508390+0000","last_clean":"2024-03-20T13:37:19.508390+0000","last_became_active":"2024-03-20T13:34:51.942732+0000","last_became_peered":"2024-03-20T13:34:51.942732+0000","last_unstale":"2024-03-20T13:37:19.508390+0000","last_undegraded":"2024-03-20T13:37:19.508390+0000","last_fullsized":"2024-03-20T13:37:19.508390+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:19.508305+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:19.508305+0000","last_clean_scrub_stamp":"2024-03-20T13:37:19.508305+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:36:37.042863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.513345+0000","last_change":"2024-03-20T13:37:25.513374+0000","last_active":"2024-03-20T13:37:25.513345+0000","last_peered":"2024-03-20T13:37:25.513345+0000","last_clean":"2024-03-20T13:37:25.513345+0000","last_became_active":"2024-03-20T13:34:49.932702+0000","last_became_peered":"2024-03-20T13:34:49.932702+0000","last_unstale":"2024-03-20T13:37:25.513345+0000","last_undegraded":"2024-03-20T13:37:25.513345+0000","last_fullsized":"2024-03-20T13:37:25.513345+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:25.513252+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:25.513252+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.513252+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:04.951193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"32'8","reported_seq":71,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.225063+0000","last_change":"2024-03-20T13:37:14.225110+0000","last_active":"2024-03-20T13:37:14.225063+0000","last_peered":"2024-03-20T13:37:14.225063+0000","last_clean":"2024-03-20T13:37:14.225063+0000","last_became_active":"2024-03-20T13:34:51.945600+0000","last_became_peered":"2024-03-20T13:34:51.945600+0000","last_unstale":"2024-03-20T13:37:14.225063+0000","last_undegraded":"2024-03-20T13:37:14.225063+0000","last_fullsized":"2024-03-20T13:37:14.225063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:14.224966+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:14.224966+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.224966+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:33:58.359943+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":35,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:40.216530+0000","last_change":"2024-03-20T13:37:40.216570+0000","last_active":"2024-03-20T13:37:40.216530+0000","last_peered":"2024-03-20T13:37:40.216530+0000","last_clean":"2024-03-20T13:37:40.216530+0000","last_became_active":"2024-03-20T13:34:49.961487+0000","last_became_peered":"2024-03-20T13:34:49.961487+0000","last_unstale":"2024-03-20T13:37:40.216530+0000","last_undegraded":"2024-03-20T13:37:40.216530+0000","last_fullsized":"2024-03-20T13:37:40.216530+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:40.216438+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:40.216438+0000","last_clean_scrub_stamp":"2024-03-20T13:37:40.216438+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:14:50.913168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"32'4","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:17.453355+0000","last_change":"2024-03-20T13:37:17.453385+0000","last_active":"2024-03-20T13:37:17.453355+0000","last_peered":"2024-03-20T13:37:17.453355+0000","last_clean":"2024-03-20T13:37:17.453355+0000","last_became_active":"2024-03-20T13:34:51.942625+0000","last_became_peered":"2024-03-20T13:34:51.942625+0000","last_unstale":"2024-03-20T13:37:17.453355+0000","last_undegraded":"2024-03-20T13:37:17.453355+0000","last_fullsized":"2024-03-20T13:37:17.453355+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:17.453269+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:17.453269+0000","last_clean_scrub_stamp":"2024-03-20T13:37:17.453269+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:39:35.300810+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.549703+0000","last_change":"2024-03-20T13:37:27.549726+0000","last_active":"2024-03-20T13:37:27.549703+0000","last_peered":"2024-03-20T13:37:27.549703+0000","last_clean":"2024-03-20T13:37:27.549703+0000","last_became_active":"2024-03-20T13:34:49.932780+0000","last_became_peered":"2024-03-20T13:34:49.932780+0000","last_unstale":"2024-03-20T13:37:27.549703+0000","last_undegraded":"2024-03-20T13:37:27.549703+0000","last_fullsized":"2024-03-20T13:37:27.549703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.549627+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.549627+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.549627+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:56.355311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.465825+0000","last_change":"2024-03-20T13:37:13.465849+0000","last_active":"2024-03-20T13:37:13.465825+0000","last_peered":"2024-03-20T13:37:13.465825+0000","last_clean":"2024-03-20T13:37:13.465825+0000","last_became_active":"2024-03-20T13:34:51.936803+0000","last_became_peered":"2024-03-20T13:34:51.936803+0000","last_unstale":"2024-03-20T13:37:13.465825+0000","last_undegraded":"2024-03-20T13:37:13.465825+0000","last_fullsized":"2024-03-20T13:37:13.465825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.465734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.465734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.465734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:02:27.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.470748+0000","last_change":"2024-03-20T13:37:10.470774+0000","last_active":"2024-03-20T13:37:10.470748+0000","last_peered":"2024-03-20T13:37:10.470748+0000","last_clean":"2024-03-20T13:37:10.470748+0000","last_became_active":"2024-03-20T13:34:49.946224+0000","last_became_peered":"2024-03-20T13:34:49.946224+0000","last_unstale":"2024-03-20T13:37:10.470748+0000","last_undegraded":"2024-03-20T13:37:10.470748+0000","last_fullsized":"2024-03-20T13:37:10.470748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.470658+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.470658+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:08:47.565070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3],"acting":[0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"32'10","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:55.807076+0000","last_change":"2024-03-20T13:36:55.807076+0000","last_active":"2024-03-20T13:36:55.807076+0000","last_peered":"2024-03-20T13:36:55.807076+0000","last_clean":"2024-03-20T13:36:55.807076+0000","last_became_active":"2024-03-20T13:34:51.952835+0000","last_became_peered":"2024-03-20T13:34:51.952835+0000","last_unstale":"2024-03-20T13:36:55.807076+0000","last_undegraded":"2024-03-20T13:36:55.807076+0000","last_fullsized":"2024-03-20T13:36:55.807076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:36:55.806960+0000","last_clean_scrub_stamp":"2024-03-20T13:36:55.806960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:46:44.670617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":15,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:27.762037+0000","last_change":"2024-03-20T13:37:27.762086+0000","last_active":"2024-03-20T13:37:27.762037+0000","last_peered":"2024-03-20T13:37:27.762037+0000","last_clean":"2024-03-20T13:37:27.762037+0000","last_became_active":"2024-03-20T13:34:49.945018+0000","last_became_peered":"2024-03-20T13:34:49.945018+0000","last_unstale":"2024-03-20T13:37:27.762037+0000","last_undegraded":"2024-03-20T13:37:27.762037+0000","last_fullsized":"2024-03-20T13:37:27.762037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:27.761939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:27.761939+0000","last_clean_scrub_stamp":"2024-03-20T13:37:27.761939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:25:07.199881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:31.580860+0000","last_change":"2024-03-20T13:37:31.580894+0000","last_active":"2024-03-20T13:37:31.580860+0000","last_peered":"2024-03-20T13:37:31.580860+0000","last_clean":"2024-03-20T13:37:31.580860+0000","last_became_active":"2024-03-20T13:34:51.946714+0000","last_became_peered":"2024-03-20T13:34:51.946714+0000","last_unstale":"2024-03-20T13:37:31.580860+0000","last_undegraded":"2024-03-20T13:37:31.580860+0000","last_fullsized":"2024-03-20T13:37:31.580860+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:31.580773+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:31.580773+0000","last_clean_scrub_stamp":"2024-03-20T13:37:31.580773+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T20:34:15.715751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"32'2","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.232063+0000","last_change":"2024-03-20T13:37:23.232120+0000","last_active":"2024-03-20T13:37:23.232063+0000","last_peered":"2024-03-20T13:37:23.232063+0000","last_clean":"2024-03-20T13:37:23.232063+0000","last_became_active":"2024-03-20T13:34:49.946249+0000","last_became_peered":"2024-03-20T13:34:49.946249+0000","last_unstale":"2024-03-20T13:37:23.232063+0000","last_undegraded":"2024-03-20T13:37:23.232063+0000","last_fullsized":"2024-03-20T13:37:23.232063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:23.231964+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:23.231964+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.231964+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:11:34.011833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"32'8","reported_seq":67,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:07.770943+0000","last_change":"2024-03-20T13:37:07.770971+0000","last_active":"2024-03-20T13:37:07.770943+0000","last_peered":"2024-03-20T13:37:07.770943+0000","last_clean":"2024-03-20T13:37:07.770943+0000","last_became_active":"2024-03-20T13:34:51.941237+0000","last_became_peered":"2024-03-20T13:34:51.941237+0000","last_unstale":"2024-03-20T13:37:07.770943+0000","last_undegraded":"2024-03-20T13:37:07.770943+0000","last_fullsized":"2024-03-20T13:37:07.770943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:07.770860+0000","last_clean_scrub_stamp":"2024-03-20T13:37:07.770860+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:51:00.706350+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":35,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:22.535234+0000","last_change":"2024-03-20T13:37:22.535259+0000","last_active":"2024-03-20T13:37:22.535234+0000","last_peered":"2024-03-20T13:37:22.535234+0000","last_clean":"2024-03-20T13:37:22.535234+0000","last_became_active":"2024-03-20T13:34:49.934172+0000","last_became_peered":"2024-03-20T13:34:49.934172+0000","last_unstale":"2024-03-20T13:37:22.535234+0000","last_undegraded":"2024-03-20T13:37:22.535234+0000","last_fullsized":"2024-03-20T13:37:22.535234+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:22.535142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:22.535142+0000","last_clean_scrub_stamp":"2024-03-20T13:37:22.535142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:17:18.418163+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:28.807590+0000","last_change":"2024-03-20T13:37:28.807616+0000","last_active":"2024-03-20T13:37:28.807590+0000","last_peered":"2024-03-20T13:37:28.807590+0000","last_clean":"2024-03-20T13:37:28.807590+0000","last_became_active":"2024-03-20T13:34:51.947123+0000","last_became_peered":"2024-03-20T13:34:51.947123+0000","last_unstale":"2024-03-20T13:37:28.807590+0000","last_undegraded":"2024-03-20T13:37:28.807590+0000","last_fullsized":"2024-03-20T13:37:28.807590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:28.807509+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:28.807509+0000","last_clean_scrub_stamp":"2024-03-20T13:37:28.807509+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:44.504905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"32'4","reported_seq":58,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:48.337956+0000","last_change":"2024-03-20T13:37:48.337991+0000","last_active":"2024-03-20T13:37:48.337956+0000","last_peered":"2024-03-20T13:37:48.337956+0000","last_clean":"2024-03-20T13:37:48.337956+0000","last_became_active":"2024-03-20T13:34:49.943991+0000","last_became_peered":"2024-03-20T13:34:49.943991+0000","last_unstale":"2024-03-20T13:37:48.337956+0000","last_undegraded":"2024-03-20T13:37:48.337956+0000","last_fullsized":"2024-03-20T13:37:48.337956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:48.337862+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:48.337862+0000","last_clean_scrub_stamp":"2024-03-20T13:37:48.337862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T21:53:33.720570+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.249034+0000","last_change":"2024-03-20T13:37:10.249034+0000","last_active":"2024-03-20T13:37:10.249034+0000","last_peered":"2024-03-20T13:37:10.249034+0000","last_clean":"2024-03-20T13:37:10.249034+0000","last_became_active":"2024-03-20T13:34:51.949137+0000","last_became_peered":"2024-03-20T13:34:51.949137+0000","last_unstale":"2024-03-20T13:37:10.249034+0000","last_undegraded":"2024-03-20T13:37:10.249034+0000","last_fullsized":"2024-03-20T13:37:10.249034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:10.248909+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.248909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T22:00:39.054592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:30.543243+0000","last_change":"2024-03-20T13:37:30.543269+0000","last_active":"2024-03-20T13:37:30.543243+0000","last_peered":"2024-03-20T13:37:30.543243+0000","last_clean":"2024-03-20T13:37:30.543243+0000","last_became_active":"2024-03-20T13:34:49.933929+0000","last_became_peered":"2024-03-20T13:34:49.933929+0000","last_unstale":"2024-03-20T13:37:30.543243+0000","last_undegraded":"2024-03-20T13:37:30.543243+0000","last_fullsized":"2024-03-20T13:37:30.543243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:30.543149+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:30.543149+0000","last_clean_scrub_stamp":"2024-03-20T13:37:30.543149+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:26:56.299365+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"32'8","reported_seq":68,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.472298+0000","last_change":"2024-03-20T13:37:09.472360+0000","last_active":"2024-03-20T13:37:09.472298+0000","last_peered":"2024-03-20T13:37:09.472298+0000","last_clean":"2024-03-20T13:37:09.472298+0000","last_became_active":"2024-03-20T13:34:51.934891+0000","last_became_peered":"2024-03-20T13:34:51.934891+0000","last_unstale":"2024-03-20T13:37:09.472298+0000","last_undegraded":"2024-03-20T13:37:09.472298+0000","last_fullsized":"2024-03-20T13:37:09.472298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'8","last_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_deep_scrub":"32'8","last_deep_scrub_stamp":"2024-03-20T13:37:09.472199+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.472199+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:56.902554+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.779854+0000","last_change":"2024-03-20T13:37:09.779881+0000","last_active":"2024-03-20T13:37:09.779854+0000","last_peered":"2024-03-20T13:37:09.779854+0000","last_clean":"2024-03-20T13:37:09.779854+0000","last_became_active":"2024-03-20T13:34:49.952229+0000","last_became_peered":"2024-03-20T13:34:49.952229+0000","last_unstale":"2024-03-20T13:37:09.779854+0000","last_undegraded":"2024-03-20T13:37:09.779854+0000","last_fullsized":"2024-03-20T13:37:09.779854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:09.779734+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.779734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:05:12.306761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2],"acting":[1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"32'4","reported_seq":46,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:16.713221+0000","last_change":"2024-03-20T13:37:16.713248+0000","last_active":"2024-03-20T13:37:16.713221+0000","last_peered":"2024-03-20T13:37:16.713221+0000","last_clean":"2024-03-20T13:37:16.713221+0000","last_became_active":"2024-03-20T13:34:51.946581+0000","last_became_peered":"2024-03-20T13:34:51.946581+0000","last_unstale":"2024-03-20T13:37:16.713221+0000","last_undegraded":"2024-03-20T13:37:16.713221+0000","last_fullsized":"2024-03-20T13:37:16.713221+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:16.713135+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:16.713135+0000","last_clean_scrub_stamp":"2024-03-20T13:37:16.713135+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T17:47:16.625022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:25.717631+0000","last_change":"2024-03-20T13:37:25.717657+0000","last_active":"2024-03-20T13:37:25.717631+0000","last_peered":"2024-03-20T13:37:25.717631+0000","last_clean":"2024-03-20T13:37:25.717631+0000","last_became_active":"2024-03-20T13:34:49.944001+0000","last_became_peered":"2024-03-20T13:34:49.944001+0000","last_unstale":"2024-03-20T13:37:25.717631+0000","last_undegraded":"2024-03-20T13:37:25.717631+0000","last_fullsized":"2024-03-20T13:37:25.717631+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:25.717548+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:25.717548+0000","last_clean_scrub_stamp":"2024-03-20T13:37:25.717548+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:51:32.380417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"32'4","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:03.698955+0000","last_change":"2024-03-20T13:37:03.698955+0000","last_active":"2024-03-20T13:37:03.698955+0000","last_peered":"2024-03-20T13:37:03.698955+0000","last_clean":"2024-03-20T13:37:03.698955+0000","last_became_active":"2024-03-20T13:34:51.948048+0000","last_became_peered":"2024-03-20T13:34:51.948048+0000","last_unstale":"2024-03-20T13:37:03.698955+0000","last_undegraded":"2024-03-20T13:37:03.698955+0000","last_fullsized":"2024-03-20T13:37:03.698955+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:03.698845+0000","last_clean_scrub_stamp":"2024-03-20T13:37:03.698845+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T16:58:41.623595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"32'2","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:39.180439+0000","last_change":"2024-03-20T13:37:39.180466+0000","last_active":"2024-03-20T13:37:39.180439+0000","last_peered":"2024-03-20T13:37:39.180439+0000","last_clean":"2024-03-20T13:37:39.180439+0000","last_became_active":"2024-03-20T13:34:49.955216+0000","last_became_peered":"2024-03-20T13:34:49.955216+0000","last_unstale":"2024-03-20T13:37:39.180439+0000","last_undegraded":"2024-03-20T13:37:39.180439+0000","last_fullsized":"2024-03-20T13:37:39.180439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:37:39.180348+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:37:39.180348+0000","last_clean_scrub_stamp":"2024-03-20T13:37:39.180348+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:31:26.782216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"32'2","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:36:57.838638+0000","last_change":"2024-03-20T13:36:57.838638+0000","last_active":"2024-03-20T13:36:57.838638+0000","last_peered":"2024-03-20T13:36:57.838638+0000","last_clean":"2024-03-20T13:36:57.838638+0000","last_became_active":"2024-03-20T13:34:51.948651+0000","last_became_peered":"2024-03-20T13:34:51.948651+0000","last_unstale":"2024-03-20T13:36:57.838638+0000","last_undegraded":"2024-03-20T13:36:57.838638+0000","last_fullsized":"2024-03-20T13:36:57.838638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'2","last_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_deep_scrub":"32'2","last_deep_scrub_stamp":"2024-03-20T13:36:57.838471+0000","last_clean_scrub_stamp":"2024-03-20T13:36:57.838471+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T19:11:27.325680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:23.213067+0000","last_change":"2024-03-20T13:37:23.213109+0000","last_active":"2024-03-20T13:37:23.213067+0000","last_peered":"2024-03-20T13:37:23.213067+0000","last_clean":"2024-03-20T13:37:23.213067+0000","last_became_active":"2024-03-20T13:34:49.962401+0000","last_became_peered":"2024-03-20T13:34:49.962401+0000","last_unstale":"2024-03-20T13:37:23.213067+0000","last_undegraded":"2024-03-20T13:37:23.213067+0000","last_fullsized":"2024-03-20T13:37:23.213067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:23.212970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:23.212970+0000","last_clean_scrub_stamp":"2024-03-20T13:37:23.212970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:19:18.200331+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2],"acting":[3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"32'10","reported_seq":64,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:09.259174+0000","last_change":"2024-03-20T13:37:09.259202+0000","last_active":"2024-03-20T13:37:09.259174+0000","last_peered":"2024-03-20T13:37:09.259174+0000","last_clean":"2024-03-20T13:37:09.259174+0000","last_became_active":"2024-03-20T13:34:51.951659+0000","last_became_peered":"2024-03-20T13:34:51.951659+0000","last_unstale":"2024-03-20T13:37:09.259174+0000","last_undegraded":"2024-03-20T13:37:09.259174+0000","last_fullsized":"2024-03-20T13:37:09.259174+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'10","last_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_deep_scrub":"32'10","last_deep_scrub_stamp":"2024-03-20T13:37:09.259090+0000","last_clean_scrub_stamp":"2024-03-20T13:37:09.259090+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T13:44:24.956485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:13.241472+0000","last_change":"2024-03-20T13:37:13.241520+0000","last_active":"2024-03-20T13:37:13.241472+0000","last_peered":"2024-03-20T13:37:13.241472+0000","last_clean":"2024-03-20T13:37:13.241472+0000","last_became_active":"2024-03-20T13:34:49.949905+0000","last_became_peered":"2024-03-20T13:34:49.949905+0000","last_unstale":"2024-03-20T13:37:13.241472+0000","last_undegraded":"2024-03-20T13:37:13.241472+0000","last_fullsized":"2024-03-20T13:37:13.241472+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:13.241356+0000","last_clean_scrub_stamp":"2024-03-20T13:37:13.241356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T18:37:38.491331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3],"acting":[2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:12.758880+0000","last_change":"2024-03-20T13:37:12.758905+0000","last_active":"2024-03-20T13:37:12.758880+0000","last_peered":"2024-03-20T13:37:12.758880+0000","last_clean":"2024-03-20T13:37:12.758880+0000","last_became_active":"2024-03-20T13:34:51.944378+0000","last_became_peered":"2024-03-20T13:34:51.944378+0000","last_unstale":"2024-03-20T13:37:12.758880+0000","last_undegraded":"2024-03-20T13:37:12.758880+0000","last_fullsized":"2024-03-20T13:37:12.758880+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:12.758780+0000","last_clean_scrub_stamp":"2024-03-20T13:37:12.758780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T14:51:41.146374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"32'4","reported_seq":55,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:36.153244+0000","last_change":"2024-03-20T13:37:36.153275+0000","last_active":"2024-03-20T13:37:36.153244+0000","last_peered":"2024-03-20T13:37:36.153244+0000","last_clean":"2024-03-20T13:37:36.153244+0000","last_became_active":"2024-03-20T13:34:49.961225+0000","last_became_peered":"2024-03-20T13:34:49.961225+0000","last_unstale":"2024-03-20T13:37:36.153244+0000","last_undegraded":"2024-03-20T13:37:36.153244+0000","last_fullsized":"2024-03-20T13:37:36.153244+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:36.153126+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:36.153126+0000","last_clean_scrub_stamp":"2024-03-20T13:37:36.153126+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:36:34.772622+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":21,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:47.302975+0000","last_change":"2024-03-20T13:37:47.303007+0000","last_active":"2024-03-20T13:37:47.302975+0000","last_peered":"2024-03-20T13:37:47.302975+0000","last_clean":"2024-03-20T13:37:47.302975+0000","last_became_active":"2024-03-20T13:34:49.943839+0000","last_became_peered":"2024-03-20T13:34:49.943839+0000","last_unstale":"2024-03-20T13:37:47.302975+0000","last_undegraded":"2024-03-20T13:37:47.302975+0000","last_fullsized":"2024-03-20T13:37:47.302975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:47.302874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:47.302874+0000","last_clean_scrub_stamp":"2024-03-20T13:37:47.302874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:48:59.438649+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":42,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:06.431612+0000","last_change":"2024-03-20T13:37:06.431612+0000","last_active":"2024-03-20T13:37:06.431612+0000","last_peered":"2024-03-20T13:37:06.431612+0000","last_clean":"2024-03-20T13:37:06.431612+0000","last_became_active":"2024-03-20T13:34:51.947012+0000","last_became_peered":"2024-03-20T13:34:51.947012+0000","last_unstale":"2024-03-20T13:37:06.431612+0000","last_undegraded":"2024-03-20T13:37:06.431612+0000","last_fullsized":"2024-03-20T13:37:06.431612+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:06.431483+0000","last_clean_scrub_stamp":"2024-03-20T13:37:06.431483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T01:00:44.278362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:14.426490+0000","last_change":"2024-03-20T13:37:14.426517+0000","last_active":"2024-03-20T13:37:14.426490+0000","last_peered":"2024-03-20T13:37:14.426490+0000","last_clean":"2024-03-20T13:37:14.426490+0000","last_became_active":"2024-03-20T13:34:49.941095+0000","last_became_peered":"2024-03-20T13:34:49.941095+0000","last_unstale":"2024-03-20T13:37:14.426490+0000","last_undegraded":"2024-03-20T13:37:14.426490+0000","last_fullsized":"2024-03-20T13:37:14.426490+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-20T13:37:14.426401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-20T13:37:14.426401+0000","last_clean_scrub_stamp":"2024-03-20T13:37:14.426401+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-21T23:06:48.338098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"32'4","reported_seq":53,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-03-20T13:37:10.765626+0000","last_change":"2024-03-20T13:37:10.765626+0000","last_active":"2024-03-20T13:37:10.765626+0000","last_peered":"2024-03-20T13:37:10.765626+0000","last_clean":"2024-03-20T13:37:10.765626+0000","last_became_active":"2024-03-20T13:34:51.944283+0000","last_became_peered":"2024-03-20T13:34:51.944283+0000","last_unstale":"2024-03-20T13:37:10.765626+0000","last_undegraded":"2024-03-20T13:37:10.765626+0000","last_fullsized":"2024-03-20T13:37:10.765626+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"32'4","last_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_deep_scrub":"32'4","last_deep_scrub_stamp":"2024-03-20T13:37:10.765500+0000","last_clean_scrub_stamp":"2024-03-20T13:37:10.765500+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-22T00:53:58.195856+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":519,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":475,"num_read_kb":443,"num_write":301,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":150,"ondisk_log_size":150,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1945,"ondisk_log_size":1945,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":7688,"num_objects":182,"num_object_clones":0,"num_object_copies":364,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":182,"num_whiteouts":0,"num_read":1532,"num_read_kb":1318,"num_write":579,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1500,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1417,"ondisk_log_size":1417,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1526,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":846,"num_read_kb":844,"num_write":22,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":949,"num_read_kb":893,"num_write":293,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":209,"num_omap_keys":1,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":8,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":84,"num_read_kb":50,"num_write":163,"num_write_kb":29309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":12288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":192,"acting":192,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":10,"seq":42949673009,"num_pgs":139,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335532,"statfs":{"total":96636764160,"available":96599584768,"internally_reserved":0,"allocated":995328,"data_stored":737413,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.44700000000000001,"15min":0.45900000000000002},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.57099999999999995,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.441,"15min":0.42499999999999999},"min":{"1min":0.30599999999999999,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":1.083}]},{"osd":1,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.31900000000000001,"15min":0.32100000000000001},"min":{"1min":0.24299999999999999,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.315,"15min":0.32300000000000001},"min":{"1min":0.221,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.41799999999999998,"5min":0.52300000000000002,"15min":0.52300000000000002},"last":0.29199999999999998}]},{"osd":3,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.32500000000000001,"15min":0.33000000000000002},"min":{"1min":0.249,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.40400000000000003,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.35899999999999999},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.439,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.307}]}]},{"osd":1,"up_from":10,"seq":42949673008,"num_pgs":138,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36324,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335516,"statfs":{"total":96636764160,"available":96599568384,"internally_reserved":0,"allocated":1011712,"data_stored":737131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.443,"15min":0.42699999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54500000000000004,"5min":1.228,"15min":1.228},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.46899999999999997,"15min":0.46700000000000003},"min":{"1min":0.24399999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.59099999999999997,"5min":1.169,"15min":1.169},"last":0.314}]},{"osd":2,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.312,"15min":0.31},"min":{"1min":0.218,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42299999999999999,"5min":0.44600000000000001,"15min":0.44600000000000001},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.32400000000000001,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.222,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.42899999999999999,"5min":0.496,"15min":0.496},"last":0.28399999999999997}]},{"osd":3,"last update":"Wed Mar 20 13:37:38 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36099999999999999,"15min":0.36499999999999999},"min":{"1min":0.26700000000000002,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.46300000000000002,"5min":0.502,"15min":0.502},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.33300000000000002,"15min":0.33400000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.47399999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.26300000000000001}]}]},{"osd":3,"up_from":9,"seq":38654705710,"num_pgs":166,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35780,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336060,"statfs":{"total":96636764160,"available":96600125440,"internally_reserved":0,"allocated":454656,"data_stored":148959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Mar 20 13:37:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.48699999999999999,"15min":0.48999999999999999},"min":{"1min":0.37,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.76800000000000002,"5min":0.99199999999999999,"15min":0.99199999999999999},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.35499999999999998,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":1.054}]},{"osd":1,"last update":"Wed Mar 20 13:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.29899999999999999,"5min":0.309,"15min":0.31},"min":{"1min":0.222,"5min":0.19,"15min":0.19},"max":{"1min":0.433,"5min":0.46100000000000002,"15min":0.46100000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.313,"5min":0.316,"15min":0.32000000000000001},"min":{"1min":0.254,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.44600000000000001,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.28899999999999998}]},{"osd":2,"last update":"Wed Mar 20 13:37:40 2024","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.28599999999999998,"5min":0.17799999999999999,"15min":0.17799999999999999},"max":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.31,"5min":0.32500000000000001,"15min":0.32700000000000001},"min":{"1min":0.26600000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.41199999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":0.307}]}]},{"osd":0,"up_from":9,"seq":38654705712,"num_pgs":151,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":409600,"data_stored":142607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Mar 20 13:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.57199999999999995,"15min":0.58899999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.56999999999999995,"15min":0.58299999999999996},"min":{"1min":0.38100000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69299999999999995,"5min":1.3160000000000001,"15min":1.3160000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Wed Mar 20 13:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.34599999999999997,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.64800000000000002,"5min":1.522,"15min":1.522},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.28699999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.63100000000000001,"5min":1.282,"15min":1.282},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Mar 20 13:37:42 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.501,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":1.593,"15min":1.593},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.51100000000000001,"15min":0.52300000000000002},"min":{"1min":0.30199999999999999,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.60699999999999998,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.45300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-20T13:38:17.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-20T13:38:17.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee83d4640 1 Processor -- start 2024-03-20T13:38:17.941 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee83d4640 1 -- start start 2024-03-20T13:38:17.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee83d4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ee0098030 0x7f3ee0098410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:17.943 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee83d4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ee009a830 con 0x7f3ee0098950 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee83d4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ee0098d70 con 0x7f3ee0098030 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee6170640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3ee0098030 0x7f3ee0098410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee596f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3ee0098950 0x7f3ee012ddb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:55436/0 (socket says 172.21.15.28:55436) 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.940+0000 7f3ee596f640 1 -- 172.21.15.28:0/1183992771 learned_addr learned my addr 172.21.15.28:0/1183992771 (peer_addr_for_me v1:172.21.15.28:0/0) 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.941+0000 7f3ee6170640 1 -- 172.21.15.28:0/1183992771 >> v1:172.21.15.28:6789/0 conn(0x7f3ee0098950 legacy=0x7f3ee012ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.941+0000 7f3ee6170640 1 -- 172.21.15.28:0/1183992771 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ee009a520 con 0x7f3ee0098030 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.941+0000 7f3ee516e640 1 -- 172.21.15.28:0/1183992771 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717984713 0 0) 0x7f3ee009a830 con 0x7f3ee0098950 2024-03-20T13:38:17.944 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.941+0000 7f3ee6170640 1 --2- 172.21.15.28:0/1183992771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0098410 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009720 tx=0x7f3edc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89d4d4f5c0bd8a2 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee516e640 1 -- 172.21.15.28:0/1183992771 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3edc02e070 con 0x7f3ee0098030 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee516e640 1 -- 172.21.15.28:0/1183992771 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc0316d0 con 0x7f3ee0098030 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee516e640 1 -- 172.21.15.28:0/1183992771 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3edc031990 con 0x7f3ee0098030 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 -- 172.21.15.28:0/1183992771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 msgr2=0x7f3ee0098410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 --2- 172.21.15.28:0/1183992771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0098410 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3edc009720 tx=0x7f3edc02b840 comp rx=0 tx=0).stop 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 -- 172.21.15.28:0/1183992771 shutdown_connections 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 --2- 172.21.15.28:0/1183992771 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0098410 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 -- 172.21.15.28:0/1183992771 >> 172.21.15.28:0/1183992771 conn(0x7f3ee00a07a0 msgr2=0x7f3ee00a0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:17.945 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 -- 172.21.15.28:0/1183992771 shutdown_connections 2024-03-20T13:38:17.946 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.942+0000 7f3ee83d4640 1 -- 172.21.15.28:0/1183992771 wait complete. 2024-03-20T13:38:17.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.943+0000 7f3ee83d4640 1 Processor -- start 2024-03-20T13:38:17.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.943+0000 7f3ee83d4640 1 -- start start 2024-03-20T13:38:17.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.943+0000 7f3ee83d4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0125650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:17.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.943+0000 7f3ee83d4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ee0127ef0 con 0x7f3ee0098030 2024-03-20T13:38:17.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee6170640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0125650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:17.948 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee6170640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0125650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52086/0 (socket says 172.21.15.28:52086) 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee6170640 1 -- 172.21.15.28:0/3643924455 learned_addr learned my addr 172.21.15.28:0/3643924455 (peer_addr_for_me v2:172.21.15.28:0/0) 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee6170640 1 -- 172.21.15.28:0/3643924455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3edc009400 con 0x7f3ee0098030 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee6170640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0125650 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3edc034040 tx=0x7f3edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3edc032830 con 0x7f3ee0098030 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3edc032990 con 0x7f3ee0098030 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ee012d6e0 con 0x7f3ee0098030 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3edc032c50 con 0x7f3ee0098030 2024-03-20T13:38:17.949 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.944+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ee0128120 con 0x7f3ee0098030 2024-03-20T13:38:17.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.945+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 45208+0+0 (secure 0 0 0) 0x7f3edc04e450 con 0x7f3ee0098030 2024-03-20T13:38:17.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.945+0000 7f3ed6ffd640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3ec4037ef0 0x7f3ec403a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-20T13:38:17.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.945+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 6342+0+0 (secure 0 0 0) 0x7f3edc06d6a0 con 0x7f3ee0098030 2024-03-20T13:38:17.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.945+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ee0127420 con 0x7f3ee0098030 2024-03-20T13:38:17.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.945+0000 7f3ee596f640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3ec4037ef0 0x7f3ec403a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-20T13:38:17.950 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.946+0000 7f3ee596f640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3ec4037ef0 0x7f3ec403a3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0000c00 tx=0x7f3ed0007970 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-20T13:38:17.951 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:17.950+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+182440 (secure 0 0 0) 0x7f3edc032db0 con 0x7f3ee0098030 2024-03-20T13:38:18.131 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.130+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3ee0127ce0 con 0x7f3ee0098030 2024-03-20T13:38:18.133 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.132+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3edc04c350 con 0x7f3ee0098030 2024-03-20T13:38:18.134 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.133+0000 7f3ed6ffd640 1 -- 172.21.15.28:0/3643924455 <== mon.0 v2:172.21.15.28:3300/0 8 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3edc032db0 con 0x7f3ee0098030 2024-03-20T13:38:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3ec4037ef0 msgr2=0x7f3ec403a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3ec4037ef0 0x7f3ec403a3b0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3ed0000c00 tx=0x7f3ed0007970 comp rx=0 tx=0).stop 2024-03-20T13:38:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 msgr2=0x7f3ee0125650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-20T13:38:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0125650 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3edc034040 tx=0x7f3edc0046c0 comp rx=0 tx=0).stop 2024-03-20T13:38:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 shutdown_connections 2024-03-20T13:38:18.136 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.177:6824/915573033,v1:172.21.15.177:6825/915573033] conn(0x7f3ec4037ef0 0x7f3ec403a3b0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 --2- 172.21.15.28:0/3643924455 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3ee0098030 0x7f3ee0125650 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-20T13:38:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.134+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 >> 172.21.15.28:0/3643924455 conn(0x7f3ee00a07a0 msgr2=0x7f3ee01b5b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-20T13:38:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.135+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 shutdown_connections 2024-03-20T13:38:18.137 INFO:teuthology.orchestra.run.smithi028.stderr:2024-03-20T13:38:18.135+0000 7f3ee83d4640 1 -- 172.21.15.28:0/3643924455 wait complete. 2024-03-20T13:38:18.146 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-20T13:38:18.146 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-20T13:38:18.146 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-20T13:38:18.146 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:18.179 INFO:tasks.ceph.osd.0:Stopped 2024-03-20T13:38:18.179 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-20T13:38:18.179 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:18.216 INFO:tasks.ceph.osd.1:Stopped 2024-03-20T13:38:18.216 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-20T13:38:18.216 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:18.282 INFO:tasks.ceph.osd.2:Stopped 2024-03-20T13:38:18.282 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-20T13:38:18.282 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:18.351 INFO:tasks.ceph.osd.3:Stopped 2024-03-20T13:38:18.352 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-20T13:38:18.352 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-20T13:38:18.352 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:18.423 INFO:tasks.ceph.mgr.x:Stopped 2024-03-20T13:38:18.423 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-20T13:38:18.423 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-20T13:38:18.423 INFO:teuthology.orchestra.run:waiting for 300 2024-03-20T13:38:18.435 INFO:tasks.ceph.mon.a:Stopped 2024-03-20T13:38:18.435 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-20T13:38:18.435 DEBUG:teuthology.orchestra.run.smithi028:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-03-20T13:38:18.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi028.front.sepia.ceph.com 2024-03-20T13:38:18.505 DEBUG:teuthology.orchestra.run.smithi028:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-20T13:38:18.695 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:38:18.695 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-20T13:38:18.832 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:38:18.833 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-20T13:38:18.907 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:38:18.907 DEBUG:teuthology.orchestra.run.smithi177:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-20T13:38:18.978 INFO:tasks.ceph:Archiving mon data... 2024-03-20T13:38:18.980 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/data/mon.a.tgz 2024-03-20T13:38:18.980 DEBUG:teuthology.orchestra.run.smithi028:> mktemp 2024-03-20T13:38:18.998 INFO:teuthology.orchestra.run.smithi028.stdout:/tmp/tmp.rqu8qKw6el 2024-03-20T13:38:18.998 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rqu8qKw6el 2024-03-20T13:38:19.139 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0666 /tmp/tmp.rqu8qKw6el 2024-03-20T13:38:19.224 DEBUG:teuthology.orchestra.remote:smithi028:/tmp/tmp.rqu8qKw6el is 245KB 2024-03-20T13:38:19.319 DEBUG:teuthology.orchestra.run.smithi028:> rm -fr /tmp/tmp.rqu8qKw6el 2024-03-20T13:38:19.333 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-20T13:38:19.333 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-20T13:38:19.375 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-20T13:38:19.455 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-20T13:38:19.472 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-20T13:38:19.472 INFO:tasks.ceph:Archiving crash dumps... 2024-03-20T13:38:19.474 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/lib/ceph/crash to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/remote/smithi028/crash 2024-03-20T13:38:19.475 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-20T13:38:19.521 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/lib/ceph/crash to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/remote/smithi177/crash 2024-03-20T13:38:19.522 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-20T13:38:19.560 INFO:tasks.ceph:Compressing logs... 2024-03-20T13:38:19.560 DEBUG:teuthology.orchestra.run.smithi028:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-20T13:38:19.566 DEBUG:teuthology.orchestra.run.smithi177:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-20T13:38:19.605 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31764.log 2024-03-20T13:38:19.605 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-20T13:38:19.605 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33074.log 2024-03-20T13:38:19.605 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-mon.a.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31764.log.gz 2024-03-20T13:38:19.605 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32391.log 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32570.log 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32391.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.33074.log.gz 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30425.log 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32570.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32391.log.gz 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32210.log 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32570.log.gz 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.30425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32294.log 2024-03-20T13:38:19.606 INFO:teuthology.orchestra.run.smithi028.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.30425.log.gz 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32210.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28550.log 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32294.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32210.log.gz 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31766.log 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32294.log.gz 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.tmp-client.admin.28550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32948.log 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28550.log.gz 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31765.log 2024-03-20T13:38:19.607 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32948.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31766.log.gz 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31496.log 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32948.log.gz 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32780.log 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31496.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31765.log.gz 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31664.log 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32780.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31496.log.gz 2024-03-20T13:38:19.608 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32780.log.gz 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32612.log 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- 85.9% /var/log/ceph/ceph-client.admin.32101.log 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31664.log.gz 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32100.log 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr: 88.4% 87.2% -- replaced with /var/log/ceph/ceph.audit.log.gz -- replaced with /var/log/ceph/ceph-client.admin.32612.log.gz 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31933.log 2024-03-20T13:38:19.609 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32101.log: /var/log/ceph/ceph-client.admin.32100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32822.log 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31931.log 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32100.log.gz 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31933.log.gz 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32654.log 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32822.log.gz 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31932.log 2024-03-20T13:38:19.610 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32042.log 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31931.log.gz 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32654.log.gz 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32990.log 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31932.log.gz 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30382.log 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32042.log.gz 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32864.log 2024-03-20T13:38:19.611 INFO:teuthology.orchestra.run.smithi028.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32990.log.gz 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.30382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30264.log 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.30382.log.gz 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32864.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33032.log 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.32864.log.gz 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.30264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31763.log 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30264.log.gz 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32528.log 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr: 85.6%/var/log/ceph/ceph-client.admin.31763.log: -- replaced with /var/log/ceph/ceph-client.admin.33032.log.gz 2024-03-20T13:38:19.612 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31622.log 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32441.log 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31763.log.gz 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32528.log.gz 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31580.log 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31622.log.gz 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31538.log 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr: 85.5%/var/log/ceph/ceph-client.admin.31580.log: -- replaced with /var/log/ceph/ceph-client.admin.32441.log.gz 2024-03-20T13:38:19.613 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31383.log 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31580.log.gz 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32252.log 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31538.log.gz 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31383.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32348.log 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32252.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.31383.log.gz 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32485.log 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32252.log.gz 2024-03-20T13:38:19.614 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32348.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr: 85.4%/var/log/ceph/ceph-client.admin.32485.log: -- replaced with /var/log/ceph/ceph-client.admin.32348.log.gz 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33114.log 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32485.log.gz 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31934.log 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.33114.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31934.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.33114.log.gz 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32696.log 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31934.log.gz 2024-03-20T13:38:19.615 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32738.log 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32696.log.gz 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32906.log 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31440.log 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32738.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.32906.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32738.log.gz 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32906.log.gz 2024-03-20T13:38:19.616 INFO:teuthology.orchestra.run.smithi028.stderr:/var/log/ceph/ceph-client.admin.31440.log: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-20T13:38:19.617 INFO:teuthology.orchestra.run.smithi028.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31440.log.gz 2024-03-20T13:38:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48701.log 2024-03-20T13:38:19.647 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57776.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.48701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50516.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.57776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74111.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.50516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46886.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.74111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46281.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48701.log.gz 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.46886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55961.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.46281.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.57776.log.gz 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65641.log 2024-03-20T13:38:19.648 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.50516.log.gz 2024-03-20T13:38:19.649 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32819.log 2024-03-20T13:38:19.710 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.55961.log: /var/log/ceph/ceph-client.0.65641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58381.log 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.74111.log.gz 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62011.log 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46281.log.gz 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.46886.log.gz 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.32819.log.gz 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.58381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86211.log 2024-03-20T13:38:19.711 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75926.log 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.62011.log: /var/log/ceph/ceph-client.0.86211.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.55961.log.gzgzip 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.80766.log 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.75926.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.65641.log.gz 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78951.log 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86211.log.gz 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.80766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45071.log 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.58381.log.gz 2024-03-20T13:38:19.712 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.78951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73506.log 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.62011.log.gz 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5/var/log/ceph/ceph-client.0.45071.log: --verbose -- /var/log/ceph/ceph-client.0.79556.log 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.75926.log.gz 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.73506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85001.log 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52331.log 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.79556.log: /var/log/ceph/ceph-client.0.85001.log: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72901.log 2024-03-20T13:38:19.713 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.0.78951.log.gz 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.80766.log.gz/var/log/ceph/ceph-client.0.52331.log: 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62616.log 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45071.log.gz 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61406.log 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.72901.log: gzip -5/var/log/ceph/ceph-client.0.62616.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.79556.log.gz 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.0.37817.log 2024-03-20T13:38:19.714 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.61406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36906.log 2024-03-20T13:38:19.715 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% 91.6%/var/log/ceph/ceph-client.0.37817.log: -- replaced with /var/log/ceph/ceph-client.0.73506.log.gz 2024-03-20T13:38:19.715 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.0.52331.log.gz 2024-03-20T13:38:19.715 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57171.log 2024-03-20T13:38:19.715 INFO:teuthology.orchestra.run.smithi177.stderr:gzip 91.1%/var/log/ceph/ceph-client.admin.36906.log: -- replaced with /var/log/ceph/ceph-client.0.72901.log.gz 2024-03-20T13:38:19.715 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.80161.log 2024-03-20T13:38:19.715 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.0.85001.log.gz 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.57171.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.36906.log.gz 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62616.log.gz 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66851.log 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.61406.log.gz 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83186.log 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.80161.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.37817.log.gz 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.66851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77741.log 2024-03-20T13:38:19.716 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.83186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60801.log 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.77741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74716.log 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.60801.log: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48096.log 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.0.57171.log.gz 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.80161.log.gz 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.74716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88607.log 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66851.log.gz 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.48096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69271.log 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77741.log.gz 2024-03-20T13:38:19.717 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.88607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82581.log 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.69271.log: gzip -5 --verbose 90.4% -- replaced with /var/log/ceph/ceph-client.0.88607.log.gz 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr: -- /var/log/ceph/ceph-osd.1.log 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.0.60801.log.gz 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.74716.log.gz 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.82581.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83186.log.gz 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76531.log 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.48096.log.gz 2024-03-20T13:38:19.718 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53541.log 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.76531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81371.log 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.69271.log.gz 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.53541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60196.log 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.82581.log.gz 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr:gzip/var/log/ceph/ceph-client.0.81371.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.60196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36946.log 2024-03-20T13:38:19.719 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32899.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71691.log 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.76531.log.gz 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36946.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.53541.log.gz 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78346.log 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36946.log.gz 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.71691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39027.log 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.60196.log.gz 2024-03-20T13:38:19.720 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81371.log.gz 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.78346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89206.log 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.39027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77136.log 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.89206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55356.log 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.77136.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78346.log.gz 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42046.log 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.71691.log.gz 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.89206.log.gz 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.55356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32779.log 2024-03-20T13:38:19.721 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.42046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39027.log.gz 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.84396.log 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.32859.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.32779.log.gz 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.77136.log.gz 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.84396.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.55356.log.gz 2024-03-20T13:38:19.722 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39632.log 2024-03-20T13:38:19.723 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42046.log.gz 2024-03-20T13:38:19.723 INFO:teuthology.orchestra.run.smithi177.stderr:gzip/var/log/ceph/ceph-osd.3.log: -5 --verbose -- /var/log/ceph/ceph-client.0.40842.log 2024-03-20T13:38:19.723 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.39632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64431.log 2024-03-20T13:38:19.723 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84396.log.gz 2024-03-20T13:38:19.723 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.40842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63221.log 2024-03-20T13:38:19.723 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5/var/log/ceph/ceph-client.0.64431.log: --verbose -- /var/log/ceph/ceph-client.admin.37066.log 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.40842.log.gz 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.63221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70481.log 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37066.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.39632.log.gz 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86810.log 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37066.log.gz 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr:gzip/var/log/ceph/ceph-client.0.70481.log: -5 --verbose -- /var/log/ceph/ceph-client.0.49911.log 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.86810.log: gzip -5 91.0% -- replaced with /var/log/ceph/ceph-client.0.64431.log.gz 2024-03-20T13:38:19.724 INFO:teuthology.orchestra.run.smithi177.stderr: --verbose -- /var/log/ceph/ceph-client.0.56566.log 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.49911.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63221.log.gz 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89805.log 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.86810.log.gz 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.56566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44466.log 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.89805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43256.log 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.44466.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49911.log.gz 2024-03-20T13:38:19.725 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.0.89805.log.gz 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90438.log 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.43256.log: /var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66246.log 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.56566.log.gz 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.90438.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.70481.log.gz 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.44466.log.gz 2024-03-20T13:38:19.726 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69876.log 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.66246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41441.log 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43256.log.gz 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.69876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42651.log 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.41441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83791.log 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.42651.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.66246.log.gz 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr:gzip 93.4% -- replaced with /var/log/ceph/ceph-client.0.90438.log.gz 2024-03-20T13:38:19.727 INFO:teuthology.orchestra.run.smithi177.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.58986.log 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.83791.log: 91.7% -- replaced with /var/log/ceph/ceph-client.0.41441.log.gz 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr: 92.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51726.log 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr: -- replaced with /var/log/ceph/ceph-client.0.69876.log.gz 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.58986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68666.log 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.42651.log.gzgzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-03-20T13:38:19.728 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.51726.log: /var/log/ceph/ceph-client.0.68666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87409.log 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.83791.log.gz 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.58986.log.gz 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr: 90.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88008.log 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.51726.log.gz 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.87409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63826.log 2024-03-20T13:38:19.729 INFO:teuthology.orchestra.run.smithi177.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68666.log.gz 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.88008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54146.log 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.87409.log.gz 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.63826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37026.log 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.0.88008.log.gz 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.54146.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.37026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85606.log 2024-03-20T13:38:19.730 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-osd.2.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.37026.log.gz 2024-03-20T13:38:19.731 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47491.log 2024-03-20T13:38:19.731 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54146.log.gz 2024-03-20T13:38:19.731 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.63826.log.gz 2024-03-20T13:38:19.731 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.85606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40237.log 2024-03-20T13:38:19.731 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.47491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51121.log 2024-03-20T13:38:19.731 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.40237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49306.log 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4%/var/log/ceph/ceph-client.0.51121.log: -- replaced with /var/log/ceph/ceph-client.0.85606.log.gz 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.47491.log.gz/var/log/ceph/ceph-client.0.49306.log: 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54751.log 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/rgw.ceph.client.0.log: 91.5% -- replaced with /var/log/ceph/ceph-client.0.40237.log.gz 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51121.log.gz 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.49306.log.gz 2024-03-20T13:38:19.732 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75321.log 2024-03-20T13:38:19.733 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.54751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36986.log 2024-03-20T13:38:19.733 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.75321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72296.log 2024-03-20T13:38:19.733 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.admin.36986.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.36986.log.gz 2024-03-20T13:38:19.733 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.54751.log.gz 2024-03-20T13:38:19.734 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81976.log 2024-03-20T13:38:19.734 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45676.log 2024-03-20T13:38:19.734 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.72296.log: 91.4%/var/log/ceph/ceph-client.0.81976.log: -- replaced with /var/log/ceph/ceph-client.0.75321.log.gz 2024-03-20T13:38:19.734 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.72296.log.gz 2024-03-20T13:38:19.735 INFO:teuthology.orchestra.run.smithi177.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.81976.log.gz 2024-03-20T13:38:19.735 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43861.log 2024-03-20T13:38:19.735 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.45676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67456.log 2024-03-20T13:38:19.735 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.43861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65036.log 2024-03-20T13:38:19.735 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.67456.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.45676.log.gz 2024-03-20T13:38:19.736 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.43861.log.gz 2024-03-20T13:38:19.736 INFO:teuthology.orchestra.run.smithi177.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.67456.log.gz 2024-03-20T13:38:19.736 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38422.log 2024-03-20T13:38:19.736 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.65036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59591.log 2024-03-20T13:38:19.736 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.38422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71086.log 2024-03-20T13:38:19.736 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.59591.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65036.log.gz 2024-03-20T13:38:19.737 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68061.log 2024-03-20T13:38:19.737 INFO:teuthology.orchestra.run.smithi177.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38422.log.gz 2024-03-20T13:38:19.737 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.71086.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.59591.log.gz 2024-03-20T13:38:19.737 INFO:teuthology.orchestra.run.smithi177.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52936.log 2024-03-20T13:38:19.737 INFO:teuthology.orchestra.run.smithi177.stderr:/var/log/ceph/ceph-client.0.68061.log: /var/log/ceph/ceph-client.0.52936.log: 92.7% -- replaced with /var/log/ceph/ceph-client.0.71086.log.gz 2024-03-20T13:38:19.737 INFO:teuthology.orchestra.run.smithi177.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.68061.log.gz 2024-03-20T13:38:19.738 INFO:teuthology.orchestra.run.smithi177.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52936.log.gz 2024-03-20T13:38:19.738 INFO:teuthology.orchestra.run.smithi177.stderr: 92.1% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-03-20T13:38:19.738 INFO:teuthology.orchestra.run.smithi177.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-20T13:38:19.741 INFO:teuthology.orchestra.run.smithi028.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-20T13:38:20.387 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-20T13:38:20.417 INFO:teuthology.orchestra.run.smithi028.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-20T13:38:20.419 INFO:teuthology.orchestra.run.smithi028.stderr: 2024-03-20T13:38:20.419 INFO:teuthology.orchestra.run.smithi028.stderr:real 0m0.841s 2024-03-20T13:38:20.419 INFO:teuthology.orchestra.run.smithi028.stderr:user 0m0.974s 2024-03-20T13:38:20.419 INFO:teuthology.orchestra.run.smithi028.stderr:sys 0m0.059s 2024-03-20T13:38:20.440 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-20T13:38:20.461 INFO:teuthology.orchestra.run.smithi177.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-20T13:38:20.463 INFO:teuthology.orchestra.run.smithi177.stderr: 2024-03-20T13:38:20.463 INFO:teuthology.orchestra.run.smithi177.stderr:real 0m0.831s 2024-03-20T13:38:20.463 INFO:teuthology.orchestra.run.smithi177.stderr:user 0m2.408s 2024-03-20T13:38:20.464 INFO:teuthology.orchestra.run.smithi177.stderr:sys 0m0.183s 2024-03-20T13:38:20.464 INFO:tasks.ceph:Archiving logs... 2024-03-20T13:38:20.464 DEBUG:teuthology.misc:Transferring archived files from smithi028:/var/log/ceph to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/remote/smithi028/log 2024-03-20T13:38:20.465 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-20T13:38:20.678 DEBUG:teuthology.misc:Transferring archived files from smithi177:/var/log/ceph to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/remote/smithi177/log 2024-03-20T13:38:20.679 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-20T13:38:21.136 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-20T13:38:21.145 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-20T13:38:21.145 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-20T13:38:21.147 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-20T13:38:21.228 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-20T13:38:21.237 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-20T13:38:21.237 DEBUG:teuthology.orchestra.run.smithi028:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:38:21.240 DEBUG:teuthology.orchestra.run.smithi177:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-20T13:38:21.252 INFO:teuthology.orchestra.run.smithi028.stderr:bash: line 1: ntpq: command not found 2024-03-20T13:38:21.253 INFO:teuthology.orchestra.run.smithi177.stderr:bash: line 1: ntpq: command not found 2024-03-20T13:38:21.256 INFO:teuthology.orchestra.run.smithi028.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-20T13:38:21.256 INFO:teuthology.orchestra.run.smithi028.stdout:=============================================================================== 2024-03-20T13:38:21.256 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -2303us[-2303us] +/- 131ms 2024-03-20T13:38:21.256 INFO:teuthology.orchestra.run.smithi028.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -878us[ -871us] +/- 55ms 2024-03-20T13:38:21.256 INFO:teuthology.orchestra.run.smithi028.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +2447us[+2455us] +/- 73ms 2024-03-20T13:38:21.256 INFO:teuthology.orchestra.run.smithi028.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:38:21.258 INFO:teuthology.orchestra.run.smithi177.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-20T13:38:21.258 INFO:teuthology.orchestra.run.smithi177.stdout:=============================================================================== 2024-03-20T13:38:21.258 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 -2292us[-2292us] +/- 131ms 2024-03-20T13:38:21.258 INFO:teuthology.orchestra.run.smithi177.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -882us[ -882us] +/- 55ms 2024-03-20T13:38:21.258 INFO:teuthology.orchestra.run.smithi177.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 15 +2459us[+2459us] +/- 73ms 2024-03-20T13:38:21.259 INFO:teuthology.orchestra.run.smithi177.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-03-20T13:38:21.259 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-20T13:38:21.268 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-20T13:38:21.268 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-20T13:38:21.276 DEBUG:teuthology.orchestra.run.smithi028:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-20T13:38:21.364 DEBUG:teuthology.orchestra.run.smithi177:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-20T13:38:21.428 DEBUG:teuthology.orchestra.run.smithi028:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-20T13:38:21.458 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:38:21.458 DEBUG:teuthology.orchestra.run.smithi177:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-20T13:38:21.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:38:21.488 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-20T13:38:21.497 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-20T13:38:21.507 INFO:teuthology.task.internal:Duration was 664.680572 seconds 2024-03-20T13:38:21.507 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-20T13:38:21.516 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-20T13:38:21.517 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-20T13:38:21.519 DEBUG:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-20T13:38:21.560 INFO:teuthology.orchestra.run.smithi028.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-20T13:38:21.571 INFO:teuthology.orchestra.run.smithi177.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-20T13:38:21.989 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-20T13:38:21.989 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi028.front.sepia.ceph.com 2024-03-20T13:38:21.990 DEBUG:teuthology.orchestra.run.smithi028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-20T13:38:22.050 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi177.front.sepia.ceph.com 2024-03-20T13:38:22.050 DEBUG:teuthology.orchestra.run.smithi177:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-20T13:38:22.078 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-20T13:38:22.078 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-20T13:38:22.093 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-20T13:38:22.146 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-20T13:38:22.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-20T13:38:22.162 DEBUG:teuthology.orchestra.run.smithi177:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-20T13:38:22.282 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-20T13:38:22.291 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-20T13:38:22.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-20T13:38:22.318 DEBUG:teuthology.orchestra.run.smithi177:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-20T13:38:22.345 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-20T13:38:22.356 DEBUG:teuthology.orchestra.run.smithi028:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:38:22.360 DEBUG:teuthology.orchestra.run.smithi177:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:38:22.383 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = core 2024-03-20T13:38:22.410 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = core 2024-03-20T13:38:22.437 DEBUG:teuthology.orchestra.run.smithi028:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:38:22.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:38:22.471 DEBUG:teuthology.orchestra.run.smithi177:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-20T13:38:22.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-20T13:38:22.491 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-20T13:38:22.502 INFO:teuthology.task.internal:Transferring archived files... 2024-03-20T13:38:22.503 DEBUG:teuthology.misc:Transferring archived files from smithi028:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/remote/smithi028 2024-03-20T13:38:22.503 DEBUG:teuthology.orchestra.run.smithi028:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-20T13:38:22.547 DEBUG:teuthology.misc:Transferring archived files from smithi177:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306/remote/smithi177 2024-03-20T13:38:22.547 DEBUG:teuthology.orchestra.run.smithi177:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-20T13:38:22.583 INFO:teuthology.task.internal:Removing archive directory... 2024-03-20T13:38:22.583 DEBUG:teuthology.orchestra.run.smithi028:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-20T13:38:22.586 DEBUG:teuthology.orchestra.run.smithi177:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-20T13:38:22.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-20T13:38:22.641 INFO:teuthology.task.internal:Not uploading archives. 2024-03-20T13:38:22.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-20T13:38:22.670 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-20T13:38:22.670 DEBUG:teuthology.orchestra.run.smithi028:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-20T13:38:22.673 DEBUG:teuthology.orchestra.run.smithi177:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-20T13:38:22.684 INFO:teuthology.orchestra.run.smithi028.stdout: 265594 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 20 13:38 /home/ubuntu/cephtest 2024-03-20T13:38:22.687 INFO:teuthology.orchestra.run.smithi177.stdout: 262166 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 20 13:38 /home/ubuntu/cephtest 2024-03-20T13:38:22.688 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-20T13:38:22.698 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-20T13:38:22.720 INFO:teuthology.nuke:Checking targets against current locks 2024-03-20T13:38:22.751 DEBUG:teuthology.nuke:shortname: smithi028 2024-03-20T13:38:22.751 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-20T13:38:22.775 DEBUG:teuthology.nuke:shortname: smithi177 2024-03-20T13:38:22.775 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-20T13:38:22.779 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:42.831143', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMbK4rSjKzHq63OtQk8TyPWImhHazniDExDiCWzzLNE9jTrGz//wfI0H7VmDV61pnyL7ekG+T2F727nuJ+GsJVk='} 2024-03-20T13:38:22.802 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi177.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/amaredia-2024-03-20_13:11:42-rgw:singleton-wip_thotz_update_attrs_from_state_setattrs-distro-default-smithi/7612306', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-20 13:18:42.832964', 'locked_by': 'scheduled_amaredia@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDqeRG9DZazhxoY5qcCH/UbzKFrb939/JY29nBxWaSMi27N06NIlI6MWSjKiVIZNxm0ylRfWB3EUtm3fg+/xQeA='} 2024-03-20T13:38:22.830 INFO:teuthology.orchestra.console.smithi028:Power off 2024-03-20T13:38:22.830 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T13:38:22.855 DEBUG:teuthology.orchestra.console.smithi028:power off output: Chassis Power Control: Down/Off 2024-03-20T13:38:22.855 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:38:22.875 INFO:teuthology.orchestra.console.smithi177:Power off 2024-03-20T13:38:22.875 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-20T13:38:22.889 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-03-20T13:38:22.902 DEBUG:teuthology.orchestra.console.smithi177:power off output: Chassis Power Control: Down/Off 2024-03-20T13:38:22.902 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:38:22.927 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-20T13:38:26.890 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:38:26.928 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:38:27.004 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is on 2024-03-20T13:38:27.041 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is on 2024-03-20T13:38:31.008 DEBUG:teuthology.orchestra.console.smithi028:pexpect command: ipmitool -H smithi028.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:38:31.043 DEBUG:teuthology.orchestra.console.smithi177:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-20T13:38:31.120 DEBUG:teuthology.orchestra.console.smithi028:check power output: Chassis Power is off 2024-03-20T13:38:31.156 DEBUG:teuthology.orchestra.console.smithi177:check power output: Chassis Power is off 2024-03-20T13:38:31.222 INFO:teuthology.orchestra.console.smithi028:Power off completed 2024-03-20T13:38:31.258 INFO:teuthology.orchestra.console.smithi177:Power off completed 2024-03-20T13:38:31.363 INFO:teuthology.run:Summary data: description: rgw:singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec supported-random-distro$/{centos_latest}} duration: 664.6805720329285 failure_reason: 'S3ResponseError: 403 Forbidden InvalidAccessKeyIdtx00000bd8ca4dfc309185e-0065fae658-4225-default4225-default-default' flavor: default owner: scheduled_amaredia@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=31766002c32e4effa9fa824c264024ab status: fail success: false 2024-03-20T13:38:31.363 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-20T13:38:31.434 INFO:teuthology.run:FAIL